data-detective-airflow


Namedata-detective-airflow JSON
Version 2.2.0 PyPI version JSON
download
home_page
SummaryFramework with task testing over Apache Airflow
upload_time2023-06-05 12:42:46
maintainer
docs_urlNone
authorTinkoff Data Detective Team
requires_python>=3.9,<4.0
licenseApache-2.0
keywords airflow testing result metadata governance catalog data detective
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ## Data Detective Airflow

[Data Detective Airflow](https://github.com/tinkoff/data-detective/tree/master/data-detective-airflow) is a framework
whose main idea is to add the concepts of work and result to [Apache Airflow](https://airflow.apache.org/).
It supports tasks testing over [Apache Airflow](https://airflow.apache.org/).
Data Detective Airflow allows developers to create workflows in the form of directed acyclic graphs (DAGs) of tasks.
The easy-to-use Data Detective Airflow scheduler makes it possible to run tasks and save results into works. 
Work storage support for s3, ftp, local disk and database is also included.

[More information about Data Detective Airflow](https://data-detective.dev/docs/data-detective-airflow/intro)

## Installation

#### Install from [PyPi](https://pypi.org/project/data-detective-airflow/)

```bash
pip install data-detective-airflow
```

See example DAG-s in [dags/dags](https://github.com/tinkoff/data-detective/tree/master/data-detective-airflow/dags/dags) folder.

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "data-detective-airflow",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.9,<4.0",
    "maintainer_email": "",
    "keywords": "airflow testing result metadata governance catalog data detective",
    "author": "Tinkoff Data Detective Team",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/b6/93/a847daa559f9404602c4196c900eeabfc79c8f9791ba1a6271c400db91ab/data_detective_airflow-2.2.0.tar.gz",
    "platform": null,
    "description": "## Data Detective Airflow\n\n[Data Detective Airflow](https://github.com/tinkoff/data-detective/tree/master/data-detective-airflow) is a framework\nwhose main idea is to add the concepts of work and result to [Apache Airflow](https://airflow.apache.org/).\nIt supports tasks testing over [Apache Airflow](https://airflow.apache.org/).\nData Detective Airflow allows developers to create workflows in the form of directed acyclic graphs (DAGs) of tasks.\nThe easy-to-use Data Detective Airflow scheduler makes it possible to run tasks and save results into works. \nWork storage support for s3, ftp, local disk and database is also included.\n\n[More information about Data Detective Airflow](https://data-detective.dev/docs/data-detective-airflow/intro)\n\n## Installation\n\n#### Install from [PyPi](https://pypi.org/project/data-detective-airflow/)\n\n```bash\npip install data-detective-airflow\n```\n\nSee example DAG-s in [dags/dags](https://github.com/tinkoff/data-detective/tree/master/data-detective-airflow/dags/dags) folder.\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Framework with task testing over Apache Airflow",
    "version": "2.2.0",
    "project_urls": {
        "Documentation": "https://data-detective.dev/docs/data-detective-airflow/intro",
        "Issue Tracker": "https://github.com/tinkoff/data-detective/issues",
        "Repository": "https://github.com/tinkoff/data-detective/tree/master/data-detective-airflow"
    },
    "split_keywords": [
        "airflow",
        "testing",
        "result",
        "metadata",
        "governance",
        "catalog",
        "data",
        "detective"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "06ab17751ded34f4fbb90cba0bbb503a2e5c1d9ba7b80c6b239cb679d0a738fd",
                "md5": "a6c52a37d3b04efb5bad4420b8674856",
                "sha256": "f21726d066f2cf1ba233468f735880de4a9f7374d2cf53a39818eb99d9a0736b"
            },
            "downloads": -1,
            "filename": "data_detective_airflow-2.2.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "a6c52a37d3b04efb5bad4420b8674856",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9,<4.0",
            "size": 59302,
            "upload_time": "2023-06-05T12:42:44",
            "upload_time_iso_8601": "2023-06-05T12:42:44.764139Z",
            "url": "https://files.pythonhosted.org/packages/06/ab/17751ded34f4fbb90cba0bbb503a2e5c1d9ba7b80c6b239cb679d0a738fd/data_detective_airflow-2.2.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b693a847daa559f9404602c4196c900eeabfc79c8f9791ba1a6271c400db91ab",
                "md5": "d0b267985fc0c83ada3533989b5ca1d1",
                "sha256": "fa30ed3b64e9904639b5d2303148cff4557b4c865228263c20219b20113298e7"
            },
            "downloads": -1,
            "filename": "data_detective_airflow-2.2.0.tar.gz",
            "has_sig": false,
            "md5_digest": "d0b267985fc0c83ada3533989b5ca1d1",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9,<4.0",
            "size": 34676,
            "upload_time": "2023-06-05T12:42:46",
            "upload_time_iso_8601": "2023-06-05T12:42:46.475462Z",
            "url": "https://files.pythonhosted.org/packages/b6/93/a847daa559f9404602c4196c900eeabfc79c8f9791ba1a6271c400db91ab/data_detective_airflow-2.2.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-06-05 12:42:46",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "tinkoff",
    "github_project": "data-detective",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "data-detective-airflow"
}
        
Elapsed time: 0.07326s