adfpy


Nameadfpy JSON
Version 0.2.0 PyPI version JSON
download
home_pagehttps://github.com/danielvdende/adfpy
SummaryA Pythonic wrapper for Azure Data Factory
upload_time2023-05-05 14:06:07
maintainer
docs_urlNone
authorDaniel van der Ende
requires_python>=3.8,<4.0
licenseApache
keywords azure data factory
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ![tests](https://github.com/danielvdende/adfpy/actions/workflows/lint_test.yml/badge.svg)
# 🏭🍰 adfPy
adfPy aims to make developers lives easier by wrapping the Azure Data Factory Python SDK with an intuitive, powerful, and easy to use API that hopefully will remind people of working with Apache Airflow ;-). 

## Install
```shell
pip install adfpy
```

## Usage
Generally, using adfPy has 2 main components:
1. Write your pipeline.
2. Deploy your pipeline.

adfPy has an opinionated syntax, which is heavily influenced by Airflow. For documentation on what the syntax looks like, please read the docs [here](https://danielvdende.github.io/adfpy/).
Some examples are provided in the examples directory of this repository.


Once you've written your pipelines, it's time to deploy them! For this, you can use adfPy's deployment script:
```shell
pip install adfpy
adfpy-deploy --path <your_path_here>
```
Note:
- This script will ensure all pipelines in the provided path are present in your target ADF.
- This script will also **remove** any ADF pipelines that are **not** in your path, but are in ADF.

## Still to come
adfPy is still in development. As such, some ADF components are not yet supported:
- Datasets
- Linked services
- Triggers (support for Schedule Triggers is available, but not for Tumbling Window, Custom Event, or Storage Event)

## Developer setup
adfPy is built with [Poetry](https://python-poetry.org/). To setup a development environment run:
```shell
poetry install
```

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/danielvdende/adfpy",
    "name": "adfpy",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.8,<4.0",
    "maintainer_email": "",
    "keywords": "azure,data,factory",
    "author": "Daniel van der Ende",
    "author_email": "daniel.vanderende@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/97/00/5b79d1241a1f0c2a47d0540788df2138280f99bdf41632e2a2b618a84ae2/adfpy-0.2.0.tar.gz",
    "platform": null,
    "description": "![tests](https://github.com/danielvdende/adfpy/actions/workflows/lint_test.yml/badge.svg)\n# \ud83c\udfed\ud83c\udf70 adfPy\nadfPy aims to make developers lives easier by wrapping the Azure Data Factory Python SDK with an intuitive, powerful, and easy to use API that hopefully will remind people of working with Apache Airflow ;-). \n\n## Install\n```shell\npip install adfpy\n```\n\n## Usage\nGenerally, using adfPy has 2 main components:\n1. Write your pipeline.\n2. Deploy your pipeline.\n\nadfPy has an opinionated syntax, which is heavily influenced by Airflow. For documentation on what the syntax looks like, please read the docs [here](https://danielvdende.github.io/adfpy/).\nSome examples are provided in the examples directory of this repository.\n\n\nOnce you've written your pipelines, it's time to deploy them! For this, you can use adfPy's deployment script:\n```shell\npip install adfpy\nadfpy-deploy --path <your_path_here>\n```\nNote:\n- This script will ensure all pipelines in the provided path are present in your target ADF.\n- This script will also **remove** any ADF pipelines that are **not** in your path, but are in ADF.\n\n## Still to come\nadfPy is still in development. As such, some ADF components are not yet supported:\n- Datasets\n- Linked services\n- Triggers (support for Schedule Triggers is available, but not for Tumbling Window, Custom Event, or Storage Event)\n\n## Developer setup\nadfPy is built with [Poetry](https://python-poetry.org/). To setup a development environment run:\n```shell\npoetry install\n```\n",
    "bugtrack_url": null,
    "license": "Apache",
    "summary": "A Pythonic wrapper for Azure Data Factory",
    "version": "0.2.0",
    "project_urls": {
        "Homepage": "https://github.com/danielvdende/adfpy",
        "Repository": "https://github.com/danielvdende/adfpy"
    },
    "split_keywords": [
        "azure",
        "data",
        "factory"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "de95909bb274560913949c8a3bfbca278a589f7f753dde653d7fe7d7cd26652a",
                "md5": "e0e06c66e536c3f896be8ff263cbb2d6",
                "sha256": "5c7a2e5dfa4ea67f5d00ea46d113ca1bf075f3db22d7504e3c9a39c414afc9df"
            },
            "downloads": -1,
            "filename": "adfpy-0.2.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "e0e06c66e536c3f896be8ff263cbb2d6",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8,<4.0",
            "size": 11410,
            "upload_time": "2023-05-05T14:06:05",
            "upload_time_iso_8601": "2023-05-05T14:06:05.187464Z",
            "url": "https://files.pythonhosted.org/packages/de/95/909bb274560913949c8a3bfbca278a589f7f753dde653d7fe7d7cd26652a/adfpy-0.2.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "97005b79d1241a1f0c2a47d0540788df2138280f99bdf41632e2a2b618a84ae2",
                "md5": "222eff666f2ab3e6d884bd7ffa34e52f",
                "sha256": "c10103eda75dc13564a545bb9ca761db9c88ceb2290ceebdf8c2cc134a3393bc"
            },
            "downloads": -1,
            "filename": "adfpy-0.2.0.tar.gz",
            "has_sig": false,
            "md5_digest": "222eff666f2ab3e6d884bd7ffa34e52f",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8,<4.0",
            "size": 9594,
            "upload_time": "2023-05-05T14:06:07",
            "upload_time_iso_8601": "2023-05-05T14:06:07.643094Z",
            "url": "https://files.pythonhosted.org/packages/97/00/5b79d1241a1f0c2a47d0540788df2138280f99bdf41632e2a2b618a84ae2/adfpy-0.2.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-05-05 14:06:07",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "danielvdende",
    "github_project": "adfpy",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "adfpy"
}
        
Elapsed time: 0.08500s