iomete-airflow-plugin


Nameiomete-airflow-plugin JSON
Version 1.0.2 PyPI version JSON
download
home_pagehttps://github.com/iomete/iomete-airflow-plugin
SummaryAn Airflow plugin for interacting with IOMETE platform.
upload_time2023-10-26 22:12:57
maintainer
docs_urlNone
authorIOMETE
requires_python>=3.7
licenseApache Software License 2.0
keywords iomete airflow airflow plugin
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # IOMETE Airflow Plugin

This Plugin helps to trigger/run Spark Jobs created in IOMETE platform.

## Installation

This plugin could be easily installed with `pip`. Just run the following in your aiflow server:
```bash
pip install iomete-airflow-plugin
```
Restart you server and check the plugins page on Airflow's admin panel to make sure plugin loaded successfully.

## Configuration

You need to add `iomete_access_token` and `iomete_host` keys to airflow's Variables page.  
Check our documentation page on how to generate personal access token.

## Usage

Here are sample DAG:
```python
from airflow import DAG
from iomete_airflow_plugin.iomete_operator import IometeOperator

dag = DAG(dag_id="...", default_args={}, schedule_interval=None)

task = IometeOperator(
    task_id="random_task_id",
    job_id="1b0fc29b-5491-4c0a-94ea-48e304c3c72e", # Spark Job ID or Name in IOMETE platform.
    dag=dag,
)

```

## Resources
For more information check: 
1. [Github repository](https://github.com/iomete/iomete-airflow-plugin)
2. [IOMETE Docs](https://iomete.com/docs)

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/iomete/iomete-airflow-plugin",
    "name": "iomete-airflow-plugin",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.7",
    "maintainer_email": "",
    "keywords": "iomete,airflow,airflow plugin",
    "author": "IOMETE",
    "author_email": "support@iomete.com",
    "download_url": "https://files.pythonhosted.org/packages/8c/c1/44bba89f277eb3b061277b372dde49464b709469096f1a6085eca90842d4/iomete_airflow_plugin-1.0.2.tar.gz",
    "platform": null,
    "description": "# IOMETE Airflow Plugin\n\nThis Plugin helps to trigger/run Spark Jobs created in IOMETE platform.\n\n## Installation\n\nThis plugin could be easily installed with `pip`. Just run the following in your aiflow server:\n```bash\npip install iomete-airflow-plugin\n```\nRestart you server and check the plugins page on Airflow's admin panel to make sure plugin loaded successfully.\n\n## Configuration\n\nYou need to add `iomete_access_token` and `iomete_host` keys to airflow's Variables page.  \nCheck our documentation page on how to generate personal access token.\n\n## Usage\n\nHere are sample DAG:\n```python\nfrom airflow import DAG\nfrom iomete_airflow_plugin.iomete_operator import IometeOperator\n\ndag = DAG(dag_id=\"...\", default_args={}, schedule_interval=None)\n\ntask = IometeOperator(\n    task_id=\"random_task_id\",\n    job_id=\"1b0fc29b-5491-4c0a-94ea-48e304c3c72e\", # Spark Job ID or Name in IOMETE platform.\n    dag=dag,\n)\n\n```\n\n## Resources\nFor more information check: \n1. [Github repository](https://github.com/iomete/iomete-airflow-plugin)\n2. [IOMETE Docs](https://iomete.com/docs)\n",
    "bugtrack_url": null,
    "license": "Apache Software License 2.0",
    "summary": "An Airflow plugin for interacting with IOMETE platform.",
    "version": "1.0.2",
    "project_urls": {
        "Homepage": "https://github.com/iomete/iomete-airflow-plugin"
    },
    "split_keywords": [
        "iomete",
        "airflow",
        "airflow plugin"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "1034b87eb4b980093ac41491b557e648a931424883b2c052d9097e6b3438576d",
                "md5": "01da7a73c424f31d621ebb5e2571a631",
                "sha256": "214be3db1037b9af81c02a940f32a9e72518aa32ba29d7b5b34df5791a918c6a"
            },
            "downloads": -1,
            "filename": "iomete_airflow_plugin-1.0.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "01da7a73c424f31d621ebb5e2571a631",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.7",
            "size": 5356,
            "upload_time": "2023-10-26T22:12:54",
            "upload_time_iso_8601": "2023-10-26T22:12:54.695171Z",
            "url": "https://files.pythonhosted.org/packages/10/34/b87eb4b980093ac41491b557e648a931424883b2c052d9097e6b3438576d/iomete_airflow_plugin-1.0.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8cc144bba89f277eb3b061277b372dde49464b709469096f1a6085eca90842d4",
                "md5": "48f5b94210b962f3381747ea4ae2fff5",
                "sha256": "32db38442a9ff72046edb6b3c970ec8c73da7502214a5a4225af7302bf621e51"
            },
            "downloads": -1,
            "filename": "iomete_airflow_plugin-1.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "48f5b94210b962f3381747ea4ae2fff5",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.7",
            "size": 4430,
            "upload_time": "2023-10-26T22:12:57",
            "upload_time_iso_8601": "2023-10-26T22:12:57.119809Z",
            "url": "https://files.pythonhosted.org/packages/8c/c1/44bba89f277eb3b061277b372dde49464b709469096f1a6085eca90842d4/iomete_airflow_plugin-1.0.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-10-26 22:12:57",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "iomete",
    "github_project": "iomete-airflow-plugin",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "iomete-airflow-plugin"
}
        
Elapsed time: 0.13053s