# IOMETE Airflow Plugin
This Plugin helps to trigger/run Spark Jobs created in IOMETE platform.
## Installation
This plugin could be easily installed with `pip`. Just run the following in your aiflow server:
```bash
pip install iomete-airflow-plugin
```
Restart you server and check the plugins page on Airflow's admin panel to make sure plugin loaded successfully.
## Configuration
You need to add `iomete_access_token` and `iomete_host` keys to airflow's Variables page.
Check our documentation page on how to generate personal access token.
## Usage
Here are sample DAG:
```python
from airflow import DAG
from iomete_airflow_plugin.iomete_operator import IometeOperator
dag = DAG(dag_id="...", default_args={}, schedule_interval=None)
task = IometeOperator(
task_id="random_task_id",
job_id="1b0fc29b-5491-4c0a-94ea-48e304c3c72e", # Spark Job ID or Name in IOMETE platform.
dag=dag,
)
```
## Resources
For more information check:
1. [Github repository](https://github.com/iomete/iomete-airflow-plugin)
2. [IOMETE Docs](https://iomete.com/docs)
Raw data
{
"_id": null,
"home_page": "https://github.com/iomete/iomete-airflow-plugin",
"name": "iomete-airflow-plugin",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "iomete, airflow, airflow plugin",
"author": "IOMETE",
"author_email": "support@iomete.com",
"download_url": "https://files.pythonhosted.org/packages/08/c9/aff2a90cf198dd5fe6e41ef2b6c3c54826531a4f2947a9734d6bd6d9a3f8/iomete_airflow_plugin-1.1.3.tar.gz",
"platform": null,
"description": "# IOMETE Airflow Plugin\n\nThis Plugin helps to trigger/run Spark Jobs created in IOMETE platform.\n\n## Installation\n\nThis plugin could be easily installed with `pip`. Just run the following in your aiflow server:\n```bash\npip install iomete-airflow-plugin\n```\nRestart you server and check the plugins page on Airflow's admin panel to make sure plugin loaded successfully.\n\n## Configuration\n\nYou need to add `iomete_access_token` and `iomete_host` keys to airflow's Variables page. \nCheck our documentation page on how to generate personal access token.\n\n## Usage\n\nHere are sample DAG:\n```python\nfrom airflow import DAG\nfrom iomete_airflow_plugin.iomete_operator import IometeOperator\n\ndag = DAG(dag_id=\"...\", default_args={}, schedule_interval=None)\n\ntask = IometeOperator(\n task_id=\"random_task_id\",\n job_id=\"1b0fc29b-5491-4c0a-94ea-48e304c3c72e\", # Spark Job ID or Name in IOMETE platform.\n dag=dag,\n)\n\n```\n\n## Resources\nFor more information check: \n1. [Github repository](https://github.com/iomete/iomete-airflow-plugin)\n2. [IOMETE Docs](https://iomete.com/docs)\n",
"bugtrack_url": null,
"license": "Apache Software License 2.0",
"summary": "An Airflow plugin for interacting with IOMETE platform.",
"version": "1.1.3",
"project_urls": {
"Homepage": "https://github.com/iomete/iomete-airflow-plugin"
},
"split_keywords": [
"iomete",
" airflow",
" airflow plugin"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "08c9aff2a90cf198dd5fe6e41ef2b6c3c54826531a4f2947a9734d6bd6d9a3f8",
"md5": "dbfa0371e75a18d7262eb5cf93f47d2e",
"sha256": "d2f30040746402cb278f569e14156a3f9c149d13a75153a8b5c65664c213b7b5"
},
"downloads": -1,
"filename": "iomete_airflow_plugin-1.1.3.tar.gz",
"has_sig": false,
"md5_digest": "dbfa0371e75a18d7262eb5cf93f47d2e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 5551,
"upload_time": "2024-12-10T08:35:59",
"upload_time_iso_8601": "2024-12-10T08:35:59.848145Z",
"url": "https://files.pythonhosted.org/packages/08/c9/aff2a90cf198dd5fe6e41ef2b6c3c54826531a4f2947a9734d6bd6d9a3f8/iomete_airflow_plugin-1.1.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-10 08:35:59",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "iomete",
"github_project": "iomete-airflow-plugin",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "iomete-airflow-plugin"
}
JSON
