# pyDataPipeline
[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)
[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)
[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)
[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)
Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.
Full documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)
## Installation
pyDataPipeline can be installed from PyPi:
```
pip3 install data-pipeline-api
```
Or from the Repository:
```
git clone https://github.com/FAIRDataPipeline/pythonFDP.git
git checkout dev
pip3 install -e .
```
**NB. PyDataPipeline requires Python3.**
## Example submission_script
Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool
```
import os
import fairdatapipeline as pipeline
token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')
handle = pipeline.initialise(token, config_path, script_path)
pipeline.finalise(token, handle)
```
## SEIRS Model Example
The SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)
Raw data
{
"_id": null,
"home_page": "https://www.fairdatapipeline.org/",
"name": "data_pipeline_api",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.9",
"maintainer_email": null,
"keywords": "FAIR Data Pipeline, FAIR, Data Management, Provenance",
"author": "Ryan J Field",
"author_email": "ryan.field@glasgow.ac.uk",
"download_url": "https://files.pythonhosted.org/packages/41/6c/89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291/data_pipeline_api-0.9.0.tar.gz",
"platform": null,
"description": "# pyDataPipeline\n\n[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)\n[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)\n[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)\n[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)\n[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)\n\nWelcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.\n\nFull documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)\n\n## Installation\npyDataPipeline can be installed from PyPi:\n```\npip3 install data-pipeline-api\n```\n\nOr from the Repository:\n```\ngit clone https://github.com/FAIRDataPipeline/pythonFDP.git\n\ngit checkout dev\n\npip3 install -e .\n```\n**NB. PyDataPipeline requires Python3.**\n\n## Example submission_script\n\nAssume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool\n\n```\nimport os\nimport fairdatapipeline as pipeline\n\ntoken = os.environ['FDP_LOCAL_TOKEN']\nconfig_dir = os.environ['FDP_CONFIG_DIR']\nconfig_path = os.path.join(config_dir, 'config.yaml')\nscript_path = os.path.join(config_dir, 'script.sh')\n\nhandle = pipeline.initialise(token, config_path, script_path)\n\npipeline.finalise(token, handle)\n\n```\n\n## SEIRS Model Example\n\nThe SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)\n",
"bugtrack_url": null,
"license": "GNU General Public License v3.0",
"summary": "Python api to interact with the Fair Data Pipeline",
"version": "0.9.0",
"project_urls": {
"Homepage": "https://www.fairdatapipeline.org/",
"Issue Tracker": "https://github.com/FAIRDataPipeline/pyDataPipeline/issues",
"Repository": "https://github.com/FAIRDataPipeline/pyDataPipeline"
},
"split_keywords": [
"fair data pipeline",
" fair",
" data management",
" provenance"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "8acbf189d830dcf3f1af89101eff023d21e845965aac1afff3f849337ab4e204",
"md5": "0cfe0e1460c2ba68a7885d999d70648e",
"sha256": "cbf1c54f23b6fbe21a86b1b2e90f03774550ce6c92cc822d5b806da75abf866f"
},
"downloads": -1,
"filename": "data_pipeline_api-0.9.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "0cfe0e1460c2ba68a7885d999d70648e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.9",
"size": 28385,
"upload_time": "2024-12-02T17:02:04",
"upload_time_iso_8601": "2024-12-02T17:02:04.412895Z",
"url": "https://files.pythonhosted.org/packages/8a/cb/f189d830dcf3f1af89101eff023d21e845965aac1afff3f849337ab4e204/data_pipeline_api-0.9.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "416c89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291",
"md5": "5d3b5a1487307da2fef85a72b4c4df5a",
"sha256": "a1cdb353f9a2e14843a1ef02fbc1dcdd91f2df564e0ef5d7276abfdf81a7db1e"
},
"downloads": -1,
"filename": "data_pipeline_api-0.9.0.tar.gz",
"has_sig": false,
"md5_digest": "5d3b5a1487307da2fef85a72b4c4df5a",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.9",
"size": 25652,
"upload_time": "2024-12-02T17:02:06",
"upload_time_iso_8601": "2024-12-02T17:02:06.021457Z",
"url": "https://files.pythonhosted.org/packages/41/6c/89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291/data_pipeline_api-0.9.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-02 17:02:06",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "FAIRDataPipeline",
"github_project": "pyDataPipeline",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "data_pipeline_api"
}