# pyDataPipeline
[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)
[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)
[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)
[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)
Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.
Full documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)
## Installation
pyDataPipeline can be installed from PyPi:
```
pip3 install data-pipeline-api
```
Or from the Repository:
```
git clone https://github.com/FAIRDataPipeline/pythonFDP.git
git checkout dev
pip3 install -e .
```
**NB. PyDataPipeline requires Python3.**
## Example submission_script
Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool
```
import os
import fairdatapipeline as pipeline
token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')
handle = pipeline.initialise(token, config_path, script_path)
pipeline.finalise(token, handle)
```
## SEIRS Model Example
The SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)
Raw data
{
"_id": null,
"home_page": "https://www.fairdatapipeline.org/",
"name": "data-pipeline-api",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8,<4.0",
"maintainer_email": "",
"keywords": "FAIR Data Pipeline,FAIR,Data Management,Provenance",
"author": "Ryan J Field",
"author_email": "ryan.field@glasgow.ac.uk",
"download_url": "https://files.pythonhosted.org/packages/40/04/801be7a91e22947d91f88d2e0e94ae7d18a5486d90143bb1b3b3b90f3b3b/data_pipeline_api-0.7.13.tar.gz",
"platform": null,
"description": "# pyDataPipeline\n\n[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)\n[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)\n[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)\n[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)\n[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)\n\nWelcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.\n\nFull documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)\n\n## Installation\npyDataPipeline can be installed from PyPi:\n```\npip3 install data-pipeline-api\n```\n\nOr from the Repository:\n```\ngit clone https://github.com/FAIRDataPipeline/pythonFDP.git\n\ngit checkout dev\n\npip3 install -e .\n```\n**NB. PyDataPipeline requires Python3.**\n\n## Example submission_script\n\nAssume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool\n\n```\nimport os\nimport fairdatapipeline as pipeline\n\ntoken = os.environ['FDP_LOCAL_TOKEN']\nconfig_dir = os.environ['FDP_CONFIG_DIR']\nconfig_path = os.path.join(config_dir, 'config.yaml')\nscript_path = os.path.join(config_dir, 'script.sh')\n\nhandle = pipeline.initialise(token, config_path, script_path)\n\npipeline.finalise(token, handle)\n\n```\n\n## SEIRS Model Example\n\nThe SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)\n",
"bugtrack_url": null,
"license": "GNU General Public License v3.0",
"summary": "Python api to interact with the Fair Data Pipeline",
"version": "0.7.13",
"project_urls": {
"Homepage": "https://www.fairdatapipeline.org/",
"Issue Tracker": "https://github.com/FAIRDataPipeline/pyDataPipeline/issues",
"Repository": "https://github.com/FAIRDataPipeline/pyDataPipeline"
},
"split_keywords": [
"fair data pipeline",
"fair",
"data management",
"provenance"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "bdec21b4d909d4cc0677dab31e133c43e1e7b21d1e059975c65e53e6b07258ef",
"md5": "0900fc1819886047a5d5e3738621a84d",
"sha256": "b352d357f5c3a81d03a3d2ed4e9d3d340edb80a86e54caa18053643e0b401b85"
},
"downloads": -1,
"filename": "data_pipeline_api-0.7.13-py3-none-any.whl",
"has_sig": false,
"md5_digest": "0900fc1819886047a5d5e3738621a84d",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8,<4.0",
"size": 28418,
"upload_time": "2023-07-08T20:45:42",
"upload_time_iso_8601": "2023-07-08T20:45:42.095485Z",
"url": "https://files.pythonhosted.org/packages/bd/ec/21b4d909d4cc0677dab31e133c43e1e7b21d1e059975c65e53e6b07258ef/data_pipeline_api-0.7.13-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "4004801be7a91e22947d91f88d2e0e94ae7d18a5486d90143bb1b3b3b90f3b3b",
"md5": "b08c2f07079367bebffd85f2006ea861",
"sha256": "3f6c35fe9767094b5505be07d2d33793a2ad6694c57b10216cb54352de96e292"
},
"downloads": -1,
"filename": "data_pipeline_api-0.7.13.tar.gz",
"has_sig": false,
"md5_digest": "b08c2f07079367bebffd85f2006ea861",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8,<4.0",
"size": 25759,
"upload_time": "2023-07-08T20:45:44",
"upload_time_iso_8601": "2023-07-08T20:45:44.012529Z",
"url": "https://files.pythonhosted.org/packages/40/04/801be7a91e22947d91f88d2e0e94ae7d18a5486d90143bb1b3b3b90f3b3b/data_pipeline_api-0.7.13.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-07-08 20:45:44",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "FAIRDataPipeline",
"github_project": "pyDataPipeline",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "data-pipeline-api"
}