data_pipeline_api


Namedata_pipeline_api JSON
Version 0.9.0 PyPI version JSON
download
home_pagehttps://www.fairdatapipeline.org/
SummaryPython api to interact with the Fair Data Pipeline
upload_time2024-12-02 17:02:06
maintainerNone
docs_urlNone
authorRyan J Field
requires_python<4.0,>=3.9
licenseGNU General Public License v3.0
keywords fair data pipeline fair data management provenance
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # pyDataPipeline

[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)
[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)
[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)
[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)

Welcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.

Full documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)

## Installation
pyDataPipeline can be installed from PyPi:
```
pip3 install data-pipeline-api
```

Or from the Repository:
```
git clone https://github.com/FAIRDataPipeline/pythonFDP.git

git checkout dev

pip3 install -e .
```
**NB. PyDataPipeline requires Python3.**

## Example submission_script

Assume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool

```
import os
import fairdatapipeline as pipeline

token = os.environ['FDP_LOCAL_TOKEN']
config_dir = os.environ['FDP_CONFIG_DIR']
config_path = os.path.join(config_dir, 'config.yaml')
script_path = os.path.join(config_dir, 'script.sh')

handle = pipeline.initialise(token, config_path, script_path)

pipeline.finalise(token, handle)

```

## SEIRS Model Example

The SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)

            

Raw data

            {
    "_id": null,
    "home_page": "https://www.fairdatapipeline.org/",
    "name": "data_pipeline_api",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": "FAIR Data Pipeline, FAIR, Data Management, Provenance",
    "author": "Ryan J Field",
    "author_email": "ryan.field@glasgow.ac.uk",
    "download_url": "https://files.pythonhosted.org/packages/41/6c/89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291/data_pipeline_api-0.9.0.tar.gz",
    "platform": null,
    "description": "# pyDataPipeline\n\n[![PyPI](https://img.shields.io/pypi/v/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/data-pipeline-api)](https://pypi.org/project/data-pipeline-api/)\n[![pyDataPipeline](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml/badge.svg?branch=dev)](https://github.com/FAIRDataPipeline/pyDataPipeline/actions/workflows/pyDataPipeline.yaml)\n[![codecov](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline/branch/dev/graph/badge.svg?token=Eax5AmrDxx)](https://codecov.io/gh/FAIRDataPipeline/pyDataPipeline)\n[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5562602.svg)](https://doi.org/10.5281/zenodo.5562602)\n[![CII Best Practices](https://bestpractices.coreinfrastructure.org/projects/5461/badge)](https://bestpractices.coreinfrastructure.org/projects/5461)\n\nWelcome to pyDataPipeline a Python api to interact with the Fair Data Pipeline.\n\nFull documention of the pyDataPipeline is avaialable at [https://www.fairdatapipeline.org/pyDataPipeline/](https://www.fairdatapipeline.org/pyDataPipeline/)\n\n## Installation\npyDataPipeline can be installed from PyPi:\n```\npip3 install data-pipeline-api\n```\n\nOr from the Repository:\n```\ngit clone https://github.com/FAIRDataPipeline/pythonFDP.git\n\ngit checkout dev\n\npip3 install -e .\n```\n**NB. PyDataPipeline requires Python3.**\n\n## Example submission_script\n\nAssume FDP_CONFIG_DIR, storage_locations and objects have been set by CLI tool\n\n```\nimport os\nimport fairdatapipeline as pipeline\n\ntoken = os.environ['FDP_LOCAL_TOKEN']\nconfig_dir = os.environ['FDP_CONFIG_DIR']\nconfig_path = os.path.join(config_dir, 'config.yaml')\nscript_path = os.path.join(config_dir, 'script.sh')\n\nhandle = pipeline.initialise(token, config_path, script_path)\n\npipeline.finalise(token, handle)\n\n```\n\n## SEIRS Model Example\n\nThe SEIRS Model Example is available at: [https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html](https://www.fairdatapipeline.org/pyDataPipeline/examples/SEIRS.html)\n",
    "bugtrack_url": null,
    "license": "GNU General Public License v3.0",
    "summary": "Python api to interact with the Fair Data Pipeline",
    "version": "0.9.0",
    "project_urls": {
        "Homepage": "https://www.fairdatapipeline.org/",
        "Issue Tracker": "https://github.com/FAIRDataPipeline/pyDataPipeline/issues",
        "Repository": "https://github.com/FAIRDataPipeline/pyDataPipeline"
    },
    "split_keywords": [
        "fair data pipeline",
        " fair",
        " data management",
        " provenance"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8acbf189d830dcf3f1af89101eff023d21e845965aac1afff3f849337ab4e204",
                "md5": "0cfe0e1460c2ba68a7885d999d70648e",
                "sha256": "cbf1c54f23b6fbe21a86b1b2e90f03774550ce6c92cc822d5b806da75abf866f"
            },
            "downloads": -1,
            "filename": "data_pipeline_api-0.9.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "0cfe0e1460c2ba68a7885d999d70648e",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 28385,
            "upload_time": "2024-12-02T17:02:04",
            "upload_time_iso_8601": "2024-12-02T17:02:04.412895Z",
            "url": "https://files.pythonhosted.org/packages/8a/cb/f189d830dcf3f1af89101eff023d21e845965aac1afff3f849337ab4e204/data_pipeline_api-0.9.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "416c89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291",
                "md5": "5d3b5a1487307da2fef85a72b4c4df5a",
                "sha256": "a1cdb353f9a2e14843a1ef02fbc1dcdd91f2df564e0ef5d7276abfdf81a7db1e"
            },
            "downloads": -1,
            "filename": "data_pipeline_api-0.9.0.tar.gz",
            "has_sig": false,
            "md5_digest": "5d3b5a1487307da2fef85a72b4c4df5a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 25652,
            "upload_time": "2024-12-02T17:02:06",
            "upload_time_iso_8601": "2024-12-02T17:02:06.021457Z",
            "url": "https://files.pythonhosted.org/packages/41/6c/89039dbbb54e407ee897faacdabec3fabca2fc8505adbf03f60fb592b291/data_pipeline_api-0.9.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-12-02 17:02:06",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "FAIRDataPipeline",
    "github_project": "pyDataPipeline",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "data_pipeline_api"
}
        
Elapsed time: 2.11987s