g3t-etl


Nameg3t-etl JSON
Version 0.0.1rc11 PyPI version JSON
download
home_pagehttps://github.com/ACED-IDP/g3t_etl.git
SummaryCommons utilities
upload_time2024-03-29 00:20:04
maintainerNone
docs_urlNone
authorEllrott Lab
requires_python<4,>=3.9
licenseNone
keywords gen3 bioinformatics
VCS
bugtrack_url
requirements gen3_tracker click pandas numpy openpyxl PyYAML orjson ndjson inflection
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
![](docs/g3t_etl-logo.png)
# g3t_etl

## Transforming Research Data to FHIR


## Use case

Measurements ([Observations](https://build.fhir.org/observation.html#10.1.1)) are a central element in healthcare, used to support diagnosis, monitor progress, determine baselines and patterns and even capture demographic characteristics, as well as capture results of tests performed on products and substances.

As a `ACED data contributor`, I have a rich set of measurements that I need to associate with several possible resources [Patient, Specimen, Procedure, Condition, etc.]

These Observations are stored in a csv file and I need to transform them into FHIR resources.

> Note: For other use cases, without a rich set of measurements, see the [adding metadata workflow](https://aced-idp.github.io/workflows/metadata/#create-metadata-files) in the ACED documentation.

### Project Overview
This project implements an the `Transform` step of the ETL (Extract, Transform, Load) pipeline for processing research into a FHIR resources.
It provides framework with robust command-line and plugin architecture. It empowers users to process diverse data, apply custom transformations, and load it into target destinations.


### Transformers

Core framework provides foundational transformations (e.g., normalization, validation, and graph construction).
Users can develop custom transformers as plugins for unique needs.

To use this project, please refer to the [project documentation](user-guide.md) for detailed instructions on how to use the project.


### Contributing
This project is open to contributions from the research community. If you are interested in contributing to the project, please contact the project team.
See the [contributing guide](CONTRIBUTING.md) for more information on how to contribute to the project.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/ACED-IDP/g3t_etl.git",
    "name": "g3t-etl",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4,>=3.9",
    "maintainer_email": null,
    "keywords": "gen3 bioinformatics",
    "author": "Ellrott Lab",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/12/51/51929a1f077c88cc1563371a09a30886db666e80b8a1f72a431d980d8e2b/g3t-etl-0.0.1rc11.tar.gz",
    "platform": null,
    "description": "\n![](docs/g3t_etl-logo.png)\n# g3t_etl\n\n## Transforming Research Data to FHIR\n\n\n## Use case\n\nMeasurements ([Observations](https://build.fhir.org/observation.html#10.1.1)) are a central element in healthcare, used to support diagnosis, monitor progress, determine baselines and patterns and even capture demographic characteristics, as well as capture results of tests performed on products and substances.\n\nAs a `ACED data contributor`, I have a rich set of measurements that I need to associate with several possible resources [Patient, Specimen, Procedure, Condition, etc.]\n\nThese Observations are stored in a csv file and I need to transform them into FHIR resources.\n\n> Note: For other use cases, without a rich set of measurements, see the [adding metadata workflow](https://aced-idp.github.io/workflows/metadata/#create-metadata-files) in the ACED documentation.\n\n### Project Overview\nThis project implements an the `Transform` step of the ETL (Extract, Transform, Load) pipeline for processing research into a FHIR resources.\nIt provides framework with robust command-line and plugin architecture. It empowers users to process diverse data, apply custom transformations, and load it into target destinations.\n\n\n### Transformers\n\nCore framework provides foundational transformations (e.g., normalization, validation, and graph construction).\nUsers can develop custom transformers as plugins for unique needs.\n\nTo use this project, please refer to the [project documentation](user-guide.md) for detailed instructions on how to use the project.\n\n\n### Contributing\nThis project is open to contributions from the research community. If you are interested in contributing to the project, please contact the project team.\nSee the [contributing guide](CONTRIBUTING.md) for more information on how to contribute to the project.\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Commons utilities",
    "version": "0.0.1rc11",
    "project_urls": {
        "Bug Reports": "https://github.com/ACED-IDP/gen3_util/issues",
        "Homepage": "https://github.com/ACED-IDP/g3t_etl.git",
        "Source": "https://github.com/ACED-IDP/gen3_util"
    },
    "split_keywords": [
        "gen3",
        "bioinformatics"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "748c809e2c608ca8e45ac12bec8270df0745dc56761957a43a7954297f907c6e",
                "md5": "8ebb3ee84c816dd359ff406625c43aff",
                "sha256": "6621240a3ea44fd62a91b91cc83d3520cd0b3d35c61eedbab625ae4610c40291"
            },
            "downloads": -1,
            "filename": "g3t_etl-0.0.1rc11-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "8ebb3ee84c816dd359ff406625c43aff",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4,>=3.9",
            "size": 27847,
            "upload_time": "2024-03-29T00:20:02",
            "upload_time_iso_8601": "2024-03-29T00:20:02.643990Z",
            "url": "https://files.pythonhosted.org/packages/74/8c/809e2c608ca8e45ac12bec8270df0745dc56761957a43a7954297f907c6e/g3t_etl-0.0.1rc11-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "125151929a1f077c88cc1563371a09a30886db666e80b8a1f72a431d980d8e2b",
                "md5": "372a1a979916efd3fad9d1c65ea553ab",
                "sha256": "b586a55ced054fb9097d07b2089305449b9a69787d23d92ecb20124d47863e1c"
            },
            "downloads": -1,
            "filename": "g3t-etl-0.0.1rc11.tar.gz",
            "has_sig": false,
            "md5_digest": "372a1a979916efd3fad9d1c65ea553ab",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4,>=3.9",
            "size": 26221,
            "upload_time": "2024-03-29T00:20:04",
            "upload_time_iso_8601": "2024-03-29T00:20:04.452897Z",
            "url": "https://files.pythonhosted.org/packages/12/51/51929a1f077c88cc1563371a09a30886db666e80b8a1f72a431d980d8e2b/g3t-etl-0.0.1rc11.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-03-29 00:20:04",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "ACED-IDP",
    "github_project": "g3t_etl",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "requirements": [
        {
            "name": "gen3_tracker",
            "specs": [
                [
                    ">=",
                    "0.0.2rc6"
                ]
            ]
        },
        {
            "name": "click",
            "specs": []
        },
        {
            "name": "pandas",
            "specs": []
        },
        {
            "name": "numpy",
            "specs": []
        },
        {
            "name": "openpyxl",
            "specs": []
        },
        {
            "name": "PyYAML",
            "specs": []
        },
        {
            "name": "orjson",
            "specs": []
        },
        {
            "name": "ndjson",
            "specs": []
        },
        {
            "name": "inflection",
            "specs": []
        }
    ],
    "lcname": "g3t-etl"
}
        
Elapsed time: 0.21247s