endurance-etl

Name	endurance-etl JSON
Version	0.1.0 JSON
	download
home_page
Summary	Polars and duckdb based json configured simple ETL pipelines
upload_time	2023-04-17 11:19:49
maintainer
docs_url	None
author	Benjamin Gutzmann
requires_python	>=3.9,<4.0
license	MIT
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # endurance_etl
Polars and duckdb based json configured simple ETL pipelines

 <span style="color:red">WARNING: PLACEHOLDER FOR LATER DEVELOPMENT</span>

# Introduction

Use endurance_etl to execute some simple ETL pipelines:

```python
import json
from endurance_etl import Tars

CONFIG = "sample.json"

with open(CONFIG) as f:
    print(json.load(f))

# Output:
{
    "SOURCES": [
        {
            "name": "csv_file_source",
            "path": "csv_file_source.csv",
            # ...other_kwargs
        }
    ],
    "TARGETS": [
        {
            "name": "csv_file_target",
            "source": "source/csv_file_source",
            "target": "csv_file_target.csv",
            "transforms": [
                {
                    "function": "lambda df: df + 1"
                }
            ]
            # ...other_kwargs
        }
    ]
}

tars = Tars.from_json(CONFIG)
tars.do()

```
            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "endurance-etl",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.9,<4.0",
    "maintainer_email": "",
    "keywords": "",
    "author": "Benjamin Gutzmann",
    "author_email": "gutzemann@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/84/87/04b85bd1921f4d973453b2f7d6d4ff9b34974969288f4e331e157a76f2da/endurance_etl-0.1.0.tar.gz",
    "platform": null,
    "description": "# endurance_etl\nPolars and duckdb based json configured simple ETL pipelines\n\n <span style=\"color:red\">WARNING: PLACEHOLDER FOR LATER DEVELOPMENT</span>\n\n# Introduction\n\nUse endurance_etl to execute some simple ETL pipelines:\n\n```python\nimport json\nfrom endurance_etl import Tars\n\nCONFIG = \"sample.json\"\n\nwith open(CONFIG) as f:\n    print(json.load(f))\n\n# Output:\n{\n    \"SOURCES\": [\n        {\n            \"name\": \"csv_file_source\",\n            \"path\": \"csv_file_source.csv\",\n            # ...other_kwargs\n        }\n    ],\n    \"TARGETS\": [\n        {\n            \"name\": \"csv_file_target\",\n            \"source\": \"source/csv_file_source\",\n            \"target\": \"csv_file_target.csv\",\n            \"transforms\": [\n                {\n                    \"function\": \"lambda df: df + 1\"\n                }\n            ]\n            # ...other_kwargs\n        }\n    ]\n}\n\ntars = Tars.from_json(CONFIG)\ntars.do()\n\n```",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Polars and duckdb based json configured simple ETL pipelines",
    "version": "0.1.0",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e7a4e71ec00d6247a69c6c0abfa7c746f16bd320a2cf88f59e2b237ca99ff21a",
                "md5": "ce191ee39e29c4deddacbf98179e634d",
                "sha256": "58dffc4b7fa31c53faae22c670b3407fc7402d20ddcc36dfbf126b1466ac9594"
            },
            "downloads": -1,
            "filename": "endurance_etl-0.1.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "ce191ee39e29c4deddacbf98179e634d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9,<4.0",
            "size": 2382,
            "upload_time": "2023-04-17T11:19:47",
            "upload_time_iso_8601": "2023-04-17T11:19:47.725821Z",
            "url": "https://files.pythonhosted.org/packages/e7/a4/e71ec00d6247a69c6c0abfa7c746f16bd320a2cf88f59e2b237ca99ff21a/endurance_etl-0.1.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "848704b85bd1921f4d973453b2f7d6d4ff9b34974969288f4e331e157a76f2da",
                "md5": "14a2e49f53d1df869d811e0fd987c9cb",
                "sha256": "681a724c1f5f094424225939bb5e9f5797b7127572ed85d4da39df57f0149c25"
            },
            "downloads": -1,
            "filename": "endurance_etl-0.1.0.tar.gz",
            "has_sig": false,
            "md5_digest": "14a2e49f53d1df869d811e0fd987c9cb",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9,<4.0",
            "size": 1903,
            "upload_time": "2023-04-17T11:19:49",
            "upload_time_iso_8601": "2023-04-17T11:19:49.896545Z",
            "url": "https://files.pythonhosted.org/packages/84/87/04b85bd1921f4d973453b2f7d6d4ff9b34974969288f4e331e157a76f2da/endurance_etl-0.1.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-04-17 11:19:49",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "lcname": "endurance-etl"
}