# dataplane-python-package
The data engineering library to build robust, reliable and on time data pipelines in Python.
### To use with Dataplane Data Platform
Install Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages<br />
Recipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api
### Run tests in repo root
```shell
pytest -s
```
### For a specific test
```shell
pytest -s src/dataplane/data_storage/test_sharepoint_upload.py
pytest -s -k test_sharepoint.py
```
### Troubleshooting errors
If an error occurs, try removing .pytest_cache and ```__pycache__``` - can happen after devcontainers build
```shell
find . | grep -E "(/__pycache__$|\.pyc$|\.pyo$)" | xargs rm -rf
rm -rf /home/vscode/.local/lib/python3.10/site-packages/
```
### S3 / Minio for testing in VS code devcontainers
* Go to http://localhost:9011
* Login with: username: admin and password: hello123
* bucket: dataplanebucket
Raw data
{
"_id": null,
"home_page": "",
"name": "dataplane",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": "",
"keywords": "workflow,data-science,data,airflow,etl,dataplane,data-engineering,data-pipelines,datawarehouse,automation,data-analysis,scheduler",
"author": "Saul Frank, Dataplane Automation Limited",
"author_email": "",
"download_url": "https://files.pythonhosted.org/packages/ea/1d/4d2f7270fb36b397f097d238e2c3ba8eefa904566cc59674a70a8fe14f0e/dataplane-0.1.3.tar.gz",
"platform": null,
"description": "# dataplane-python-package\nThe data engineering library to build robust, reliable and on time data pipelines in Python.\n\n### To use with Dataplane Data Platform\nInstall Python Package on Dataplane: https://learn.dataplane.app/installing-python-packages<br />\nRecipes to use Dataplane Python Package: https://recipes.dataplane.app/office-365/sharepoint-api\n\n### Run tests in repo root\n```shell\npytest -s\n```\n\n### For a specific test\n\n```shell\npytest -s src/dataplane/data_storage/test_sharepoint_upload.py\npytest -s -k test_sharepoint.py\n```\n\n### Troubleshooting errors\nIf an error occurs, try removing .pytest_cache and ```__pycache__``` - can happen after devcontainers build\n\n```shell\nfind . | grep -E \"(/__pycache__$|\\.pyc$|\\.pyo$)\" | xargs rm -rf\nrm -rf /home/vscode/.local/lib/python3.10/site-packages/\n```\n\n###\u00a0S3 / Minio for testing in VS code devcontainers\n* Go to http://localhost:9011\n* Login with: username: admin and password: hello123\n* bucket: dataplanebucket\n",
"bugtrack_url": null,
"license": "",
"summary": "The data engineering library to build robust, reliable and on time data pipelines in Python.",
"version": "0.1.3",
"project_urls": {
"Feedback": "https://github.com/dataplane-app/dataplane/discussions",
"Github": "https://github.com/dataplane-app/dataplane-python-package",
"Homepage": "https://dataplane.app",
"Issues": "https://github.com/dataplane-app/dataplane/issues"
},
"split_keywords": [
"workflow",
"data-science",
"data",
"airflow",
"etl",
"dataplane",
"data-engineering",
"data-pipelines",
"datawarehouse",
"automation",
"data-analysis",
"scheduler"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "88c4258b5cdb9709c98bda7053eacccf539d1635f4ea8765e3213a6e4cf77064",
"md5": "566aad6c2c50f33bb62e0da5673638f4",
"sha256": "d0efcf853e4c114c87b37d3c785c8e8725bcdb44bbad0b9da277e4e0a8a52878"
},
"downloads": -1,
"filename": "dataplane-0.1.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "566aad6c2c50f33bb62e0da5673638f4",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 21727,
"upload_time": "2023-07-18T16:01:34",
"upload_time_iso_8601": "2023-07-18T16:01:34.529659Z",
"url": "https://files.pythonhosted.org/packages/88/c4/258b5cdb9709c98bda7053eacccf539d1635f4ea8765e3213a6e4cf77064/dataplane-0.1.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ea1d4d2f7270fb36b397f097d238e2c3ba8eefa904566cc59674a70a8fe14f0e",
"md5": "795ab53b485533254f921b787bb06ac4",
"sha256": "1275e55a5461fb2b0f96cbf2d9203915fbb7fadd17af13fe5622a37293def3b4"
},
"downloads": -1,
"filename": "dataplane-0.1.3.tar.gz",
"has_sig": false,
"md5_digest": "795ab53b485533254f921b787bb06ac4",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7",
"size": 11010,
"upload_time": "2023-07-18T16:01:35",
"upload_time_iso_8601": "2023-07-18T16:01:35.526896Z",
"url": "https://files.pythonhosted.org/packages/ea/1d/4d2f7270fb36b397f097d238e2c3ba8eefa904566cc59674a70a8fe14f0e/dataplane-0.1.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-07-18 16:01:35",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "dataplane-app",
"github_project": "dataplane",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "dataplane"
}
JSON
