| Name | data-prep-lab JSON |
| Version |
0.1.6
JSON |
| download |
| home_page | None |
| Summary | Data Preparation Laboratory Library |
| upload_time | 2024-05-08 18:24:10 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.10 |
| license | Apache-2.0 |
| keywords |
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# Data Processing Library
This provides a python framework for developing _transforms_
on data stored in files - currently parquet files are supported -
and running them in a [ray](https://ray.com) cluster.
Data files may be stored in the local file system or COS/S3.
For more details see the [documentation](doc/overview.md).
### Virtual Environment
The project uses `pyproject.toml` and a Makefile for operations.
To do development you should establish the virtual environment
```shell
make venv
```
and then either activate
```shell
source venv/bin/activate
```
or set up your IDE to use the venv directory when developing in this project
## Library Artifact Build and Publish
To test, build and publish the library to artifactory
```shell
make test build publish
```
To up the version number, edit the Makefile to change VERSION and rerun
the above. This will require committing both the `Makefile` and the
autotmatically updated `pyproject.toml` file.
Raw data
{
"_id": null,
"home_page": null,
"name": "data-prep-lab",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": null,
"author": null,
"author_email": "David Wood <dawood@us.ibm.com>, Boris Lublinsky <blublinsky@ibm.com>",
"download_url": "https://files.pythonhosted.org/packages/ea/66/f7e8772e520ffa71164a29cc96a540baa0534f0c54fce2934746f57ecb7c/data_prep_lab-0.1.6.tar.gz",
"platform": null,
"description": "# Data Processing Library\nThis provides a python framework for developing _transforms_\non data stored in files - currently parquet files are supported -\nand running them in a [ray](https://ray.com) cluster.\nData files may be stored in the local file system or COS/S3.\nFor more details see the [documentation](doc/overview.md).\n\n### Virtual Environment\nThe project uses `pyproject.toml` and a Makefile for operations.\nTo do development you should establish the virtual environment\n```shell\nmake venv\n```\nand then either activate\n```shell\nsource venv/bin/activate\n```\nor set up your IDE to use the venv directory when developing in this project\n\n## Library Artifact Build and Publish\nTo test, build and publish the library to artifactory\n```shell\nmake test build publish\n```\nTo up the version number, edit the Makefile to change VERSION and rerun\nthe above. This will require committing both the `Makefile` and the\nautotmatically updated `pyproject.toml` file.\n\n\n",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "Data Preparation Laboratory Library",
"version": "0.1.6",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "160365a64b18029b2c15fd8a810f7cb98a8461a364d1c5aa698acd787f80af33",
"md5": "b2a182f6a51a87e6a564c9468e419a0b",
"sha256": "bb05092ea99e8f7293176272fc9c93c0eff7412e05cf8a51145aeaad59be3260"
},
"downloads": -1,
"filename": "data_prep_lab-0.1.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "b2a182f6a51a87e6a564c9468e419a0b",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 56331,
"upload_time": "2024-05-08T18:24:08",
"upload_time_iso_8601": "2024-05-08T18:24:08.905631Z",
"url": "https://files.pythonhosted.org/packages/16/03/65a64b18029b2c15fd8a810f7cb98a8461a364d1c5aa698acd787f80af33/data_prep_lab-0.1.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ea66f7e8772e520ffa71164a29cc96a540baa0534f0c54fce2934746f57ecb7c",
"md5": "dbe8bdc5a83d9e1a93745bd293bbf2a1",
"sha256": "8197e52f19e355028211b324cd2132709ff58fbd6c686d908407b198f4e1e8b9"
},
"downloads": -1,
"filename": "data_prep_lab-0.1.6.tar.gz",
"has_sig": false,
"md5_digest": "dbe8bdc5a83d9e1a93745bd293bbf2a1",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 293325,
"upload_time": "2024-05-08T18:24:10",
"upload_time_iso_8601": "2024-05-08T18:24:10.861995Z",
"url": "https://files.pythonhosted.org/packages/ea/66/f7e8772e520ffa71164a29cc96a540baa0534f0c54fce2934746f57ecb7c/data_prep_lab-0.1.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-08 18:24:10",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "data-prep-lab"
}
