| Name | datasets-dump JSON |
| Version |
0.1.4
JSON |
| download |
| home_page | None |
| Summary | A tool for dumping datasets from the Hugging Face datasets library |
| upload_time | 2024-12-05 20:28:45 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.10 |
| license | MIT |
| keywords |
datasets
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# datasets-dump
Dump embedded datasets to audio folder or images folder.
Get the audio folder / image folder back from parquet files.
## Usage
```bash
datasets-dump someone/dataset ./dist
```
Python API:
```python
def dump(
dataset: Union[str, Dataset, DatasetDict],
dist: str | Path,
audio_column: Optional[str] = None,
image_column: Optional[str] = None,
metadata_format: Literal["jsonl", "csv"] = "jsonl",
) -> None
```
Raw data
{
"_id": null,
"home_page": null,
"name": "datasets-dump",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "datasets",
"author": null,
"author_email": "Jacob Lin <jacoblincool@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/06/c8/ead077efcfcb4db3da6d2212ccb9ecafd4d98790fb2529b0a9f34cd2ced9/datasets_dump-0.1.4.tar.gz",
"platform": null,
"description": "# datasets-dump\n\nDump embedded datasets to audio folder or images folder.\n\nGet the audio folder / image folder back from parquet files.\n\n\n\n## Usage\n\n```bash\ndatasets-dump someone/dataset ./dist\n```\n\nPython API:\n\n```python\ndef dump(\n dataset: Union[str, Dataset, DatasetDict],\n dist: str | Path,\n audio_column: Optional[str] = None,\n image_column: Optional[str] = None,\n metadata_format: Literal[\"jsonl\", \"csv\"] = \"jsonl\",\n) -> None\n```\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A tool for dumping datasets from the Hugging Face datasets library",
"version": "0.1.4",
"project_urls": {
"homepage": "https://github.com/JacobLinCool/datasets-dump",
"repository": "https://github.com/JacobLinCool/datasets-dump"
},
"split_keywords": [
"datasets"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "afa9efb25925b99a50a8d1752fefe65d3f846ebc1d2ef996b43c9092a014406f",
"md5": "2662636dc8a35c6c126a95ea80ee7e9a",
"sha256": "7f1d1642e162ccdfdfc0c50d2dfee9d346fed3f1db45dc6cf40d3af6fe2bb710"
},
"downloads": -1,
"filename": "datasets_dump-0.1.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "2662636dc8a35c6c126a95ea80ee7e9a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 5401,
"upload_time": "2024-12-05T20:28:42",
"upload_time_iso_8601": "2024-12-05T20:28:42.156272Z",
"url": "https://files.pythonhosted.org/packages/af/a9/efb25925b99a50a8d1752fefe65d3f846ebc1d2ef996b43c9092a014406f/datasets_dump-0.1.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "06c8ead077efcfcb4db3da6d2212ccb9ecafd4d98790fb2529b0a9f34cd2ced9",
"md5": "189c460f3351b071c243fe199054fc1e",
"sha256": "804657524a28869dc5f20e3b27272face5d26169c09862eac0f608c23bdf2ac2"
},
"downloads": -1,
"filename": "datasets_dump-0.1.4.tar.gz",
"has_sig": false,
"md5_digest": "189c460f3351b071c243fe199054fc1e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 5419,
"upload_time": "2024-12-05T20:28:45",
"upload_time_iso_8601": "2024-12-05T20:28:45.915754Z",
"url": "https://files.pythonhosted.org/packages/06/c8/ead077efcfcb4db3da6d2212ccb9ecafd4d98790fb2529b0a9f34cd2ced9/datasets_dump-0.1.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-05 20:28:45",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "JacobLinCool",
"github_project": "datasets-dump",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "datasets-dump"
}
