safetensors-dataset

Name	safetensors-dataset JSON
Version	0.0.5 JSON
	download
home_page	None
Summary	A simple but handy Python library to save PyTorch datasets in safetensors format.
upload_time	2024-09-26 10:20:16
maintainer	None
docs_url	None
author	None
requires_python	>=3.8
license	Apache 2.0
keywords	datasets saving loading safetensors
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # safetensors-dataset

`safetensors-dataset` is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:

```python3
import torch
from safetensors_dataset import SafetensorsDataset

dataset = SafetensorsDataset.from_dict({
    "x": torch.randn(8, 12, 3),
    "y": torch.randint(12, (8,))
})
dataset.save_to_file("test.safetensors")
```

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "safetensors-dataset",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "datasets, saving, loading, safetensors",
    "author": null,
    "author_email": "Moritz Hennen <mail@fleance.de>",
    "download_url": "https://files.pythonhosted.org/packages/2d/ad/b34fdecc0870561b899612077f3585ae08bd53a0e2652d99a9a09a0b052b/safetensors_dataset-0.0.5.tar.gz",
    "platform": null,
    "description": "# safetensors-dataset\n\n`safetensors-dataset` is a very simple and tiny package adding support to efficiently load and store Pytorch datasets in the safetensors file format:\n\n```python3\nimport torch\nfrom safetensors_dataset import SafetensorsDataset\n\ndataset = SafetensorsDataset.from_dict({\n    \"x\": torch.randn(8, 12, 3),\n    \"y\": torch.randint(12, (8,))\n})\ndataset.save_to_file(\"test.safetensors\")\n```\n",
    "bugtrack_url": null,
    "license": "Apache 2.0",
    "summary": "A simple but handy Python library to save PyTorch datasets in safetensors format.",
    "version": "0.0.5",
    "project_urls": {
        "repository": "https://github.com/fleonce/safetensors-dataset/"
    },
    "split_keywords": [
        "datasets",
        " saving",
        " loading",
        " safetensors"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6a1e811e6f71171eeb69f48bad1b011bb918129d700d2beffe961e486290745b",
                "md5": "07f5dc5f0a5cb7e7c52ff9d5e7a5cf0b",
                "sha256": "ac7948ffc36e48a6b9df8e4e09cbd82625f04a2243e999060654843be1b4c7e9"
            },
            "downloads": -1,
            "filename": "safetensors_dataset-0.0.5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "07f5dc5f0a5cb7e7c52ff9d5e7a5cf0b",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 11001,
            "upload_time": "2024-09-26T10:20:14",
            "upload_time_iso_8601": "2024-09-26T10:20:14.701145Z",
            "url": "https://files.pythonhosted.org/packages/6a/1e/811e6f71171eeb69f48bad1b011bb918129d700d2beffe961e486290745b/safetensors_dataset-0.0.5-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "2dadb34fdecc0870561b899612077f3585ae08bd53a0e2652d99a9a09a0b052b",
                "md5": "bbbc484c14bf8d944de21c102f067f08",
                "sha256": "b1fb5bd4e5e64d9483e0f08284406bb5975d79e00294973c444edc6f1a280144"
            },
            "downloads": -1,
            "filename": "safetensors_dataset-0.0.5.tar.gz",
            "has_sig": false,
            "md5_digest": "bbbc484c14bf8d944de21c102f067f08",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 11458,
            "upload_time": "2024-09-26T10:20:16",
            "upload_time_iso_8601": "2024-09-26T10:20:16.532980Z",
            "url": "https://files.pythonhosted.org/packages/2d/ad/b34fdecc0870561b899612077f3585ae08bd53a0e2652d99a9a09a0b052b/safetensors_dataset-0.0.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-09-26 10:20:16",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "fleonce",
    "github_project": "safetensors-dataset",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "safetensors-dataset"
}