# seaweedfs-bin
https://github.com/seaweedfs/seaweedfs
SeaweedFS is a simple and highly scalable distributed file system. There are two objectives:
1. to store billions of files!
2. to serve the files fast!
SeaweedFS started as an Object Store to handle small files efficiently.
Instead of managing all file metadata in a central master,
the central master only manages volumes on volume servers,
and these volume servers manage files and their metadata.
This relieves concurrency pressure from the central master and spreads file metadata into volume servers,
allowing faster file access (O(1), usually just one disk read operation).
There is only 40 bytes of disk storage overhead for each file's metadata.
It is so simple with O(1) disk reads that you are welcome to challenge the performance with your actual use cases.
SeaweedFS started by implementing [Facebook's Haystack design paper](http://www.usenix.org/event/osdi10/tech/full_papers/Beaver.pdf).
Also, SeaweedFS implements erasure coding with ideas from
[f4: Facebook’s Warm BLOB Storage System](https://www.usenix.org/system/files/conference/osdi14/osdi14-paper-muralidhar.pdf), and has a lot of similarities with [Facebook’s Tectonic Filesystem](https://www.usenix.org/system/files/fast21-pan.pdf)
On top of the object store, optional [Filer] can support directories and POSIX attributes.
Filer is a separate linearly-scalable stateless server with customizable metadata stores,
e.g., MySql, Postgres, Redis, Cassandra, HBase, Mongodb, Elastic Search, LevelDB, RocksDB, Sqlite, MemSql, TiDB, Etcd, CockroachDB, YDB, etc.
For any distributed key value stores, the large values can be offloaded to SeaweedFS.
With the fast access speed and linearly scalable capacity,
SeaweedFS can work as a distributed [Key-Large-Value store][KeyLargeValueStore].
SeaweedFS can transparently integrate with the cloud.
With hot data on local cluster, and warm data on the cloud with O(1) access time,
SeaweedFS can achieve both fast local access time and elastic cloud storage capacity.
What's more, the cloud storage access API cost is minimized.
Faster and cheaper than direct cloud storage!
## install
```sh
pip install seaweedfs-bin
```
Raw data
{
"_id": null,
"home_page": null,
"name": "seaweedfs-bin",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": null,
"keywords": "seaweedfs, distributed storage, distributed file system, erasure coding, blob storage, object storage, file system, data lake, s3",
"author": null,
"author_email": "dowon <ks2515@naver.com>",
"download_url": "https://files.pythonhosted.org/packages/29/a4/fd6714b99de1ceb1ae5e856936fc9ffc18f6475e697a5c39dfd38a84915c/seaweedfs_bin-3.94.tar.gz",
"platform": null,
"description": "# seaweedfs-bin\n\nhttps://github.com/seaweedfs/seaweedfs\n\nSeaweedFS is a simple and highly scalable distributed file system. There are two objectives:\n\n1. to store billions of files!\n2. to serve the files fast!\n\nSeaweedFS started as an Object Store to handle small files efficiently.\nInstead of managing all file metadata in a central master,\nthe central master only manages volumes on volume servers,\nand these volume servers manage files and their metadata.\nThis relieves concurrency pressure from the central master and spreads file metadata into volume servers,\nallowing faster file access (O(1), usually just one disk read operation).\n\nThere is only 40 bytes of disk storage overhead for each file's metadata.\nIt is so simple with O(1) disk reads that you are welcome to challenge the performance with your actual use cases.\n\nSeaweedFS started by implementing [Facebook's Haystack design paper](http://www.usenix.org/event/osdi10/tech/full_papers/Beaver.pdf).\nAlso, SeaweedFS implements erasure coding with ideas from\n[f4: Facebook\u2019s Warm BLOB Storage System](https://www.usenix.org/system/files/conference/osdi14/osdi14-paper-muralidhar.pdf), and has a lot of similarities with [Facebook\u2019s Tectonic Filesystem](https://www.usenix.org/system/files/fast21-pan.pdf)\n\nOn top of the object store, optional [Filer] can support directories and POSIX attributes.\nFiler is a separate linearly-scalable stateless server with customizable metadata stores,\ne.g., MySql, Postgres, Redis, Cassandra, HBase, Mongodb, Elastic Search, LevelDB, RocksDB, Sqlite, MemSql, TiDB, Etcd, CockroachDB, YDB, etc.\n\nFor any distributed key value stores, the large values can be offloaded to SeaweedFS.\nWith the fast access speed and linearly scalable capacity,\nSeaweedFS can work as a distributed [Key-Large-Value store][KeyLargeValueStore].\n\nSeaweedFS can transparently integrate with the cloud.\nWith hot data on local cluster, and warm data on the cloud with O(1) access time,\nSeaweedFS can achieve both fast local access time and elastic cloud storage capacity.\nWhat's more, the cloud storage access API cost is minimized.\nFaster and cheaper than direct cloud storage!\n\n## install\n\n```sh\npip install seaweedfs-bin\n```\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "\ud83c\udf3fSeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering.",
"version": "3.94",
"project_urls": {
"repository": "https://github.com/Bing-su/pip-binary-factory",
"seaweedfs": "https://github.com/seaweedfs/seaweedfs"
},
"split_keywords": [
"seaweedfs",
" distributed storage",
" distributed file system",
" erasure coding",
" blob storage",
" object storage",
" file system",
" data lake",
" s3"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "74620eb44113a0d566706dbfea8d85642e1d54237dadee0714faaa1dedadee2f",
"md5": "5218e13b17a3f15c234f48f18ddc99ba",
"sha256": "c3c36286c2cf47b0e0e5a994b2375913d9de4719418b3fc6c9a31a916ce10c5f"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94-py3-none-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "5218e13b17a3f15c234f48f18ddc99ba",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 28032442,
"upload_time": "2025-07-14T04:21:45",
"upload_time_iso_8601": "2025-07-14T04:21:45.423575Z",
"url": "https://files.pythonhosted.org/packages/74/62/0eb44113a0d566706dbfea8d85642e1d54237dadee0714faaa1dedadee2f/seaweedfs_bin-3.94-py3-none-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "fe4f1d4e69572709b63e648fb6792e57b6a7760cfe087f3bf4e0f9783c218f10",
"md5": "4a33ec84cd42b2976eb7969a089d72a3",
"sha256": "f1b15ea4c43555f7e3abe4a0bf679c260d4ea70d31ce1fb69b941a3cbd6f308f"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94-py3-none-manylinux2014_aarch64.manylinux_2_17_aarch64.musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "4a33ec84cd42b2976eb7969a089d72a3",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 26714852,
"upload_time": "2025-07-14T04:21:48",
"upload_time_iso_8601": "2025-07-14T04:21:48.441658Z",
"url": "https://files.pythonhosted.org/packages/fe/4f/1d4e69572709b63e648fb6792e57b6a7760cfe087f3bf4e0f9783c218f10/seaweedfs_bin-3.94-py3-none-manylinux2014_aarch64.manylinux_2_17_aarch64.musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "c4ee78288fd838fc3749eec19e31dd1ed94b36b26473a4e806fec04f31260ce7",
"md5": "461b63525adf8b18fa3826bbe46a9c6e",
"sha256": "5a1d88a31c1fe23c3933af0e327aa57de438589c0be9096a4f85c18a28fbda4d"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "461b63525adf8b18fa3826bbe46a9c6e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 29388507,
"upload_time": "2025-07-14T04:21:51",
"upload_time_iso_8601": "2025-07-14T04:21:51.428908Z",
"url": "https://files.pythonhosted.org/packages/c4/ee/78288fd838fc3749eec19e31dd1ed94b36b26473a4e806fec04f31260ce7/seaweedfs_bin-3.94-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "5ff843163ef7515c335cfd1d9e7261bd11767c696b761daad9855d51fd125a9b",
"md5": "c8923dc047d4890f5248e8d2bac1e3c7",
"sha256": "9e5f8b9de4b2b95d48090db7645cfff419d926b97c75ab58dbca296f73bfed09"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94-py3-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "c8923dc047d4890f5248e8d2bac1e3c7",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 29696371,
"upload_time": "2025-07-14T04:21:53",
"upload_time_iso_8601": "2025-07-14T04:21:53.874973Z",
"url": "https://files.pythonhosted.org/packages/5f/f8/43163ef7515c335cfd1d9e7261bd11767c696b761daad9855d51fd125a9b/seaweedfs_bin-3.94-py3-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "dca3f2517508a067d097026721c3c1d1995499f9af25e0c277e81371a8be0747",
"md5": "c6b0b8034b18fecbb0ba0c63ffa2496f",
"sha256": "759cff903b650beefb7111a07a81a2de77183702e02db999fe44cde87762c9e5"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94-py3-none-win_arm64.whl",
"has_sig": false,
"md5_digest": "c6b0b8034b18fecbb0ba0c63ffa2496f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 26566300,
"upload_time": "2025-07-14T04:21:56",
"upload_time_iso_8601": "2025-07-14T04:21:56.441405Z",
"url": "https://files.pythonhosted.org/packages/dc/a3/f2517508a067d097026721c3c1d1995499f9af25e0c277e81371a8be0747/seaweedfs_bin-3.94-py3-none-win_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "29a4fd6714b99de1ceb1ae5e856936fc9ffc18f6475e697a5c39dfd38a84915c",
"md5": "da0de17ccb06e0cfa619d5d7f7282a5b",
"sha256": "9379c2617959bd9ec5f1e441cb1e85e9ce50b2bf2146d7df02b65185bd1a303d"
},
"downloads": -1,
"filename": "seaweedfs_bin-3.94.tar.gz",
"has_sig": false,
"md5_digest": "da0de17ccb06e0cfa619d5d7f7282a5b",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7",
"size": 30839592,
"upload_time": "2025-07-14T04:21:59",
"upload_time_iso_8601": "2025-07-14T04:21:59.063847Z",
"url": "https://files.pythonhosted.org/packages/29/a4/fd6714b99de1ceb1ae5e856936fc9ffc18f6475e697a5c39dfd38a84915c/seaweedfs_bin-3.94.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-07-14 04:21:59",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Bing-su",
"github_project": "pip-binary-factory",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "seaweedfs-bin"
}
JSON
