| Name | libp2p-accelerate-py JSON |
| Version |
0.0.3
JSON |
| download |
| home_page | None |
| Summary | a python wrapper around nodejs orbitdb |
| upload_time | 2024-09-03 04:46:08 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.8 |
| license | None |
| keywords |
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# IPFS ACCELERATE
This is meant to be an extension of the Huggingface accelerate library, with the intent that the method load_checkpoint_and_dispatch() is going to be overloaded with a new function which will have some modular back ends, such as Libp2p, Akash, Lilypad, Huggingface Zero, Vast AI. If the model is already listed in the ipfs_model_manager there should be an associated hw_requirements key of the manifest. In the case of libp2p the request to do inference will go out to peers if there are peers in the network available to fulfill the task, otherwise a docker container will need to be launched with one of the providers here. The docker containers will will then be loaded with the ipfs_model_manager, and will use the from_auto_download() method to download the requested model and perform inference for the user.
# Method #1 Huggingface Zero
# Method #2 Akash
# Method #3 Lilypad
# Method #4 Vast AI
# IPFS Huggingface Bridge:
for huggingface transformers python library visit:
https://github.com/endomorphosis/ipfs_transformers/
for huggingface datasets python library visit:
https://github.com/endomorphosis/ipfs_datasets/
for faiss KNN index python library visit:
https://github.com/endomorphosis/ipfs_faiss
for transformers.js visit:
https://github.com/endomorphosis/ipfs_transformers_js
for orbitdb_kit nodejs library visit:
https://github.com/endomorphosis/orbitdb_kit/
for fireproof_kit nodejs library visit:
https://github.com/endomorphosis/fireproof_kit
for ipfs_kit nodejs library visit:
https://github.com/endomorphosis/ipfs_kit/
for python model manager library visit:
https://github.com/endomorphosis/ipfs_model_manager/
for nodejs model manager library visit:
https://github.com/endomorphosis/ipfs_model_manager_js/
for nodejs ipfs huggingface scraper with pinning services visit:
https://github.com/endomorphosis/ipfs_huggingface_scraper/
for ipfs agents visit:
https://github.com/endomorphosis/ipfs_agents/
for ipfs accelerate visit:
https://github.com/endomorphosis/ipfs_accelerate/
Author - Benjamin Barber
QA - Kevin De Haan
Raw data
{
"_id": null,
"home_page": null,
"name": "libp2p-accelerate-py",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": null,
"author_email": "Benjamin Barber <starworks5@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/57/2f/18f495ff23aa3f2f2cca685ef20db9f2824e0c597b597a72bc89b9289095/libp2p_accelerate_py-0.0.3.tar.gz",
"platform": null,
"description": "# IPFS ACCELERATE\n\nThis is meant to be an extension of the Huggingface accelerate library, with the intent that the method load_checkpoint_and_dispatch() is going to be overloaded with a new function which will have some modular back ends, such as Libp2p, Akash, Lilypad, Huggingface Zero, Vast AI. If the model is already listed in the ipfs_model_manager there should be an associated hw_requirements key of the manifest. In the case of libp2p the request to do inference will go out to peers if there are peers in the network available to fulfill the task, otherwise a docker container will need to be launched with one of the providers here. The docker containers will will then be loaded with the ipfs_model_manager, and will use the from_auto_download() method to download the requested model and perform inference for the user.\n\n# Method #1 Huggingface Zero\n\n# Method #2 Akash\n\n# Method #3 Lilypad\n\n# Method #4 Vast AI\n\n\n# IPFS Huggingface Bridge:\n\nfor huggingface transformers python library visit:\nhttps://github.com/endomorphosis/ipfs_transformers/\n\nfor huggingface datasets python library visit:\nhttps://github.com/endomorphosis/ipfs_datasets/\n\nfor faiss KNN index python library visit:\nhttps://github.com/endomorphosis/ipfs_faiss\n\nfor transformers.js visit: \nhttps://github.com/endomorphosis/ipfs_transformers_js\n\nfor orbitdb_kit nodejs library visit:\nhttps://github.com/endomorphosis/orbitdb_kit/\n\nfor fireproof_kit nodejs library visit:\nhttps://github.com/endomorphosis/fireproof_kit\n\nfor ipfs_kit nodejs library visit:\nhttps://github.com/endomorphosis/ipfs_kit/\n\nfor python model manager library visit: \nhttps://github.com/endomorphosis/ipfs_model_manager/\n\nfor nodejs model manager library visit: \nhttps://github.com/endomorphosis/ipfs_model_manager_js/\n\nfor nodejs ipfs huggingface scraper with pinning services visit:\nhttps://github.com/endomorphosis/ipfs_huggingface_scraper/\n\nfor ipfs agents visit:\nhttps://github.com/endomorphosis/ipfs_agents/\n\nfor ipfs accelerate visit:\nhttps://github.com/endomorphosis/ipfs_accelerate/\n\nAuthor - Benjamin Barber\nQA - Kevin De Haan\n",
"bugtrack_url": null,
"license": null,
"summary": "a python wrapper around nodejs orbitdb",
"version": "0.0.3",
"project_urls": {
"Homepage": "https://github.com/endomorphosis/libp2p_kit_py",
"Issues": "https://github.com/endomorphosis/libp2p_kit_py/issues"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0451ec22eb121d1a621259f873f1bdfe819cca55bc75c8be2a8d70dedf9bd530",
"md5": "743a753be4809b61bb3bc21977070bbf",
"sha256": "5f036e72d1037edc06c8bb9ffa88e363811f84db25755e4ad1a95e9ddb3d734d"
},
"downloads": -1,
"filename": "libp2p_accelerate_py-0.0.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "743a753be4809b61bb3bc21977070bbf",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 14820,
"upload_time": "2024-09-03T04:46:06",
"upload_time_iso_8601": "2024-09-03T04:46:06.793919Z",
"url": "https://files.pythonhosted.org/packages/04/51/ec22eb121d1a621259f873f1bdfe819cca55bc75c8be2a8d70dedf9bd530/libp2p_accelerate_py-0.0.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "572f18f495ff23aa3f2f2cca685ef20db9f2824e0c597b597a72bc89b9289095",
"md5": "2db39a3fc92256cb6451b710a6929502",
"sha256": "382907a5e9d2a30d12d72767efd8e9b9db51700286e4cab2846963d86096c8c1"
},
"downloads": -1,
"filename": "libp2p_accelerate_py-0.0.3.tar.gz",
"has_sig": false,
"md5_digest": "2db39a3fc92256cb6451b710a6929502",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 14522,
"upload_time": "2024-09-03T04:46:08",
"upload_time_iso_8601": "2024-09-03T04:46:08.505685Z",
"url": "https://files.pythonhosted.org/packages/57/2f/18f495ff23aa3f2f2cca685ef20db9f2824e0c597b597a72bc89b9289095/libp2p_accelerate_py-0.0.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-09-03 04:46:08",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "endomorphosis",
"github_project": "libp2p_kit_py",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "libp2p-accelerate-py"
}
