| Name | aiconfig-extension-hugging-face-transformers JSON |
| Version |
0.0.4
JSON |
| download |
| home_page | |
| Summary | An extension for using Hugging Face transformers to parse models for AIConfig. |
| upload_time | 2023-12-06 18:18:36 |
| maintainer | |
| docs_url | None |
| author | LastMile AI |
| requires_python | >=3.8 |
| license | |
| keywords |
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# Using HuggingFace transformers for model parsing with AIConfig
We are prioritizing the Python library so that it can be used with the Gradio backend (which is written in Python) to support Hugging Face workspaces, which is why this is an extension and not part of the core library.
The goal is for these transformers to be used to power the model parser backends.
## Usage
### Part 1: Update and test this extention
If you are not testing locally (just using the published extension), ignore this and go to Part 2
1. From the `aiconfig/HuggingFaceTransformers`, run this command: `pip install build && cd python && python -m build && pip install dist/*.whl`
2. After you're done testing, be sure to delete the generated folder(s) in the `aiconfig/HuggingFaceTransformers` dir. It'll probalby look something like `python/dist` and `python/<package_name>.egg-info`
### Part 2: Importing and using this extension
1. Import whatever outputs pip gives from last command. For now it's `import text-generation` but this may change in the future
2. In code, add all the relevant model parsers that you want to use from this extension to the registry: `ModelParserRegistry.register_model_parser(HuggingFaceTextGenerationTransformer())`. You can read the docstrings under `ModelParserRegistry` class for more info
Raw data
{
"_id": null,
"home_page": "",
"name": "aiconfig-extension-hugging-face-transformers",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "",
"author": "LastMile AI",
"author_email": "Rossdan Craig <rossdan@lastmileai.dev>, Ankush Pala <ankush@lastmileai.dev>",
"download_url": "https://files.pythonhosted.org/packages/77/5f/beaec438c35d704a9025f9dea286b7ff4d464ef90578ee1ac63368a5de52/aiconfig_extension_hugging_face_transformers-0.0.4.tar.gz",
"platform": null,
"description": "# Using HuggingFace transformers for model parsing with AIConfig\n\nWe are prioritizing the Python library so that it can be used with the Gradio backend (which is written in Python) to support Hugging Face workspaces, which is why this is an extension and not part of the core library.\n\nThe goal is for these transformers to be used to power the model parser backends.\n\n## Usage\n\n### Part 1: Update and test this extention\n\nIf you are not testing locally (just using the published extension), ignore this and go to Part 2\n\n1. From the `aiconfig/HuggingFaceTransformers`, run this command: `pip install build && cd python && python -m build && pip install dist/*.whl`\n2. After you're done testing, be sure to delete the generated folder(s) in the `aiconfig/HuggingFaceTransformers` dir. It'll probalby look something like `python/dist` and `python/<package_name>.egg-info`\n\n### Part 2: Importing and using this extension\n\n1. Import whatever outputs pip gives from last command. For now it's `import text-generation` but this may change in the future\n2. In code, add all the relevant model parsers that you want to use from this extension to the registry: `ModelParserRegistry.register_model_parser(HuggingFaceTextGenerationTransformer())`. You can read the docstrings under `ModelParserRegistry` class for more info\n",
"bugtrack_url": null,
"license": "",
"summary": "An extension for using Hugging Face transformers to parse models for AIConfig.",
"version": "0.0.4",
"project_urls": {
"Homepage": "https://github.com/lastmile-ai/aiconfig/",
"Issues": "https://github.com/lastmile-ai/aiconfig/issues"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "551a54206f340cfc0879d2093852277977e9164687bb864b03a318a025a985d7",
"md5": "c8e3799b5896f37ecbef36d378476e6e",
"sha256": "8235630c1aec8776c08a146298be77a3201772ab163c97cc3de99414f88215d0"
},
"downloads": -1,
"filename": "aiconfig_extension_hugging_face_transformers-0.0.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "c8e3799b5896f37ecbef36d378476e6e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 6862,
"upload_time": "2023-12-06T18:18:34",
"upload_time_iso_8601": "2023-12-06T18:18:34.910048Z",
"url": "https://files.pythonhosted.org/packages/55/1a/54206f340cfc0879d2093852277977e9164687bb864b03a318a025a985d7/aiconfig_extension_hugging_face_transformers-0.0.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "775fbeaec438c35d704a9025f9dea286b7ff4d464ef90578ee1ac63368a5de52",
"md5": "9af3de1d04d9fe98de21c03cdbdf47d3",
"sha256": "5b81f808bb4a5c8f677a295990d4a570b43b5d04d3239184544fd3fe28dc8b85"
},
"downloads": -1,
"filename": "aiconfig_extension_hugging_face_transformers-0.0.4.tar.gz",
"has_sig": false,
"md5_digest": "9af3de1d04d9fe98de21c03cdbdf47d3",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 6561,
"upload_time": "2023-12-06T18:18:36",
"upload_time_iso_8601": "2023-12-06T18:18:36.449787Z",
"url": "https://files.pythonhosted.org/packages/77/5f/beaec438c35d704a9025f9dea286b7ff4d464ef90578ee1ac63368a5de52/aiconfig_extension_hugging_face_transformers-0.0.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-12-06 18:18:36",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "lastmile-ai",
"github_project": "aiconfig",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "aiconfig-extension-hugging-face-transformers"
}
