# transformers-collection
- A collection of transformer models built using huggingface for various tasks. Training done using pytorch lightning.
- Datasets, models and tokenizers from hugging face.
- **Goal**: Get familiar with huggingface and pytorch lightning ecosystems.
## Get started
### Train Models using the library
- To train models, install using pip: `pip install transformers_collection`
- check installation: `transformers-collection version`
### Clone project and modify code
To play around with the code clone the repo:
- `git clone git@github.com:aadhithya/transformers-collection.git`
- Install poetry: `pip install poetry`
- Intsall dependencies: `poetry install`
**Note:** `poetry install` will create a new venv.
**Note**: `poetry/pip install` installs CPU version of pytorch if not available, please make sure to install CUDA version if needed.
## Train a model
- Create the yaml config file for the model (see configs/sentiment-clf.yml for example).
- train model using: `transformers-collection train /path/to/config.yml`
- For a list of supported models, see section Supported Models.
## Supported Models / Task
The following models are planned:
| Model | Dataset | Status | Checkpoint |
| :------------------------------- | :------------------------------------------------: | :-------: | ---------: |
| Sentiment/Emotion Classification | [emotion](https://huggingface.co/datasets/emotion) | ✅ | TBD |
| Text Summarization | | 🗓️ Planned | TBD |
Raw data
{
"_id": null,
"home_page": "https://github.com/aadhithya/transformers-collection",
"name": "transformers-collection",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.9,<3.11",
"maintainer_email": "",
"keywords": "transformers,huggingface,NLP",
"author": "Aadhithya Sankar",
"author_email": "aadhithya.s@outlook.com",
"download_url": "https://files.pythonhosted.org/packages/0a/ee/d48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1/transformers_collection-0.2.0.tar.gz",
"platform": null,
"description": "# transformers-collection\n- A collection of transformer models built using huggingface for various tasks. Training done using pytorch lightning.\n- Datasets, models and tokenizers from hugging face.\n- **Goal**: Get familiar with huggingface and pytorch lightning ecosystems.\n\n## Get started\n### Train Models using the library\n- To train models, install using pip: `pip install transformers_collection`\n- check installation: `transformers-collection version`\n\n### Clone project and modify code\nTo play around with the code clone the repo:\n- `git clone git@github.com:aadhithya/transformers-collection.git`\n- Install poetry: `pip install poetry`\n- Intsall dependencies: `poetry install`\n\n**Note:** `poetry install` will create a new venv.\n**Note**: `poetry/pip install` installs CPU version of pytorch if not available, please make sure to install CUDA version if needed.\n\n\n## Train a model\n- Create the yaml config file for the model (see configs/sentiment-clf.yml for example).\n- train model using: `transformers-collection train /path/to/config.yml`\n\n- For a list of supported models, see section Supported Models.\n\n\n\n## Supported Models / Task\nThe following models are planned:\n| Model | Dataset | Status | Checkpoint |\n| :------------------------------- | :------------------------------------------------: | :-------: | ---------: |\n| Sentiment/Emotion Classification | [emotion](https://huggingface.co/datasets/emotion) | \u2705 | TBD |\n| Text Summarization | | \ud83d\uddd3\ufe0f Planned | TBD |\n\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A collection of transformer models built using huggingface for various tasks.",
"version": "0.2.0",
"split_keywords": [
"transformers",
"huggingface",
"nlp"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "08559f8d20b1f08dcd9d65d815229f24383675db8a19e49218248873ea900f91",
"md5": "da4e2daa2ce12fbb32a10b1a80a88319",
"sha256": "29e44a33d7c407452c5c0565980ab695d83bb37b69a38809a528d11b81c70178"
},
"downloads": -1,
"filename": "transformers_collection-0.2.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "da4e2daa2ce12fbb32a10b1a80a88319",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.9,<3.11",
"size": 6571,
"upload_time": "2023-01-26T15:03:10",
"upload_time_iso_8601": "2023-01-26T15:03:10.922051Z",
"url": "https://files.pythonhosted.org/packages/08/55/9f8d20b1f08dcd9d65d815229f24383675db8a19e49218248873ea900f91/transformers_collection-0.2.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0aeed48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1",
"md5": "81c01a8b56ecc729a265adba71e9443b",
"sha256": "5ea87e8f7fa90b6c257c5d168fd10b8102395728430ad0659bd3ec4dc20d766f"
},
"downloads": -1,
"filename": "transformers_collection-0.2.0.tar.gz",
"has_sig": false,
"md5_digest": "81c01a8b56ecc729a265adba71e9443b",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.9,<3.11",
"size": 5425,
"upload_time": "2023-01-26T15:03:12",
"upload_time_iso_8601": "2023-01-26T15:03:12.565186Z",
"url": "https://files.pythonhosted.org/packages/0a/ee/d48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1/transformers_collection-0.2.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-01-26 15:03:12",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "aadhithya",
"github_project": "transformers-collection",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "transformers-collection"
}
JSON
