transformers-collection


Nametransformers-collection JSON
Version 0.2.0 PyPI version JSON
download
home_pagehttps://github.com/aadhithya/transformers-collection
SummaryA collection of transformer models built using huggingface for various tasks.
upload_time2023-01-26 15:03:12
maintainer
docs_urlNone
authorAadhithya Sankar
requires_python>=3.9,<3.11
licenseMIT
keywords transformers huggingface nlp
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # transformers-collection
- A collection of transformer models built  using huggingface for various tasks. Training done using pytorch lightning.
- Datasets, models and tokenizers from hugging face.
- **Goal**: Get familiar with huggingface and pytorch lightning ecosystems.

## Get started
### Train Models using the library
- To train models, install using pip: `pip install transformers_collection`
- check installation: `transformers-collection version`

### Clone project and modify code
To play around with the code clone the repo:
- `git clone git@github.com:aadhithya/transformers-collection.git`
- Install poetry: `pip install poetry`
- Intsall dependencies: `poetry install`

**Note:** `poetry install` will create a new venv.
**Note**: `poetry/pip install` installs CPU version of pytorch if not available, please make sure to install CUDA version if needed.


## Train a model
- Create the yaml config file for the model (see configs/sentiment-clf.yml for example).
- train model using: `transformers-collection train /path/to/config.yml`

- For a list of supported models, see section Supported Models.



## Supported Models / Task
The following models are planned:
| Model                            |                      Dataset                       |  Status   | Checkpoint |
| :------------------------------- | :------------------------------------------------: | :-------: | ---------: |
| Sentiment/Emotion Classification | [emotion](https://huggingface.co/datasets/emotion) |     ✅     |        TBD |
| Text Summarization               |                                                    | 🗓️ Planned |        TBD |


            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/aadhithya/transformers-collection",
    "name": "transformers-collection",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.9,<3.11",
    "maintainer_email": "",
    "keywords": "transformers,huggingface,NLP",
    "author": "Aadhithya Sankar",
    "author_email": "aadhithya.s@outlook.com",
    "download_url": "https://files.pythonhosted.org/packages/0a/ee/d48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1/transformers_collection-0.2.0.tar.gz",
    "platform": null,
    "description": "# transformers-collection\n- A collection of transformer models built  using huggingface for various tasks. Training done using pytorch lightning.\n- Datasets, models and tokenizers from hugging face.\n- **Goal**: Get familiar with huggingface and pytorch lightning ecosystems.\n\n## Get started\n### Train Models using the library\n- To train models, install using pip: `pip install transformers_collection`\n- check installation: `transformers-collection version`\n\n### Clone project and modify code\nTo play around with the code clone the repo:\n- `git clone git@github.com:aadhithya/transformers-collection.git`\n- Install poetry: `pip install poetry`\n- Intsall dependencies: `poetry install`\n\n**Note:** `poetry install` will create a new venv.\n**Note**: `poetry/pip install` installs CPU version of pytorch if not available, please make sure to install CUDA version if needed.\n\n\n## Train a model\n- Create the yaml config file for the model (see configs/sentiment-clf.yml for example).\n- train model using: `transformers-collection train /path/to/config.yml`\n\n- For a list of supported models, see section Supported Models.\n\n\n\n## Supported Models / Task\nThe following models are planned:\n| Model                            |                      Dataset                       |  Status   | Checkpoint |\n| :------------------------------- | :------------------------------------------------: | :-------: | ---------: |\n| Sentiment/Emotion Classification | [emotion](https://huggingface.co/datasets/emotion) |     \u2705     |        TBD |\n| Text Summarization               |                                                    | \ud83d\uddd3\ufe0f Planned |        TBD |\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "A collection of transformer models built  using huggingface for various tasks.",
    "version": "0.2.0",
    "split_keywords": [
        "transformers",
        "huggingface",
        "nlp"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "08559f8d20b1f08dcd9d65d815229f24383675db8a19e49218248873ea900f91",
                "md5": "da4e2daa2ce12fbb32a10b1a80a88319",
                "sha256": "29e44a33d7c407452c5c0565980ab695d83bb37b69a38809a528d11b81c70178"
            },
            "downloads": -1,
            "filename": "transformers_collection-0.2.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "da4e2daa2ce12fbb32a10b1a80a88319",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9,<3.11",
            "size": 6571,
            "upload_time": "2023-01-26T15:03:10",
            "upload_time_iso_8601": "2023-01-26T15:03:10.922051Z",
            "url": "https://files.pythonhosted.org/packages/08/55/9f8d20b1f08dcd9d65d815229f24383675db8a19e49218248873ea900f91/transformers_collection-0.2.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0aeed48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1",
                "md5": "81c01a8b56ecc729a265adba71e9443b",
                "sha256": "5ea87e8f7fa90b6c257c5d168fd10b8102395728430ad0659bd3ec4dc20d766f"
            },
            "downloads": -1,
            "filename": "transformers_collection-0.2.0.tar.gz",
            "has_sig": false,
            "md5_digest": "81c01a8b56ecc729a265adba71e9443b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9,<3.11",
            "size": 5425,
            "upload_time": "2023-01-26T15:03:12",
            "upload_time_iso_8601": "2023-01-26T15:03:12.565186Z",
            "url": "https://files.pythonhosted.org/packages/0a/ee/d48f9043dcef95bb8a3697d5bd2529df27bc6811fb9a776ec90c385f9df1/transformers_collection-0.2.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-01-26 15:03:12",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": "aadhithya",
    "github_project": "transformers-collection",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "transformers-collection"
}
        
Elapsed time: 0.07499s