# Nendo Plugin TextGen
<br>
<p align="left">
<img src="https://okio.ai/docs/assets/nendo_core_logo.png" width="350" alt="nendo core">
</p>
<br>
<p align="left">
<a href="https://okio.ai" target="_blank">
<img src="https://img.shields.io/website/https/okio.ai" alt="Website">
</a>
<a href="https://twitter.com/okio_ai" target="_blank">
<img src="https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai" alt="Twitter">
</a>
<a href="https://discord.gg/gaZMZKzScj" target="_blank">
<img src="https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat" alt="Discord">
</a>
</p>
---
A text generation plugin using local LLMs or other text generation methods.
Builds on top of `transformers` by Hugging Face.
## Features
- Generate text from a prompt using a local LLM
- Access all LLMs from the [Hugging Face Model Hub](https://huggingface.co/models)
## Requirements
Since we depend on `transformers`, please make sure that you fulfill their requirements.
You also need Pytorch installed on your system, please refer to the [pytorch installation instructions](https://pytorch.org/get-started/locally/).
## Installation
1. [Install Nendo](https://github.com/okio-ai/nendo#installation)
2. `pip install nendo-plugin-textgen`
If you have a CUDA GPU you can install the following library for an additional speedup:
`pip install flash-attn --no-build-isolation`
Then set `ATTN_IMPLEMENTATION=flash_attention_2` in your environment variables.
## Usage
Take a look at a basic usage example below.
For more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).
```pycon
>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_textgen"])
>>> nd.plugins.textgen(prompt=["Tell me about your favorite song."])[0]
```
## Contributing
Visit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)
## License
Nendo: MIT License
Raw data
{
"_id": null,
"home_page": "https://okio.ai",
"name": "nendo-plugin-textgen",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8,<3.11",
"maintainer_email": "",
"keywords": "AI,generative,music,okio,nendo,text generation,LLM,transformers,music analysis,song analysis",
"author": "Aaron Abebe",
"author_email": "aaron@okio.ai",
"download_url": "https://files.pythonhosted.org/packages/b3/df/719906ec71a373fb53234d54fe3b95d2dc0de9208e03430cd1dd7653fc92/nendo_plugin_textgen-0.1.1.tar.gz",
"platform": null,
"description": "# Nendo Plugin TextGen\n\n<br>\n<p align=\"left\">\n <img src=\"https://okio.ai/docs/assets/nendo_core_logo.png\" width=\"350\" alt=\"nendo core\">\n</p>\n<br>\n\n<p align=\"left\">\n<a href=\"https://okio.ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/website/https/okio.ai\" alt=\"Website\">\n</a>\n<a href=\"https://twitter.com/okio_ai\" target=\"_blank\">\n <img src=\"https://img.shields.io/twitter/url/https/twitter.com/okio_ai.svg?style=social&label=Follow%20%40okio_ai\" alt=\"Twitter\">\n</a>\n<a href=\"https://discord.gg/gaZMZKzScj\" target=\"_blank\">\n <img src=\"https://dcbadge.vercel.app/api/server/XpkUsjwXTp?compact=true&style=flat\" alt=\"Discord\">\n</a>\n</p>\n\n---\n\nA text generation plugin using local LLMs or other text generation methods. \nBuilds on top of `transformers` by Hugging Face.\n\n## Features \n- Generate text from a prompt using a local LLM\n- Access all LLMs from the [Hugging Face Model Hub](https://huggingface.co/models)\n\n## Requirements\n\nSince we depend on `transformers`, please make sure that you fulfill their requirements.\nYou also need Pytorch installed on your system, please refer to the [pytorch installation instructions](https://pytorch.org/get-started/locally/).\n\n## Installation\n\n1. [Install Nendo](https://github.com/okio-ai/nendo#installation)\n2. `pip install nendo-plugin-textgen`\n\nIf you have a CUDA GPU you can install the following library for an additional speedup: \n\n`pip install flash-attn --no-build-isolation`\n\nThen set `ATTN_IMPLEMENTATION=flash_attention_2` in your environment variables.\n\n\n## Usage\n\nTake a look at a basic usage example below.\nFor more detailed information, please refer to the [documentation](https://okio.ai/docs/plugins).\n\n```pycon\n>>> from nendo import Nendo\n>>> nd = Nendo(plugins=[\"nendo_plugin_textgen\"])\n\n>>> nd.plugins.textgen(prompt=[\"Tell me about your favorite song.\"])[0]\n```\n\n\n## Contributing\n\nVisit our docs to learn all about how to contribute to Nendo: [Contributing](https://okio.ai/docs/contributing/)\n\n\n## License\n\nNendo: MIT License\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A text generation plugin using local LLMs or other text generation methods. Builds on top of `transformers` by Hugging Face.",
"version": "0.1.1",
"project_urls": {
"Homepage": "https://okio.ai",
"Repository": "https://github.com/okio-ai/nendo_plugin_textgen"
},
"split_keywords": [
"ai",
"generative",
"music",
"okio",
"nendo",
"text generation",
"llm",
"transformers",
"music analysis",
"song analysis"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "561aca80f02bb15dbcf2d33b06b03514d7d18cd8cf57edd562a2b1a6c0932a5a",
"md5": "72dada8856e477a2b9fc0f3628bf7fca",
"sha256": "1a6a0945a3b06fc09995caa89d25d7a90920bdc646a959ec05e5611391c5a7c1"
},
"downloads": -1,
"filename": "nendo_plugin_textgen-0.1.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "72dada8856e477a2b9fc0f3628bf7fca",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8,<3.11",
"size": 7524,
"upload_time": "2024-03-14T09:17:27",
"upload_time_iso_8601": "2024-03-14T09:17:27.317251Z",
"url": "https://files.pythonhosted.org/packages/56/1a/ca80f02bb15dbcf2d33b06b03514d7d18cd8cf57edd562a2b1a6c0932a5a/nendo_plugin_textgen-0.1.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b3df719906ec71a373fb53234d54fe3b95d2dc0de9208e03430cd1dd7653fc92",
"md5": "92e3995ea28c47e9fe0b7f470fcfe8bf",
"sha256": "644a56daa44df1956a53caf186431c81b18ae2aabee15d4322e43491516b241e"
},
"downloads": -1,
"filename": "nendo_plugin_textgen-0.1.1.tar.gz",
"has_sig": false,
"md5_digest": "92e3995ea28c47e9fe0b7f470fcfe8bf",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8,<3.11",
"size": 7466,
"upload_time": "2024-03-14T09:17:28",
"upload_time_iso_8601": "2024-03-14T09:17:28.588288Z",
"url": "https://files.pythonhosted.org/packages/b3/df/719906ec71a373fb53234d54fe3b95d2dc0de9208e03430cd1dd7653fc92/nendo_plugin_textgen-0.1.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-14 09:17:28",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "okio-ai",
"github_project": "nendo_plugin_textgen",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "nendo-plugin-textgen"
}
JSON
