[](https://capsizegames.itch.io/chat-ai)
[](https://github.com/Capsize-Games/chatai/actions/workflows/python-publish.yml)
[](https://discord.gg/PUVDDCJ7gz)
# Chat AI: Run LLMs with your own hardware
Chat AI is an interface that sits on top of a custom engine which is responsible for processing requests and responses
to and from an active Google T5-Flan model.
---
## Bundled Installation
[Official Build can be acquired here](https://capsizegames.itch.io/chat-ai) for those who want to use a compiled version of Chat AI without having to install any additional requirements
---
## Development
### Prerequisites
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
#### Pypi installation
Use this installation method if you intend to use Chat AI from the command line or with
other python libraries or scripts.
Windows
```
pip install torch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/cu117
pip install aihandlerwindows
pip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix.tar.gz
pip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz
pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.0/bitsandbytes-0.37.2-py3-none-any.whl
pip install chatai --no-deps
```
Linux
```
pip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix.tar.gz
pip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz
pip install chatairunner
```
#### Development installation
Use this installation method if you intend to modify the source code of Chat AI.
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
1. Fork this repo on github
2. `git clone https://github.com/Capsize-Games/chatai`
3. `python -m venv env` - skip if you don't want to use venv
3. `cd chatai && pip install -e .`
4. `cd chatai && python main.py`
---
Here are the special tokens used by the model:
- <pad>: Used to pad sequences to a fixed length.
- <bos>: Beginning of sequence token, used to indicate the start of a sequence.
- <eos>: End of sequence token, used to indicate the end of a sequence.
- <unk>: Unknown token, used to represent out-of-vocabulary words.
- <mask>: Mask token, used for masked language modeling tasks.
- <extra_id_X>: Special token used to represent additional task-specific labels, where X is a number from 0 to 99.
- <eot>: End of turn token, used in conversation models to indicate the end of a speaker's turn.
Raw data
{
"_id": null,
"home_page": "https://github.com/Capsize-Games/chat-ai",
"name": "chatairunner",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.10.0",
"maintainer_email": "",
"keywords": "ai,chatbot,chat,ai",
"author": "Capsize LLC",
"author_email": "contact@capsize.gg",
"download_url": "https://files.pythonhosted.org/packages/88/7e/e91665143e1dd30372251897f8acd1543a9c8321cc9ed9f9597d768b2a4a/chatairunner-1.0.9.tar.gz",
"platform": null,
"description": "[](https://capsizegames.itch.io/chat-ai)\n[](https://github.com/Capsize-Games/chatai/actions/workflows/python-publish.yml)\n[](https://discord.gg/PUVDDCJ7gz)\n\n\n\n\n\n\n\n# Chat AI: Run LLMs with your own hardware\n\nChat AI is an interface that sits on top of a custom engine which is responsible for processing requests and responses \nto and from an active Google T5-Flan model.\n\n\n\n---\n\n## Bundled Installation\n\n[Official Build can be acquired here](https://capsizegames.itch.io/chat-ai) for those who want to use a compiled version of Chat AI without having to install any additional requirements\n\n---\n\n## Development\n\n### Prerequisites\n\n- Ubuntu 20.04+ or Windows 10+\n- Python 3.10.6\n- pip-23.0.1\n\n#### Pypi installation\n\nUse this installation method if you intend to use Chat AI from the command line or with\nother python libraries or scripts.\n\nWindows\n```\npip install torch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/cu117\npip install aihandlerwindows\npip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix.tar.gz\npip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz\npip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.0/bitsandbytes-0.37.2-py3-none-any.whl\npip install chatai --no-deps\n```\n\nLinux\n```\npip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix.tar.gz\npip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz\npip install chatairunner\n```\n\n#### Development installation\n\nUse this installation method if you intend to modify the source code of Chat AI.\n\n- Ubuntu 20.04+ or Windows 10+\n- Python 3.10.6\n- pip-23.0.1\n\n1. Fork this repo on github\n2. `git clone https://github.com/Capsize-Games/chatai`\n3. `python -m venv env` - skip if you don't want to use venv\n3. `cd chatai && pip install -e .`\n4. `cd chatai && python main.py`\n\n---\n\nHere are the special tokens used by the model:\n\n- <pad>: Used to pad sequences to a fixed length.\n- <bos>: Beginning of sequence token, used to indicate the start of a sequence.\n- <eos>: End of sequence token, used to indicate the end of a sequence.\n- <unk>: Unknown token, used to represent out-of-vocabulary words.\n- <mask>: Mask token, used for masked language modeling tasks.\n- <extra_id_X>: Special token used to represent additional task-specific labels, where X is a number from 0 to 99.\n- <eot>: End of turn token, used in conversation models to indicate the end of a speaker's turn.\n",
"bugtrack_url": null,
"license": "AGPL-3.0",
"summary": "Chat AI: A chatbot framework",
"version": "1.0.9",
"split_keywords": [
"ai",
"chatbot",
"chat",
"ai"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "f45e3d20b8e90ab6b309726ce29e54c852174e15c8ce83a1490c4914cfa191c5",
"md5": "6a13596ca90e7ccb794ce5624244d61a",
"sha256": "0a94f376fb70043ca1a6fd2b64922536eda72fe3669468c9a68d738132e5fa38"
},
"downloads": -1,
"filename": "chatairunner-1.0.9-py3-none-any.whl",
"has_sig": false,
"md5_digest": "6a13596ca90e7ccb794ce5624244d61a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10.0",
"size": 28576,
"upload_time": "2023-03-31T02:48:02",
"upload_time_iso_8601": "2023-03-31T02:48:02.310647Z",
"url": "https://files.pythonhosted.org/packages/f4/5e/3d20b8e90ab6b309726ce29e54c852174e15c8ce83a1490c4914cfa191c5/chatairunner-1.0.9-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "887ee91665143e1dd30372251897f8acd1543a9c8321cc9ed9f9597d768b2a4a",
"md5": "ac203fe4db6320fcf3f5062be09db4fd",
"sha256": "5010fac965d1a8a964e9c05b078d7b9dd84ffbd7a0116804766397954de1e00b"
},
"downloads": -1,
"filename": "chatairunner-1.0.9.tar.gz",
"has_sig": false,
"md5_digest": "ac203fe4db6320fcf3f5062be09db4fd",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10.0",
"size": 27452,
"upload_time": "2023-03-31T02:48:03",
"upload_time_iso_8601": "2023-03-31T02:48:03.521265Z",
"url": "https://files.pythonhosted.org/packages/88/7e/e91665143e1dd30372251897f8acd1543a9c8321cc9ed9f9597d768b2a4a/chatairunner-1.0.9.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-03-31 02:48:03",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "Capsize-Games",
"github_project": "chat-ai",
"lcname": "chatairunner"
}
JSON
