| Name | genoss JSON |
| Version |
0.0.2a3
JSON |
| download |
| home_page | https://genoss.ai/ |
| Summary | Replace OpenAI GPT with any LLMs in your app with one line. Common Inference API for all LLMs either Private or Public (Anthropic, Llama, GPT, Vertex, ...) |
| upload_time | 2023-08-25 10:41:16 |
| maintainer | |
| docs_url | None |
| author | mattzcarey |
| requires_python | >=3.11,<4.0 |
| license | |
| keywords |
server
llm
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# Genoss GPT
## One line replacement for openAI ChatGPT & Embeddings powered by OSS models
<div align="center">
<img src="https://raw.githubusercontent.com/OpenGenerativeAI/GenossGPT/v0.0.1/doc/assets/logo.png" alt="Genoss" width="40%" style="border-radius: 50%; padding-bottom: 20px"/>
</div>
Genoss is a pioneering open-source initiative that aims to offer a seamless alternative to OpenAI models such as GPT 3.5 & 4, using open-source models like GPT4ALL.
Project bootstrapped using [Sicarator](https://github.com/sicara/sicarator)
## Features
- **Open-Source**: Genoss is built on top of open-source models like GPT4ALL.
- **One Line Replacement**: Genoss is a one-line replacement for OpenAI ChatGPT API.
## Demo
Chat Completion and Embedding with GPT4ALL
https://github.com/OpenGenenerativeAI/GenossGPT/assets/19614572/9cfd4f69-6396-4883-b94d-e94dd76663dc
## Supported Models
- GPT4ALL Model & Embeddings
- More models coming soon!
## Starting Up
Before you embark, ensure Python 3.11 or higher is installed on your machine.
### Install the server
#### Using pip (RECOMMENDED)
:warning: we are currently in prepublish.
```shell
pip install genoss
```
#### Install the latest version from this repository
```shell
pip install git+https://github.com/OpenGenerativeAI/GenossGPT.git@main\#egg\=genoss
```
#### Run the server
```shell
genoss-server
# To know more
genoss-server --help
```
Access the api docs via http://localhost:4321/docs .
## Models Installation
<details>
<summary>Install GPT4ALL Model</summary>
The first step is to install GPT4ALL, which is the only supported model at the moment. You can do this by following these steps:
1. Clone the repository:
```bash
git clone --recurse-submodules git@github.com:nomic-ai/gpt4all.git
```
2. Navigate to the backend directory:
```bash
cd gpt4all/gpt4all-backend/
```
3. Create a new build directory and navigate into it:
```bash
mkdir build && cd build
```
4. Configure and build the project using cmake:
```bash
cmake ..
cmake --build . --parallel
```
5. Verify that libllmodel.* exists in `gpt4all-backend/build`.
6. Navigate back to the root and install the Python package:
```bash
cd ../../gpt4all-bindings/python
pip3 install -e .
```
7. Download it to your local machine from [here](https://gpt4all.io/models/ggml-gpt4all-j-v1.3-groovy.bin) and put it in the `local_models` directory as `local_models/ggml-gpt4all-j-v1.3-groovy.bin`
</details>
## Running the Application
You need to install [poetry](https://python-poetry.org/docs/) and a valid python version (3.11*).
```bash
poetry install
```
For more, on a complete install for development purpose, you can check the [CONTRIBUTING.md](CONTRIBUTING.md).
If you simply want to start the server, you can install with the corresponding poetry groups :
```bash
poetry install --only main,llms
```
After the Python package has been installed, you can run the application. The Uvicorn ASGI server can be used to run your application:
```bash
uvicorn main:app --host 0.0.0.0 --port 4321
```
This command launches the Genoss application on port 4321 of your machine.
## Running the Webapp Demo
In the `demo/`
```bash
cp .env.example .env
```
Replace the values and then
```bash
PYTHONPATH=. streamlit run demo/main.py
```
## Genoss API Usage
The Genoss API is a one-line replacement for the OpenAI ChatGPT API. It supports the same parameters and returns the same response format as the OpenAI API.
Simply replace the OpenAI API endpoint with the Genoss API endpoint and you're good to go!
Modify the models to the supported list of models and you're good to go!
You can find the API documentation at `/docs` or `/redoc`.
## Upcoming Developments
While GPT4ALL is the only model currently supported, we are planning to add more models in the future. So, stay tuned for more exciting updates.
The vision:
- [X] Allow LLM models to be ran locally
- [X] Allow LLM to be ran locally using HuggingFace
- [X] ALlow LLM to be ran on HuggingFace and just be a wrapper around the inference API.
- [ ] Allow easy installation of LLM models locally
- [ ] Allow users to use cloud provider solutions such as GCP, AWS, Azure, etc ...
- [ ] Allow users management with API keys
- [ ] Have all kinds of models available for use (text to text, text to image, text to audio, audio to text, etc.)
- [X] Be compatible with OpenAI API for models that are compatible with OpenAI API
## History
Genoss was imagined by [Stan Girard](https://github.com/StanGirard) when a feature of [Quivr](https://github.com/StanGirard/quivr) became too big and complicated to maintain.
The idea was to create a simple API that would allow to use any model with the same API as OpenAI's ChatGPT API.
Then @[mattzcarey](https://github.com/mattzcarey), @[MaximeThoonsen](https://github.com/MaximeThoonsen), @[Wirg](https://github.com/Wirg) and @[StanGirard](https://github.com/StanGirard) started working on the project and it became a reality.
## Contributions
Your contributions to Genoss are immensely appreciated! Feel free to submit any issues or pull requests.
Thanks go to these wonderful people:
<a href="https://github.com/opengenerativeai/genossGPT/graphs/contributors">
<img src="https://contrib.rocks/image?repo=opengenerativeai/genossGPT" />
</a>
## Sponsors ❤️
This project could not be possible without the support of our sponsors. Thank you for your support!
<a href="https://www.theodo.fr/">
<img src="https://avatars.githubusercontent.com/u/332041?s=200&v=4" alt="Theodo" style="padding: 10px" width="70px">
</a>
<a href="https://www.aleios.com/">
<img src="https://avatars.githubusercontent.com/u/97908131?s=200&v=4" alt="Aleios" style="padding: 10px" width="70px">
</a>
<a href="https://www.sicara.fr/">
<img src="https://avatars.githubusercontent.com/u/23194788?s=200&v=4" alt="Sicara" style="padding: 10px" width="70px">
</a>
## License
Genoss is licensed under the Apache2 License. For more details, refer to the [LICENSE](LICENSE) file.
Raw data
{
"_id": null,
"home_page": "https://genoss.ai/",
"name": "genoss",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.11,<4.0",
"maintainer_email": "",
"keywords": "server,llm",
"author": "mattzcarey",
"author_email": "mattc@aleios.com",
"download_url": "https://files.pythonhosted.org/packages/9c/35/8fbe6b7d0e3f14d2312f6cb994ba7108b4642f99057006a9a2c07b297ca0/genoss-0.0.2a3.tar.gz",
"platform": null,
"description": "# Genoss GPT\n## One line replacement for openAI ChatGPT & Embeddings powered by OSS models\n\n\n<div align=\"center\">\n <img src=\"https://raw.githubusercontent.com/OpenGenerativeAI/GenossGPT/v0.0.1/doc/assets/logo.png\" alt=\"Genoss\" width=\"40%\" style=\"border-radius: 50%; padding-bottom: 20px\"/>\n</div>\n\nGenoss is a pioneering open-source initiative that aims to offer a seamless alternative to OpenAI models such as GPT 3.5 & 4, using open-source models like GPT4ALL.\n\nProject bootstrapped using [Sicarator](https://github.com/sicara/sicarator)\n\n## Features\n\n- **Open-Source**: Genoss is built on top of open-source models like GPT4ALL.\n- **One Line Replacement**: Genoss is a one-line replacement for OpenAI ChatGPT API.\n\n## Demo\n\nChat Completion and Embedding with GPT4ALL\n\n\nhttps://github.com/OpenGenenerativeAI/GenossGPT/assets/19614572/9cfd4f69-6396-4883-b94d-e94dd76663dc\n\n\n\n## Supported Models\n\n- GPT4ALL Model & Embeddings\n- More models coming soon!\n\n\n## Starting Up\n\nBefore you embark, ensure Python 3.11 or higher is installed on your machine.\n\n### Install the server\n#### Using pip (RECOMMENDED)\n:warning: we are currently in prepublish.\n\n```shell\npip install genoss\n```\n\n#### Install the latest version from this repository\n```shell\npip install git+https://github.com/OpenGenerativeAI/GenossGPT.git@main\\#egg\\=genoss\n```\n\n#### Run the server\n\n```shell\ngenoss-server\n# To know more\ngenoss-server --help\n```\n\nAccess the api docs via http://localhost:4321/docs .\n\n## Models Installation\n\n<details>\n<summary>Install GPT4ALL Model</summary>\nThe first step is to install GPT4ALL, which is the only supported model at the moment. You can do this by following these steps:\n\n1. Clone the repository:\n\n```bash\ngit clone --recurse-submodules git@github.com:nomic-ai/gpt4all.git\n```\n\n2. Navigate to the backend directory:\n\n```bash\ncd gpt4all/gpt4all-backend/\n```\n\n3. Create a new build directory and navigate into it:\n\n```bash\nmkdir build && cd build\n```\n\n4. Configure and build the project using cmake:\n\n```bash\ncmake ..\ncmake --build . --parallel\n```\n\n5. Verify that libllmodel.* exists in `gpt4all-backend/build`.\n\n6. Navigate back to the root and install the Python package:\n\n```bash\ncd ../../gpt4all-bindings/python\npip3 install -e .\n```\n\n7. Download it to your local machine from [here](https://gpt4all.io/models/ggml-gpt4all-j-v1.3-groovy.bin) and put it in the `local_models` directory as `local_models/ggml-gpt4all-j-v1.3-groovy.bin`\n\n</details>\n\n## Running the Application\nYou need to install [poetry](https://python-poetry.org/docs/) and a valid python version (3.11*).\n```bash\npoetry install\n```\nFor more, on a complete install for development purpose, you can check the [CONTRIBUTING.md](CONTRIBUTING.md).\nIf you simply want to start the server, you can install with the corresponding poetry groups :\n```bash\npoetry install --only main,llms\n```\n\nAfter the Python package has been installed, you can run the application. The Uvicorn ASGI server can be used to run your application:\n\n```bash\nuvicorn main:app --host 0.0.0.0 --port 4321\n```\n\nThis command launches the Genoss application on port 4321 of your machine.\n\n## Running the Webapp Demo\n\nIn the `demo/`\n\n```bash\ncp .env.example .env\n```\n\nReplace the values and then\n\n```bash\nPYTHONPATH=. streamlit run demo/main.py\n```\n\n## Genoss API Usage\n\nThe Genoss API is a one-line replacement for the OpenAI ChatGPT API. It supports the same parameters and returns the same response format as the OpenAI API.\n\nSimply replace the OpenAI API endpoint with the Genoss API endpoint and you're good to go!\n\nModify the models to the supported list of models and you're good to go!\n\nYou can find the API documentation at `/docs` or `/redoc`.\n\n\n\n\n## Upcoming Developments\n\nWhile GPT4ALL is the only model currently supported, we are planning to add more models in the future. So, stay tuned for more exciting updates.\n\nThe vision:\n\n- [X] Allow LLM models to be ran locally\n- [X] Allow LLM to be ran locally using HuggingFace\n- [X] ALlow LLM to be ran on HuggingFace and just be a wrapper around the inference API.\n- [ ] Allow easy installation of LLM models locally\n- [ ] Allow users to use cloud provider solutions such as GCP, AWS, Azure, etc ...\n- [ ] Allow users management with API keys\n- [ ] Have all kinds of models available for use (text to text, text to image, text to audio, audio to text, etc.)\n- [X] Be compatible with OpenAI API for models that are compatible with OpenAI API\n\n\n\n## History\n\nGenoss was imagined by [Stan Girard](https://github.com/StanGirard) when a feature of [Quivr](https://github.com/StanGirard/quivr) became too big and complicated to maintain.\n\nThe idea was to create a simple API that would allow to use any model with the same API as OpenAI's ChatGPT API.\n\nThen @[mattzcarey](https://github.com/mattzcarey), @[MaximeThoonsen](https://github.com/MaximeThoonsen), @[Wirg](https://github.com/Wirg) and @[StanGirard](https://github.com/StanGirard) started working on the project and it became a reality.\n\n## Contributions\n\nYour contributions to Genoss are immensely appreciated! Feel free to submit any issues or pull requests.\n\nThanks go to these wonderful people:\n\n<a href=\"https://github.com/opengenerativeai/genossGPT/graphs/contributors\">\n<img src=\"https://contrib.rocks/image?repo=opengenerativeai/genossGPT\" />\n</a>\n\n## Sponsors \u2764\ufe0f\n\nThis project could not be possible without the support of our sponsors. Thank you for your support!\n\n<a href=\"https://www.theodo.fr/\">\n <img src=\"https://avatars.githubusercontent.com/u/332041?s=200&v=4\" alt=\"Theodo\" style=\"padding: 10px\" width=\"70px\">\n</a>\n<a href=\"https://www.aleios.com/\">\n <img src=\"https://avatars.githubusercontent.com/u/97908131?s=200&v=4\" alt=\"Aleios\" style=\"padding: 10px\" width=\"70px\">\n</a>\n<a href=\"https://www.sicara.fr/\">\n <img src=\"https://avatars.githubusercontent.com/u/23194788?s=200&v=4\" alt=\"Sicara\" style=\"padding: 10px\" width=\"70px\">\n</a>\n\n## License\n\nGenoss is licensed under the Apache2 License. For more details, refer to the [LICENSE](LICENSE) file.\n",
"bugtrack_url": null,
"license": "",
"summary": "Replace OpenAI GPT with any LLMs in your app with one line. Common Inference API for all LLMs either Private or Public (Anthropic, Llama, GPT, Vertex, ...)",
"version": "0.0.2a3",
"project_urls": {
"Homepage": "https://genoss.ai/",
"Repository": "https://github.com/OpenGenerativeAI/GenossGPT"
},
"split_keywords": [
"server",
"llm"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "28256de14b59ff1d0dc94133b33f0e4b088f6cbfcf8921fde58ae85e8f206b7d",
"md5": "21f39291c193b5a1aba7b0879fb9fe04",
"sha256": "922ccc9c719591f99462764bf77f8b91488934924bea85cb4b72d400bf8ec796"
},
"downloads": -1,
"filename": "genoss-0.0.2a3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "21f39291c193b5a1aba7b0879fb9fe04",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.11,<4.0",
"size": 18039,
"upload_time": "2023-08-25T10:41:15",
"upload_time_iso_8601": "2023-08-25T10:41:15.303632Z",
"url": "https://files.pythonhosted.org/packages/28/25/6de14b59ff1d0dc94133b33f0e4b088f6cbfcf8921fde58ae85e8f206b7d/genoss-0.0.2a3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9c358fbe6b7d0e3f14d2312f6cb994ba7108b4642f99057006a9a2c07b297ca0",
"md5": "1ae903f6f0a355fc78b6b5632bd317cc",
"sha256": "c0641bb0f69c6d2eace3e00b9565410a83bc2fa6463b30994e5bafd4d013258b"
},
"downloads": -1,
"filename": "genoss-0.0.2a3.tar.gz",
"has_sig": false,
"md5_digest": "1ae903f6f0a355fc78b6b5632bd317cc",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.11,<4.0",
"size": 16144,
"upload_time": "2023-08-25T10:41:16",
"upload_time_iso_8601": "2023-08-25T10:41:16.944412Z",
"url": "https://files.pythonhosted.org/packages/9c/35/8fbe6b7d0e3f14d2312f6cb994ba7108b4642f99057006a9a2c07b297ca0/genoss-0.0.2a3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-08-25 10:41:16",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "OpenGenerativeAI",
"github_project": "GenossGPT",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "genoss"
}
