## Introduction
This is the Sunholo Python project, a comprehensive toolkit for working with language models and vector stores on Google Cloud Platform. It provides a wide range of functionalities and utilities to facilitate the development and deployment of language model applications.
This is the sunholo-py project. It provides a collection of useful tools and functionalities for working with language models, databases, and various bots.
# sunholo-py
(draft release https://pypi.org/project/sunholo/ )
## Table of Contents
- [Agents](#agents)
- [Archive](#archive)
- [Bots](#bots)
- [Chunker](#chunker)
- [Components](#components)
- [Database](#database)
- [Embedder](#embedder)
- [PubSub](#pubsub)
- [QnA](#qna)
- [Streaming](#streaming)
- [Summarise](#summarise)
- [Utils](#utils)
```sh
pip install sunholo
```
A python library to enable LLMOps within cloud environments
`sunholo` provides utilities to help manage LLM operations on Google Cloud Platform at first, but it is hoped that making it open source will help it support other clouds in the future. A lot of the functionality is not Google Cloud Platform specific, so still may be helpful.
It is derived from the Edmonbrain project, the original blog post you can read here: https://code.markedmondson.me/running-llms-on-gcp/ and owes a lot to Langchain ( https://github.com/langchain-ai/langchain )
The package includes:
* `agents/` - functions for working with agents, including easy flask apps, parsing chat history and dispatching requests to different agent endpoints
* `archive/` - functions to record all Q&A activity to BigQuery via PubSub
* `bots/` - functions for special cases regarding frontend bots such as GChat, Web Apps, Discord and Slack
* `chunker/` - functions to slice up documents for sending into vector stores
* `components/` - functions to help configure which LLM, prompt, vectorstore or document retriever you will use based on a yaml config file
* `database/` - database setup functions and SQL to run on those sources such as Supabase
* `embedder/` - functions to send chunks into embedding vector stores
* `pubsub/` - use of PubSub for a message queue between components
* `qna/` - utilities for running agents such as retry strats and parsing of output/input
* `streaming/` - creation of streaming responses from LLM bots
* `summarise/` - creation of summaries of large documents
* `utils/` - reading configuration files, Google Cloud Platform metadata
## Configuration
The library uses the config specifications that some examples are given in the `config/` folder.
When using the functions, make sure to have the `config/` folder in the root of where your application is running (usually `$HOME/config`)
```
Copyright [2024] [Holosun ApS]
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
```
Raw data
{
"_id": null,
"home_page": "https://github.com/sunholo-data/sunholo-py",
"name": "sunholo",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": null,
"keywords": "llms, devops, google_cloud_platform",
"author": "Holosun ApS",
"author_email": "multivac@sunholo.com",
"download_url": "https://files.pythonhosted.org/packages/a1/61/e0b65669ecbf0280cb3897648b202ed56777e36418397b29b5a9d0e095c2/sunholo-0.49.7.tar.gz",
"platform": null,
"description": "## Introduction\nThis is the Sunholo Python project, a comprehensive toolkit for working with language models and vector stores on Google Cloud Platform. It provides a wide range of functionalities and utilities to facilitate the development and deployment of language model applications.\n\nThis is the sunholo-py project. It provides a collection of useful tools and functionalities for working with language models, databases, and various bots.\n\n# sunholo-py\n\n(draft release https://pypi.org/project/sunholo/ )\n## Table of Contents\n- [Agents](#agents)\n- [Archive](#archive)\n- [Bots](#bots)\n- [Chunker](#chunker)\n- [Components](#components)\n- [Database](#database)\n- [Embedder](#embedder)\n- [PubSub](#pubsub)\n- [QnA](#qna)\n- [Streaming](#streaming)\n- [Summarise](#summarise)\n- [Utils](#utils)\n\n\n```sh\npip install sunholo\n```\n\nA python library to enable LLMOps within cloud environments\n\n`sunholo` provides utilities to help manage LLM operations on Google Cloud Platform at first, but it is hoped that making it open source will help it support other clouds in the future. A lot of the functionality is not Google Cloud Platform specific, so still may be helpful.\n\nIt is derived from the Edmonbrain project, the original blog post you can read here: https://code.markedmondson.me/running-llms-on-gcp/ and owes a lot to Langchain ( https://github.com/langchain-ai/langchain )\n\nThe package includes:\n\n* `agents/` - functions for working with agents, including easy flask apps, parsing chat history and dispatching requests to different agent endpoints\n* `archive/` - functions to record all Q&A activity to BigQuery via PubSub\n* `bots/` - functions for special cases regarding frontend bots such as GChat, Web Apps, Discord and Slack\n* `chunker/` - functions to slice up documents for sending into vector stores\n* `components/` - functions to help configure which LLM, prompt, vectorstore or document retriever you will use based on a yaml config file\n* `database/` - database setup functions and SQL to run on those sources such as Supabase\n* `embedder/` - functions to send chunks into embedding vector stores\n* `pubsub/` - use of PubSub for a message queue between components\n* `qna/` - utilities for running agents such as retry strats and parsing of output/input\n* `streaming/` - creation of streaming responses from LLM bots\n* `summarise/` - creation of summaries of large documents\n* `utils/` - reading configuration files, Google Cloud Platform metadata\n\n## Configuration\n\nThe library uses the config specifications that some examples are given in the `config/` folder.\n\nWhen using the functions, make sure to have the `config/` folder in the root of where your application is running (usually `$HOME/config`)\n\n```\n Copyright [2024] [Holosun ApS]\n\n Licensed under the Apache License, Version 2.0 (the \"License\");\n you may not use this file except in compliance with the License.\n You may obtain a copy of the License at\n\n http://www.apache.org/licenses/LICENSE-2.0\n\n Unless required by applicable law or agreed to in writing, software\n distributed under the License is distributed on an \"AS IS\" BASIS,\n WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n See the License for the specific language governing permissions and\n limitations under the License.\n```\n\n",
"bugtrack_url": null,
"license": "Apache License, Version 2.0",
"summary": "Large Language Model DevOps - a package to help deploy LLMs to the Cloud.",
"version": "0.49.7",
"project_urls": {
"Download": "https://github.com/sunholo-data/sunholo-py/archive/refs/tags/v0.49.7.tar.gz",
"Homepage": "https://github.com/sunholo-data/sunholo-py"
},
"split_keywords": [
"llms",
" devops",
" google_cloud_platform"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0d197a563f19f866bc889b8bf1d1b422faac30e2bfd3f4020d3df9f9ac52470d",
"md5": "11212bda6ad5c41ec18cde4b98df24b8",
"sha256": "c5995ad6472bc42c0fa52eea489e15320557818ea5eba7daac7480a0294c9265"
},
"downloads": -1,
"filename": "sunholo-0.49.7-py3-none-any.whl",
"has_sig": false,
"md5_digest": "11212bda6ad5c41ec18cde4b98df24b8",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 99157,
"upload_time": "2024-05-04T08:37:30",
"upload_time_iso_8601": "2024-05-04T08:37:30.343687Z",
"url": "https://files.pythonhosted.org/packages/0d/19/7a563f19f866bc889b8bf1d1b422faac30e2bfd3f4020d3df9f9ac52470d/sunholo-0.49.7-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a161e0b65669ecbf0280cb3897648b202ed56777e36418397b29b5a9d0e095c2",
"md5": "061345214a4a47751a194227f2e0016e",
"sha256": "67920c645faaf52215f29e072348c7b7ea6b67c03c0dab6f54b3e92f388bbbb0"
},
"downloads": -1,
"filename": "sunholo-0.49.7.tar.gz",
"has_sig": false,
"md5_digest": "061345214a4a47751a194227f2e0016e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 70259,
"upload_time": "2024-05-04T08:37:32",
"upload_time_iso_8601": "2024-05-04T08:37:32.432938Z",
"url": "https://files.pythonhosted.org/packages/a1/61/e0b65669ecbf0280cb3897648b202ed56777e36418397b29b5a9d0e095c2/sunholo-0.49.7.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-04 08:37:32",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "sunholo-data",
"github_project": "sunholo-py",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "sunholo"
}
JSON
