llmstudio


Namellmstudio JSON
Version 1.0.1 PyPI version JSON
download
home_pagehttps://llmstudio.ai/
SummaryPrompt Perfection at Your Fingertips
upload_time2024-11-19 16:30:38
maintainerNone
docs_urlNone
authorCláudio Lemos
requires_python<4.0,>=3.9
licenseMIT
keywords ml ai llm llmops openai langchain chatgpt llmstudio tensorops
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # LLMstudio by [TensorOps](http://tensorops.ai "TensorOps")

Prompt Engineering at your fingertips

![LLMstudio logo](https://imgur.com/Xqsj6V2.gif)

## 🌟 Features

![LLMstudio UI](https://imgur.com/wrwiIUs.png)

- **LLM Proxy Access**: Seamless access to all the latest LLMs by OpenAI, Anthropic, Google.
- **Custom and Local LLM Support**: Use custom or local open-source LLMs through Ollama.
- **Prompt Playground UI**: A user-friendly interface for engineering and fine-tuning your prompts.
- **Python SDK**: Easily integrate LLMstudio into your existing workflows.
- **Monitoring and Logging**: Keep track of your usage and performance for all requests.
- **LangChain Integration**: LLMstudio integrates with your already existing LangChain projects.
- **Batch Calling**: Send multiple requests at once for improved efficiency.
- **Smart Routing and Fallback**: Ensure 24/7 availability by routing your requests to trusted LLMs.
- **Type Casting (soon)**: Convert data types as needed for your specific use case.

## 🚀 Quickstart

Don't forget to check out [https://docs.llmstudio.ai](docs) page.

## Installation

Install the latest version of **LLMstudio** using `pip`. We suggest that you create and activate a new environment using `conda`

For full version:
```bash
pip install 'llmstudio[proxy,tracker]'
```

For lightweight (core) version:
```bash
pip install llmstudio
```

Create a `.env` file at the same path you'll run **LLMstudio**

```bash
OPENAI_API_KEY="sk-api_key"
ANTHROPIC_API_KEY="sk-api_key"
VERTEXAI_KEY="sk-api-key"
```

Now you should be able to run **LLMstudio** using the following command.

```bash
llmstudio server --proxy --tracker
```

When the `--proxy` flag is set, you'll be able to access the [Swagger at http://0.0.0.0:50001/docs (default port)](http://0.0.0.0:50001/docs)

When the `--tracker` flag is set, you'll be able to access the [Swagger at http://0.0.0.0:50002/docs (default port)](http://0.0.0.0:50002/docs)

## 📖 Documentation

- [Visit our docs to learn how the SDK works](https://docs.LLMstudio.ai) (coming soon)
- Checkout our [notebook examples](https://github.com/TensorOpsAI/LLMstudio/tree/main/examples) to follow along with interactive tutorials

## 👨‍💻 Contributing

- Head on to our [Contribution Guide](https://github.com/TensorOpsAI/LLMstudio/tree/main/CONTRIBUTING.md) to see how you can help LLMstudio.
- Join our [Discord](https://discord.gg/GkAfPZR9wy) to talk with other LLMstudio enthusiasts.

## Training

[![Banner](https://imgur.com/XTRFZ4m.png)](https://www.tensorops.ai/llm-studio-workshop)

---

Thank you for choosing LLMstudio. Your journey to perfecting AI interactions starts here.

            

Raw data

            {
    "_id": null,
    "home_page": "https://llmstudio.ai/",
    "name": "llmstudio",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": "ml, ai, llm, llmops, openai, langchain, chatgpt, llmstudio, tensorops",
    "author": "Cl\u00e1udio Lemos",
    "author_email": "claudio@tensorops.ai",
    "download_url": "https://files.pythonhosted.org/packages/ea/93/a60640b087b89d053b3939b350b50f39e376af53659a23fec151931c33fa/llmstudio-1.0.1.tar.gz",
    "platform": null,
    "description": "# LLMstudio by [TensorOps](http://tensorops.ai \"TensorOps\")\n\nPrompt Engineering at your fingertips\n\n![LLMstudio logo](https://imgur.com/Xqsj6V2.gif)\n\n## \ud83c\udf1f Features\n\n![LLMstudio UI](https://imgur.com/wrwiIUs.png)\n\n- **LLM Proxy Access**: Seamless access to all the latest LLMs by OpenAI, Anthropic, Google.\n- **Custom and Local LLM Support**: Use custom or local open-source LLMs through Ollama.\n- **Prompt Playground UI**: A user-friendly interface for engineering and fine-tuning your prompts.\n- **Python SDK**: Easily integrate LLMstudio into your existing workflows.\n- **Monitoring and Logging**: Keep track of your usage and performance for all requests.\n- **LangChain Integration**: LLMstudio integrates with your already existing LangChain projects.\n- **Batch Calling**: Send multiple requests at once for improved efficiency.\n- **Smart Routing and Fallback**: Ensure 24/7 availability by routing your requests to trusted LLMs.\n- **Type Casting (soon)**: Convert data types as needed for your specific use case.\n\n## \ud83d\ude80 Quickstart\n\nDon't forget to check out [https://docs.llmstudio.ai](docs) page.\n\n## Installation\n\nInstall the latest version of **LLMstudio** using `pip`. We suggest that you create and activate a new environment using `conda`\n\nFor full version:\n```bash\npip install 'llmstudio[proxy,tracker]'\n```\n\nFor lightweight (core) version:\n```bash\npip install llmstudio\n```\n\nCreate a `.env` file at the same path you'll run **LLMstudio**\n\n```bash\nOPENAI_API_KEY=\"sk-api_key\"\nANTHROPIC_API_KEY=\"sk-api_key\"\nVERTEXAI_KEY=\"sk-api-key\"\n```\n\nNow you should be able to run **LLMstudio** using the following command.\n\n```bash\nllmstudio server --proxy --tracker\n```\n\nWhen the `--proxy` flag is set, you'll be able to access the [Swagger at http://0.0.0.0:50001/docs (default port)](http://0.0.0.0:50001/docs)\n\nWhen the `--tracker` flag is set, you'll be able to access the [Swagger at http://0.0.0.0:50002/docs (default port)](http://0.0.0.0:50002/docs)\n\n## \ud83d\udcd6 Documentation\n\n- [Visit our docs to learn how the SDK works](https://docs.LLMstudio.ai) (coming soon)\n- Checkout our [notebook examples](https://github.com/TensorOpsAI/LLMstudio/tree/main/examples) to follow along with interactive tutorials\n\n## \ud83d\udc68\u200d\ud83d\udcbb Contributing\n\n- Head on to our [Contribution Guide](https://github.com/TensorOpsAI/LLMstudio/tree/main/CONTRIBUTING.md) to see how you can help LLMstudio.\n- Join our [Discord](https://discord.gg/GkAfPZR9wy) to talk with other LLMstudio enthusiasts.\n\n## Training\n\n[![Banner](https://imgur.com/XTRFZ4m.png)](https://www.tensorops.ai/llm-studio-workshop)\n\n---\n\nThank you for choosing LLMstudio. Your journey to perfecting AI interactions starts here.\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Prompt Perfection at Your Fingertips",
    "version": "1.0.1",
    "project_urls": {
        "Bug Tracker": "https://github.com/tensoropsai/llmstudio/issues",
        "Documentation": "https://docs.llmstudio.ai",
        "Homepage": "https://llmstudio.ai/",
        "Repository": "https://github.com/tensoropsai/llmstudio"
    },
    "split_keywords": [
        "ml",
        " ai",
        " llm",
        " llmops",
        " openai",
        " langchain",
        " chatgpt",
        " llmstudio",
        " tensorops"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a81cb420d67e43733d515283440f1349eb9c7b8c021855c166f7076f9497f1c9",
                "md5": "eac028dede7a4560ef8abd33a9dd3805",
                "sha256": "f9db25d5a81502fb395ef52a5e4b549c60c63922d1f4f97a1d233450744cc244"
            },
            "downloads": -1,
            "filename": "llmstudio-1.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "eac028dede7a4560ef8abd33a9dd3805",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 8140,
            "upload_time": "2024-11-19T16:30:36",
            "upload_time_iso_8601": "2024-11-19T16:30:36.983288Z",
            "url": "https://files.pythonhosted.org/packages/a8/1c/b420d67e43733d515283440f1349eb9c7b8c021855c166f7076f9497f1c9/llmstudio-1.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ea93a60640b087b89d053b3939b350b50f39e376af53659a23fec151931c33fa",
                "md5": "d22806e82d6f1f7cf7b71b090af43adc",
                "sha256": "1051de53f4a76c8e99627a535819006ae4881c18b094b6041773b7a5c3858890"
            },
            "downloads": -1,
            "filename": "llmstudio-1.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "d22806e82d6f1f7cf7b71b090af43adc",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 7729,
            "upload_time": "2024-11-19T16:30:38",
            "upload_time_iso_8601": "2024-11-19T16:30:38.828804Z",
            "url": "https://files.pythonhosted.org/packages/ea/93/a60640b087b89d053b3939b350b50f39e376af53659a23fec151931c33fa/llmstudio-1.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-11-19 16:30:38",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "tensoropsai",
    "github_project": "llmstudio",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "llmstudio"
}
        
Elapsed time: 0.39778s