Name | solo-cli JSON |
Version |
0.2.3
JSON |
| download |
home_page | https://github.com/AIEngineersDev/solo-cli |
Summary | A CLI tool to manage and recommend machine learning models based on system GPU and memory. |
upload_time | 2024-06-25 06:49:33 |
maintainer | None |
docs_url | None |
author | Dhruv Diddi |
requires_python | >=3.6 |
license | None |
keywords |
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# Solo CLI
A CLI tool to manage and execute LLaMA files.
## π Features
- Initialize and download models
- Pull specific models by name
- Quickstart to execute a default model
- Serve models on the internet using ngrok
- Start models with specific configurations
## π Getting Started
### Prerequisites
- Python 3.7 or higher
- Pip (Python package installer)
- ngrok account (optional, for serving models)
### Installation
Install the package using pip:
```bash
pip install solo-cli
```
### Usage
```bash
solo-cli init
solo-cli pull model_name
solo-cli quickstart
solo-cli serve --port 8080
solo-cli start model_name --port 8080
```
## π Examples
### Initialize
```bash
solo-cli init
```
### Pull a Model
```bash
solo-cli pull llava-v1.5-7b-q4
```
### Quickstart
```bash
solo-cli quickstart
```
### Serve a Model
```bash
solo-cli serve --port 8080
```
### Start a Model
```bash
solo-cli start llava-v1.5-7b-q4 --port 8080
```
## π¦ Dependencies
Typer
Requests
tqdm
ngrok
## πΊοΈ Roadmap
Add support for more models
Improve error handling
Add more configuration options
## π€ Contribution
Contributions are welcome! Please open an issue or submit a pull request on GitHub.
Raw data
{
"_id": null,
"home_page": "https://github.com/AIEngineersDev/solo-cli",
"name": "solo-cli",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": null,
"keywords": null,
"author": "Dhruv Diddi",
"author_email": "dhruv.diddi@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/9c/de/d1791d14d5ccc8afb043c35b19a9d4560a7c16f8693e0d004607bbbfe083/solo_cli-0.2.3.tar.gz",
"platform": null,
"description": "# Solo CLI\n\nA CLI tool to manage and execute LLaMA files.\n\n## \ud83c\udf1f Features\n\n- Initialize and download models\n- Pull specific models by name\n- Quickstart to execute a default model\n- Serve models on the internet using ngrok\n- Start models with specific configurations\n\n## \ud83d\ude80 Getting Started\n\n### Prerequisites\n\n- Python 3.7 or higher\n- Pip (Python package installer)\n- ngrok account (optional, for serving models)\n\n### Installation\n\nInstall the package using pip:\n\n```bash\npip install solo-cli\n```\n\n### Usage\n\n```bash\nsolo-cli init\nsolo-cli pull model_name\nsolo-cli quickstart\nsolo-cli serve --port 8080\nsolo-cli start model_name --port 8080\n```\n\n## \ud83d\udcd6 Examples\n\n### Initialize\n```bash\nsolo-cli init\n```\n### Pull a Model\n```bash\nsolo-cli pull llava-v1.5-7b-q4\n```\n### Quickstart\n```bash\nsolo-cli quickstart\n```\n### Serve a Model\n```bash\nsolo-cli serve --port 8080\n```\n### Start a Model\n```bash\nsolo-cli start llava-v1.5-7b-q4 --port 8080\n```\n\n## \ud83d\udce6 Dependencies\nTyper\nRequests\ntqdm\nngrok\n\n## \ud83d\uddfa\ufe0f Roadmap\nAdd support for more models\nImprove error handling\nAdd more configuration options\n\n## \ud83e\udd1d Contribution\nContributions are welcome! Please open an issue or submit a pull request on GitHub.\n",
"bugtrack_url": null,
"license": null,
"summary": "A CLI tool to manage and recommend machine learning models based on system GPU and memory.",
"version": "0.2.3",
"project_urls": {
"Homepage": "https://github.com/AIEngineersDev/solo-cli"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "a3831cc048a64284e19303fcbdc22b74c994b88003534b6eb789a61ed3a45599",
"md5": "feb03becb62c412b06c5b267a642c559",
"sha256": "3b5f0312c9b801bfa379b73809c1dcff5273e1f9635ddde6faee6fff11fea691"
},
"downloads": -1,
"filename": "solo_cli-0.2.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "feb03becb62c412b06c5b267a642c559",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 11032,
"upload_time": "2024-06-25T06:49:32",
"upload_time_iso_8601": "2024-06-25T06:49:32.928125Z",
"url": "https://files.pythonhosted.org/packages/a3/83/1cc048a64284e19303fcbdc22b74c994b88003534b6eb789a61ed3a45599/solo_cli-0.2.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9cded1791d14d5ccc8afb043c35b19a9d4560a7c16f8693e0d004607bbbfe083",
"md5": "c0b2448c881c242b8476508953fbfd5c",
"sha256": "6d7a32b53ca13636a4d96c764c49bd0440088060ae9f3a67e2f26eb12a32b5cf"
},
"downloads": -1,
"filename": "solo_cli-0.2.3.tar.gz",
"has_sig": false,
"md5_digest": "c0b2448c881c242b8476508953fbfd5c",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 8604,
"upload_time": "2024-06-25T06:49:33",
"upload_time_iso_8601": "2024-06-25T06:49:33.969501Z",
"url": "https://files.pythonhosted.org/packages/9c/de/d1791d14d5ccc8afb043c35b19a9d4560a7c16f8693e0d004607bbbfe083/solo_cli-0.2.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-06-25 06:49:33",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "AIEngineersDev",
"github_project": "solo-cli",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [],
"lcname": "solo-cli"
}