titan-iris


Nametitan-iris JSON
Version 0.58.2 PyPI version JSON
download
home_page
Summary
upload_time2024-01-18 16:50:15
maintainer
docs_urlNone
author
requires_python
license
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # TitanML iris package

## 🎯 About

Iris is your portal to the TitanML platform.
Using Iris, you can setup Takeoff servers, launch jobs to run on TitanML servers, run your own models and datasets through our compression algorithms, and explore and download the optimised models from the Titan Store.

For usage information, tutorials, and usage examples, see the [docs](https://docs.titanml.co/docs/intro).

<h1 align="center">New! Try the TitanML Takeoff Server</h1>

<p align="center">
  <img src="https://github.com/titanml/takeoff/assets/6034059/5b561d1a-7be3-4258-bd4d-bb670fdb2c1e" alt="Image from TitanML">
</p>

✔️ Easy deployment and streaming responses for popular Large Language Models

✔️ Optimized int8 quantization

✔️ Chat and playground-like interface

✔️ Support for encoder-decoder (T5 family) and decoder models

For the pro edition, including multi-gpu inference, int4 quantization, and more [contact us](mailto:hello@titanml.co)

## Dependencies

Iris is tested on the following versions of python:

- python >= 3.7 <=3.10

Iris should work on later versions, but likely won't work on earlier versions.

## iris API

**Usage**:

<pre class="language-console"><code class="lang-console"><strong>$ iris [OPTIONS] COMMAND [ARGS]...
</strong></code></pre>

**Options**:

- `--help`: Show this message and exit.

**Commands**:

- `delete`: delete objects from the TYTN api.
- `download`: Download the titan-optimized onnx model.
- `get`: Get objects from the TYTN api.
- `infer`: Run inference on a model.
- `login`: Login to iris.
- `logout`: Logout from iris.
- `makesafe`: Convert a non-safetensor model into a...
- `post`: Dispatch a job to the TitanML platform
- `pull`: Pull the titan-optimized server docker image.
- `status`: Get the status of an experiment
- `upload`: Upload an artefact to the TitanML hub.
- `takeoff`: Launch a TitanML inference server. See [docs](https://docs.titanml.co/docs/titan-takeoff/getting-started) for more information.

## Help

For more information on the Iris CLI, see the [docs](https://docs.titanml.co/).

## Authors

TitanML

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "titan-iris",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "",
    "author": "",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/ec/30/7f59ff38735f407fcb40e8fb3363acbb37cde019dccadb7ef2da13a89777/titan-iris-0.58.2.tar.gz",
    "platform": null,
    "description": "# TitanML iris package\n\n## \ud83c\udfaf About\n\nIris is your portal to the TitanML platform.\nUsing Iris, you can setup Takeoff servers, launch jobs to run on TitanML servers, run your own models and datasets through our compression algorithms, and explore and download the optimised models from the Titan Store.\n\nFor usage information, tutorials, and usage examples, see the [docs](https://docs.titanml.co/docs/intro).\n\n<h1 align=\"center\">New! Try the TitanML Takeoff Server</h1>\n\n<p align=\"center\">\n  <img src=\"https://github.com/titanml/takeoff/assets/6034059/5b561d1a-7be3-4258-bd4d-bb670fdb2c1e\" alt=\"Image from TitanML\">\n</p>\n\n\u2714\ufe0f Easy deployment and streaming responses for popular Large Language Models\n\n\u2714\ufe0f Optimized int8 quantization\n\n\u2714\ufe0f Chat and playground-like interface\n\n\u2714\ufe0f Support for encoder-decoder (T5 family) and decoder models\n\nFor the pro edition, including multi-gpu inference, int4 quantization, and more [contact us](mailto:hello@titanml.co)\n\n## Dependencies\n\nIris is tested on the following versions of python:\n\n- python >= 3.7 <=3.10\n\nIris should work on later versions, but likely won't work on earlier versions.\n\n## iris API\n\n**Usage**:\n\n<pre class=\"language-console\"><code class=\"lang-console\"><strong>$ iris [OPTIONS] COMMAND [ARGS]...\n</strong></code></pre>\n\n**Options**:\n\n- `--help`: Show this message and exit.\n\n**Commands**:\n\n- `delete`: delete objects from the TYTN api.\n- `download`: Download the titan-optimized onnx model.\n- `get`: Get objects from the TYTN api.\n- `infer`: Run inference on a model.\n- `login`: Login to iris.\n- `logout`: Logout from iris.\n- `makesafe`: Convert a non-safetensor model into a...\n- `post`: Dispatch a job to the TitanML platform\n- `pull`: Pull the titan-optimized server docker image.\n- `status`: Get the status of an experiment\n- `upload`: Upload an artefact to the TitanML hub.\n- `takeoff`: Launch a TitanML inference server. See [docs](https://docs.titanml.co/docs/titan-takeoff/getting-started) for more information.\n\n## Help\n\nFor more information on the Iris CLI, see the [docs](https://docs.titanml.co/).\n\n## Authors\n\nTitanML\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "",
    "version": "0.58.2",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c9204ca53747d6ac400ece0b281e677091e501d47fa30d5e2239cf8fb08bffd8",
                "md5": "d75abbf35c3d8fc9fcfb44e297f885af",
                "sha256": "7f436ead7bbc5cfe75adcec3263dccc6799ac5430ba63dd97a6d8bf3d3b0cfa2"
            },
            "downloads": -1,
            "filename": "titan_iris-0.58.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "d75abbf35c3d8fc9fcfb44e297f885af",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 45079,
            "upload_time": "2024-01-18T16:50:08",
            "upload_time_iso_8601": "2024-01-18T16:50:08.055463Z",
            "url": "https://files.pythonhosted.org/packages/c9/20/4ca53747d6ac400ece0b281e677091e501d47fa30d5e2239cf8fb08bffd8/titan_iris-0.58.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ec307f59ff38735f407fcb40e8fb3363acbb37cde019dccadb7ef2da13a89777",
                "md5": "d8af7405871fd6a7ff76c4ae0f0c2e96",
                "sha256": "d56b4bbe1b9dc1e8f49e57ddb5c3241c3c238236ef1467f4f8dac4c27bb907f3"
            },
            "downloads": -1,
            "filename": "titan-iris-0.58.2.tar.gz",
            "has_sig": false,
            "md5_digest": "d8af7405871fd6a7ff76c4ae0f0c2e96",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 49680,
            "upload_time": "2024-01-18T16:50:15",
            "upload_time_iso_8601": "2024-01-18T16:50:15.608657Z",
            "url": "https://files.pythonhosted.org/packages/ec/30/7f59ff38735f407fcb40e8fb3363acbb37cde019dccadb7ef2da13a89777/titan-iris-0.58.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-01-18 16:50:15",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "titan-iris"
}
        
Elapsed time: 0.21802s