llama-index-agent-llm-compiler

Name	llama-index-agent-llm-compiler JSON
Version	0.2.0 JSON
	download
home_page	None
Summary	llama-index agent llm compiler integration
upload_time	2024-08-22 13:33:46
maintainer	jerryjliu
docs_url	None
author	Your Name
requires_python	<4.0,>=3.8.1
license	MIT
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # LlamaIndex Agent Integration: LLM Compiler

This Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).

A lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits
to the original authors for a great work!

A full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).

## Usage

First install the package:

```bash
pip install llama-index-agent-llm-compiler
```

```python
# setup pack arguments

from llama_index.core.agent import AgentRunner
from llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker

agent_worker = LLMCompilerAgentWorker.from_tools(
    tools, llm=llm, verbose=True, callback_manager=callback_manager
)
agent = AgentRunner(agent_worker, callback_manager=callback_manager)

# start using the agent
response = agent.chat("What is (121 * 3) + 42?")
```

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "llama-index-agent-llm-compiler",
    "maintainer": "jerryjliu",
    "docs_url": null,
    "requires_python": "<4.0,>=3.8.1",
    "maintainer_email": null,
    "keywords": null,
    "author": "Your Name",
    "author_email": "you@example.com",
    "download_url": "https://files.pythonhosted.org/packages/a5/d8/00dd9c27059465a5787e1deb1ac865ef66c2d6466c85bcb49373453d1d42/llama_index_agent_llm_compiler-0.2.0.tar.gz",
    "platform": null,
    "description": "# LlamaIndex Agent Integration: LLM Compiler\n\nThis Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).\n\nA lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits\nto the original authors for a great work!\n\nA full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).\n\n## Usage\n\nFirst install the package:\n\n```bash\npip install llama-index-agent-llm-compiler\n```\n\n```python\n# setup pack arguments\n\nfrom llama_index.core.agent import AgentRunner\nfrom llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker\n\nagent_worker = LLMCompilerAgentWorker.from_tools(\n    tools, llm=llm, verbose=True, callback_manager=callback_manager\n)\nagent = AgentRunner(agent_worker, callback_manager=callback_manager)\n\n# start using the agent\nresponse = agent.chat(\"What is (121 * 3) + 42?\")\n```\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "llama-index agent llm compiler integration",
    "version": "0.2.0",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8529b1d5af31a79aed7d2bc7f121aea9c91937f184c66bdf289745cd69020423",
                "md5": "1e9ab424a8be83ad701595914dc2acb1",
                "sha256": "ca9d28e031fe1e6335147da8232dd2ca900fe00341e2f9eb44f88cc4053e8904"
            },
            "downloads": -1,
            "filename": "llama_index_agent_llm_compiler-0.2.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "1e9ab424a8be83ad701595914dc2acb1",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.8.1",
            "size": 19400,
            "upload_time": "2024-08-22T13:33:45",
            "upload_time_iso_8601": "2024-08-22T13:33:45.180652Z",
            "url": "https://files.pythonhosted.org/packages/85/29/b1d5af31a79aed7d2bc7f121aea9c91937f184c66bdf289745cd69020423/llama_index_agent_llm_compiler-0.2.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a5d800dd9c27059465a5787e1deb1ac865ef66c2d6466c85bcb49373453d1d42",
                "md5": "7d3c291a0566ff823afe6bb97361778b",
                "sha256": "a6d40638fae383c7ca0d4e659cb047f549359875fcaaa3b3282a44bc35848668"
            },
            "downloads": -1,
            "filename": "llama_index_agent_llm_compiler-0.2.0.tar.gz",
            "has_sig": false,
            "md5_digest": "7d3c291a0566ff823afe6bb97361778b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.8.1",
            "size": 17155,
            "upload_time": "2024-08-22T13:33:46",
            "upload_time_iso_8601": "2024-08-22T13:33:46.750937Z",
            "url": "https://files.pythonhosted.org/packages/a5/d8/00dd9c27059465a5787e1deb1ac865ef66c2d6466c85bcb49373453d1d42/llama_index_agent_llm_compiler-0.2.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-08-22 13:33:46",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "llama-index-agent-llm-compiler"
}