llama-index-agent-llm-compiler


Namellama-index-agent-llm-compiler JSON
Version 0.3.0 PyPI version JSON
download
home_pageNone
Summaryllama-index agent llm compiler integration
upload_time2024-11-18 01:36:40
maintainerjerryjliu
docs_urlNone
authorYour Name
requires_python<4.0,>=3.9
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # LlamaIndex Agent Integration: LLM Compiler

This Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).

A lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits
to the original authors for a great work!

A full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).

## Usage

First install the package:

```bash
pip install llama-index-agent-llm-compiler
```

```python
# setup pack arguments

from llama_index.core.agent import AgentRunner
from llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker

agent_worker = LLMCompilerAgentWorker.from_tools(
    tools, llm=llm, verbose=True, callback_manager=callback_manager
)
agent = AgentRunner(agent_worker, callback_manager=callback_manager)

# start using the agent
response = agent.chat("What is (121 * 3) + 42?")
```

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "llama-index-agent-llm-compiler",
    "maintainer": "jerryjliu",
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "Your Name",
    "author_email": "you@example.com",
    "download_url": "https://files.pythonhosted.org/packages/f3/38/446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b/llama_index_agent_llm_compiler-0.3.0.tar.gz",
    "platform": null,
    "description": "# LlamaIndex Agent Integration: LLM Compiler\n\nThis Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).\n\nA lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits\nto the original authors for a great work!\n\nA full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).\n\n## Usage\n\nFirst install the package:\n\n```bash\npip install llama-index-agent-llm-compiler\n```\n\n```python\n# setup pack arguments\n\nfrom llama_index.core.agent import AgentRunner\nfrom llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker\n\nagent_worker = LLMCompilerAgentWorker.from_tools(\n    tools, llm=llm, verbose=True, callback_manager=callback_manager\n)\nagent = AgentRunner(agent_worker, callback_manager=callback_manager)\n\n# start using the agent\nresponse = agent.chat(\"What is (121 * 3) + 42?\")\n```\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "llama-index agent llm compiler integration",
    "version": "0.3.0",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "482cbb06520bc5e89c3a80d8539967766bfd421c19802769f3c2bdcd38ffa4d0",
                "md5": "017553ef43920fa7df57105f0173ec9e",
                "sha256": "3401eb13bd3bac4e2f7dfa76ac88e2d3db49d8b2a1c771c313f62485b2c56225"
            },
            "downloads": -1,
            "filename": "llama_index_agent_llm_compiler-0.3.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "017553ef43920fa7df57105f0173ec9e",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 19392,
            "upload_time": "2024-11-18T01:36:38",
            "upload_time_iso_8601": "2024-11-18T01:36:38.281992Z",
            "url": "https://files.pythonhosted.org/packages/48/2c/bb06520bc5e89c3a80d8539967766bfd421c19802769f3c2bdcd38ffa4d0/llama_index_agent_llm_compiler-0.3.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "f338446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b",
                "md5": "3567e2333a1b9e8b991e57c7402e26d7",
                "sha256": "510c1fe4f54f94e57f774b2a02d22c4dbd91031571d4e586ad81fc80c8dc8323"
            },
            "downloads": -1,
            "filename": "llama_index_agent_llm_compiler-0.3.0.tar.gz",
            "has_sig": false,
            "md5_digest": "3567e2333a1b9e8b991e57c7402e26d7",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 17161,
            "upload_time": "2024-11-18T01:36:40",
            "upload_time_iso_8601": "2024-11-18T01:36:40.745575Z",
            "url": "https://files.pythonhosted.org/packages/f3/38/446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b/llama_index_agent_llm_compiler-0.3.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-11-18 01:36:40",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "llama-index-agent-llm-compiler"
}
        
Elapsed time: 0.58890s