Name | llama-index-agent-llm-compiler JSON |
Version |
0.3.0
JSON |
| download |
home_page | None |
Summary | llama-index agent llm compiler integration |
upload_time | 2024-11-18 01:36:40 |
maintainer | jerryjliu |
docs_url | None |
author | Your Name |
requires_python | <4.0,>=3.9 |
license | MIT |
keywords |
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# LlamaIndex Agent Integration: LLM Compiler
This Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).
A lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits
to the original authors for a great work!
A full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).
## Usage
First install the package:
```bash
pip install llama-index-agent-llm-compiler
```
```python
# setup pack arguments
from llama_index.core.agent import AgentRunner
from llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker
agent_worker = LLMCompilerAgentWorker.from_tools(
tools, llm=llm, verbose=True, callback_manager=callback_manager
)
agent = AgentRunner(agent_worker, callback_manager=callback_manager)
# start using the agent
response = agent.chat("What is (121 * 3) + 42?")
```
Raw data
{
"_id": null,
"home_page": null,
"name": "llama-index-agent-llm-compiler",
"maintainer": "jerryjliu",
"docs_url": null,
"requires_python": "<4.0,>=3.9",
"maintainer_email": null,
"keywords": null,
"author": "Your Name",
"author_email": "you@example.com",
"download_url": "https://files.pythonhosted.org/packages/f3/38/446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b/llama_index_agent_llm_compiler-0.3.0.tar.gz",
"platform": null,
"description": "# LlamaIndex Agent Integration: LLM Compiler\n\nThis Agent integration implements the [LLMCompiler agent paper](https://github.com/SqueezeAILab/LLMCompiler).\n\nA lot of code came from the source repo, we repurposed with LlamaIndex abstractions. All credits\nto the original authors for a great work!\n\nA full notebook guide can be found [here](https://github.com/run-llama/llama_index/blob/main/docs/docs/examples/agent/llm_compiler.ipynb).\n\n## Usage\n\nFirst install the package:\n\n```bash\npip install llama-index-agent-llm-compiler\n```\n\n```python\n# setup pack arguments\n\nfrom llama_index.core.agent import AgentRunner\nfrom llama_index.agent.llm_compiler.step import LLMCompilerAgentWorker\n\nagent_worker = LLMCompilerAgentWorker.from_tools(\n tools, llm=llm, verbose=True, callback_manager=callback_manager\n)\nagent = AgentRunner(agent_worker, callback_manager=callback_manager)\n\n# start using the agent\nresponse = agent.chat(\"What is (121 * 3) + 42?\")\n```\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "llama-index agent llm compiler integration",
"version": "0.3.0",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "482cbb06520bc5e89c3a80d8539967766bfd421c19802769f3c2bdcd38ffa4d0",
"md5": "017553ef43920fa7df57105f0173ec9e",
"sha256": "3401eb13bd3bac4e2f7dfa76ac88e2d3db49d8b2a1c771c313f62485b2c56225"
},
"downloads": -1,
"filename": "llama_index_agent_llm_compiler-0.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "017553ef43920fa7df57105f0173ec9e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.9",
"size": 19392,
"upload_time": "2024-11-18T01:36:38",
"upload_time_iso_8601": "2024-11-18T01:36:38.281992Z",
"url": "https://files.pythonhosted.org/packages/48/2c/bb06520bc5e89c3a80d8539967766bfd421c19802769f3c2bdcd38ffa4d0/llama_index_agent_llm_compiler-0.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f338446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b",
"md5": "3567e2333a1b9e8b991e57c7402e26d7",
"sha256": "510c1fe4f54f94e57f774b2a02d22c4dbd91031571d4e586ad81fc80c8dc8323"
},
"downloads": -1,
"filename": "llama_index_agent_llm_compiler-0.3.0.tar.gz",
"has_sig": false,
"md5_digest": "3567e2333a1b9e8b991e57c7402e26d7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.9",
"size": 17161,
"upload_time": "2024-11-18T01:36:40",
"upload_time_iso_8601": "2024-11-18T01:36:40.745575Z",
"url": "https://files.pythonhosted.org/packages/f3/38/446e9030458e878d76ffe518b16b2171c494cd08286d24916f106d07611b/llama_index_agent_llm_compiler-0.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-11-18 01:36:40",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "llama-index-agent-llm-compiler"
}