llama-index-llms-openai


Namellama-index-llms-openai JSON
Version 0.5.5 PyPI version JSON
download
home_pageNone
Summaryllama-index llms openai integration
upload_time2025-09-08 13:33:07
maintainerNone
docs_urlNone
authorllama-index
requires_python<4.0,>=3.9
licenseNone
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # LlamaIndex Llms Integration: Openai

## Installation

To install the required package, run:

```bash
%pip install llama-index-llms-openai
```

## Setup

1. Set your OpenAI API key as an environment variable. You can replace `"sk-..."` with your actual API key:

```python
import os

os.environ["OPENAI_API_KEY"] = "sk-..."
```

## Basic Usage

### Generate Completions

To generate a completion for a prompt, use the `complete` method:

```python
from llama_index.llms.openai import OpenAI

resp = OpenAI().complete("Paul Graham is ")
print(resp)
```

### Chat Responses

To send a chat message and receive a response, create a list of `ChatMessage` instances and use the `chat` method:

```python
from llama_index.core.llms import ChatMessage

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality."
    ),
    ChatMessage(role="user", content="What is your name?"),
]
resp = OpenAI().chat(messages)
print(resp)
```

## Streaming Responses

### Stream Complete

To stream responses for a prompt, use the `stream_complete` method:

```python
from llama_index.llms.openai import OpenAI

llm = OpenAI()
resp = llm.stream_complete("Paul Graham is ")
for r in resp:
    print(r.delta, end="")
```

### Stream Chat

To stream chat responses, use the `stream_chat` method:

```python
from llama_index.llms.openai import OpenAI
from llama_index.core.llms import ChatMessage

llm = OpenAI()
messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality."
    ),
    ChatMessage(role="user", content="What is your name?"),
]
resp = llm.stream_chat(messages)
for r in resp:
    print(r.delta, end="")
```

## Configure Model

You can specify a particular model when creating the `OpenAI` instance:

```python
llm = OpenAI(model="gpt-3.5-turbo")
resp = llm.complete("Paul Graham is ")
print(resp)

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality."
    ),
    ChatMessage(role="user", content="What is your name?"),
]
resp = llm.chat(messages)
print(resp)
```

## Asynchronous Usage

You can also use asynchronous methods for completion:

```python
from llama_index.llms.openai import OpenAI

llm = OpenAI(model="gpt-3.5-turbo")
resp = await llm.acomplete("Paul Graham is ")
print(resp)
```

## Set API Key at a Per-Instance Level

If desired, you can have separate LLM instances use different API keys:

```python
from llama_index.llms.openai import OpenAI

llm = OpenAI(model="gpt-3.5-turbo", api_key="BAD_KEY")
resp = OpenAI().complete("Paul Graham is ")
print(resp)
```

### LLM Implementation example

https://docs.llamaindex.ai/en/stable/examples/llm/openai/

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "llama-index-llms-openai",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "llama-index",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/63/27/739806b58be3a461aea9c8a5f929991950d717b688c65e3072a66b388aac/llama_index_llms_openai-0.5.5.tar.gz",
    "platform": null,
    "description": "# LlamaIndex Llms Integration: Openai\n\n## Installation\n\nTo install the required package, run:\n\n```bash\n%pip install llama-index-llms-openai\n```\n\n## Setup\n\n1. Set your OpenAI API key as an environment variable. You can replace `\"sk-...\"` with your actual API key:\n\n```python\nimport os\n\nos.environ[\"OPENAI_API_KEY\"] = \"sk-...\"\n```\n\n## Basic Usage\n\n### Generate Completions\n\nTo generate a completion for a prompt, use the `complete` method:\n\n```python\nfrom llama_index.llms.openai import OpenAI\n\nresp = OpenAI().complete(\"Paul Graham is \")\nprint(resp)\n```\n\n### Chat Responses\n\nTo send a chat message and receive a response, create a list of `ChatMessage` instances and use the `chat` method:\n\n```python\nfrom llama_index.core.llms import ChatMessage\n\nmessages = [\n    ChatMessage(\n        role=\"system\", content=\"You are a pirate with a colorful personality.\"\n    ),\n    ChatMessage(role=\"user\", content=\"What is your name?\"),\n]\nresp = OpenAI().chat(messages)\nprint(resp)\n```\n\n## Streaming Responses\n\n### Stream Complete\n\nTo stream responses for a prompt, use the `stream_complete` method:\n\n```python\nfrom llama_index.llms.openai import OpenAI\n\nllm = OpenAI()\nresp = llm.stream_complete(\"Paul Graham is \")\nfor r in resp:\n    print(r.delta, end=\"\")\n```\n\n### Stream Chat\n\nTo stream chat responses, use the `stream_chat` method:\n\n```python\nfrom llama_index.llms.openai import OpenAI\nfrom llama_index.core.llms import ChatMessage\n\nllm = OpenAI()\nmessages = [\n    ChatMessage(\n        role=\"system\", content=\"You are a pirate with a colorful personality.\"\n    ),\n    ChatMessage(role=\"user\", content=\"What is your name?\"),\n]\nresp = llm.stream_chat(messages)\nfor r in resp:\n    print(r.delta, end=\"\")\n```\n\n## Configure Model\n\nYou can specify a particular model when creating the `OpenAI` instance:\n\n```python\nllm = OpenAI(model=\"gpt-3.5-turbo\")\nresp = llm.complete(\"Paul Graham is \")\nprint(resp)\n\nmessages = [\n    ChatMessage(\n        role=\"system\", content=\"You are a pirate with a colorful personality.\"\n    ),\n    ChatMessage(role=\"user\", content=\"What is your name?\"),\n]\nresp = llm.chat(messages)\nprint(resp)\n```\n\n## Asynchronous Usage\n\nYou can also use asynchronous methods for completion:\n\n```python\nfrom llama_index.llms.openai import OpenAI\n\nllm = OpenAI(model=\"gpt-3.5-turbo\")\nresp = await llm.acomplete(\"Paul Graham is \")\nprint(resp)\n```\n\n## Set API Key at a Per-Instance Level\n\nIf desired, you can have separate LLM instances use different API keys:\n\n```python\nfrom llama_index.llms.openai import OpenAI\n\nllm = OpenAI(model=\"gpt-3.5-turbo\", api_key=\"BAD_KEY\")\nresp = OpenAI().complete(\"Paul Graham is \")\nprint(resp)\n```\n\n### LLM Implementation example\n\nhttps://docs.llamaindex.ai/en/stable/examples/llm/openai/\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "llama-index llms openai integration",
    "version": "0.5.5",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "7b91b9a9c93b83570ccb635d4c511d7946b1a5d3abaf3535942e2d3883f3f00b",
                "md5": "3059532ba9ed3858fbf7fecdf24e9f55",
                "sha256": "2f0177c92d168296066b9904213a1b5e98cc8079cb9bcf676b271c2ffa5f154d"
            },
            "downloads": -1,
            "filename": "llama_index_llms_openai-0.5.5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "3059532ba9ed3858fbf7fecdf24e9f55",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 25367,
            "upload_time": "2025-09-08T13:33:06",
            "upload_time_iso_8601": "2025-09-08T13:33:06.635057Z",
            "url": "https://files.pythonhosted.org/packages/7b/91/b9a9c93b83570ccb635d4c511d7946b1a5d3abaf3535942e2d3883f3f00b/llama_index_llms_openai-0.5.5-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "6327739806b58be3a461aea9c8a5f929991950d717b688c65e3072a66b388aac",
                "md5": "102d3dc51942f8bff9f4661b0ece1085",
                "sha256": "9958abaa3fdf5d2dc1a6d16cf487396692ec8a82f289fde2f9a40f6a0f105479"
            },
            "downloads": -1,
            "filename": "llama_index_llms_openai-0.5.5.tar.gz",
            "has_sig": false,
            "md5_digest": "102d3dc51942f8bff9f4661b0ece1085",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 24236,
            "upload_time": "2025-09-08T13:33:07",
            "upload_time_iso_8601": "2025-09-08T13:33:07.645715Z",
            "url": "https://files.pythonhosted.org/packages/63/27/739806b58be3a461aea9c8a5f929991950d717b688c65e3072a66b388aac/llama_index_llms_openai-0.5.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-09-08 13:33:07",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "llama-index-llms-openai"
}
        
Elapsed time: 8.96943s