# Python GPT4All
This package contains a set of Python bindings around the `llmodel` C-API.
Package on PyPI: https://pypi.org/project/gpt4all/
## Documentation
https://docs.gpt4all.io/gpt4all_python.html
## Installation
The easiest way to install the Python bindings for GPT4All is to use pip:
```
pip install gpt4all
```
This will download the latest version of the `gpt4all` package from PyPI.
## Local Build
As an alternative to downloading via pip, you may build the Python bindings from source.
### Prerequisites
On Windows and Linux, building GPT4All requires the complete Vulkan SDK. You may download it from here: https://vulkan.lunarg.com/sdk/home
macOS users do not need Vulkan, as GPT4All will use Metal instead.
### Building the python bindings
1. Clone GPT4All and change directory:
```
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all.git
cd gpt4all/gpt4all-backend
```
2. Build the backend.
If you are using Windows and have Visual Studio installed:
```
cmake -B build
cmake --build build --parallel --config RelWithDebInfo
```
For all other platforms:
```
cmake -B build -DCMAKE_BUILD_TYPE=RelWithDebInfo
cmake --build build --parallel
```
`RelWithDebInfo` is a good default, but you can also use `Release` or `Debug` depending on the situation.
2. Install the Python package:
```
cd ../../gpt4all-bindings/python
pip install -e .
```
## Usage
Test it out! In a Python script or console:
```python
from gpt4all import GPT4All
model = GPT4All("orca-mini-3b-gguf2-q4_0.gguf")
output = model.generate("The capital of France is ", max_tokens=3)
print(output)
```
GPU Usage
```python
from gpt4all import GPT4All
model = GPT4All("orca-mini-3b-gguf2-q4_0.gguf", device='gpu') # device='amd', device='intel'
output = model.generate("The capital of France is ", max_tokens=3)
print(output)
```
## Troubleshooting a Local Build
- If you're on Windows and have compiled with a MinGW toolchain, you might run into an error like:
```
FileNotFoundError: Could not find module '<...>\gpt4all-bindings\python\gpt4all\llmodel_DO_NOT_MODIFY\build\libllmodel.dll'
(or one of its dependencies). Try using the full path with constructor syntax.
```
The key phrase in this case is _"or one of its dependencies"_. The Python interpreter you're using
probably doesn't see the MinGW runtime dependencies. At the moment, the following three are required:
`libgcc_s_seh-1.dll`, `libstdc++-6.dll` and `libwinpthread-1.dll`. You should copy them from MinGW
into a folder where Python will see them, preferably next to `libllmodel.dll`.
- Note regarding the Microsoft toolchain: Compiling with MSVC is possible, but not the official way to
go about it at the moment. MSVC doesn't produce DLLs with a `lib` prefix, which the bindings expect.
You'd have to amend that yourself.
Raw data
{
"_id": null,
"home_page": "https://gpt4all.io/",
"name": "gpt4all",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": "Nomic and the Open Source Community",
"author_email": "support@nomic.ai",
"download_url": null,
"platform": null,
"description": "# Python GPT4All\n\nThis package contains a set of Python bindings around the `llmodel` C-API.\n\nPackage on PyPI: https://pypi.org/project/gpt4all/\n\n## Documentation\nhttps://docs.gpt4all.io/gpt4all_python.html\n\n## Installation\n\nThe easiest way to install the Python bindings for GPT4All is to use pip:\n\n```\npip install gpt4all\n```\n\nThis will download the latest version of the `gpt4all` package from PyPI.\n\n## Local Build\n\nAs an alternative to downloading via pip, you may build the Python bindings from source.\n\n### Prerequisites\n\nOn Windows and Linux, building GPT4All requires the complete Vulkan SDK. You may download it from here: https://vulkan.lunarg.com/sdk/home\n\nmacOS users do not need Vulkan, as GPT4All will use Metal instead.\n\n### Building the python bindings\n\n1. Clone GPT4All and change directory:\n```\ngit clone --recurse-submodules https://github.com/nomic-ai/gpt4all.git\ncd gpt4all/gpt4all-backend\n```\n\n2. Build the backend.\n\nIf you are using Windows and have Visual Studio installed:\n```\ncmake -B build\ncmake --build build --parallel --config RelWithDebInfo\n```\n\nFor all other platforms:\n```\ncmake -B build -DCMAKE_BUILD_TYPE=RelWithDebInfo\ncmake --build build --parallel\n```\n\n`RelWithDebInfo` is a good default, but you can also use `Release` or `Debug` depending on the situation.\n\n2. Install the Python package:\n```\ncd ../../gpt4all-bindings/python\npip install -e .\n```\n\n## Usage\n\nTest it out! In a Python script or console:\n\n```python\nfrom gpt4all import GPT4All\nmodel = GPT4All(\"orca-mini-3b-gguf2-q4_0.gguf\")\noutput = model.generate(\"The capital of France is \", max_tokens=3)\nprint(output)\n```\n\n\nGPU Usage\n```python\nfrom gpt4all import GPT4All\nmodel = GPT4All(\"orca-mini-3b-gguf2-q4_0.gguf\", device='gpu') # device='amd', device='intel'\noutput = model.generate(\"The capital of France is \", max_tokens=3)\nprint(output)\n```\n\n## Troubleshooting a Local Build\n- If you're on Windows and have compiled with a MinGW toolchain, you might run into an error like:\n ```\n FileNotFoundError: Could not find module '<...>\\gpt4all-bindings\\python\\gpt4all\\llmodel_DO_NOT_MODIFY\\build\\libllmodel.dll'\n (or one of its dependencies). Try using the full path with constructor syntax.\n ```\n The key phrase in this case is _\"or one of its dependencies\"_. The Python interpreter you're using\n probably doesn't see the MinGW runtime dependencies. At the moment, the following three are required:\n `libgcc_s_seh-1.dll`, `libstdc++-6.dll` and `libwinpthread-1.dll`. You should copy them from MinGW\n into a folder where Python will see them, preferably next to `libllmodel.dll`.\n\n- Note regarding the Microsoft toolchain: Compiling with MSVC is possible, but not the official way to\n go about it at the moment. MSVC doesn't produce DLLs with a `lib` prefix, which the bindings expect.\n You'd have to amend that yourself.\n",
"bugtrack_url": null,
"license": null,
"summary": "Python bindings for GPT4All",
"version": "2.6.0",
"project_urls": {
"Documentation": "https://docs.gpt4all.io/gpt4all_python.html",
"Homepage": "https://gpt4all.io/",
"Source code": "https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-bindings/python"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "905924293de6b70894ae90cd0e242db03a037ae03e5f01ca9df51191a6da360d",
"md5": "cc7bb8f5f9bbe723a32d381ba4abe136",
"sha256": "2d750cf20a3dbfd9ed0ffbd780161eb2720ae923130e8a259e9dcc9a9b108983"
},
"downloads": -1,
"filename": "gpt4all-2.6.0-py3-none-macosx_10_15_universal2.whl",
"has_sig": false,
"md5_digest": "cc7bb8f5f9bbe723a32d381ba4abe136",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 5859690,
"upload_time": "2024-04-25T18:18:47",
"upload_time_iso_8601": "2024-04-25T18:18:47.539700Z",
"url": "https://files.pythonhosted.org/packages/90/59/24293de6b70894ae90cd0e242db03a037ae03e5f01ca9df51191a6da360d/gpt4all-2.6.0-py3-none-macosx_10_15_universal2.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b3ea7dc46ea220d95c396de14dfdc69175e96d6678cf2afcf341392ff72f9f70",
"md5": "638814b08d726d8516db860b94991117",
"sha256": "506a0e0089044e36e0a0792cd7abba0e2f688669101bc927b8bae4f82409dcec"
},
"downloads": -1,
"filename": "gpt4all-2.6.0-py3-none-manylinux1_x86_64.whl",
"has_sig": false,
"md5_digest": "638814b08d726d8516db860b94991117",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 3922736,
"upload_time": "2024-04-25T18:18:54",
"upload_time_iso_8601": "2024-04-25T18:18:54.443603Z",
"url": "https://files.pythonhosted.org/packages/b3/ea/7dc46ea220d95c396de14dfdc69175e96d6678cf2afcf341392ff72f9f70/gpt4all-2.6.0-py3-none-manylinux1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "debf68645d6c086d63477464262deb29be284b8236d147c28f73b422300c3774",
"md5": "1cca53f8165a2ce5d2e5312a66443526",
"sha256": "997c40a4c9ef639eef74861d9eb731e80be29ac8a455b2530df98fdeded6557f"
},
"downloads": -1,
"filename": "gpt4all-2.6.0-py3-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "1cca53f8165a2ce5d2e5312a66443526",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 6278592,
"upload_time": "2024-04-25T18:18:56",
"upload_time_iso_8601": "2024-04-25T18:18:56.182840Z",
"url": "https://files.pythonhosted.org/packages/de/bf/68645d6c086d63477464262deb29be284b8236d147c28f73b422300c3774/gpt4all-2.6.0-py3-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-25 18:18:47",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "nomic-ai",
"github_project": "gpt4all",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"circle": true,
"lcname": "gpt4all"
}
JSON
