| Name | llm-evals-plugin JSON |
| Version |
0.1a0
JSON |
| download |
| home_page | None |
| Summary | Run evals against prompts using LLM |
| upload_time | 2024-04-21 15:32:40 |
| maintainer | None |
| docs_url | None |
| author | Simon Willison |
| requires_python | None |
| license | Apache-2.0 |
| keywords |
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# llm-evals-plugin
[](https://pypi.org/project/llm-evals-plugin/)
[](https://github.com/simonw/llm-evals-plugin/releases)
[](https://github.com/simonw/llm-evals-plugin/actions/workflows/test.yml)
[](https://github.com/simonw/llm-evals-plugin/blob/main/LICENSE)
Run evals against prompts using LLM
**Very early alpha**: everything is likely to change.
## Installation
Install this plugin in the same environment as [LLM](https://llm.datasette.io/).
```bash
llm install llm-evals-plugin
```
## Usage
See [issue 1](https://github.com/simonw/llm-evals-plugin/issues/1).
## Development
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
```bash
cd llm-evals-plugin
python3 -m venv venv
source venv/bin/activate
```
Now install the dependencies and test dependencies:
```bash
llm install -e '.[test]'
```
To run the tests:
```bash
pytest
```
Raw data
{
"_id": null,
"home_page": null,
"name": "llm-evals-plugin",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": null,
"keywords": null,
"author": "Simon Willison",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/a7/a0/ef0135290edd381d06bb4bccfc457e2cb0b5cb8b7e44a718f0d697305545/llm_evals_plugin-0.1a0.tar.gz",
"platform": null,
"description": "# llm-evals-plugin\n\n[](https://pypi.org/project/llm-evals-plugin/)\n[](https://github.com/simonw/llm-evals-plugin/releases)\n[](https://github.com/simonw/llm-evals-plugin/actions/workflows/test.yml)\n[](https://github.com/simonw/llm-evals-plugin/blob/main/LICENSE)\n\nRun evals against prompts using LLM\n\n**Very early alpha**: everything is likely to change.\n\n## Installation\n\nInstall this plugin in the same environment as [LLM](https://llm.datasette.io/).\n```bash\nllm install llm-evals-plugin\n```\n## Usage\n\nSee [issue 1](https://github.com/simonw/llm-evals-plugin/issues/1).\n\n## Development\n\nTo set up this plugin locally, first checkout the code. Then create a new virtual environment:\n```bash\ncd llm-evals-plugin\npython3 -m venv venv\nsource venv/bin/activate\n```\nNow install the dependencies and test dependencies:\n```bash\nllm install -e '.[test]'\n```\nTo run the tests:\n```bash\npytest\n```\n",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "Run evals against prompts using LLM",
"version": "0.1a0",
"project_urls": {
"CI": "https://github.com/simonw/llm-evals-plugin/actions",
"Changelog": "https://github.com/simonw/llm-evals-plugin/releases",
"Homepage": "https://github.com/simonw/llm-evals-plugin",
"Issues": "https://github.com/simonw/llm-evals-plugin/issues"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "186964001098a1bd794431e92e2ce628090864d2076ca53de83cd213262195d1",
"md5": "6c2daf8c5b85db31d7df784d889af8e1",
"sha256": "233c74a893c30391f3c239718930297cf4764ff7261f49a6e55b87160b24cedd"
},
"downloads": -1,
"filename": "llm_evals_plugin-0.1a0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "6c2daf8c5b85db31d7df784d889af8e1",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 3472,
"upload_time": "2024-04-21T15:32:39",
"upload_time_iso_8601": "2024-04-21T15:32:39.588074Z",
"url": "https://files.pythonhosted.org/packages/18/69/64001098a1bd794431e92e2ce628090864d2076ca53de83cd213262195d1/llm_evals_plugin-0.1a0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a7a0ef0135290edd381d06bb4bccfc457e2cb0b5cb8b7e44a718f0d697305545",
"md5": "33a10b8e3d0eb3b4ef5cdbb5c749d6d6",
"sha256": "049d3e4f79a626c083ff6dd80ea2fb2246e7cbe3cde5adf040af32e93c4b28a1"
},
"downloads": -1,
"filename": "llm_evals_plugin-0.1a0.tar.gz",
"has_sig": false,
"md5_digest": "33a10b8e3d0eb3b4ef5cdbb5c749d6d6",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 2924,
"upload_time": "2024-04-21T15:32:40",
"upload_time_iso_8601": "2024-04-21T15:32:40.581744Z",
"url": "https://files.pythonhosted.org/packages/a7/a0/ef0135290edd381d06bb4bccfc457e2cb0b5cb8b7e44a718f0d697305545/llm_evals_plugin-0.1a0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-21 15:32:40",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "simonw",
"github_project": "llm-evals-plugin",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "llm-evals-plugin"
}
