inspect-ai

Name	inspect-ai JSON
Version	0.3.42 JSON
	download
home_page	None
Summary	Framework for large language model evaluations
upload_time	2024-10-23 21:19:50
maintainer	None
docs_url	None
author	UK AI Safety Institute
requires_python	>=3.10
license	MIT License
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            [<img width="295" src="https://inspect.ai-safety-institute.org.uk/images/aisi-logo.png" />](https://aisi.gov.uk/)

Welcome to Inspect, a framework for large language model evaluations created by the [UK AI Safety Institute](https://aisi.gov.uk/).

Inspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g. to support new elicitation and scoring techniques) can be provided by other Python packages.

To get started with Inspect, please see the documentation at <https://inspect.ai-safety-institute.org.uk/>.

***



To work on development of Inspect, clone the repository and install with the `-e` flag and `[dev]` optional dependencies:

```bash
$ git clone https://github.com/UKGovernmentBEIS/inspect_ai.git
$ cd inspect_ai
$ pip install -e ".[dev]"
```

Optionally install pre-commit hooks via
```bash
make hooks
```

Run linting, formatting, and tests via
```bash
make check
make test
```

If you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "inspect-ai",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.10",
    "maintainer_email": null,
    "keywords": null,
    "author": "UK AI Safety Institute",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/04/f6/e0f890646e6bcae6163f61d41c03c0757b3b1fba9eb6b5b6202c1fa613a2/inspect_ai-0.3.42.tar.gz",
    "platform": null,
    "description": "[<img width=\"295\" src=\"https://inspect.ai-safety-institute.org.uk/images/aisi-logo.png\" />](https://aisi.gov.uk/)\n\nWelcome to Inspect, a framework for large language model evaluations created by the [UK AI Safety Institute](https://aisi.gov.uk/).\n\nInspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g.\u00a0to support new elicitation and scoring techniques) can be provided by other Python packages.\n\nTo get started with Inspect, please see the documentation at <https://inspect.ai-safety-institute.org.uk/>.\n\n***\n\n\n\nTo work on development of Inspect, clone the repository and install with the `-e` flag and `[dev]` optional dependencies:\n\n```bash\n$ git clone https://github.com/UKGovernmentBEIS/inspect_ai.git\n$ cd inspect_ai\n$ pip install -e \".[dev]\"\n```\n\nOptionally install pre-commit hooks via\n```bash\nmake hooks\n```\n\nRun linting, formatting, and tests via\n```bash\nmake check\nmake test\n```\n\nIf you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code.\n",
    "bugtrack_url": null,
    "license": "MIT License",
    "summary": "Framework for large language model evaluations",
    "version": "0.3.42",
    "project_urls": {
        "Documentation": "https://inspect.ai-safety-institute.org.uk/",
        "Issue Tracker": "https://github.com/UKGovernmentBEIS/inspect_ai/issues",
        "Source Code": "https://github.com/UKGovernmentBEIS/inspect_ai"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "4d7651e2afc1c53d30afc43be403151cb683c7c60cf4a646d587345337f6439d",
                "md5": "4fe6e2b373c2c256439fd1b92b158632",
                "sha256": "e57f8d8a6d1fafc16e3023532639d3600c46d93628b970faa8e8a75740e0e8ba"
            },
            "downloads": -1,
            "filename": "inspect_ai-0.3.42-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "4fe6e2b373c2c256439fd1b92b158632",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10",
            "size": 1294939,
            "upload_time": "2024-10-23T21:19:46",
            "upload_time_iso_8601": "2024-10-23T21:19:46.618450Z",
            "url": "https://files.pythonhosted.org/packages/4d/76/51e2afc1c53d30afc43be403151cb683c7c60cf4a646d587345337f6439d/inspect_ai-0.3.42-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "04f6e0f890646e6bcae6163f61d41c03c0757b3b1fba9eb6b5b6202c1fa613a2",
                "md5": "e4ca0949495a52af9468dd64f00e363a",
                "sha256": "92e4706879dec802611a3c55fd6825756d84e939050872f9039067c193724f9b"
            },
            "downloads": -1,
            "filename": "inspect_ai-0.3.42.tar.gz",
            "has_sig": false,
            "md5_digest": "e4ca0949495a52af9468dd64f00e363a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10",
            "size": 7792277,
            "upload_time": "2024-10-23T21:19:50",
            "upload_time_iso_8601": "2024-10-23T21:19:50.463669Z",
            "url": "https://files.pythonhosted.org/packages/04/f6/e0f890646e6bcae6163f61d41c03c0757b3b1fba9eb6b5b6202c1fa613a2/inspect_ai-0.3.42.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-10-23 21:19:50",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "UKGovernmentBEIS",
    "github_project": "inspect_ai",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [],
    "lcname": "inspect-ai"
}