inspect-ai


Nameinspect-ai JSON
Version 0.3.18 PyPI version JSON
download
home_pageNone
SummaryFramework for large language model evaluations
upload_time2024-07-14 12:21:41
maintainerNone
docs_urlNone
authorUK AI Safety Institute
requires_python>=3.10
licenseMIT License
keywords
VCS
bugtrack_url
requirements aiofiles anyio beautifulsoup4 click debugpy docstring-parser fsspec httpx json-stream jsonlines nest_asyncio numpy platformdirs psutil pydantic python-dotenv pyyaml rich s3fs semver shortuuid tenacity typing_extensions zipp
Travis-CI No Travis.
coveralls test coverage No coveralls.
            [<img width="295" src="https://ukgovernmentbeis.github.io/inspect_ai/images/aisi-logo.png" />](https://www.gov.uk/government/organisations/ai-safety-institute)

Welcome to Inspect, a framework for large language model evaluations created by the [UK AI Safety Institute](https://www.gov.uk/government/organisations/ai-safety-institute).

Inspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g. to support new elicitation and scoring techniques) can be provided by other Python packages.

To get started with Inspect, please see the documentation at <https://UKGovernmentBEIS.github.io/inspect_ai/>.

***

#### Development

To work on development of Inspect, clone the repository and install with the `-e` flag and `[dev]` optional dependencies:

```         
$ git clone https://github.com/UKGovernmentBEIS/inspect_ai.git
$ cd inspect_ai
$ pip install -e ".[dev]"
```

If you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "inspect-ai",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.10",
    "maintainer_email": null,
    "keywords": null,
    "author": "UK AI Safety Institute",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/60/7e/b8d48a24a778bedef968bbc0e9623e8a8649a0d7683ac33d7b1a10b8bdaf/inspect_ai-0.3.18.tar.gz",
    "platform": null,
    "description": "[<img width=\"295\" src=\"https://ukgovernmentbeis.github.io/inspect_ai/images/aisi-logo.png\" />](https://www.gov.uk/government/organisations/ai-safety-institute)\n\nWelcome to Inspect, a framework for large language model evaluations created by the [UK AI Safety Institute](https://www.gov.uk/government/organisations/ai-safety-institute).\n\nInspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g.\u00a0to support new elicitation and scoring techniques) can be provided by other Python packages.\n\nTo get started with Inspect, please see the documentation at <https://UKGovernmentBEIS.github.io/inspect_ai/>.\n\n***\n\n#### Development\n\nTo work on development of Inspect, clone the repository and install with the `-e` flag and `[dev]` optional dependencies:\n\n```         \n$ git clone https://github.com/UKGovernmentBEIS/inspect_ai.git\n$ cd inspect_ai\n$ pip install -e \".[dev]\"\n```\n\nIf you use VS Code, you should be sure to have installed the recommended extensions (Python, Ruff, and MyPy). Note that you'll be prompted to install these when you open the project in VS Code.\n",
    "bugtrack_url": null,
    "license": "MIT License",
    "summary": "Framework for large language model evaluations",
    "version": "0.3.18",
    "project_urls": {
        "Documentation": "https://UKGovernmentBEIS.github.io/inspect_ai/",
        "Issue Tracker": "https://github.com/UKGovernmentBEIS/inspect_ai/issues",
        "Source Code": "https://github.com/UKGovernmentBEIS/inspect_ai"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5e87066289070839b24ad4b9b3f0205ec6ca793400c6fa5feac8f7caafbd4ed7",
                "md5": "b3375becd76c60bee0eb42e5dbd114b7",
                "sha256": "c6ded2398f8ec50207b7130e5ff05327767bf6a52bcf195abd76278b8084b6a8"
            },
            "downloads": -1,
            "filename": "inspect_ai-0.3.18-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "b3375becd76c60bee0eb42e5dbd114b7",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10",
            "size": 783506,
            "upload_time": "2024-07-14T12:21:38",
            "upload_time_iso_8601": "2024-07-14T12:21:38.438164Z",
            "url": "https://files.pythonhosted.org/packages/5e/87/066289070839b24ad4b9b3f0205ec6ca793400c6fa5feac8f7caafbd4ed7/inspect_ai-0.3.18-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "607eb8d48a24a778bedef968bbc0e9623e8a8649a0d7683ac33d7b1a10b8bdaf",
                "md5": "ef3f8030212bdb9a56db8e767b88f8ea",
                "sha256": "b44606bd64d13e20f7ae081b0b624311e9a13da70b484f765e00dd23b819427c"
            },
            "downloads": -1,
            "filename": "inspect_ai-0.3.18.tar.gz",
            "has_sig": false,
            "md5_digest": "ef3f8030212bdb9a56db8e767b88f8ea",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10",
            "size": 6482211,
            "upload_time": "2024-07-14T12:21:41",
            "upload_time_iso_8601": "2024-07-14T12:21:41.078385Z",
            "url": "https://files.pythonhosted.org/packages/60/7e/b8d48a24a778bedef968bbc0e9623e8a8649a0d7683ac33d7b1a10b8bdaf/inspect_ai-0.3.18.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-07-14 12:21:41",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "UKGovernmentBEIS",
    "github_project": "inspect_ai",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [
        {
            "name": "aiofiles",
            "specs": []
        },
        {
            "name": "anyio",
            "specs": [
                [
                    ">=",
                    "4.4.0"
                ]
            ]
        },
        {
            "name": "beautifulsoup4",
            "specs": []
        },
        {
            "name": "click",
            "specs": []
        },
        {
            "name": "debugpy",
            "specs": []
        },
        {
            "name": "docstring-parser",
            "specs": []
        },
        {
            "name": "fsspec",
            "specs": []
        },
        {
            "name": "httpx",
            "specs": []
        },
        {
            "name": "json-stream",
            "specs": []
        },
        {
            "name": "jsonlines",
            "specs": []
        },
        {
            "name": "nest_asyncio",
            "specs": []
        },
        {
            "name": "numpy",
            "specs": []
        },
        {
            "name": "platformdirs",
            "specs": []
        },
        {
            "name": "psutil",
            "specs": []
        },
        {
            "name": "pydantic",
            "specs": [
                [
                    ">=",
                    "2"
                ]
            ]
        },
        {
            "name": "python-dotenv",
            "specs": []
        },
        {
            "name": "pyyaml",
            "specs": []
        },
        {
            "name": "rich",
            "specs": []
        },
        {
            "name": "s3fs",
            "specs": [
                [
                    ">=",
                    "2023"
                ]
            ]
        },
        {
            "name": "semver",
            "specs": []
        },
        {
            "name": "shortuuid",
            "specs": []
        },
        {
            "name": "tenacity",
            "specs": []
        },
        {
            "name": "typing_extensions",
            "specs": []
        },
        {
            "name": "zipp",
            "specs": [
                [
                    ">=",
                    "3.19.1"
                ]
            ]
        }
    ],
    "lcname": "inspect-ai"
}
        
Elapsed time: 0.26828s