trulens


Nametrulens JSON
Version 1.0.8 PyPI version JSON
download
home_pagehttps://trulens.org/
SummaryLibrary to systematically track and evaluate LLM based applications.
upload_time2024-10-04 23:11:14
maintainerNone
docs_urlNone
authorSnowflake Inc.
requires_python!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,>=3.9
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ![PyPI - Version](https://img.shields.io/pypi/v/trulens?label=trulens&link=https%3A%2F%2Fpypi.org%2Fproject%2Ftrulens%2F)
![Azure DevOps builds (job)](https://img.shields.io/azure-devops/build/truera/5a27f3d2-132d-40fc-9b0c-81abd1182f41/9)
![GitHub](https://img.shields.io/github/license/truera/trulens)
![PyPI - Downloads](https://img.shields.io/pypi/dm/trulens)
[![Slack](https://img.shields.io/badge/slack-join-green?logo=slack)](https://communityinviter.com/apps/aiqualityforum/josh)
[![Docs](https://img.shields.io/badge/docs-trulens.org-blue)](https://www.trulens.org/trulens/getting_started/)
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/langchain_quickstart.ipynb)

# 🦑 Welcome to TruLens!

![TruLens](https://www.trulens.org/assets/images/Neural_Network_Explainability.png)

**Don't just vibe-check your llm app!** Systematically evaluate and track your
LLM experiments with TruLens. As you develop your app including prompts, models,
retrievers, knowledge sources and more, *TruLens* is the tool you need to
understand its performance.

Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help
you to identify failure modes & systematically iterate to improve your
application.

Read more about the core concepts behind TruLens including [Feedback Functions](https://www.trulens.org/trulens/getting_started/core_concepts/feedback_functions/),
[The RAG Triad](https://www.trulens.org/trulens/getting_started/core_concepts/rag_triad/),
and [Honest, Harmless and Helpful Evals](https://www.trulens.org/trulens/getting_started/core_concepts/honest_harmless_helpful_evals/).

## TruLens in the development workflow

Build your first prototype then connect instrumentation and logging with
TruLens. Decide what feedbacks you need, and specify them with TruLens to run
alongside your app. Then iterate and compare versions of your app in an
easy-to-use user interface 👇

![Architecture
Diagram](https://www.trulens.org/assets/images/TruLens_Architecture.png)

## Installation and Setup

Install the trulens pip package from PyPI.

```bash
    pip install trulens
```

## Quick Usage

Walk through how to instrument and evaluate a RAG built from scratch with
TruLens.

[![Open In
Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/quickstart.ipynb)

### 💡 Contributing & Community

Interested in contributing? See our [contributing
guide](https://www.trulens.org/trulens/contributing/) for more details.

The best way to support TruLens is to give us a ⭐ on
[GitHub](https://www.github.com/truera/trulens) and join our [slack
community](https://communityinviter.com/apps/aiqualityforum/josh)!


            

Raw data

            {
    "_id": null,
    "home_page": "https://trulens.org/",
    "name": "trulens",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,>=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "Snowflake Inc.",
    "author_email": "ml-observability-wg-dl@snowflake.com",
    "download_url": "https://files.pythonhosted.org/packages/90/96/a73a83784c27ac917671db56a6eed505bb4639b646ab60dc82feef4f0362/trulens-1.0.8.tar.gz",
    "platform": null,
    "description": "![PyPI - Version](https://img.shields.io/pypi/v/trulens?label=trulens&link=https%3A%2F%2Fpypi.org%2Fproject%2Ftrulens%2F)\n![Azure DevOps builds (job)](https://img.shields.io/azure-devops/build/truera/5a27f3d2-132d-40fc-9b0c-81abd1182f41/9)\n![GitHub](https://img.shields.io/github/license/truera/trulens)\n![PyPI - Downloads](https://img.shields.io/pypi/dm/trulens)\n[![Slack](https://img.shields.io/badge/slack-join-green?logo=slack)](https://communityinviter.com/apps/aiqualityforum/josh)\n[![Docs](https://img.shields.io/badge/docs-trulens.org-blue)](https://www.trulens.org/trulens/getting_started/)\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/langchain_quickstart.ipynb)\n\n# \ud83e\udd91 Welcome to TruLens!\n\n![TruLens](https://www.trulens.org/assets/images/Neural_Network_Explainability.png)\n\n**Don't just vibe-check your llm app!** Systematically evaluate and track your\nLLM experiments with TruLens. As you develop your app including prompts, models,\nretrievers, knowledge sources and more, *TruLens* is the tool you need to\nunderstand its performance.\n\nFine-grained, stack-agnostic instrumentation and comprehensive evaluations help\nyou to identify failure modes & systematically iterate to improve your\napplication.\n\nRead more about the core concepts behind TruLens including [Feedback Functions](https://www.trulens.org/trulens/getting_started/core_concepts/feedback_functions/),\n[The RAG Triad](https://www.trulens.org/trulens/getting_started/core_concepts/rag_triad/),\nand [Honest, Harmless and Helpful Evals](https://www.trulens.org/trulens/getting_started/core_concepts/honest_harmless_helpful_evals/).\n\n## TruLens in the development workflow\n\nBuild your first prototype then connect instrumentation and logging with\nTruLens. Decide what feedbacks you need, and specify them with TruLens to run\nalongside your app. Then iterate and compare versions of your app in an\neasy-to-use user interface \ud83d\udc47\n\n![Architecture\nDiagram](https://www.trulens.org/assets/images/TruLens_Architecture.png)\n\n## Installation and Setup\n\nInstall the trulens pip package from PyPI.\n\n```bash\n    pip install trulens\n```\n\n## Quick Usage\n\nWalk through how to instrument and evaluate a RAG built from scratch with\nTruLens.\n\n[![Open In\nColab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/quickstart.ipynb)\n\n### \ud83d\udca1 Contributing & Community\n\nInterested in contributing? See our [contributing\nguide](https://www.trulens.org/trulens/contributing/) for more details.\n\nThe best way to support TruLens is to give us a \u2b50 on\n[GitHub](https://www.github.com/truera/trulens) and join our [slack\ncommunity](https://communityinviter.com/apps/aiqualityforum/josh)!\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Library to systematically track and evaluate LLM based applications.",
    "version": "1.0.8",
    "project_urls": {
        "Documentation": "https://trulens.org/trulens/getting_started/",
        "Homepage": "https://trulens.org/",
        "Repository": "https://github.com/truera/trulens"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5c025de082c6f3470a2ec8819fad8b5b7355afbf7befbb4daa74d69876c75b80",
                "md5": "1f207c1b7993c259a213d05840d857ce",
                "sha256": "5dbabda7308f62a135a3850b281a5f55c424d23cb64754845244bd69ea94f5a7"
            },
            "downloads": -1,
            "filename": "trulens-1.0.8-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "1f207c1b7993c259a213d05840d857ce",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,>=3.9",
            "size": 3600,
            "upload_time": "2024-10-04T23:10:56",
            "upload_time_iso_8601": "2024-10-04T23:10:56.220123Z",
            "url": "https://files.pythonhosted.org/packages/5c/02/5de082c6f3470a2ec8819fad8b5b7355afbf7befbb4daa74d69876c75b80/trulens-1.0.8-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "9096a73a83784c27ac917671db56a6eed505bb4639b646ab60dc82feef4f0362",
                "md5": "45eb240b1099e516f14f2ef6fe2f6911",
                "sha256": "22fdec9000200be7dab0a52449cb04de13199e0a198f8c4b88fa1526edfb7bde"
            },
            "downloads": -1,
            "filename": "trulens-1.0.8.tar.gz",
            "has_sig": false,
            "md5_digest": "45eb240b1099e516f14f2ef6fe2f6911",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,!=3.8.*,>=3.9",
            "size": 4195,
            "upload_time": "2024-10-04T23:11:14",
            "upload_time_iso_8601": "2024-10-04T23:11:14.768923Z",
            "url": "https://files.pythonhosted.org/packages/90/96/a73a83784c27ac917671db56a6eed505bb4639b646ab60dc82feef4f0362/trulens-1.0.8.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-10-04 23:11:14",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "truera",
    "github_project": "trulens",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "trulens"
}
        
Elapsed time: 1.14389s