Name | trulens JSON |
Version |
1.2.7
JSON |
| download |
home_page | https://trulens.org/ |
Summary | Library to systematically track and evaluate LLM based applications. |
upload_time | 2024-11-14 22:34:20 |
maintainer | None |
docs_url | None |
author | Snowflake Inc. |
requires_python | !=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,>=3.8 |
license | MIT |
keywords |
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
![PyPI - Version](https://img.shields.io/pypi/v/trulens?label=trulens&link=https%3A%2F%2Fpypi.org%2Fproject%2Ftrulens%2F)
[![Azure Build Status](https://dev.azure.com/truera/trulens/_apis/build/status%2FTruLens%20E2E%20Tests?branchName=main)](https://dev.azure.com/truera/trulens/_build/latest?definitionId=8&branchName=main)
![GitHub](https://img.shields.io/github/license/truera/trulens)
![PyPI - Downloads](https://img.shields.io/pypi/dm/trulens)
[![Slack](https://img.shields.io/badge/slack-join-green?logo=slack)](https://communityinviter.com/apps/aiqualityforum/josh)
[![Docs](https://img.shields.io/badge/docs-trulens.org-blue)](https://www.trulens.org/getting_started/)
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/langchain_quickstart.ipynb)
# 🦑 Welcome to TruLens!
![TruLens](https://www.trulens.org/assets/images/Neural_Network_Explainability.png)
**Don't just vibe-check your llm app!** Systematically evaluate and track your
LLM experiments with TruLens. As you develop your app including prompts, models,
retrievers, knowledge sources and more, *TruLens* is the tool you need to
understand its performance.
Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help
you to identify failure modes & systematically iterate to improve your
application.
Read more about the core concepts behind TruLens including [Feedback Functions](https://www.trulens.org/getting_started/core_concepts/feedback_functions/),
[The RAG Triad](https://www.trulens.org/getting_started/core_concepts/rag_triad/),
and [Honest, Harmless and Helpful Evals](https://www.trulens.org/getting_started/core_concepts/honest_harmless_helpful_evals/).
## TruLens in the development workflow
Build your first prototype then connect instrumentation and logging with
TruLens. Decide what feedbacks you need, and specify them with TruLens to run
alongside your app. Then iterate and compare versions of your app in an
easy-to-use user interface 👇
![Architecture
Diagram](https://www.trulens.org/assets/images/TruLens_Architecture.png)
## Installation and Setup
Install the trulens pip package from PyPI.
```bash
pip install trulens
```
## Quick Usage
Walk through how to instrument and evaluate a RAG built from scratch with
TruLens.
[![Open In
Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/quickstart.ipynb)
### 💡 Contributing & Community
Interested in contributing? See our [contributing
guide](https://www.trulens.org/trulens/contributing/) for more details.
The best way to support TruLens is to give us a ⭐ on
[GitHub](https://www.github.com/truera/trulens) and join our [slack
community](https://communityinviter.com/apps/aiqualityforum/josh)!
Raw data
{
"_id": null,
"home_page": "https://trulens.org/",
"name": "trulens",
"maintainer": null,
"docs_url": null,
"requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,>=3.8",
"maintainer_email": null,
"keywords": null,
"author": "Snowflake Inc.",
"author_email": "ml-observability-wg-dl@snowflake.com",
"download_url": "https://files.pythonhosted.org/packages/2f/80/c956b024101834da2d1b9a4cbee632651510b399337911c22d12a532cc09/trulens-1.2.7.tar.gz",
"platform": null,
"description": "![PyPI - Version](https://img.shields.io/pypi/v/trulens?label=trulens&link=https%3A%2F%2Fpypi.org%2Fproject%2Ftrulens%2F)\n[![Azure Build Status](https://dev.azure.com/truera/trulens/_apis/build/status%2FTruLens%20E2E%20Tests?branchName=main)](https://dev.azure.com/truera/trulens/_build/latest?definitionId=8&branchName=main)\n![GitHub](https://img.shields.io/github/license/truera/trulens)\n![PyPI - Downloads](https://img.shields.io/pypi/dm/trulens)\n[![Slack](https://img.shields.io/badge/slack-join-green?logo=slack)](https://communityinviter.com/apps/aiqualityforum/josh)\n[![Docs](https://img.shields.io/badge/docs-trulens.org-blue)](https://www.trulens.org/getting_started/)\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/langchain_quickstart.ipynb)\n\n# \ud83e\udd91 Welcome to TruLens!\n\n![TruLens](https://www.trulens.org/assets/images/Neural_Network_Explainability.png)\n\n**Don't just vibe-check your llm app!** Systematically evaluate and track your\nLLM experiments with TruLens. As you develop your app including prompts, models,\nretrievers, knowledge sources and more, *TruLens* is the tool you need to\nunderstand its performance.\n\nFine-grained, stack-agnostic instrumentation and comprehensive evaluations help\nyou to identify failure modes & systematically iterate to improve your\napplication.\n\nRead more about the core concepts behind TruLens including [Feedback Functions](https://www.trulens.org/getting_started/core_concepts/feedback_functions/),\n[The RAG Triad](https://www.trulens.org/getting_started/core_concepts/rag_triad/),\nand [Honest, Harmless and Helpful Evals](https://www.trulens.org/getting_started/core_concepts/honest_harmless_helpful_evals/).\n\n## TruLens in the development workflow\n\nBuild your first prototype then connect instrumentation and logging with\nTruLens. Decide what feedbacks you need, and specify them with TruLens to run\nalongside your app. Then iterate and compare versions of your app in an\neasy-to-use user interface \ud83d\udc47\n\n![Architecture\nDiagram](https://www.trulens.org/assets/images/TruLens_Architecture.png)\n\n## Installation and Setup\n\nInstall the trulens pip package from PyPI.\n\n```bash\n pip install trulens\n```\n\n## Quick Usage\n\nWalk through how to instrument and evaluate a RAG built from scratch with\nTruLens.\n\n[![Open In\nColab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/main/examples/quickstart/quickstart.ipynb)\n\n### \ud83d\udca1 Contributing & Community\n\nInterested in contributing? See our [contributing\nguide](https://www.trulens.org/trulens/contributing/) for more details.\n\nThe best way to support TruLens is to give us a \u2b50 on\n[GitHub](https://www.github.com/truera/trulens) and join our [slack\ncommunity](https://communityinviter.com/apps/aiqualityforum/josh)!\n\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Library to systematically track and evaluate LLM based applications.",
"version": "1.2.7",
"project_urls": {
"Documentation": "https://trulens.org/getting_started/",
"Homepage": "https://trulens.org/",
"Repository": "https://github.com/truera/trulens"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "64f45a81ddeb43593e783242f01ee722c575644b817c19071a4b70f21c531c99",
"md5": "934dfa3cb232d0545f77e25735fb536f",
"sha256": "4875e84720a6a80a3d05d565bb1c50a1664fd4e6f37761ea1a7d4eb73f8c914a"
},
"downloads": -1,
"filename": "trulens-1.2.7-py3-none-any.whl",
"has_sig": false,
"md5_digest": "934dfa3cb232d0545f77e25735fb536f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,>=3.8",
"size": 3627,
"upload_time": "2024-11-14T22:33:58",
"upload_time_iso_8601": "2024-11-14T22:33:58.451908Z",
"url": "https://files.pythonhosted.org/packages/64/f4/5a81ddeb43593e783242f01ee722c575644b817c19071a4b70f21c531c99/trulens-1.2.7-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2f80c956b024101834da2d1b9a4cbee632651510b399337911c22d12a532cc09",
"md5": "5074cad553db15326da6616a7b868037",
"sha256": "81a2df8330e027b3c78cab883e8691b46b87fbe3d614544f7f3338bec066f862"
},
"downloads": -1,
"filename": "trulens-1.2.7.tar.gz",
"has_sig": false,
"md5_digest": "5074cad553db15326da6616a7b868037",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "!=2.7.*,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,!=3.5.*,!=3.6.*,!=3.7.*,>=3.8",
"size": 3990,
"upload_time": "2024-11-14T22:34:20",
"upload_time_iso_8601": "2024-11-14T22:34:20.306263Z",
"url": "https://files.pythonhosted.org/packages/2f/80/c956b024101834da2d1b9a4cbee632651510b399337911c22d12a532cc09/trulens-1.2.7.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-11-14 22:34:20",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "truera",
"github_project": "trulens",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "trulens"
}