Name | pyevaltool JSON |
Version |
0.1.7
JSON |
| download |
home_page | |
Summary | A package to evaluate the models. |
upload_time | 2024-02-12 12:23:10 |
maintainer | |
docs_url | None |
author | |
requires_python | >=3.8 |
license | |
keywords |
testing
evaluate
model
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# pycvtools
[![forthebadge made-with-python](http://ForTheBadge.com/images/badges/made-with-python.svg)](https://www.python.org/)
[![Python 3.10](https://img.shields.io/badge/python-3.10-blue.svg)](https://www.python.org/downloads/)
## Functionality of the pyevaltool
- Automated testing of the bot response deployed gpt
```
pip install pyevaltool
```
#### To run
```
from pyevaltool import *
```
#### For GPT test -
```
url = '' # Add the frontend url
token = '' # add your token or key - Apim-Subscription-Key or Bearer token
# change the chat completion format if required.
# This code will work only if the question asked is at chat_completion_format['messages'][0]["content"]
chat_completion_format = {'chatId': '', 'siteInfo': {'domain': ''}, 'messages': [{'role': 'user', 'content': ''}], 'model': '', 'stream': False}
answer_loc = "['choices'][0]['messages'][0]['content']" #in string format
input_file = " " # Here you add your input file link
gpt_test(url,token,chat_completion_format,answer_loc,input_file,output_file = "output.csv" )
```
Raw data
{
"_id": null,
"home_page": "",
"name": "pyevaltool",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "testing,evaluate,model",
"author": "",
"author_email": "Ateendra Jha <ajha@phaf.in>",
"download_url": "https://files.pythonhosted.org/packages/25/78/b5c0fcebc60d49d28ae1edb866b0d98f41a02569191ae1629798bab59f14/pyevaltool-0.1.7.tar.gz",
"platform": null,
"description": "# pycvtools\r\n\r\n[![forthebadge made-with-python](http://ForTheBadge.com/images/badges/made-with-python.svg)](https://www.python.org/) \r\n[![Python 3.10](https://img.shields.io/badge/python-3.10-blue.svg)](https://www.python.org/downloads/) \r\n\r\n## Functionality of the pyevaltool\r\n\r\n- Automated testing of the bot response deployed gpt\r\n\r\n\r\n```\r\npip install pyevaltool\r\n```\r\n#### To run\r\n```\r\nfrom pyevaltool import *\r\n```\r\n#### For GPT test -\r\n```\r\nurl = '' # Add the frontend url \r\ntoken = '' # add your token or key - Apim-Subscription-Key or Bearer token\r\n# change the chat completion format if required. \r\n# This code will work only if the question asked is at chat_completion_format['messages'][0][\"content\"]\r\nchat_completion_format = {'chatId': '', 'siteInfo': {'domain': ''}, 'messages': [{'role': 'user', 'content': ''}], 'model': '', 'stream': False} \r\nanswer_loc = \"['choices'][0]['messages'][0]['content']\" #in string format\r\ninput_file = \" \" # Here you add your input file link\r\ngpt_test(url,token,chat_completion_format,answer_loc,input_file,output_file = \"output.csv\" )\r\n```\r\n\r\n\r\n",
"bugtrack_url": null,
"license": "",
"summary": "A package to evaluate the models.",
"version": "0.1.7",
"project_urls": {
"Homepage": "https://www.drateendrajha.com/projects/pyevaltool",
"Issues": "https://www.drateendrajha.com/projects/pyevaltool"
},
"split_keywords": [
"testing",
"evaluate",
"model"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "301a37fa68756f530e762a87108e2dff9c2eac8f7d1db37130fef9769f518a7a",
"md5": "8238f00bdf6c18e094b5d9f7d17f2cc2",
"sha256": "832f51bcbad4c2bc9db19ffc3c81933bd033d77cf3aa5e92508ba5f73f809d86"
},
"downloads": -1,
"filename": "pyevaltool-0.1.7-py3-none-any.whl",
"has_sig": false,
"md5_digest": "8238f00bdf6c18e094b5d9f7d17f2cc2",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 3880,
"upload_time": "2024-02-12T12:23:08",
"upload_time_iso_8601": "2024-02-12T12:23:08.531583Z",
"url": "https://files.pythonhosted.org/packages/30/1a/37fa68756f530e762a87108e2dff9c2eac8f7d1db37130fef9769f518a7a/pyevaltool-0.1.7-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2578b5c0fcebc60d49d28ae1edb866b0d98f41a02569191ae1629798bab59f14",
"md5": "436ef862c1e24ecca0eb45467201ccde",
"sha256": "ff564c9b753462dd4afa42d8891f8b8628bc1453e77e11e3db8f6c1ce49df8aa"
},
"downloads": -1,
"filename": "pyevaltool-0.1.7.tar.gz",
"has_sig": false,
"md5_digest": "436ef862c1e24ecca0eb45467201ccde",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 3568,
"upload_time": "2024-02-12T12:23:10",
"upload_time_iso_8601": "2024-02-12T12:23:10.288864Z",
"url": "https://files.pythonhosted.org/packages/25/78/b5c0fcebc60d49d28ae1edb866b0d98f41a02569191ae1629798bab59f14/pyevaltool-0.1.7.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-12 12:23:10",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "pyevaltool"
}