startbenchmark


Namestartbenchmark JSON
Version 0.0.11 PyPI version JSON
download
home_page
SummaryBenchmarking the performance of agents far and wide, regardless of how they are set up and how they work
upload_time2024-01-12 17:27:15
maintainer
docs_urlNone
authorMd Sulaiman
requires_python>=3.10,<4.0
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Start-GPT Benchmarks

Built for the purpose of benchmarking the performance of agents regardless of how they work.

Objectively know how well your agent is performing in categories like code, retrieval, memory, and safety.

Save time and money while doing it through smart dependencies. The best part? It's all automated.

## Scores:

<img width="733" alt="Screenshot 2023-07-25 at 10 35 01 AM" src="https://github.com/KhulnaSoft/Start-GPT-Benchmarks/assets/9652976/98963e0b-18b9-4b17-9a6a-4d3e4418af70">

## Ranking overall:

- 1- [Beebot](https://github.com/AutoPackAI/beebot)
- 2- [mini-agi](https://github.com/muellerberndt/mini-agi)
- 3- [Start-GPT](https://github.com/KhulnaSoft/StartGPT)

## Detailed results:

<img width="733" alt="Screenshot 2023-07-25 at 10 42 15 AM" src="https://github.com/KhulnaSoft/Start-GPT-Benchmarks/assets/9652976/39be464c-c842-4437-b28a-07d878542a83">

[Click here to see the results and the raw data!](https://docs.google.com/spreadsheets/d/1WXm16P2AHNbKpkOI0LYBpcsGG0O7D8HYTG5Uj0PaJjA/edit#gid=203558751)!

More agents coming soon !

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "startbenchmark",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.10,<4.0",
    "maintainer_email": "",
    "keywords": "",
    "author": "Md Sulaiman",
    "author_email": "infosulaimanbd@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/94/8d/14a2d9769ee5884affcd57a2fb718b2b078de2067bbbb3980edaac4171dd/startbenchmark-0.0.11.tar.gz",
    "platform": null,
    "description": "# Start-GPT Benchmarks\n\nBuilt for the purpose of benchmarking the performance of agents regardless of how they work.\n\nObjectively know how well your agent is performing in categories like code, retrieval, memory, and safety.\n\nSave time and money while doing it through smart dependencies. The best part? It's all automated.\n\n## Scores:\n\n<img width=\"733\" alt=\"Screenshot 2023-07-25 at 10 35 01 AM\" src=\"https://github.com/KhulnaSoft/Start-GPT-Benchmarks/assets/9652976/98963e0b-18b9-4b17-9a6a-4d3e4418af70\">\n\n## Ranking overall:\n\n- 1- [Beebot](https://github.com/AutoPackAI/beebot)\n- 2- [mini-agi](https://github.com/muellerberndt/mini-agi)\n- 3- [Start-GPT](https://github.com/KhulnaSoft/StartGPT)\n\n## Detailed results:\n\n<img width=\"733\" alt=\"Screenshot 2023-07-25 at 10 42 15 AM\" src=\"https://github.com/KhulnaSoft/Start-GPT-Benchmarks/assets/9652976/39be464c-c842-4437-b28a-07d878542a83\">\n\n[Click here to see the results and the raw data!](https://docs.google.com/spreadsheets/d/1WXm16P2AHNbKpkOI0LYBpcsGG0O7D8HYTG5Uj0PaJjA/edit#gid=203558751)!\n\nMore agents coming soon !\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Benchmarking the performance of agents far and wide, regardless of how they are set up and how they work",
    "version": "0.0.11",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "60cf8776d2dea9dab1b630513a299e0476131579320c3d512623034e1474aa9f",
                "md5": "cbc8f5aa494e9ef7fc207efedb48993f",
                "sha256": "9cee587b5dff2ae8249826eefdbf8aca079d71b766d67c31d0d9d468578c5fd6"
            },
            "downloads": -1,
            "filename": "startbenchmark-0.0.11-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "cbc8f5aa494e9ef7fc207efedb48993f",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10,<4.0",
            "size": 199529,
            "upload_time": "2024-01-12T17:27:13",
            "upload_time_iso_8601": "2024-01-12T17:27:13.722343Z",
            "url": "https://files.pythonhosted.org/packages/60/cf/8776d2dea9dab1b630513a299e0476131579320c3d512623034e1474aa9f/startbenchmark-0.0.11-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "948d14a2d9769ee5884affcd57a2fb718b2b078de2067bbbb3980edaac4171dd",
                "md5": "2ae860f69f384b0e7d2c76ed1a12a21a",
                "sha256": "225e6f52bb6455d4be3c1adda17e2b5dad0f1b7f241bda95c0e5c23c6a0dd85d"
            },
            "downloads": -1,
            "filename": "startbenchmark-0.0.11.tar.gz",
            "has_sig": false,
            "md5_digest": "2ae860f69f384b0e7d2c76ed1a12a21a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10,<4.0",
            "size": 93577,
            "upload_time": "2024-01-12T17:27:15",
            "upload_time_iso_8601": "2024-01-12T17:27:15.378103Z",
            "url": "https://files.pythonhosted.org/packages/94/8d/14a2d9769ee5884affcd57a2fb718b2b078de2067bbbb3980edaac4171dd/startbenchmark-0.0.11.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-01-12 17:27:15",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "startbenchmark"
}
        
Elapsed time: 0.34289s