cedarverse-bda

Name	cedarverse-bda JSON
Version	0.0.1 JSON
	download
home_page	None
Summary	Interactive dashboard tool for analyzing differences between Aider benchmark runs
upload_time	2024-12-18 19:52:50
maintainer	None
docs_url	None
author	None
requires_python	>=3.12
license	Apache-2.0
keywords	benchmark testing analysis visualization dashboard comparison aider
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # BDA - Benchmark Delta Analysis Tool

A Python tool for analyzing and visualizing differences between two Aider benchmark runs through an interactive dashboard.

## Features

- Compares two benchmark run folders (raw or tar-bz2 archives)
- Interactive web dashboard built with Dash
- Detailed test-by-test comparison analysis
- Visualizes performance changes and differences

## Dashboard Features
- Test result comparison
- Performance metrics visualization
- Interactive data filtering and sorting
- Detailed test case analysis

![img.png](img.png)

![img_1.png](img_1.png)

![img_2.png](img_2.png)

![img_3.png](img_3.png)

## Installation

```bash
pipx install cedarverse-bda
```

## Usage

```bash
# Info on a single benchmark run
bda <run-path>

# Delta Analysis
bda <run1-path> <run2-path>

# Interactive dashboard
bda --dashboard <run-path>

```

## Development


```bash
# Install development dependencies
pip install -e .[dev]
```

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "cedarverse-bda",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.12",
    "maintainer_email": null,
    "keywords": "benchmark, testing, analysis, visualization, dashboard, comparison, aider",
    "author": null,
    "author_email": "Elifarley <elifarley@cedarverse.com>",
    "download_url": "https://files.pythonhosted.org/packages/f0/63/165bdca553df5b7d7b12284bb123d2af28f60db5ede1afb078c7cd664337/cedarverse_bda-0.0.1.tar.gz",
    "platform": null,
    "description": "# BDA - Benchmark Delta Analysis Tool\n\nA Python tool for analyzing and visualizing differences between two Aider benchmark runs through an interactive dashboard.\n\n## Features\n\n- Compares two benchmark run folders (raw or tar-bz2 archives)\n- Interactive web dashboard built with Dash\n- Detailed test-by-test comparison analysis\n- Visualizes performance changes and differences\n\n## Dashboard Features\n- Test result comparison\n- Performance metrics visualization\n- Interactive data filtering and sorting\n- Detailed test case analysis\n\n![img.png](img.png)\n\n![img_1.png](img_1.png)\n\n![img_2.png](img_2.png)\n\n![img_3.png](img_3.png)\n\n## Installation\n\n```bash\npipx install cedarverse-bda\n```\n\n## Usage\n\n```bash\n# Info on a single benchmark run\nbda <run-path>\n\n# Delta Analysis\nbda <run1-path> <run2-path>\n\n# Interactive dashboard\nbda --dashboard <run-path>\n\n```\n\n## Development\n\n\n```bash\n# Install development dependencies\npip install -e .[dev]\n```\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Interactive dashboard tool for analyzing differences between Aider benchmark runs",
    "version": "0.0.1",
    "project_urls": {
        "Bug Tracker": "https://github.com/cedarverse/benchmark-delta-analysis/issues",
        "Documentation": "https://github.com/cedarverse/benchmark-delta-analysis#readme",
        "Homepage": "https://github.com/cedarverse/benchmark-delta-analysis",
        "Repository": "https://github.com/cedarverse/benchmark-delta-analysis.git"
    },
    "split_keywords": [
        "benchmark",
        " testing",
        " analysis",
        " visualization",
        " dashboard",
        " comparison",
        " aider"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3b13ab021da5ffc50b43f763948236874d620bb6badf8460027e33a56f2a3969",
                "md5": "8ef76ddbcbcbbce6f3ccb80fee33a5d1",
                "sha256": "feefc238036ff2eafd1cec1659d2e0e6bf55f9471895006e0d4259f204058729"
            },
            "downloads": -1,
            "filename": "cedarverse_bda-0.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "8ef76ddbcbcbbce6f3ccb80fee33a5d1",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.12",
            "size": 24416,
            "upload_time": "2024-12-18T19:52:47",
            "upload_time_iso_8601": "2024-12-18T19:52:47.644278Z",
            "url": "https://files.pythonhosted.org/packages/3b/13/ab021da5ffc50b43f763948236874d620bb6badf8460027e33a56f2a3969/cedarverse_bda-0.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "f063165bdca553df5b7d7b12284bb123d2af28f60db5ede1afb078c7cd664337",
                "md5": "c9874fc09e8ec91b38475d0f3f08778b",
                "sha256": "6f7944479c7e867a77535efb544e30ef2b025f3de32989600b0f3ab27d11d35e"
            },
            "downloads": -1,
            "filename": "cedarverse_bda-0.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "c9874fc09e8ec91b38475d0f3f08778b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.12",
            "size": 208017,
            "upload_time": "2024-12-18T19:52:50",
            "upload_time_iso_8601": "2024-12-18T19:52:50.360085Z",
            "url": "https://files.pythonhosted.org/packages/f0/63/165bdca553df5b7d7b12284bb123d2af28f60db5ede1afb078c7cd664337/cedarverse_bda-0.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-12-18 19:52:50",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "cedarverse",
    "github_project": "benchmark-delta-analysis",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "cedarverse-bda"
}