evaluateqa

Name	evaluateqa JSON
Version	0.1.3 JSON
	download
home_page	https://github.com/MihailSalnikov/EvaluateQA
Summary
upload_time	2023-07-13 15:43:42
maintainer
docs_url	None
author	Mikhail Salnikov
requires_python	>=3.8,<4.0
license	MIT
keywords	qa kgqa odqa evaluate
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            [![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)

# EvaluateQA

Package for evaluate QA datasets and Leaderboard with SOTA approaches

## Install

```bash
pip install evaluateqa
```

## Supported datasets


### [Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering](https://github.com/amazon-science/mintaka)

```python
from evaluateqa.mintaka import evaluate

predictions = {
    '9ace9041': 'Q90',
    '9ace9042': 3,
    ...
}

results = evaluate(
    predictions,
    split='test',
    mode='kg',
    lang='en',
)
```




            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/MihailSalnikov/EvaluateQA",
    "name": "evaluateqa",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.8,<4.0",
    "maintainer_email": "",
    "keywords": "QA,KGQA,ODQA,Evaluate",
    "author": "Mikhail Salnikov",
    "author_email": "2613180+MihailSalnikov@users.noreply.github.com",
    "download_url": "https://files.pythonhosted.org/packages/7b/b2/95ab77c4956c7d170f4fdae0d3fb2c1cd6b74b92b6771751d146c20665a8/evaluateqa-0.1.3.tar.gz",
    "platform": null,
    "description": "[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n\n# EvaluateQA\n\nPackage for evaluate QA datasets and Leaderboard with SOTA approaches\n\n## Install\n\n```bash\npip install evaluateqa\n```\n\n## Supported datasets\n\n\n### [Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering](https://github.com/amazon-science/mintaka)\n\n```python\nfrom evaluateqa.mintaka import evaluate\n\npredictions = {\n    '9ace9041': 'Q90',\n    '9ace9042': 3,\n    ...\n}\n\nresults = evaluate(\n    predictions,\n    split='test',\n    mode='kg',\n    lang='en',\n)\n```\n\n\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "",
    "version": "0.1.3",
    "project_urls": {
        "Homepage": "https://github.com/MihailSalnikov/EvaluateQA",
        "Repository": "https://github.com/MihailSalnikov/EvaluateQA"
    },
    "split_keywords": [
        "qa",
        "kgqa",
        "odqa",
        "evaluate"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "497643351edae9660350e7ab6bcb8ed57a5413432ff08cc78191218e238a6297",
                "md5": "31ded66838a1108b0d10ec79371fd816",
                "sha256": "64bf48c4ef82a965c04f7e28bfde8927674a7c191b97d813953e1a89d4ace477"
            },
            "downloads": -1,
            "filename": "evaluateqa-0.1.3-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "31ded66838a1108b0d10ec79371fd816",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8,<4.0",
            "size": 6099,
            "upload_time": "2023-07-13T15:43:41",
            "upload_time_iso_8601": "2023-07-13T15:43:41.512791Z",
            "url": "https://files.pythonhosted.org/packages/49/76/43351edae9660350e7ab6bcb8ed57a5413432ff08cc78191218e238a6297/evaluateqa-0.1.3-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7bb295ab77c4956c7d170f4fdae0d3fb2c1cd6b74b92b6771751d146c20665a8",
                "md5": "5a9fa8a387c38301f6651d4035ca317e",
                "sha256": "8013f685cbd568ca6861bff243f89e34481deda022a57bd09f189e63ae4072e1"
            },
            "downloads": -1,
            "filename": "evaluateqa-0.1.3.tar.gz",
            "has_sig": false,
            "md5_digest": "5a9fa8a387c38301f6651d4035ca317e",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8,<4.0",
            "size": 5244,
            "upload_time": "2023-07-13T15:43:42",
            "upload_time_iso_8601": "2023-07-13T15:43:42.879447Z",
            "url": "https://files.pythonhosted.org/packages/7b/b2/95ab77c4956c7d170f4fdae0d3fb2c1cd6b74b92b6771751d146c20665a8/evaluateqa-0.1.3.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-07-13 15:43:42",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "MihailSalnikov",
    "github_project": "EvaluateQA",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "evaluateqa"
}