mt-thresholds

Name	mt-thresholds JSON
Version	1.0.2 JSON
	download
home_page	None
Summary	Tool to check how metric deltas for machine translation reflect on system-level human accuracies.
upload_time	2024-08-19 13:24:59
maintainer	None
docs_url	None
author	None
requires_python	>=3.9
license	None
keywords	machine-translation evaluation
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # MT-Thresholds

Local version of the [online tool](https://kocmitom.github.io/MT-Thresholds). Use either from the command-line:
```bash
# accuracy is 63.989%
mt-thresholds bleu 1.00

# ChrF needs 0.710 difference for the same accuracy as BLEU
mt-thresholds chrf 0.63989 --delta
```

Or it can be used from Python:
```python3
import mt_thresholds

mt_thresholds.accuracy(1.0, "bleu") # 0.63989
mt_thresholds.delta(0.63989, "chrf") # 0.665
```


<!-- 
Notes for maintainers:

cd python-tool
pip install build twine

python3 -m build

twine check dist/*

# first tets
twine upload -r testpypi dist/*

# live
twine upload dist/* -u __token__
# user __token__ as username and the API token generated online
-->

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "mt-thresholds",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": null,
    "keywords": "machine-translation, evaluation",
    "author": null,
    "author_email": "Tom Kocmi <tomkocmi@microsoft.com>, Vil\u00e9m Zouhar <vzouhar@ethz.ch>",
    "download_url": "https://files.pythonhosted.org/packages/ba/37/ab555242042cae9659e3ffe4ff2fc239fed7411d03e8676cd6e0f3deaa83/mt_thresholds-1.0.2.tar.gz",
    "platform": null,
    "description": "# MT-Thresholds\n\nLocal version of the [online tool](https://kocmitom.github.io/MT-Thresholds). Use either from the command-line:\n```bash\n# accuracy is 63.989%\nmt-thresholds bleu 1.00\n\n# ChrF needs 0.710 difference for the same accuracy as BLEU\nmt-thresholds chrf 0.63989 --delta\n```\n\nOr it can be used from Python:\n```python3\nimport mt_thresholds\n\nmt_thresholds.accuracy(1.0, \"bleu\") # 0.63989\nmt_thresholds.delta(0.63989, \"chrf\") # 0.665\n```\n\n\n<!-- \nNotes for maintainers:\n\ncd python-tool\npip install build twine\n\npython3 -m build\n\ntwine check dist/*\n\n# first tets\ntwine upload -r testpypi dist/*\n\n# live\ntwine upload dist/* -u __token__\n# user __token__ as username and the API token generated online\n-->\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Tool to check how metric deltas for machine translation reflect on system-level human accuracies.",
    "version": "1.0.2",
    "project_urls": {
        "Demo": "https://kocmitom.github.io/MT-Thresholds",
        "Homepage": "https://github.com/kocmitom/MT-Thresholds"
    },
    "split_keywords": [
        "machine-translation",
        " evaluation"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d99969b38a956d5f2062eeaefa9ce8aa8b82331591b36f34afbeaecfa233acf1",
                "md5": "843d409549d4ce9e10a8bf0843ea2517",
                "sha256": "ef9079dfca1176deb6fbac41f522d4e13b50cfc017c1f0e451b13f9ba79388cc"
            },
            "downloads": -1,
            "filename": "mt_thresholds-1.0.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "843d409549d4ce9e10a8bf0843ea2517",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 3437,
            "upload_time": "2024-08-19T13:24:57",
            "upload_time_iso_8601": "2024-08-19T13:24:57.998074Z",
            "url": "https://files.pythonhosted.org/packages/d9/99/69b38a956d5f2062eeaefa9ce8aa8b82331591b36f34afbeaecfa233acf1/mt_thresholds-1.0.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ba37ab555242042cae9659e3ffe4ff2fc239fed7411d03e8676cd6e0f3deaa83",
                "md5": "1178aec6352a36ebd07a3876d74f54fc",
                "sha256": "abb46e04f8d12b077a06f49fb312621e9c77172ec74b56399826703851b554a2"
            },
            "downloads": -1,
            "filename": "mt_thresholds-1.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "1178aec6352a36ebd07a3876d74f54fc",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 3100,
            "upload_time": "2024-08-19T13:24:59",
            "upload_time_iso_8601": "2024-08-19T13:24:59.453558Z",
            "url": "https://files.pythonhosted.org/packages/ba/37/ab555242042cae9659e3ffe4ff2fc239fed7411d03e8676cd6e0f3deaa83/mt_thresholds-1.0.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-08-19 13:24:59",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "kocmitom",
    "github_project": "MT-Thresholds",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "mt-thresholds"
}