mt-thresholds

Name	mt-thresholds JSON
Version	0.0.4 JSON
	download
home_page
Summary	Tool to check how metric deltas for machine translation reflect on system-level human accuracies.
upload_time	2024-02-12 20:40:24
maintainer
docs_url	None
author
requires_python	>=3.9
license
keywords	machine-translation evaluation
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # MT-Thresholds

Local version of the [online tool](https://kocmitom.github.io/MT-Thresholds). Use either from the command-line:
```bash
# accuracy is 63.989%
mt-thresholds bleu 1.00

# ChrF needs 0.710 difference for the same accuracy as BLEU
mt-thresholds chrf 0.63989 --delta
```

Or it can be used from Python:
```python3
import mt_thresholds

mt_thresholds.accuracy(1.0, "bleu") # 0.63989
mt_thresholds.delta(0.63989, "chrf") # 0.665
```


<!-- 
Notes for maintainers:

cd python-tool
# older version is required
pip install 'build<0.10.0' twine
python3 -m build
twine check dist/*
# first tets
twine upload -r testpypi dist/*
# live
twine upload dist/*
# user __token__ as username and the API token generated online
-->

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "mt-thresholds",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": "",
    "keywords": "machine-translation,evaluation",
    "author": "",
    "author_email": "Tom Kocmi <tomkocmi@microsoft.com>, Vil\u00e9m Zouhar <vzouhar@ethz.ch>",
    "download_url": "https://files.pythonhosted.org/packages/12/d1/99c5ff7c95578d0f739b3cf12ac2c0665d8069ee8a1f41b0d062d8226b7f/mt-thresholds-0.0.4.tar.gz",
    "platform": null,
    "description": "# MT-Thresholds\n\nLocal version of the [online tool](https://kocmitom.github.io/MT-Thresholds). Use either from the command-line:\n```bash\n# accuracy is 63.989%\nmt-thresholds bleu 1.00\n\n# ChrF needs 0.710 difference for the same accuracy as BLEU\nmt-thresholds chrf 0.63989 --delta\n```\n\nOr it can be used from Python:\n```python3\nimport mt_thresholds\n\nmt_thresholds.accuracy(1.0, \"bleu\") # 0.63989\nmt_thresholds.delta(0.63989, \"chrf\") # 0.665\n```\n\n\n<!-- \nNotes for maintainers:\n\ncd python-tool\n# older version is required\npip install 'build<0.10.0' twine\npython3 -m build\ntwine check dist/*\n# first tets\ntwine upload -r testpypi dist/*\n# live\ntwine upload dist/*\n# user __token__ as username and the API token generated online\n-->\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "Tool to check how metric deltas for machine translation reflect on system-level human accuracies.",
    "version": "0.0.4",
    "project_urls": {
        "Demo": "https://kocmitom.github.io/MT-Thresholds",
        "Homepage": "https://github.com/kocmitom/MT-Thresholds"
    },
    "split_keywords": [
        "machine-translation",
        "evaluation"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0eafd28b0b3bc66cc64a3d025694af32abed042607a8b73c05b0b819891fe38d",
                "md5": "903035161f3e6df1fd2fb78b6dbeb2fb",
                "sha256": "2b15f526c7c4707cf6ba24aa28f73c0d2eeb273d12c34d540bd23af1d748baf7"
            },
            "downloads": -1,
            "filename": "mt_thresholds-0.0.4-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "903035161f3e6df1fd2fb78b6dbeb2fb",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 3136,
            "upload_time": "2024-02-12T20:40:22",
            "upload_time_iso_8601": "2024-02-12T20:40:22.605842Z",
            "url": "https://files.pythonhosted.org/packages/0e/af/d28b0b3bc66cc64a3d025694af32abed042607a8b73c05b0b819891fe38d/mt_thresholds-0.0.4-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "12d199c5ff7c95578d0f739b3cf12ac2c0665d8069ee8a1f41b0d062d8226b7f",
                "md5": "901ad65243269600cf7ed8d3cf6ca193",
                "sha256": "456446500d2067c429f94781bb956ac7c310c12b1b79d9c2659c2810efcbd3f4"
            },
            "downloads": -1,
            "filename": "mt-thresholds-0.0.4.tar.gz",
            "has_sig": false,
            "md5_digest": "901ad65243269600cf7ed8d3cf6ca193",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 2737,
            "upload_time": "2024-02-12T20:40:24",
            "upload_time_iso_8601": "2024-02-12T20:40:24.408271Z",
            "url": "https://files.pythonhosted.org/packages/12/d1/99c5ff7c95578d0f739b3cf12ac2c0665d8069ee8a1f41b0d062d8226b7f/mt-thresholds-0.0.4.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-02-12 20:40:24",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "kocmitom",
    "github_project": "MT-Thresholds",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "mt-thresholds"
}