tratreetra


Nametratreetra JSON
Version 0.1 PyPI version JSON
download
home_pagehttps://github.com/alexeyev/tratreetra
SummarySyntactic transfer from more resourced languages: TRAnslating TREEbanks for Syntactic TRAnsfer.
upload_time2024-12-17 16:20:21
maintainerNone
docs_urlNone
authorAnton Alekseev, Alina Tillabaeva
requires_python>=3.11
licenseNone
keywords natural language processing less-resourced languages syntax universal dependencies
VCS
bugtrack_url
requirements scipy conllu sacrebleu
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Simple Syntactic Transfer Based on the Treebank Translation Method

## Intended use 

Given 
* the sentence in the language of interest (LRL, e.g. Kyrgyz),
* the translation of the sentence to the more resourced language (e.g. Turkish),
* the dependency parser (UD) for the more resourced language (e.g. Stanza-UD_BOUN-BERT),
* the alignment model of your liking (source language should be the language of interest),
* the morphological analyzer including PoS tags (Universal Tagset) for the language of interest (e.g. `apertium-kir`; note that it must not modify the tokenization),

generate a dependency tree for the sentence in the target language.

Clearly, it's far from perfect, but may still be useful to speed up the manual treebank annotation. Please see the paper for more details.

## Example

We have provided some bindings to the popular libraries in [tratreetra/models.py](tratreetra/models.py); the appropriate
versions of these libraries should be installed, please consult the respective docstrings.

The example code in [example/example.py](example/example.py) reproduces one of the results from the paper:

* `Stanza-IMST-charlm`
* `SimAlign-XLMR`
* `apertium-kir` (without morphological disambiguation)
* Translation via `ChatGPT4o`

Please see more details in the [example/README](example/README.md).

## How to cite

The paper is still in print, the preprint on arXiv will be made available soon.

Meanwhile, if you use our tool, we'll be grateful if you cite it as follows:

```bibtex
@article{atkn2025syntax,
    author = {Alekseev, Anton and Tillabaeva, Alina and Kabaeva, Gulnara Dzh. and Nikolenko, Sergey I.},
    title = {{Syntactic Transfer to Kyrgyz Using the Treebank Translation Method (in print)}},
    journal = {To appear in the Journal of Mathematical Sciences},
    publisher = {Springer},
    year = {2025}
}
```

## TODO 

* Thoughtful approach to data structures
* Profile the code
* Upload to pypi
* Tests
* Redesign logging here and in apertium2ud

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/alexeyev/tratreetra",
    "name": "tratreetra",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.11",
    "maintainer_email": null,
    "keywords": "natural language processing, less-resourced languages, syntax, universal dependencies",
    "author": "Anton Alekseev, Alina Tillabaeva",
    "author_email": "anton.m.alexeyev+kyrgyz@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/b6/a7/c8db1987c6491cf7d193a60226c3d33ef33eae585596f8722c084e599376/tratreetra-0.1.tar.gz",
    "platform": null,
    "description": "# Simple Syntactic Transfer Based on the Treebank Translation Method\n\n## Intended use \n\nGiven \n* the sentence in the language of interest (LRL, e.g. Kyrgyz),\n* the translation of the sentence to the more resourced language (e.g. Turkish),\n* the dependency parser (UD) for the more resourced language (e.g. Stanza-UD_BOUN-BERT),\n* the alignment model of your liking (source language should be the language of interest),\n* the morphological analyzer including PoS tags (Universal Tagset) for the language of interest (e.g. `apertium-kir`; note that it must not modify the tokenization),\n\ngenerate a dependency tree for the sentence in the target language.\n\nClearly, it's far from perfect, but may still be useful to speed up the manual treebank annotation. Please see the paper for more details.\n\n## Example\n\nWe have provided some bindings to the popular libraries in [tratreetra/models.py](tratreetra/models.py); the appropriate\nversions of these libraries should be installed, please consult the respective docstrings.\n\nThe example code in [example/example.py](example/example.py) reproduces one of the results from the paper:\n\n* `Stanza-IMST-charlm`\n* `SimAlign-XLMR`\n* `apertium-kir` (without morphological disambiguation)\n* Translation via `ChatGPT4o`\n\nPlease see more details in the [example/README](example/README.md).\n\n## How to cite\n\nThe paper is still in print, the preprint on arXiv will be made available soon.\n\nMeanwhile, if you use our tool, we'll be grateful if you cite it as follows:\n\n```bibtex\n@article{atkn2025syntax,\n    author = {Alekseev, Anton and Tillabaeva, Alina and Kabaeva, Gulnara Dzh. and Nikolenko, Sergey I.},\n    title = {{Syntactic Transfer to Kyrgyz Using the Treebank Translation Method (in print)}},\n    journal = {To appear in the Journal of Mathematical Sciences},\n    publisher = {Springer},\n    year = {2025}\n}\n```\n\n## TODO \n\n* Thoughtful approach to data structures\n* Profile the code\n* Upload to pypi\n* Tests\n* Redesign logging here and in apertium2ud\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Syntactic transfer from more resourced languages: TRAnslating TREEbanks for Syntactic TRAnsfer.",
    "version": "0.1",
    "project_urls": {
        "Homepage": "https://github.com/alexeyev/tratreetra"
    },
    "split_keywords": [
        "natural language processing",
        " less-resourced languages",
        " syntax",
        " universal dependencies"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d9fecbaa17c41c6471f9a3183ea898362ffa349a9c287dc3dac6a84a39124ce6",
                "md5": "0598ad99da9c4de5542c0e5ccf83101f",
                "sha256": "629d32be7a2cd3e46101e4d5110f58477fb46f11ba9d5e93499cdeeb67234340"
            },
            "downloads": -1,
            "filename": "tratreetra-0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "0598ad99da9c4de5542c0e5ccf83101f",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.11",
            "size": 24708,
            "upload_time": "2024-12-17T16:20:20",
            "upload_time_iso_8601": "2024-12-17T16:20:20.029648Z",
            "url": "https://files.pythonhosted.org/packages/d9/fe/cbaa17c41c6471f9a3183ea898362ffa349a9c287dc3dac6a84a39124ce6/tratreetra-0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b6a7c8db1987c6491cf7d193a60226c3d33ef33eae585596f8722c084e599376",
                "md5": "7c849b4c793042a8ee865bbca80c4f64",
                "sha256": "9ab6090bb064eafb9eaf051e6907cc554144291b1153143fc1b06a222e68fa46"
            },
            "downloads": -1,
            "filename": "tratreetra-0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "7c849b4c793042a8ee865bbca80c4f64",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.11",
            "size": 11385,
            "upload_time": "2024-12-17T16:20:21",
            "upload_time_iso_8601": "2024-12-17T16:20:21.871526Z",
            "url": "https://files.pythonhosted.org/packages/b6/a7/c8db1987c6491cf7d193a60226c3d33ef33eae585596f8722c084e599376/tratreetra-0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-12-17 16:20:21",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "alexeyev",
    "github_project": "tratreetra",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "requirements": [
        {
            "name": "scipy",
            "specs": [
                [
                    ">=",
                    "1.14.1"
                ]
            ]
        },
        {
            "name": "conllu",
            "specs": [
                [
                    ">=",
                    "6.0.0"
                ]
            ]
        },
        {
            "name": "sacrebleu",
            "specs": [
                [
                    ">=",
                    "2.4.3"
                ]
            ]
        }
    ],
    "lcname": "tratreetra"
}
        
Elapsed time: 0.45164s