# jntajis-python
Documentation: https://jntajis-python.readthedocs.io/
## What's JNTAJIS-python?
JNTAJIS-python is a transliteration library, specifically designed for dealing with three different character sets; JIS X 0208, JIS X 0213, and Unicode.
```python
import jntajis
print(jntajis.mj_shrink_candidates("髙島屋", jntajis.MJShrinkSchemeCombo.JIS_INCORPORATION_UCS_UNIFICATION_RULE)) # outputs ["高島屋", "髙島屋"]
print(jntajis.jnta_shrink_translit("麴町")) # outputs "麹町"
```
To that end, this library refers to three different character tables; MJ character table, MJ shrink conversion map, and NTA shrink conversion map.
The MJ character table (*MJ文字一覧表*) defines a vast set of kanji (*漢字*) characters used in information processing of Japanese texts initially developed by Information-technology Promotion Agency.
The MJ shrink conversion map (*MJ縮退マップ*) was also developed alongside for the sake of interoperability between MJ-aware systems and systems based on Unicode, which is used to transliterate complex, less-frequently-used character variants to commonly-used, more-used ones.
The NTA shrink conversion map (*国税庁JIS縮退マップ*) was developed by Japan National Tax Agency to canonicalize user inputs for its corporation number search service provided as a public web API. This maps JIS level 3 and 4 characters to JIS level 1 and 2 characters (i.e. characters defined in JIS X 0208.) Note that not all level 3 and level 4 characters have level 1 and 2 counterparts. Also note that some of level 3 and 4 characters don't map to a single character one by each. Instead, they map to sequences of two or more characters.
The table below shows some examples of transliteration by the MJ character table suite and NTA shrink conversion map.
| Glyph | MJ code | Unicode | JIS X 0213 | Glyph\* | MJ code\* | JIS X 0208\* | Transliterator |
| ----- | ------- | ------- | ---------- | ------ | ------- | ---------- | -------------- |
|  | MJ014031 | U+68C3 | 2-14-90 |  | MJ014007 | 1-45-92 | MJ / JNTA |
|  | MJ030196 | U+FA11 | 1-47-82 |  | MJ010541 | 1-26-74 | MJ / JNTA |
|  | MJ028902 | U+9AD9 | N/A |  | MJ028901 | 1-25-66 | MJ |
The conversion schematics is shown below:
* JNTA transliteration
As every JIS X 0213 characters maps to its Unicode counterpart, the conversion is done only with the single JNTA character mappings table.
* MJ transliteration
Transliteration is done in two phases:
1. Conversion from Unicode to MJ character mappings.
While not all characters in the MJ characters table map to Unicode, each MJ code has different shrink mappings. Because of this, the transliterator tries to convert Unicode codepoints to MJ codes first.
2. Transliteration by MJ shrink mappings.
The transliteration result as a string isn't necessarily single as some MJ codes have more than one transliteration candidate. This happens because a) a Unicode codepoint may map to multiple MJ codes and b) multiple transliteration schemes are designated to a single MJ code.
Relationship between Unicode, MJ character mappings, JIS X 0213, and JIS X 0208 can be depicted as follows:
## License
The source code except `src/jntajis/_jntajis.h` is published under the BSD 3-clause license.
`src/jntajis/_jntajis.h` contains the data from the following entities:
* JIS shrink conversion mappings (国税庁: JIS縮退マップ)
Publisher: National Tax Agency
Author: National Tax Agency
Source: https://www.houjin-bangou.nta.go.jp/download/
License: CC BY 4.0
* MJ character table (文字情報技術促進協議会: MJ文字一覧表)
Publisher: Character Information Technology Promotion Council (CITPC)
Author: Information-technology Promotion Agency (IPA)
Source: https://moji.or.jp/mojikiban/mjlist/
License: CC BY-SA 2.1 JP
* MJ shrink conversion mappings (文字情報技術促進協議会: MJ縮退マップ)
Publisher: Character Information Technology Promotion Council (CITPC)
Author: Information-technology Promotion Agency (IPA)
Source: https://moji.or.jp/mojikiban/map/
License: CC BY-SA 2.1 JP
Raw data
{
"_id": null,
"home_page": "https://github.com/opencollector/jntajis-python",
"name": "jntajis-python",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "Unicode,JIS,encoding,conversion,transliteration,Japanese",
"author": "Open Collector, inc.",
"author_email": "<info@opencollector.co.jp>",
"download_url": "https://files.pythonhosted.org/packages/96/65/d6b6a05ca1536fe237cc642ae6182fd2314c3fe7ec7734a0628306085880/jntajis-python-0.0.14.tar.gz",
"platform": null,
"description": "# jntajis-python\n\nDocumentation: https://jntajis-python.readthedocs.io/\n\n## What's JNTAJIS-python?\n\nJNTAJIS-python is a transliteration library, specifically designed for dealing with three different character sets; JIS X 0208, JIS X 0213, and Unicode.\n\n```python\nimport jntajis\n\nprint(jntajis.mj_shrink_candidates(\"\u9ad9\u5cf6\u5c4b\", jntajis.MJShrinkSchemeCombo.JIS_INCORPORATION_UCS_UNIFICATION_RULE)) # outputs [\"\u9ad8\u5cf6\u5c4b\", \"\u9ad9\u5cf6\u5c4b\"]\nprint(jntajis.jnta_shrink_translit(\"\u9eb4\u753a\")) # outputs \"\u9eb9\u753a\"\n```\n\nTo that end, this library refers to three different character tables; MJ character table, MJ shrink conversion map, and NTA shrink conversion map.\n\nThe MJ character table (*MJ\u6587\u5b57\u4e00\u89a7\u8868*) defines a vast set of kanji (*\u6f22\u5b57*) characters used in information processing of Japanese texts initially developed by Information-technology Promotion Agency.\n\nThe MJ shrink conversion map (*MJ\u7e2e\u9000\u30de\u30c3\u30d7*) was also developed alongside for the sake of interoperability between MJ-aware systems and systems based on Unicode, which is used to transliterate complex, less-frequently-used character variants to commonly-used, more-used ones.\n\nThe NTA shrink conversion map (*\u56fd\u7a0e\u5e81JIS\u7e2e\u9000\u30de\u30c3\u30d7*) was developed by Japan National Tax Agency to canonicalize user inputs for its corporation number search service provided as a public web API. This maps JIS level 3 and 4 characters to JIS level 1 and 2 characters (i.e. characters defined in JIS X 0208.) Note that not all level 3 and level 4 characters have level 1 and 2 counterparts. Also note that some of level 3 and 4 characters don't map to a single character one by each. Instead, they map to sequences of two or more characters.\n\nThe table below shows some examples of transliteration by the MJ character table suite and NTA shrink conversion map.\n\n| Glyph | MJ code | Unicode | JIS X 0213 | Glyph\\* | MJ code\\* | JIS X 0208\\* | Transliterator |\n| ----- | ------- | ------- | ---------- | ------ | ------- | ---------- | -------------- | \n|  | MJ014031 | U+68C3 | 2-14-90 |  | MJ014007 | 1-45-92 | MJ / JNTA |\n|  | MJ030196 | U+FA11 | 1-47-82 |  | MJ010541 | 1-26-74 | MJ / JNTA |\n|  | MJ028902 | U+9AD9 | N/A |  | MJ028901 | 1-25-66 | MJ |\n\nThe conversion schematics is shown below:\n\n\n\n* JNTA transliteration\n\n As every JIS X 0213 characters maps to its Unicode counterpart, the conversion is done only with the single JNTA character mappings table.\n\n* MJ transliteration\n\n Transliteration is done in two phases:\n\n 1. Conversion from Unicode to MJ character mappings.\n\n While not all characters in the MJ characters table map to Unicode, each MJ code has different shrink mappings. Because of this, the transliterator tries to convert Unicode codepoints to MJ codes first.\n\n 2. Transliteration by MJ shrink mappings.\n\n The transliteration result as a string isn't necessarily single as some MJ codes have more than one transliteration candidate. This happens because a) a Unicode codepoint may map to multiple MJ codes and b) multiple transliteration schemes are designated to a single MJ code.\n\n\nRelationship between Unicode, MJ character mappings, JIS X 0213, and JIS X 0208 can be depicted as follows:\n\n\n\n## License\n\nThe source code except `src/jntajis/_jntajis.h` is published under the BSD 3-clause license.\n\n`src/jntajis/_jntajis.h` contains the data from the following entities:\n\n* JIS shrink conversion mappings (\u56fd\u7a0e\u5e81: JIS\u7e2e\u9000\u30de\u30c3\u30d7)\n\n Publisher: National Tax Agency\n\n Author: National Tax Agency\n\n Source: https://www.houjin-bangou.nta.go.jp/download/\n\n License: CC BY 4.0\n\n* MJ character table (\u6587\u5b57\u60c5\u5831\u6280\u8853\u4fc3\u9032\u5354\u8b70\u4f1a: MJ\u6587\u5b57\u4e00\u89a7\u8868)\n\n Publisher: Character Information Technology Promotion Council (CITPC)\n\n Author: Information-technology Promotion Agency (IPA)\n\n Source: https://moji.or.jp/mojikiban/mjlist/\n\n License: CC BY-SA 2.1 JP\n\n* MJ shrink conversion mappings (\u6587\u5b57\u60c5\u5831\u6280\u8853\u4fc3\u9032\u5354\u8b70\u4f1a: MJ\u7e2e\u9000\u30de\u30c3\u30d7)\n\n Publisher: Character Information Technology Promotion Council (CITPC)\n\n Author: Information-technology Promotion Agency (IPA)\n\n Source: https://moji.or.jp/mojikiban/map/ \n\n License: CC BY-SA 2.1 JP\n\n\n",
"bugtrack_url": null,
"license": "BSD License",
"summary": "A fast character conversion and transliteration library based on the scheme defined for Japan National Tax Agency's corporate number system.",
"version": "0.0.14",
"project_urls": {
"Homepage": "https://github.com/opencollector/jntajis-python"
},
"split_keywords": [
"unicode",
"jis",
"encoding",
"conversion",
"transliteration",
"japanese"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "9665d6b6a05ca1536fe237cc642ae6182fd2314c3fe7ec7734a0628306085880",
"md5": "5e3c6ae9b407af0ee25a8f8018381c3f",
"sha256": "b268c743ed04d42340db962881d8255b254fbc3338e1048a4a37d698997cb318"
},
"downloads": -1,
"filename": "jntajis-python-0.0.14.tar.gz",
"has_sig": false,
"md5_digest": "5e3c6ae9b407af0ee25a8f8018381c3f",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 840833,
"upload_time": "2023-06-16T14:15:49",
"upload_time_iso_8601": "2023-06-16T14:15:49.460248Z",
"url": "https://files.pythonhosted.org/packages/96/65/d6b6a05ca1536fe237cc642ae6182fd2314c3fe7ec7734a0628306085880/jntajis-python-0.0.14.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-06-16 14:15:49",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "opencollector",
"github_project": "jntajis-python",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "jntajis-python"
}
JSON
