sentencepiece


Namesentencepiece JSON
Version 0.1.98 PyPI version JSON
download
home_pagehttps://github.com/google/sentencepiece
SummarySentencePiece python wrapper
upload_time2023-04-12 09:37:46
maintainer
docs_urlNone
authorTaku Kudo
requires_python
licenseApache
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # SentencePiece Python Wrapper

Python wrapper for SentencePiece. This API will offer the encoding, decoding and training of Sentencepiece.

## Build and Install SentencePiece
For Linux (x64/i686), macOS, and Windows(win32/x64) environment, you can simply use pip command to install SentencePiece python module.

```
% pip install sentencepiece
```

To build and install the Python wrapper from source, try the following commands to build and install wheel package.
```
% git clone https://github.com/google/sentencepiece.git 
% cd sentencepiece
% mkdir build
% cd build
% cmake .. -DSPM_ENABLE_SHARED=OFF -DCMAKE_INSTALL_PREFIX=./root
% make install
% cd ../python
% python setup.py bdist_wheel
% pip install dist/sentencepiece*.whl
```

If you don’t have write permission to the global site-packages directory or don’t want to install into it, please try:
```
% python setup.py install --user
```

## Usage

See [this google colab page](https://github.com/google/sentencepiece/blob/master/python/sentencepiece_python_module_example.ipynb) to run sentencepiece interactively.

### Segmentation
```
% python
>>> import sentencepiece as spm
>>> sp = spm.SentencePieceProcessor(model_file='test/test_model.model')

>>> sp.encode('This is a test')
[284, 47, 11, 4, 15, 400]

>>> sp.encode(['This is a test', 'Hello world'], out_type=int)
[[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]]

>>> sp.encode_as_ids(['This is a test', 'Hello world'])
[[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]]

>>> sp.encode('This is a test', out_type=str)
['▁This', '▁is', '▁a', '▁', 't', 'est']

>>> sp.encode(['This is a test', 'Hello world'], out_type=str)
[['▁This', '▁is', '▁a', '▁', 't', 'est'], ['▁He', 'll', 'o', '▁world']]

>>> sp.encode_as_pieces(['This is a test', 'Hello world'])
[['▁This', '▁is', '▁a', '▁', 't', 'est'], ['▁He', 'll', 'o', '▁world']]

>>> proto = sp.encode('This is a test', out_type='immutable_proto')
>>> for n in proto.pieces:
...     print('piece="{}" surface="{}" id={} begin={} end={}'.format(n.piece, n.surface, n.id, n.begin, n.end))
... 
piece="▁This" surface="This" id=284 begin=0 end=4
piece="▁is" surface=" is" id=47 begin=4 end=7
piece="▁a" surface=" a" id=11 begin=7 end=9
piece="▁" surface=" " id=4 begin=9 end=10
piece="t" surface="t" id=15 begin=10 end=11
piece="est" surface="est" id=400 begin=11 end=14

>>> [[x.id for x in proto.pieces], [x.piece for x in proto.pieces], [x.begin for x in proto.pieces], [x.end for x in proto.pieces]]
[[284, 47, 11, 4, 15, 400], ['▁This', '▁is', '▁a', '▁', 't', 'est'], [0, 4, 7, 9, 10, 11], [4, 7, 9, 10, 11, 14]]

>>> proto2 = sp.encode_as_immutable_proto('This is a test')
>>> proto2 == proto
True

>>> for _ in range(10):
...     sp.encode('This is a test', out_type=str, enable_sampling=True, alpha=0.1, nbest_size=-1)
... 
['▁', 'This', '▁', 'is', '▁a', '▁', 't', 'e', 'st']
['▁T', 'h', 'i', 's', '▁is', '▁a', '▁', 'te', 's', 't']
['▁T', 'h', 'is', '▁', 'is', '▁', 'a', '▁', 't', 'est']
['▁', 'This', '▁is', '▁', 'a', '▁', 't', 'e', 'st']
['▁', 'This', '▁', 'is', '▁', 'a', '▁', 't', 'e', 's', 't']
['▁This', '▁is', '▁a', '▁', 'te', 's', 't']
['▁This', '▁is', '▁', 'a', '▁', 't', 'e', 'st']
['▁', 'T', 'h', 'is', '▁', 'is', '▁', 'a', '▁', 'te', 'st']
['▁', 'This', '▁', 'i', 's', '▁a', '▁', 't', 'e', 'st']
['▁This', '▁', 'is', '▁a', '▁', 't', 'est']

>> sp.nbest_encode('This is a test', nbest_size=5, out_type=str)
[['▁This', '▁is', '▁a', '▁', 't', 'est'], 
['▁This', '▁is', '▁a', '▁', 'te', 'st'], 
['▁This', '▁is', '▁a', '▁', 'te', 's', 't'],
['▁This', '▁is', '▁a', '▁', 't', 'e', 'st'],
['▁This', '▁is', '▁a', '▁', 't', 'es', 't']]

>>> sp.sample_encode_and_score('This is a test', num_samples=5, alpha=0.1, out_type=str, wor=True)
[(['▁This', '▁', 'i', 's', '▁a', '▁', 'te', 's', 't'], -3.043105125427246),
(['▁This', '▁', 'i', 's', '▁a', '▁', 'te', 'st'], -2.8475849628448486),
(['▁', 'This', '▁is', '▁', 'a', '▁', 'te', 'st'], -3.043248176574707),
(['▁', 'This', '▁is', '▁a', '▁', 't', 'e', 'st'], -2.87727689743042),
(['▁', 'This', '▁', 'i', 's', '▁', 'a', '▁', 't', 'est'], -3.6284031867980957)]

>>> sp.decode([284, 47, 11, 4, 15, 400])
'This is a test'

>>> sp.decode([[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]])
['This is a test', 'Hello world']

>>> proto = sp.decode([284, 47, 11, 4, 15, 400], out_type='immutable_proto') 
>>> proto.text
'This is a test'

>>> sp.decode(['▁', 'This', '▁', 'is', '▁a', '▁', 't', 'e', 'st'])
'This is a test'

>>> sp.decode([['▁This', '▁is', '▁a', '▁', 't', 'est'], ['▁He', 'll', 'o', '▁world']])
['This is a test', 'Hello world']

>>> sp.get_piece_size()
1000

>>> sp.id_to_piece(2)
'</s>'

>>> sp.id_to_piece([2, 3, 4])
['</s>', '\r', '▁']

>>> sp.piece_to_id('<s>')
1

>>> sp.piece_to_id(['</s>', '\r', '▁'])
[2, 3, 4]

>>> len(sp)
1000

>>> sp['</s>']
2
```

### Model Training
Training is performed by passing parameters of [spm_train](https://github.com/google/sentencepiece#train-sentencepiece-model) to  SentencePieceTrainer.train() function.

```
>>> import sentencepiece as spm
>>> spm.SentencePieceTrainer.train(input='test/botchan.txt', model_prefix='m', vocab_size=1000, user_defined_symbols=['foo', 'bar'])
sentencepiece_trainer.cc(73) LOG(INFO) Starts training with : 
trainer_spec {
  input: test/botchan.txt
  .. snip
unigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=1 size=1188 obj=10.2839 num_tokens=32182 num_tokens/piece=27.0892
unigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=0 size=1100 obj=10.4269 num_tokens=33001 num_tokens/piece=30.0009
unigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=1 size=1100 obj=10.4069 num_tokens=33002 num_tokens/piece=30.0018
trainer_interface.cc(595) LOG(INFO) Saving model: m.model
trainer_interface.cc(619) LOG(INFO) Saving vocabs: m.vocab
>>>
```

### Training without local filesystem
Sentencepiece trainer can receive any iterable object to feed training sentences. You can also pass a file object (instance with write() method) to emit the output model to any devices. These features are useful to run sentencepiece on environment that have limited access to the local file system (e.g., Google colab.)

```
import urllib.request
import io
import sentencepiece as spm

# Loads model from URL as iterator and stores the model to BytesIO.
model = io.BytesIO()
with urllib.request.urlopen(
    'https://raw.githubusercontent.com/google/sentencepiece/master/data/botchan.txt'
) as response:
  spm.SentencePieceTrainer.train(
      sentence_iterator=response, model_writer=model, vocab_size=1000)

# Serialize the model as file.
# with open('out.model', 'wb') as f:
#   f.write(model.getvalue())

# Directly load the model from serialized model.
sp = spm.SentencePieceProcessor(model_proto=model.getvalue())
print(sp.encode('this is test'))
```



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/google/sentencepiece",
    "name": "sentencepiece",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "",
    "author": "Taku Kudo",
    "author_email": "taku@google.com",
    "download_url": "https://files.pythonhosted.org/packages/30/ea/b6cc06f178c4ad88f265011d7a2649a7d5278a88a7afa63cda9344513ea6/sentencepiece-0.1.98.tar.gz",
    "platform": "Unix",
    "description": "# SentencePiece Python Wrapper\n\nPython wrapper for SentencePiece. This API will offer the encoding, decoding and training of Sentencepiece.\n\n## Build and Install SentencePiece\nFor Linux (x64/i686), macOS, and Windows(win32/x64) environment, you can simply use pip command to install SentencePiece python module.\n\n```\n% pip install sentencepiece\n```\n\nTo build and install the Python wrapper from source, try the following commands to build and install wheel package.\n```\n% git clone https://github.com/google/sentencepiece.git \n% cd sentencepiece\n% mkdir build\n% cd build\n% cmake .. -DSPM_ENABLE_SHARED=OFF -DCMAKE_INSTALL_PREFIX=./root\n% make install\n% cd ../python\n% python setup.py bdist_wheel\n% pip install dist/sentencepiece*.whl\n```\n\nIf you don\u2019t have write permission to the global site-packages directory or don\u2019t want to install into it, please try:\n```\n% python setup.py install --user\n```\n\n## Usage\n\nSee [this google colab page](https://github.com/google/sentencepiece/blob/master/python/sentencepiece_python_module_example.ipynb) to run sentencepiece interactively.\n\n### Segmentation\n```\n% python\n>>> import sentencepiece as spm\n>>> sp = spm.SentencePieceProcessor(model_file='test/test_model.model')\n\n>>> sp.encode('This is a test')\n[284, 47, 11, 4, 15, 400]\n\n>>> sp.encode(['This is a test', 'Hello world'], out_type=int)\n[[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]]\n\n>>> sp.encode_as_ids(['This is a test', 'Hello world'])\n[[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]]\n\n>>> sp.encode('This is a test', out_type=str)\n['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est']\n\n>>> sp.encode(['This is a test', 'Hello world'], out_type=str)\n[['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est'], ['\u2581He', 'll', 'o', '\u2581world']]\n\n>>> sp.encode_as_pieces(['This is a test', 'Hello world'])\n[['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est'], ['\u2581He', 'll', 'o', '\u2581world']]\n\n>>> proto = sp.encode('This is a test', out_type='immutable_proto')\n>>> for n in proto.pieces:\n...     print('piece=\"{}\" surface=\"{}\" id={} begin={} end={}'.format(n.piece, n.surface, n.id, n.begin, n.end))\n... \npiece=\"\u2581This\" surface=\"This\" id=284 begin=0 end=4\npiece=\"\u2581is\" surface=\" is\" id=47 begin=4 end=7\npiece=\"\u2581a\" surface=\" a\" id=11 begin=7 end=9\npiece=\"\u2581\" surface=\" \" id=4 begin=9 end=10\npiece=\"t\" surface=\"t\" id=15 begin=10 end=11\npiece=\"est\" surface=\"est\" id=400 begin=11 end=14\n\n>>> [[x.id for x in proto.pieces], [x.piece for x in proto.pieces], [x.begin for x in proto.pieces], [x.end for x in proto.pieces]]\n[[284, 47, 11, 4, 15, 400], ['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est'], [0, 4, 7, 9, 10, 11], [4, 7, 9, 10, 11, 14]]\n\n>>> proto2 = sp.encode_as_immutable_proto('This is a test')\n>>> proto2 == proto\nTrue\n\n>>> for _ in range(10):\n...     sp.encode('This is a test', out_type=str, enable_sampling=True, alpha=0.1, nbest_size=-1)\n... \n['\u2581', 'This', '\u2581', 'is', '\u2581a', '\u2581', 't', 'e', 'st']\n['\u2581T', 'h', 'i', 's', '\u2581is', '\u2581a', '\u2581', 'te', 's', 't']\n['\u2581T', 'h', 'is', '\u2581', 'is', '\u2581', 'a', '\u2581', 't', 'est']\n['\u2581', 'This', '\u2581is', '\u2581', 'a', '\u2581', 't', 'e', 'st']\n['\u2581', 'This', '\u2581', 'is', '\u2581', 'a', '\u2581', 't', 'e', 's', 't']\n['\u2581This', '\u2581is', '\u2581a', '\u2581', 'te', 's', 't']\n['\u2581This', '\u2581is', '\u2581', 'a', '\u2581', 't', 'e', 'st']\n['\u2581', 'T', 'h', 'is', '\u2581', 'is', '\u2581', 'a', '\u2581', 'te', 'st']\n['\u2581', 'This', '\u2581', 'i', 's', '\u2581a', '\u2581', 't', 'e', 'st']\n['\u2581This', '\u2581', 'is', '\u2581a', '\u2581', 't', 'est']\n\n>> sp.nbest_encode('This is a test', nbest_size=5, out_type=str)\n[['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est'], \n['\u2581This', '\u2581is', '\u2581a', '\u2581', 'te', 'st'], \n['\u2581This', '\u2581is', '\u2581a', '\u2581', 'te', 's', 't'],\n['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'e', 'st'],\n['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'es', 't']]\n\n>>> sp.sample_encode_and_score('This is a test', num_samples=5, alpha=0.1, out_type=str, wor=True)\n[(['\u2581This', '\u2581', 'i', 's', '\u2581a', '\u2581', 'te', 's', 't'], -3.043105125427246),\n(['\u2581This', '\u2581', 'i', 's', '\u2581a', '\u2581', 'te', 'st'], -2.8475849628448486),\n(['\u2581', 'This', '\u2581is', '\u2581', 'a', '\u2581', 'te', 'st'], -3.043248176574707),\n(['\u2581', 'This', '\u2581is', '\u2581a', '\u2581', 't', 'e', 'st'], -2.87727689743042),\n(['\u2581', 'This', '\u2581', 'i', 's', '\u2581', 'a', '\u2581', 't', 'est'], -3.6284031867980957)]\n\n>>> sp.decode([284, 47, 11, 4, 15, 400])\n'This is a test'\n\n>>> sp.decode([[284, 47, 11, 4, 15, 400], [151, 88, 21, 887]])\n['This is a test', 'Hello world']\n\n>>> proto = sp.decode([284, 47, 11, 4, 15, 400], out_type='immutable_proto') \n>>> proto.text\n'This is a test'\n\n>>> sp.decode(['\u2581', 'This', '\u2581', 'is', '\u2581a', '\u2581', 't', 'e', 'st'])\n'This is a test'\n\n>>> sp.decode([['\u2581This', '\u2581is', '\u2581a', '\u2581', 't', 'est'], ['\u2581He', 'll', 'o', '\u2581world']])\n['This is a test', 'Hello world']\n\n>>> sp.get_piece_size()\n1000\n\n>>> sp.id_to_piece(2)\n'</s>'\n\n>>> sp.id_to_piece([2, 3, 4])\n['</s>', '\\r', '\u2581']\n\n>>> sp.piece_to_id('<s>')\n1\n\n>>> sp.piece_to_id(['</s>', '\\r', '\u2581'])\n[2, 3, 4]\n\n>>> len(sp)\n1000\n\n>>> sp['</s>']\n2\n```\n\n### Model Training\nTraining is performed by passing parameters of [spm_train](https://github.com/google/sentencepiece#train-sentencepiece-model) to  SentencePieceTrainer.train() function.\n\n```\n>>> import sentencepiece as spm\n>>> spm.SentencePieceTrainer.train(input='test/botchan.txt', model_prefix='m', vocab_size=1000, user_defined_symbols=['foo', 'bar'])\nsentencepiece_trainer.cc(73) LOG(INFO) Starts training with : \ntrainer_spec {\n  input: test/botchan.txt\n  .. snip\nunigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=1 size=1188 obj=10.2839 num_tokens=32182 num_tokens/piece=27.0892\nunigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=0 size=1100 obj=10.4269 num_tokens=33001 num_tokens/piece=30.0009\nunigram_model_trainer.cc(500) LOG(INFO) EM sub_iter=1 size=1100 obj=10.4069 num_tokens=33002 num_tokens/piece=30.0018\ntrainer_interface.cc(595) LOG(INFO) Saving model: m.model\ntrainer_interface.cc(619) LOG(INFO) Saving vocabs: m.vocab\n>>>\n```\n\n### Training without local filesystem\nSentencepiece trainer can receive any iterable object to feed training sentences. You can also pass a file object (instance with write() method) to emit the output model to any devices. These features are useful to run sentencepiece on environment that have limited access to the local file system (e.g., Google colab.)\n\n```\nimport urllib.request\nimport io\nimport sentencepiece as spm\n\n# Loads model from URL as iterator and stores the model to BytesIO.\nmodel = io.BytesIO()\nwith urllib.request.urlopen(\n    'https://raw.githubusercontent.com/google/sentencepiece/master/data/botchan.txt'\n) as response:\n  spm.SentencePieceTrainer.train(\n      sentence_iterator=response, model_writer=model, vocab_size=1000)\n\n# Serialize the model as file.\n# with open('out.model', 'wb') as f:\n#   f.write(model.getvalue())\n\n# Directly load the model from serialized model.\nsp = spm.SentencePieceProcessor(model_proto=model.getvalue())\nprint(sp.encode('this is test'))\n```\n\n\n",
    "bugtrack_url": null,
    "license": "Apache",
    "summary": "SentencePiece python wrapper",
    "version": "0.1.98",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "155eabe10f29dcb1637d3558e3036485b34e835a4a7c4fce0e2c974b409cd7c3",
                "md5": "162cc6494c22e31af1331e4ae7b42f08",
                "sha256": "1daf0a79cd953e4830746c41e92b98a2f2e9e5ec0e90a9447aa10350e11bd027"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-macosx_10_9_universal2.whl",
            "has_sig": false,
            "md5_digest": "162cc6494c22e31af1331e4ae7b42f08",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 2384051,
            "upload_time": "2023-04-12T09:36:58",
            "upload_time_iso_8601": "2023-04-12T09:36:58.369030Z",
            "url": "https://files.pythonhosted.org/packages/15/5e/abe10f29dcb1637d3558e3036485b34e835a4a7c4fce0e2c974b409cd7c3/sentencepiece-0.1.98-cp310-cp310-macosx_10_9_universal2.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3355d6806341d283e17189536c9a507fe000b7728ee6f1be12f65c93a96b02d6",
                "md5": "4d961fb3d6ef46e43904fba99656bd67",
                "sha256": "57911445fc91c80d59552adf8a749af9205458920a7328f3bd7d51308658bcd9"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "4d961fb3d6ef46e43904fba99656bd67",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 1227017,
            "upload_time": "2023-04-12T09:37:01",
            "upload_time_iso_8601": "2023-04-12T09:37:01.507201Z",
            "url": "https://files.pythonhosted.org/packages/33/55/d6806341d283e17189536c9a507fe000b7728ee6f1be12f65c93a96b02d6/sentencepiece-0.1.98-cp310-cp310-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5b4989a7e2a7c912c858f8842baaa3c0d36b3b8b7499094e20e4e89464fd84c6",
                "md5": "b4fa8605c2705f74030446f75f0e3c88",
                "sha256": "3f9239785849ed1f55a825bcc282bef1a6073f7431cc535bdc658a94873652ea"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "b4fa8605c2705f74030446f75f0e3c88",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 1167889,
            "upload_time": "2023-04-12T09:37:04",
            "upload_time_iso_8601": "2023-04-12T09:37:04.324229Z",
            "url": "https://files.pythonhosted.org/packages/5b/49/89a7e2a7c912c858f8842baaa3c0d36b3b8b7499094e20e4e89464fd84c6/sentencepiece-0.1.98-cp310-cp310-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c38c25fe455cbc78e699ed7dfb8a2cd84f289e2d2276668603712503910a4695",
                "md5": "0eae127edea2be00b3d1eda780bc63a6",
                "sha256": "467740ef8af170e5b6cfe22c272114ed930c899c297619ac7a2ac463a13bdbac"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "0eae127edea2be00b3d1eda780bc63a6",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 1252372,
            "upload_time": "2023-04-12T09:37:07",
            "upload_time_iso_8601": "2023-04-12T09:37:07.093372Z",
            "url": "https://files.pythonhosted.org/packages/c3/8c/25fe455cbc78e699ed7dfb8a2cd84f289e2d2276668603712503910a4695/sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "959d6aa074018d6eb624f0f21294dc503dc869be8eed60eef8e40837635317ec",
                "md5": "af8834127ed083691d568550de8c6002",
                "sha256": "9b6f0b9ffb601e2699e265f3f20c353ec9a661e4b5f0cff08ad6c9909c0ae43e"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "af8834127ed083691d568550de8c6002",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 1352857,
            "upload_time": "2023-04-12T09:37:09",
            "upload_time_iso_8601": "2023-04-12T09:37:09.707461Z",
            "url": "https://files.pythonhosted.org/packages/95/9d/6aa074018d6eb624f0f21294dc503dc869be8eed60eef8e40837635317ec/sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e21b5f1374ba4c4009bd300566ea60697a4e37a82d8b36420999420463d85e56",
                "md5": "9e865c314b099722f554f91588503520",
                "sha256": "6150ba525fac4fda76f5c4777ae300597e70cef739ed2a47cea02ff81a88873f"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "9e865c314b099722f554f91588503520",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 1298743,
            "upload_time": "2023-04-12T09:37:14",
            "upload_time_iso_8601": "2023-04-12T09:37:14.195940Z",
            "url": "https://files.pythonhosted.org/packages/e2/1b/5f1374ba4c4009bd300566ea60697a4e37a82d8b36420999420463d85e56/sentencepiece-0.1.98-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "30e090fe8e2b6f26d8bfc0b4f8b0ffede7c4fba6624c0764f6cdb55c467e0888",
                "md5": "665af83f5f8882e4009768e58fe0bfaa",
                "sha256": "58ca96d73ea0e5575e3f6a9524449c673d62e6ecee3b2ddd5bfb4f49cb315c0a"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-win32.whl",
            "has_sig": false,
            "md5_digest": "665af83f5f8882e4009768e58fe0bfaa",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 924867,
            "upload_time": "2023-04-12T09:37:16",
            "upload_time_iso_8601": "2023-04-12T09:37:16.575111Z",
            "url": "https://files.pythonhosted.org/packages/30/e0/90fe8e2b6f26d8bfc0b4f8b0ffede7c4fba6624c0764f6cdb55c467e0888/sentencepiece-0.1.98-cp310-cp310-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "96a5ee104b5ccffbe0bcdaf1a9988384253c46ea353bee329ddf571139e0b29c",
                "md5": "7bb73f4a3975d85d73f84c4bdb03aae7",
                "sha256": "8abe5c4c034e497e69f485dcd2c0e6bc87bf0498ad5aef5f539a7d0f9eae6275"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp310-cp310-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "7bb73f4a3975d85d73f84c4bdb03aae7",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": null,
            "size": 977784,
            "upload_time": "2023-04-12T09:37:19",
            "upload_time_iso_8601": "2023-04-12T09:37:19.547780Z",
            "url": "https://files.pythonhosted.org/packages/96/a5/ee104b5ccffbe0bcdaf1a9988384253c46ea353bee329ddf571139e0b29c/sentencepiece-0.1.98-cp310-cp310-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0f6d527ca412d512da5ab25768ac77dcdc99a1f301527e23e70888b1e09eb93b",
                "md5": "322d1be6e636bf975c17e7aa87c3db16",
                "sha256": "b6ed62f89c0bd25cec39a7075f6b9354fe4c240ed964e63009d77efcf29c34e9"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-macosx_10_9_universal2.whl",
            "has_sig": false,
            "md5_digest": "322d1be6e636bf975c17e7aa87c3db16",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 2384074,
            "upload_time": "2023-04-12T09:37:23",
            "upload_time_iso_8601": "2023-04-12T09:37:23.015539Z",
            "url": "https://files.pythonhosted.org/packages/0f/6d/527ca412d512da5ab25768ac77dcdc99a1f301527e23e70888b1e09eb93b/sentencepiece-0.1.98-cp311-cp311-macosx_10_9_universal2.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6fca32ad85fa0cb8a0e22807f06120facdc3dbdfb8ede4779088eeba57c811ce",
                "md5": "125a622626546b5477eeb2d37432e728",
                "sha256": "2c2d9a74986d3716dc6961e9dbae7a3b25bb1260118f098545fd963ae23252c1"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "125a622626546b5477eeb2d37432e728",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 1227033,
            "upload_time": "2023-04-12T09:37:26",
            "upload_time_iso_8601": "2023-04-12T09:37:26.153757Z",
            "url": "https://files.pythonhosted.org/packages/6f/ca/32ad85fa0cb8a0e22807f06120facdc3dbdfb8ede4779088eeba57c811ce/sentencepiece-0.1.98-cp311-cp311-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "511200397a20c3934efb2ecc5778e3d0dd0912dd60229f8a1b974e3d38b692d4",
                "md5": "e18edc26084f85534b3add3a93195eee",
                "sha256": "7f7dc2fc175623529fb60a2799748f8877cd48c4541b32cd97b8523465e88b69"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "e18edc26084f85534b3add3a93195eee",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 1167892,
            "upload_time": "2023-04-12T09:37:29",
            "upload_time_iso_8601": "2023-04-12T09:37:29.033324Z",
            "url": "https://files.pythonhosted.org/packages/51/12/00397a20c3934efb2ecc5778e3d0dd0912dd60229f8a1b974e3d38b692d4/sentencepiece-0.1.98-cp311-cp311-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d0b4b0a96ac2e94291f9017e566a27302062642937bfc2f34b9c450f468d1a7a",
                "md5": "7f381268559d0f322339c3d44d556a88",
                "sha256": "64e32c55d04a2e21f0c2fda1b7a3dd108133ebfb8616b52896916bb30e4352ed"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "7f381268559d0f322339c3d44d556a88",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 1252366,
            "upload_time": "2023-04-12T09:37:32",
            "upload_time_iso_8601": "2023-04-12T09:37:32.753722Z",
            "url": "https://files.pythonhosted.org/packages/d0/b4/b0a96ac2e94291f9017e566a27302062642937bfc2f34b9c450f468d1a7a/sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c51f2e20bacb264eb2cf4d0f154704a557e52e63b2fb931063df41519104e5a8",
                "md5": "a91b839821c8c9e642f639267c02cebc",
                "sha256": "443f32e94b18571231b02a51be173686114b5556b5edfcbf347fb63e7bd5ddc6"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "a91b839821c8c9e642f639267c02cebc",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 1352514,
            "upload_time": "2023-04-12T09:37:35",
            "upload_time_iso_8601": "2023-04-12T09:37:35.551079Z",
            "url": "https://files.pythonhosted.org/packages/c5/1f/2e20bacb264eb2cf4d0f154704a557e52e63b2fb931063df41519104e5a8/sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d3ce097ff15e68f04acb88f013db34c737b2aa3b17bc7b034b2861c7ccb70f33",
                "md5": "c972e4dcf59c4c983a495f8dd4c8fb64",
                "sha256": "558a373a8660bdff299d6c133c2a4f4fb0875e9e6fafe225b8080ecce8a405f9"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "c972e4dcf59c4c983a495f8dd4c8fb64",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 1298561,
            "upload_time": "2023-04-12T09:37:37",
            "upload_time_iso_8601": "2023-04-12T09:37:37.841343Z",
            "url": "https://files.pythonhosted.org/packages/d3/ce/097ff15e68f04acb88f013db34c737b2aa3b17bc7b034b2861c7ccb70f33/sentencepiece-0.1.98-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a2ac4b8179922d73907d31bc5b2852d842bd5a8407ff31f234c3d6e8dc6ab0a7",
                "md5": "43f506168ed132c51d876363cf63d6c3",
                "sha256": "fcf100268cefe1774794b18cbaf3065e2bf988f168a387973eb1260d51198795"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-win32.whl",
            "has_sig": false,
            "md5_digest": "43f506168ed132c51d876363cf63d6c3",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 924869,
            "upload_time": "2023-04-12T09:37:40",
            "upload_time_iso_8601": "2023-04-12T09:37:40.901281Z",
            "url": "https://files.pythonhosted.org/packages/a2/ac/4b8179922d73907d31bc5b2852d842bd5a8407ff31f234c3d6e8dc6ab0a7/sentencepiece-0.1.98-cp311-cp311-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a9bfc81ffe9dcde1ea255343b218d8c20b2add15f4bf0d2a0c91aff332d6c3c8",
                "md5": "28c941922aa29f5258aa112cdd1f3246",
                "sha256": "05b4eecbece0606883cd81ed86bb3c619680bb570b997b236533ec854d64a575"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp311-cp311-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "28c941922aa29f5258aa112cdd1f3246",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": null,
            "size": 977785,
            "upload_time": "2023-04-12T09:37:43",
            "upload_time_iso_8601": "2023-04-12T09:37:43.239473Z",
            "url": "https://files.pythonhosted.org/packages/a9/bf/c81ffe9dcde1ea255343b218d8c20b2add15f4bf0d2a0c91aff332d6c3c8/sentencepiece-0.1.98-cp311-cp311-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "4007277299ff964ddf9ce73041185132bc013230b5c3881bfab409921084f26e",
                "md5": "52eaf358671c66d21f91e719c373e90c",
                "sha256": "35af00f5103a4779694fedea41b6e24947a9ed81166efe63864ab1e781d70a66"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "52eaf358671c66d21f91e719c373e90c",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 1227311,
            "upload_time": "2023-04-12T09:35:33",
            "upload_time_iso_8601": "2023-04-12T09:35:33.432329Z",
            "url": "https://files.pythonhosted.org/packages/40/07/277299ff964ddf9ce73041185132bc013230b5c3881bfab409921084f26e/sentencepiece-0.1.98-cp36-cp36m-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5f4ef2e5d0a98635214eac51d1bb3739d40125e903c91fbc0b58bd5a22b52e0e",
                "md5": "e764d1cf273e2439bbcc1f871522868b",
                "sha256": "2766cd708e9fc2b5b9784a990a8b303b9e0b9a69fa482616fe86fa538daa1756"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "e764d1cf273e2439bbcc1f871522868b",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 1252507,
            "upload_time": "2023-04-12T09:35:36",
            "upload_time_iso_8601": "2023-04-12T09:35:36.770474Z",
            "url": "https://files.pythonhosted.org/packages/5f/4e/f2e5d0a98635214eac51d1bb3739d40125e903c91fbc0b58bd5a22b52e0e/sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "bdda42b219a44091f24a67b8e147ee8aea20d5226125828d5661abe452c6284c",
                "md5": "2ab2a864825bce125c944cef61b6ac3a",
                "sha256": "b2531c0e9cc8cd404fabd856d80d695b373371c00f1fce29c06f41f3f7429d87"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "2ab2a864825bce125c944cef61b6ac3a",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 1352744,
            "upload_time": "2023-04-12T09:35:39",
            "upload_time_iso_8601": "2023-04-12T09:35:39.520715Z",
            "url": "https://files.pythonhosted.org/packages/bd/da/42b219a44091f24a67b8e147ee8aea20d5226125828d5661abe452c6284c/sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a07f4d529e437fd15e5f4258eadc308de1efbe07486d25f6c03f0ed88c31d09e",
                "md5": "dd4abce588b28b8309c3b34a1223093a",
                "sha256": "ffcc78e80c55eab67ee3439ade493607a4e37e1f0b82b168ead3debf9eaeaabe"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "dd4abce588b28b8309c3b34a1223093a",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 1298636,
            "upload_time": "2023-04-12T09:35:42",
            "upload_time_iso_8601": "2023-04-12T09:35:42.905300Z",
            "url": "https://files.pythonhosted.org/packages/a0/7f/4d529e437fd15e5f4258eadc308de1efbe07486d25f6c03f0ed88c31d09e/sentencepiece-0.1.98-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "1753b22cb725ff41549a174e71974124480716c09a15fa829584da656d224250",
                "md5": "dc2d09564048f25d3f9d743f7b73b84b",
                "sha256": "ef384b31ec7a06a9a6aba42e68435f3f3b38809aa65559ede3658cdd446a562c"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-win32.whl",
            "has_sig": false,
            "md5_digest": "dc2d09564048f25d3f9d743f7b73b84b",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 933969,
            "upload_time": "2023-04-12T09:35:45",
            "upload_time_iso_8601": "2023-04-12T09:35:45.329502Z",
            "url": "https://files.pythonhosted.org/packages/17/53/b22cb725ff41549a174e71974124480716c09a15fa829584da656d224250/sentencepiece-0.1.98-cp36-cp36m-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7a74a1b6637d51c7387e27929ed8fcc95da171526a9ffe432805deffe2d991a5",
                "md5": "0dc4aac1e92d34886e96668d3fb36352",
                "sha256": "e7a828f1fe2e51d2d9e5e9b3283d4006f1891efb02a3d9303ed39ddafdd9c864"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp36-cp36m-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "0dc4aac1e92d34886e96668d3fb36352",
            "packagetype": "bdist_wheel",
            "python_version": "cp36",
            "requires_python": null,
            "size": 990982,
            "upload_time": "2023-04-12T09:35:47",
            "upload_time_iso_8601": "2023-04-12T09:35:47.985735Z",
            "url": "https://files.pythonhosted.org/packages/7a/74/a1b6637d51c7387e27929ed8fcc95da171526a9ffe432805deffe2d991a5/sentencepiece-0.1.98-cp36-cp36m-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ca9ac3a90185f4a36e4e0e84ca899ef3641b0bef5a0bba03ca56ace8f89e8cc4",
                "md5": "a8c09868e5795fadd52fa17fff856909",
                "sha256": "8663be00a68098f85d6cda1f7041a27de05c320e433fa730ecb1156a8304f21c"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "a8c09868e5795fadd52fa17fff856909",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 1227325,
            "upload_time": "2023-04-12T09:35:50",
            "upload_time_iso_8601": "2023-04-12T09:35:50.709550Z",
            "url": "https://files.pythonhosted.org/packages/ca/9a/c3a90185f4a36e4e0e84ca899ef3641b0bef5a0bba03ca56ace8f89e8cc4/sentencepiece-0.1.98-cp37-cp37m-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7702136b64a0adf2db5829a7df13808fe8ce920909e7461935950c7daa8f2c9d",
                "md5": "a4ba87d1922048a9d9f6683c30c8a90c",
                "sha256": "daf05611089a075b78d353720ccc3a09a78e0846332cff0cc78fda8b2383626a"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "a4ba87d1922048a9d9f6683c30c8a90c",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 1252507,
            "upload_time": "2023-04-12T09:35:53",
            "upload_time_iso_8601": "2023-04-12T09:35:53.642005Z",
            "url": "https://files.pythonhosted.org/packages/77/02/136b64a0adf2db5829a7df13808fe8ce920909e7461935950c7daa8f2c9d/sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b7f57cb2c4aa0b99971fcf38372601863c67c256466cd7d2e64323d9fc7c01d0",
                "md5": "4badb8afabdac364261d49f64c42917f",
                "sha256": "11f410cc7eeb3e1cfa8d92d128b568e5dc7829b7904b164499fd0209316ec2fa"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "4badb8afabdac364261d49f64c42917f",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 1352743,
            "upload_time": "2023-04-12T09:35:56",
            "upload_time_iso_8601": "2023-04-12T09:35:56.313847Z",
            "url": "https://files.pythonhosted.org/packages/b7/f5/7cb2c4aa0b99971fcf38372601863c67c256466cd7d2e64323d9fc7c01d0/sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "09fac7ff41ec3aafe16b98ce607b9b3caa76f1f30a20c5bba5e501e5a5648d06",
                "md5": "c937344e01bc95e347187082acc853e3",
                "sha256": "c5ea8fb2c68073fe25a08a178eed269ed382fba074ff2ba4de72f0f56d86630e"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "c937344e01bc95e347187082acc853e3",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 1298636,
            "upload_time": "2023-04-12T09:35:59",
            "upload_time_iso_8601": "2023-04-12T09:35:59.110597Z",
            "url": "https://files.pythonhosted.org/packages/09/fa/c7ff41ec3aafe16b98ce607b9b3caa76f1f30a20c5bba5e501e5a5648d06/sentencepiece-0.1.98-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6714a9d507b785093eea044f1f1ad340710a75414ed61c98df8947705b032914",
                "md5": "c28db58943d12734a7764abb84a8f4ee",
                "sha256": "fa13a125417d28e84fbdebcaf6aa115e4177d3e93aa66b857a42e7179f515b88"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-win32.whl",
            "has_sig": false,
            "md5_digest": "c28db58943d12734a7764abb84a8f4ee",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 925137,
            "upload_time": "2023-04-12T09:36:01",
            "upload_time_iso_8601": "2023-04-12T09:36:01.895538Z",
            "url": "https://files.pythonhosted.org/packages/67/14/a9d507b785093eea044f1f1ad340710a75414ed61c98df8947705b032914/sentencepiece-0.1.98-cp37-cp37m-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5b0fcaa1866f7ffe2f31b30e31f5eba865c778d8154a4daad50f5c7c207fcb78",
                "md5": "13df4c1477f7d995aaee704e8791d5d2",
                "sha256": "e54aa70b574eee895d184072d84e62824f404821e551a82c619c5d4320a93834"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp37-cp37m-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "13df4c1477f7d995aaee704e8791d5d2",
            "packagetype": "bdist_wheel",
            "python_version": "cp37",
            "requires_python": null,
            "size": 977853,
            "upload_time": "2023-04-12T09:36:04",
            "upload_time_iso_8601": "2023-04-12T09:36:04.652465Z",
            "url": "https://files.pythonhosted.org/packages/5b/0f/caa1866f7ffe2f31b30e31f5eba865c778d8154a4daad50f5c7c207fcb78/sentencepiece-0.1.98-cp37-cp37m-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "9cf3481911dd560b69834034384f95e9b53ac8131760a410efec17466b9311ec",
                "md5": "b02505c8a6ad121257c4d8b3c7fbc22c",
                "sha256": "515a971c2a157647ca0e60ce3c435f4b43cd5c9f5862159cfefa0b5b4d46d3c3"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-macosx_10_9_universal2.whl",
            "has_sig": false,
            "md5_digest": "b02505c8a6ad121257c4d8b3c7fbc22c",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 2384496,
            "upload_time": "2023-04-12T09:36:07",
            "upload_time_iso_8601": "2023-04-12T09:36:07.900389Z",
            "url": "https://files.pythonhosted.org/packages/9c/f3/481911dd560b69834034384f95e9b53ac8131760a410efec17466b9311ec/sentencepiece-0.1.98-cp38-cp38-macosx_10_9_universal2.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b3a5f58542a5aa5bab8475330ca27d91cfabf4c8102e1836961a9010fc1ee8f7",
                "md5": "b8e433e2dcb2acffbf4da131eb484baf",
                "sha256": "c23c3a562221bc40eaae42428fcd8e607e0f084ea8aa968ba3f1a7d0ea975807"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "b8e433e2dcb2acffbf4da131eb484baf",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 1227332,
            "upload_time": "2023-04-12T09:36:10",
            "upload_time_iso_8601": "2023-04-12T09:36:10.331465Z",
            "url": "https://files.pythonhosted.org/packages/b3/a5/f58542a5aa5bab8475330ca27d91cfabf4c8102e1836961a9010fc1ee8f7/sentencepiece-0.1.98-cp38-cp38-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e00de00c3b00ec83bfce2afb2a5d08cceaedfae3b885961f15cb62696d218eb6",
                "md5": "d8625fa75d0881208175b1e361511cd6",
                "sha256": "c067ba22be8edc699f6365e01ec15046bf3563dbabfdc052ecc88e581b675cba"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "d8625fa75d0881208175b1e361511cd6",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 1168109,
            "upload_time": "2023-04-12T09:36:12",
            "upload_time_iso_8601": "2023-04-12T09:36:12.351461Z",
            "url": "https://files.pythonhosted.org/packages/e0/0d/e00c3b00ec83bfce2afb2a5d08cceaedfae3b885961f15cb62696d218eb6/sentencepiece-0.1.98-cp38-cp38-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5c4348e5c2e4056e4fcc5c39e2e2dc9a94055a156d79272f740162cda6a797d3",
                "md5": "eb20c52a7fe2f36f2cf4596afc201087",
                "sha256": "12c913493d6ebac86ee7ae109e368522a5a365a7b150d4d8cf845599262d2b21"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "eb20c52a7fe2f36f2cf4596afc201087",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 1252523,
            "upload_time": "2023-04-12T09:36:15",
            "upload_time_iso_8601": "2023-04-12T09:36:15.397035Z",
            "url": "https://files.pythonhosted.org/packages/5c/43/48e5c2e4056e4fcc5c39e2e2dc9a94055a156d79272f740162cda6a797d3/sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "1458f6a172f46cebf35356cde88207a5cff5616b44fad3d01972b20ed43a0dc5",
                "md5": "42defa85ca672d11e5e4f009f90fb602",
                "sha256": "720f827dc69ee24951ea4f51b9fb69cc56890a7190fc52c2c0da2545caab1760"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "42defa85ca672d11e5e4f009f90fb602",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 1352585,
            "upload_time": "2023-04-12T09:36:19",
            "upload_time_iso_8601": "2023-04-12T09:36:19.998215Z",
            "url": "https://files.pythonhosted.org/packages/14/58/f6a172f46cebf35356cde88207a5cff5616b44fad3d01972b20ed43a0dc5/sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ca37f0469a6f2a6a59074561d2214effec23ad9a2deac74cce467027f32167b4",
                "md5": "eab178d97db9d73f7c5a03a334623b65",
                "sha256": "918b4caf18b2f73c302c4e197d1c2dafba39eb143d16b4590930b45f15042fdd"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "eab178d97db9d73f7c5a03a334623b65",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 1298751,
            "upload_time": "2023-04-12T09:36:22",
            "upload_time_iso_8601": "2023-04-12T09:36:22.891275Z",
            "url": "https://files.pythonhosted.org/packages/ca/37/f0469a6f2a6a59074561d2214effec23ad9a2deac74cce467027f32167b4/sentencepiece-0.1.98-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "da7a564e731dd824ce2659d9f4636b747796ec93263a92548a1c5536e6547d4c",
                "md5": "08b78eee90e34beaf7473f9cfb4f75ef",
                "sha256": "2d50edfc4649a1566b64f1a8402cd607e1893bf8e368732337d83f00df62d3fa"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-win32.whl",
            "has_sig": false,
            "md5_digest": "08b78eee90e34beaf7473f9cfb4f75ef",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 924965,
            "upload_time": "2023-04-12T09:36:26",
            "upload_time_iso_8601": "2023-04-12T09:36:26.015184Z",
            "url": "https://files.pythonhosted.org/packages/da/7a/564e731dd824ce2659d9f4636b747796ec93263a92548a1c5536e6547d4c/sentencepiece-0.1.98-cp38-cp38-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c1d6bbf1ade2b0f29d6561fcb1aabb3826c135dca785fd94bb11226e1f831fc5",
                "md5": "6878d0a5a56ee18e280c03d5fd15142c",
                "sha256": "7425b727c3d6b3b7bad0005a3be316078b254180b712d73955ff08cae3f6a385"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp38-cp38-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "6878d0a5a56ee18e280c03d5fd15142c",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": null,
            "size": 977870,
            "upload_time": "2023-04-12T09:36:29",
            "upload_time_iso_8601": "2023-04-12T09:36:29.381211Z",
            "url": "https://files.pythonhosted.org/packages/c1/d6/bbf1ade2b0f29d6561fcb1aabb3826c135dca785fd94bb11226e1f831fc5/sentencepiece-0.1.98-cp38-cp38-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "39110d43f15c37f8fe9b0c146fe58cf244315fb51fd756438a690beb721abff1",
                "md5": "b21bf647d87188ab79c17bd3375b799d",
                "sha256": "00b2becbd7b98905a6de9695cf8682abe0d510ab0198e23c7d86fb2b793b6ae0"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-macosx_10_9_universal2.whl",
            "has_sig": false,
            "md5_digest": "b21bf647d87188ab79c17bd3375b799d",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 2384081,
            "upload_time": "2023-04-12T09:36:32",
            "upload_time_iso_8601": "2023-04-12T09:36:32.628805Z",
            "url": "https://files.pythonhosted.org/packages/39/11/0d43f15c37f8fe9b0c146fe58cf244315fb51fd756438a690beb721abff1/sentencepiece-0.1.98-cp39-cp39-macosx_10_9_universal2.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "922ba048a1ef77efb4ef8e92b39161eebfbf24eea1ce7456dbaf0e5b75af5ed6",
                "md5": "25b101ed24fca5c3ab7d71941fb4728a",
                "sha256": "7f71c4bdedb797052fb2ccad0871c2409bf6f812cb6b651917c55f9e8eced07f"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-macosx_10_9_x86_64.whl",
            "has_sig": false,
            "md5_digest": "25b101ed24fca5c3ab7d71941fb4728a",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 1227100,
            "upload_time": "2023-04-12T09:36:34",
            "upload_time_iso_8601": "2023-04-12T09:36:34.633349Z",
            "url": "https://files.pythonhosted.org/packages/92/2b/a048a1ef77efb4ef8e92b39161eebfbf24eea1ce7456dbaf0e5b75af5ed6/sentencepiece-0.1.98-cp39-cp39-macosx_10_9_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "efa5b7f72e71398a0f9139e6aa64bedca997a50a01076a8ef56f718b2ebc2ade",
                "md5": "ed0256262ec8c7efbb6752d4de1b47ad",
                "sha256": "7287461d2346f530928ab187f0834cb15ddfbc4553592cacdcb6470364739ec6"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "ed0256262ec8c7efbb6752d4de1b47ad",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 1167858,
            "upload_time": "2023-04-12T09:36:37",
            "upload_time_iso_8601": "2023-04-12T09:36:37.300444Z",
            "url": "https://files.pythonhosted.org/packages/ef/a5/b7f72e71398a0f9139e6aa64bedca997a50a01076a8ef56f718b2ebc2ade/sentencepiece-0.1.98-cp39-cp39-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "fd81ca9b601fa4f6c8d1154eeaddc757e7d3be07da7826ed1b2b35ed3706d68e",
                "md5": "c690d1fa838993c2321420c97e199605",
                "sha256": "472ad943eaffcb6871ece56c7850388e7b8722f520ba73c93e7a6ef965453221"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "has_sig": false,
            "md5_digest": "c690d1fa838993c2321420c97e199605",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 1252383,
            "upload_time": "2023-04-12T09:36:40",
            "upload_time_iso_8601": "2023-04-12T09:36:40.162630Z",
            "url": "https://files.pythonhosted.org/packages/fd/81/ca9b601fa4f6c8d1154eeaddc757e7d3be07da7826ed1b2b35ed3706d68e/sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c3b5935d75c25c9f990c47910a88bf0b2d24936cb375be1c8d965bdb28a722ae",
                "md5": "5054c9ec6f590181fb93ab6705005f04",
                "sha256": "4b7e23aaf9d5afd91ca13550968bd17f0c17b0966823188ad2a50c51544cf8ed"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl",
            "has_sig": false,
            "md5_digest": "5054c9ec6f590181fb93ab6705005f04",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 1352933,
            "upload_time": "2023-04-12T09:36:44",
            "upload_time_iso_8601": "2023-04-12T09:36:44.339465Z",
            "url": "https://files.pythonhosted.org/packages/c3/b5/935d75c25c9f990c47910a88bf0b2d24936cb375be1c8d965bdb28a722ae/sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "49be74c8c451703f18a629eff629707e7a3f62fdad670a74b4e0db079f1c5fa3",
                "md5": "ff58cdfff7faf54b8e43ac19297e1279",
                "sha256": "6b0ce9efc790c209cce2463058855dceb21438213d2ff13cb5a565d52a7efe25"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "has_sig": false,
            "md5_digest": "ff58cdfff7faf54b8e43ac19297e1279",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 1298568,
            "upload_time": "2023-04-12T09:36:46",
            "upload_time_iso_8601": "2023-04-12T09:36:46.659234Z",
            "url": "https://files.pythonhosted.org/packages/49/be/74c8c451703f18a629eff629707e7a3f62fdad670a74b4e0db079f1c5fa3/sentencepiece-0.1.98-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c6dd1bebcd8842d02cff2525250e8130543cc25fdd63ef723d3522071211d8b2",
                "md5": "56189612b216ddf32ff0251946e4ac72",
                "sha256": "8b50cbe8e46204eff7aa5a663af5652c45e7807aa560d08e5f5b10c60e795a49"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-win32.whl",
            "has_sig": false,
            "md5_digest": "56189612b216ddf32ff0251946e4ac72",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 924844,
            "upload_time": "2023-04-12T09:36:51",
            "upload_time_iso_8601": "2023-04-12T09:36:51.160389Z",
            "url": "https://files.pythonhosted.org/packages/c6/dd/1bebcd8842d02cff2525250e8130543cc25fdd63ef723d3522071211d8b2/sentencepiece-0.1.98-cp39-cp39-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e349e5aa99222a913bb7839256661513e01da808b49ea6f0f3e384bba53188ec",
                "md5": "9435dcb170ac45b92970e97fd14c7236",
                "sha256": "14841bd2a3d77c4dbba58f02488c374866551e428d755e8d473d82325a0a94f3"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98-cp39-cp39-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "9435dcb170ac45b92970e97fd14c7236",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": null,
            "size": 977831,
            "upload_time": "2023-04-12T09:36:54",
            "upload_time_iso_8601": "2023-04-12T09:36:54.791163Z",
            "url": "https://files.pythonhosted.org/packages/e3/49/e5aa99222a913bb7839256661513e01da808b49ea6f0f3e384bba53188ec/sentencepiece-0.1.98-cp39-cp39-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "30eab6cc06f178c4ad88f265011d7a2649a7d5278a88a7afa63cda9344513ea6",
                "md5": "456d2110b6eca5bca20740133fe1cf91",
                "sha256": "947cf0a4b8a480510d560a922f8256f34e93984a86cf870be4d05731f59fb28d"
            },
            "downloads": -1,
            "filename": "sentencepiece-0.1.98.tar.gz",
            "has_sig": false,
            "md5_digest": "456d2110b6eca5bca20740133fe1cf91",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 2628020,
            "upload_time": "2023-04-12T09:37:46",
            "upload_time_iso_8601": "2023-04-12T09:37:46.148126Z",
            "url": "https://files.pythonhosted.org/packages/30/ea/b6cc06f178c4ad88f265011d7a2649a7d5278a88a7afa63cda9344513ea6/sentencepiece-0.1.98.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-04-12 09:37:46",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": "google",
    "github_project": "sentencepiece",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "sentencepiece"
}
        
Elapsed time: 0.08193s