<p align="center">
<br>
<img src="https://huggingface.co/landing/assets/tokenizers/tokenizers-logo.png" width="600"/>
<br>
<p>
<p align="center">
<a href="https://badge.fury.io/py/tokenizers">
<img alt="Build" src="https://badge.fury.io/py/tokenizers.svg">
</a>
<a href="https://github.com/huggingface/tokenizers/blob/master/LICENSE">
<img alt="GitHub" src="https://img.shields.io/github/license/huggingface/tokenizers.svg?color=blue">
</a>
</p>
<br>
# Tokenizers
Provides an implementation of today's most used tokenizers, with a focus on performance and
versatility.
Bindings over the [Rust](https://github.com/huggingface/tokenizers/tree/master/tokenizers) implementation.
If you are interested in the High-level design, you can go check it there.
Otherwise, let's dive in!
## Main features:
- Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3
most common BPE versions).
- Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes
less than 20 seconds to tokenize a GB of text on a server's CPU.
- Easy to use, but also extremely versatile.
- Designed for research and production.
- Normalization comes with alignments tracking. It's always possible to get the part of the
original sentence that corresponds to a given token.
- Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.
### Installation
#### With pip:
```bash
pip install tokenizers
```
#### From sources:
To use this method, you need to have the Rust installed:
```bash
# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"
```
Once Rust is installed, you can compile doing the following
```bash
git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python
# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate
# Install `tokenizers` in the current virtual env
pip install -e .
```
### Load a pretrained tokenizer from the Hub
```python
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_pretrained("bert-base-cased")
```
### Using the provided Tokenizers
We provide some pre-build tokenizers to cover the most common cases. You can easily load one of
these using some `vocab.json` and `merges.txt` files:
```python
from tokenizers import CharBPETokenizer
# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)
# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)
```
And you can train them just as simply:
```python
from tokenizers import CharBPETokenizer
# Initialize a tokenizer
tokenizer = CharBPETokenizer()
# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])
# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")
# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")
```
#### Provided Tokenizers
- `CharBPETokenizer`: The original BPE
- `ByteLevelBPETokenizer`: The byte level version of the BPE
- `SentencePieceBPETokenizer`: A BPE implementation compatible with the one used by SentencePiece
- `BertWordPieceTokenizer`: The famous Bert tokenizer, using WordPiece
All of these can be used and trained as explained above!
### Build your own
Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer,
by putting all the different parts you need together.
You can check how we implemented the [provided tokenizers](https://github.com/huggingface/tokenizers/tree/master/bindings/python/py_src/tokenizers/implementations) and adapt them easily to your own needs.
#### Building a byte-level BPE
Here is an example showing how to build your own byte-level BPE by putting all the different pieces
together, and then saving it to a single file:
```python
from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors
# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())
# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)
# And then train
trainer = trainers.BpeTrainer(
vocab_size=20000,
min_frequency=2,
initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
"./path/to/dataset/1.txt",
"./path/to/dataset/2.txt",
"./path/to/dataset/3.txt"
], trainer=trainer)
# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)
```
Now, when you want to use this tokenizer, this is as simple as:
```python
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")
encoded = tokenizer.encode("I can feel the magic, can you?")
```
Raw data
{
"_id": null,
"home_page": null,
"name": "tokenizers",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": null,
"keywords": "NLP, tokenizer, BPE, transformer, deep learning",
"author": "Anthony MOI <m.anthony.moi@gmail.com>",
"author_email": "Nicolas Patry <patry.nicolas@protonmail.com>, Anthony Moi <anthony@huggingface.co>",
"download_url": "https://files.pythonhosted.org/packages/48/04/2071c150f374aab6d5e92aaec38d0f3c368d227dd9e0469a1f0966ac68d1/tokenizers-0.19.1.tar.gz",
"platform": null,
"description": "<p align=\"center\">\n <br>\n <img src=\"https://huggingface.co/landing/assets/tokenizers/tokenizers-logo.png\" width=\"600\"/>\n <br>\n<p>\n<p align=\"center\">\n <a href=\"https://badge.fury.io/py/tokenizers\">\n <img alt=\"Build\" src=\"https://badge.fury.io/py/tokenizers.svg\">\n </a>\n <a href=\"https://github.com/huggingface/tokenizers/blob/master/LICENSE\">\n <img alt=\"GitHub\" src=\"https://img.shields.io/github/license/huggingface/tokenizers.svg?color=blue\">\n </a>\n</p>\n<br>\n\n# Tokenizers\n\nProvides an implementation of today's most used tokenizers, with a focus on performance and\nversatility.\n\nBindings over the [Rust](https://github.com/huggingface/tokenizers/tree/master/tokenizers) implementation.\nIf you are interested in the High-level design, you can go check it there.\n\nOtherwise, let's dive in!\n\n## Main features:\n\n - Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3\n most common BPE versions).\n - Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes\n less than 20 seconds to tokenize a GB of text on a server's CPU.\n - Easy to use, but also extremely versatile.\n - Designed for research and production.\n - Normalization comes with alignments tracking. It's always possible to get the part of the\n original sentence that corresponds to a given token.\n - Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.\n\n### Installation\n\n#### With pip:\n\n```bash\npip install tokenizers\n```\n\n#### From sources:\n\nTo use this method, you need to have the Rust installed:\n\n```bash\n# Install with:\ncurl https://sh.rustup.rs -sSf | sh -s -- -y\nexport PATH=\"$HOME/.cargo/bin:$PATH\"\n```\n\nOnce Rust is installed, you can compile doing the following\n\n```bash\ngit clone https://github.com/huggingface/tokenizers\ncd tokenizers/bindings/python\n\n# Create a virtual env (you can use yours as well)\npython -m venv .env\nsource .env/bin/activate\n\n# Install `tokenizers` in the current virtual env\npip install -e .\n```\n\n### Load a pretrained tokenizer from the Hub\n\n```python\nfrom tokenizers import Tokenizer\n\ntokenizer = Tokenizer.from_pretrained(\"bert-base-cased\")\n```\n\n### Using the provided Tokenizers\n\nWe provide some pre-build tokenizers to cover the most common cases. You can easily load one of\nthese using some `vocab.json` and `merges.txt` files:\n\n```python\nfrom tokenizers import CharBPETokenizer\n\n# Initialize a tokenizer\nvocab = \"./path/to/vocab.json\"\nmerges = \"./path/to/merges.txt\"\ntokenizer = CharBPETokenizer(vocab, merges)\n\n# And then encode:\nencoded = tokenizer.encode(\"I can feel the magic, can you?\")\nprint(encoded.ids)\nprint(encoded.tokens)\n```\n\nAnd you can train them just as simply:\n\n```python\nfrom tokenizers import CharBPETokenizer\n\n# Initialize a tokenizer\ntokenizer = CharBPETokenizer()\n\n# Then train it!\ntokenizer.train([ \"./path/to/files/1.txt\", \"./path/to/files/2.txt\" ])\n\n# Now, let's use it:\nencoded = tokenizer.encode(\"I can feel the magic, can you?\")\n\n# And finally save it somewhere\ntokenizer.save(\"./path/to/directory/my-bpe.tokenizer.json\")\n```\n\n#### Provided Tokenizers\n\n - `CharBPETokenizer`: The original BPE\n - `ByteLevelBPETokenizer`: The byte level version of the BPE\n - `SentencePieceBPETokenizer`: A BPE implementation compatible with the one used by SentencePiece\n - `BertWordPieceTokenizer`: The famous Bert tokenizer, using WordPiece\n\nAll of these can be used and trained as explained above!\n\n### Build your own\n\nWhenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer,\nby putting all the different parts you need together.\nYou can check how we implemented the [provided tokenizers](https://github.com/huggingface/tokenizers/tree/master/bindings/python/py_src/tokenizers/implementations) and adapt them easily to your own needs.\n\n#### Building a byte-level BPE\n\nHere is an example showing how to build your own byte-level BPE by putting all the different pieces\ntogether, and then saving it to a single file:\n\n```python\nfrom tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors\n\n# Initialize a tokenizer\ntokenizer = Tokenizer(models.BPE())\n\n# Customize pre-tokenization and decoding\ntokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)\ntokenizer.decoder = decoders.ByteLevel()\ntokenizer.post_processor = processors.ByteLevel(trim_offsets=True)\n\n# And then train\ntrainer = trainers.BpeTrainer(\n vocab_size=20000,\n min_frequency=2,\n initial_alphabet=pre_tokenizers.ByteLevel.alphabet()\n)\ntokenizer.train([\n \"./path/to/dataset/1.txt\",\n \"./path/to/dataset/2.txt\",\n \"./path/to/dataset/3.txt\"\n], trainer=trainer)\n\n# And Save it\ntokenizer.save(\"byte-level-bpe.tokenizer.json\", pretty=True)\n```\n\nNow, when you want to use this tokenizer, this is as simple as:\n\n```python\nfrom tokenizers import Tokenizer\n\ntokenizer = Tokenizer.from_file(\"byte-level-bpe.tokenizer.json\")\n\nencoded = tokenizer.encode(\"I can feel the magic, can you?\")\n```\n\n",
"bugtrack_url": null,
"license": null,
"summary": null,
"version": "0.19.1",
"project_urls": {
"Homepage": "https://github.com/huggingface/tokenizers",
"Source": "https://github.com/huggingface/tokenizers"
},
"split_keywords": [
"nlp",
" tokenizer",
" bpe",
" transformer",
" deep learning"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "c16091cac8d496b304ec5a22f07606893cad35ea8e1a8406dc8909e365f97a80",
"md5": "7db5f4b616a06b1a93e0719e3158d1cb",
"sha256": "952078130b3d101e05ecfc7fc3640282d74ed26bcf691400f872563fca15ac97"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "7db5f4b616a06b1a93e0719e3158d1cb",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 2533301,
"upload_time": "2024-04-17T21:36:02",
"upload_time_iso_8601": "2024-04-17T21:36:02.256587Z",
"url": "https://files.pythonhosted.org/packages/c1/60/91cac8d496b304ec5a22f07606893cad35ea8e1a8406dc8909e365f97a80/tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "4c129cb68762ff5fee1efd51aefe2f62cb225f26f060a68a3779e1060bbc7a59",
"md5": "2ab6e3386315145e64df7476f98c81d1",
"sha256": "82c8b8063de6c0468f08e82c4e198763e7b97aabfe573fd4cf7b33930ca4df77"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "2ab6e3386315145e64df7476f98c81d1",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 2440223,
"upload_time": "2024-04-17T21:36:06",
"upload_time_iso_8601": "2024-04-17T21:36:06.941060Z",
"url": "https://files.pythonhosted.org/packages/4c/12/9cb68762ff5fee1efd51aefe2f62cb225f26f060a68a3779e1060bbc7a59/tokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e403b2020e6a78fb994cff1ec962adc157c23109172a46b4fe451d6d0dd33fdb",
"md5": "d811b1e3b1be9d4742f76f644bed6be6",
"sha256": "f03727225feaf340ceeb7e00604825addef622d551cbd46b7b775ac834c1e1c4"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "d811b1e3b1be9d4742f76f644bed6be6",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 3683779,
"upload_time": "2024-04-17T21:36:09",
"upload_time_iso_8601": "2024-04-17T21:36:09.626307Z",
"url": "https://files.pythonhosted.org/packages/e4/03/b2020e6a78fb994cff1ec962adc157c23109172a46b4fe451d6d0dd33fdb/tokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "504e2e5549a26dc6f9e434f83bebf16c2d7dc9dc3477cc0ec8b23ede4d465b90",
"md5": "863773622df5c0b8055c158a57e740c6",
"sha256": "453e4422efdfc9c6b6bf2eae00d5e323f263fff62b29a8c9cd526c5003f3f642"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "863773622df5c0b8055c158a57e740c6",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 3569431,
"upload_time": "2024-04-17T21:36:12",
"upload_time_iso_8601": "2024-04-17T21:36:12.283253Z",
"url": "https://files.pythonhosted.org/packages/50/4e/2e5549a26dc6f9e434f83bebf16c2d7dc9dc3477cc0ec8b23ede4d465b90/tokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7579158626bd794e75551e0c6bb93f1cd3c9ba08ba14b181b98f09e95994f609",
"md5": "af37024b72c0ca795ecbf134c2ddd1af",
"sha256": "02e81bf089ebf0e7f4df34fa0207519f07e66d8491d963618252f2e0729e0b46"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "af37024b72c0ca795ecbf134c2ddd1af",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 3424739,
"upload_time": "2024-04-17T21:36:14",
"upload_time_iso_8601": "2024-04-17T21:36:14.787308Z",
"url": "https://files.pythonhosted.org/packages/75/79/158626bd794e75551e0c6bb93f1cd3c9ba08ba14b181b98f09e95994f609/tokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "658e5f4316976c26009f1ae0b6543f3d97af29afa5ba5dc145251e6a07314618",
"md5": "31d778744425faa24196a593e7a1c3df",
"sha256": "b07c538ba956843833fee1190cf769c60dc62e1cf934ed50d77d5502194d63b1"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "31d778744425faa24196a593e7a1c3df",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 3965791,
"upload_time": "2024-04-17T21:36:18",
"upload_time_iso_8601": "2024-04-17T21:36:18.528479Z",
"url": "https://files.pythonhosted.org/packages/65/8e/5f4316976c26009f1ae0b6543f3d97af29afa5ba5dc145251e6a07314618/tokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "6ae15dbac9618709972434eea072670cd69fba1aa988e6200f16057722b4bf96",
"md5": "8453e2d502806f51cf64400c091b5336",
"sha256": "e28cab1582e0eec38b1f38c1c1fb2e56bce5dc180acb1724574fc5f47da2a4fe"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "8453e2d502806f51cf64400c091b5336",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 4049879,
"upload_time": "2024-04-17T21:36:21",
"upload_time_iso_8601": "2024-04-17T21:36:21.251957Z",
"url": "https://files.pythonhosted.org/packages/6a/e1/5dbac9618709972434eea072670cd69fba1aa988e6200f16057722b4bf96/tokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "404feb78de4af3b17b589f43a369cbf0c3a7173f25c3d2cd93068852c07689aa",
"md5": "ad127afbf190713479ec8e9182e8b37e",
"sha256": "8b01afb7193d47439f091cd8f070a1ced347ad0f9144952a30a41836902fe09e"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "ad127afbf190713479ec8e9182e8b37e",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 3607049,
"upload_time": "2024-04-17T21:36:23",
"upload_time_iso_8601": "2024-04-17T21:36:23.803111Z",
"url": "https://files.pythonhosted.org/packages/40/4f/eb78de4af3b17b589f43a369cbf0c3a7173f25c3d2cd93068852c07689aa/tokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f5f8141dcb0f88e9452af8d20d14dd53aab5937222a2bb4f2c04bfed6829263c",
"md5": "62fabe77fe828a8c2efc2c279f10dd3a",
"sha256": "7fb297edec6c6841ab2e4e8f357209519188e4a59b557ea4fafcf4691d1b4c98"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "62fabe77fe828a8c2efc2c279f10dd3a",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 9634084,
"upload_time": "2024-04-17T21:36:26",
"upload_time_iso_8601": "2024-04-17T21:36:26.750279Z",
"url": "https://files.pythonhosted.org/packages/f5/f8/141dcb0f88e9452af8d20d14dd53aab5937222a2bb4f2c04bfed6829263c/tokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2ebedebb7caa3f88ed54015170db16e07aa3a5fea2d3983d0dde92f98d888dc8",
"md5": "520d8c2d19ce7e2c60eef1305769d730",
"sha256": "2e8a3dd055e515df7054378dc9d6fa8c8c34e1f32777fb9a01fea81496b3f9d3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "520d8c2d19ce7e2c60eef1305769d730",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 9949480,
"upload_time": "2024-04-17T21:36:29",
"upload_time_iso_8601": "2024-04-17T21:36:29.592554Z",
"url": "https://files.pythonhosted.org/packages/2e/be/debb7caa3f88ed54015170db16e07aa3a5fea2d3983d0dde92f98d888dc8/tokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7ae726bedf5d270d293d572a90bd66b0b030012aedb95d8ee87e8bcd446b76fb",
"md5": "81d7879a3d4847a17d73d0f3a4b4fc22",
"sha256": "7ff898780a155ea053f5d934925f3902be2ed1f4d916461e1a93019cc7250837"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-none-win32.whl",
"has_sig": false,
"md5_digest": "81d7879a3d4847a17d73d0f3a4b4fc22",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 2041462,
"upload_time": "2024-04-17T21:36:33",
"upload_time_iso_8601": "2024-04-17T21:36:33.369732Z",
"url": "https://files.pythonhosted.org/packages/7a/e7/26bedf5d270d293d572a90bd66b0b030012aedb95d8ee87e8bcd446b76fb/tokenizers-0.19.1-cp310-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f485d999b9a05fd101d48f1a365d68be0b109277bb25c89fb37a389d669f9185",
"md5": "4adcc7ad724cb444dd1d481d59d2acdb",
"sha256": "bea6f9947e9419c2fda21ae6c32871e3d398cba549b93f4a65a2d369662d9403"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp310-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "4adcc7ad724cb444dd1d481d59d2acdb",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.7",
"size": 2220036,
"upload_time": "2024-04-17T21:36:35",
"upload_time_iso_8601": "2024-04-17T21:36:35.903944Z",
"url": "https://files.pythonhosted.org/packages/f4/85/d999b9a05fd101d48f1a365d68be0b109277bb25c89fb37a389d669f9185/tokenizers-0.19.1-cp310-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c8d66e1d728d765eb4102767f071bf7f6439ab10d7f4a975c9217db65715207a",
"md5": "5cd34189d886eda58f482e32ed60551f",
"sha256": "5c88d1481f1882c2e53e6bb06491e474e420d9ac7bdff172610c4f9ad3898059"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "5cd34189d886eda58f482e32ed60551f",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 2533448,
"upload_time": "2024-04-17T21:36:38",
"upload_time_iso_8601": "2024-04-17T21:36:38.610600Z",
"url": "https://files.pythonhosted.org/packages/c8/d6/6e1d728d765eb4102767f071bf7f6439ab10d7f4a975c9217db65715207a/tokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9079d17a0f491d10817cd30f1121a07aa09c8e97a81114b116e473baf1577f09",
"md5": "1f0705e2d594bf1084e61e83bdb85b3c",
"sha256": "ddf672ed719b4ed82b51499100f5417d7d9f6fb05a65e232249268f35de5ed14"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "1f0705e2d594bf1084e61e83bdb85b3c",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 2440254,
"upload_time": "2024-04-17T21:36:40",
"upload_time_iso_8601": "2024-04-17T21:36:40.398056Z",
"url": "https://files.pythonhosted.org/packages/90/79/d17a0f491d10817cd30f1121a07aa09c8e97a81114b116e473baf1577f09/tokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c7282d11c3ff94f9d42eceb2ea549a06e3f166fe391c5a025e5d96fac898a3ac",
"md5": "9d2b564309110806dcafc80f408fd779",
"sha256": "dadc509cc8a9fe460bd274c0e16ac4184d0958117cf026e0ea8b32b438171594"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "9d2b564309110806dcafc80f408fd779",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 3684971,
"upload_time": "2024-04-17T21:36:43",
"upload_time_iso_8601": "2024-04-17T21:36:43.115242Z",
"url": "https://files.pythonhosted.org/packages/c7/28/2d11c3ff94f9d42eceb2ea549a06e3f166fe391c5a025e5d96fac898a3ac/tokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "36c6537f22b57e6003904d35d07962dbde2f2e9bdd791d0241da976a4c7f8194",
"md5": "f69d98e37af910d2019a4b84df49b917",
"sha256": "dfedf31824ca4915b511b03441784ff640378191918264268e6923da48104acc"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "f69d98e37af910d2019a4b84df49b917",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 3568894,
"upload_time": "2024-04-17T21:36:45",
"upload_time_iso_8601": "2024-04-17T21:36:45.011471Z",
"url": "https://files.pythonhosted.org/packages/36/c6/537f22b57e6003904d35d07962dbde2f2e9bdd791d0241da976a4c7f8194/tokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "afef3c1deed14ec59b2c8e7e2fa27b2a53f7d101181277a43b89ab17d891ef2e",
"md5": "7f7f17aad33ebad3a4ca9b9bae041b99",
"sha256": "ac11016d0a04aa6487b1513a3a36e7bee7eec0e5d30057c9c0408067345c48d2"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "7f7f17aad33ebad3a4ca9b9bae041b99",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 3426873,
"upload_time": "2024-04-17T21:36:47",
"upload_time_iso_8601": "2024-04-17T21:36:47.001434Z",
"url": "https://files.pythonhosted.org/packages/af/ef/3c1deed14ec59b2c8e7e2fa27b2a53f7d101181277a43b89ab17d891ef2e/tokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "06dbc0320c4798ac6bd12d2ef895bec9d10d216a3b4d6fff10e9d68883ea7edc",
"md5": "e4a3fb5af5b5588961042fcf66764e82",
"sha256": "76951121890fea8330d3a0df9a954b3f2a37e3ec20e5b0530e9a0044ca2e11fe"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "e4a3fb5af5b5588961042fcf66764e82",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 3965050,
"upload_time": "2024-04-17T21:36:49",
"upload_time_iso_8601": "2024-04-17T21:36:49.202385Z",
"url": "https://files.pythonhosted.org/packages/06/db/c0320c4798ac6bd12d2ef895bec9d10d216a3b4d6fff10e9d68883ea7edc/tokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "4c8aa166888d6cb14db55f5eb7ce0b1d4777d145aa27cbf4f945712cf6c29935",
"md5": "7060c1188ede557fc2611a0145de7eb0",
"sha256": "b342d2ce8fc8d00f376af068e3274e2e8649562e3bc6ae4a67784ded6b99428d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "7060c1188ede557fc2611a0145de7eb0",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 4047855,
"upload_time": "2024-04-17T21:36:52",
"upload_time_iso_8601": "2024-04-17T21:36:52.864272Z",
"url": "https://files.pythonhosted.org/packages/4c/8a/a166888d6cb14db55f5eb7ce0b1d4777d145aa27cbf4f945712cf6c29935/tokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a703fb50fc03f86016b227a967c8d474f90230c885c0d18f78acdfda7a96ce56",
"md5": "58aa86e1256b2ad4c4c4ad2e9c64a34f",
"sha256": "d16ff18907f4909dca9b076b9c2d899114dd6abceeb074eca0c93e2353f943aa"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "58aa86e1256b2ad4c4c4ad2e9c64a34f",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 3608228,
"upload_time": "2024-04-17T21:36:55",
"upload_time_iso_8601": "2024-04-17T21:36:55.700718Z",
"url": "https://files.pythonhosted.org/packages/a7/03/fb50fc03f86016b227a967c8d474f90230c885c0d18f78acdfda7a96ce56/tokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "5bcd0385e1026e1e03732fd398e964792a3a8433918b166748c82507e014d748",
"md5": "5172af6b7578f7439b2978cf2e4f952a",
"sha256": "706a37cc5332f85f26efbe2bdc9ef8a9b372b77e4645331a405073e4b3a8c1c6"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "5172af6b7578f7439b2978cf2e4f952a",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 9633115,
"upload_time": "2024-04-17T21:36:58",
"upload_time_iso_8601": "2024-04-17T21:36:58.299464Z",
"url": "https://files.pythonhosted.org/packages/5b/cd/0385e1026e1e03732fd398e964792a3a8433918b166748c82507e014d748/tokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "25508f8ad0bbdaf09d04b15e6502d1fa1c653754ed7e016e4ae009726aa1a4e4",
"md5": "82bae0ff96d8c4b7fc2b257deec87e93",
"sha256": "16baac68651701364b0289979ecec728546133e8e8fe38f66fe48ad07996b88b"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "82bae0ff96d8c4b7fc2b257deec87e93",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 9949062,
"upload_time": "2024-04-17T21:37:01",
"upload_time_iso_8601": "2024-04-17T21:37:01.947819Z",
"url": "https://files.pythonhosted.org/packages/25/50/8f8ad0bbdaf09d04b15e6502d1fa1c653754ed7e016e4ae009726aa1a4e4/tokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "db1131be66710f1d14526f3588a441efadeb184e1e68458067007b20ead03c59",
"md5": "fb73604c4d08e7f649b293f15fc1f74b",
"sha256": "9ed240c56b4403e22b9584ee37d87b8bfa14865134e3e1c3fb4b2c42fafd3256"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-none-win32.whl",
"has_sig": false,
"md5_digest": "fb73604c4d08e7f649b293f15fc1f74b",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 2041039,
"upload_time": "2024-04-17T21:37:05",
"upload_time_iso_8601": "2024-04-17T21:37:05.607278Z",
"url": "https://files.pythonhosted.org/packages/db/11/31be66710f1d14526f3588a441efadeb184e1e68458067007b20ead03c59/tokenizers-0.19.1-cp311-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "658e6d7d72b28f22c422cff8beae10ac3c2e4376b9be721ef8167b7eecd1da62",
"md5": "17c0000754eb1df2fe6053f7d31f5f90",
"sha256": "ad57d59341710b94a7d9dbea13f5c1e7d76fd8d9bcd944a7a6ab0b0da6e0cc66"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp311-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "17c0000754eb1df2fe6053f7d31f5f90",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.7",
"size": 2220386,
"upload_time": "2024-04-17T21:37:08",
"upload_time_iso_8601": "2024-04-17T21:37:08.295479Z",
"url": "https://files.pythonhosted.org/packages/65/8e/6d7d72b28f22c422cff8beae10ac3c2e4376b9be721ef8167b7eecd1da62/tokenizers-0.19.1-cp311-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "63902890cd096898dcdb596ee172cde40c0f54a9cf43b0736aa260a5501252af",
"md5": "42eed543e4a641027f8b2bc37943bd75",
"sha256": "621d670e1b1c281a1c9698ed89451395d318802ff88d1fc1accff0867a06f153"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "42eed543e4a641027f8b2bc37943bd75",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 2530580,
"upload_time": "2024-04-17T21:37:10",
"upload_time_iso_8601": "2024-04-17T21:37:10.688761Z",
"url": "https://files.pythonhosted.org/packages/63/90/2890cd096898dcdb596ee172cde40c0f54a9cf43b0736aa260a5501252af/tokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "74d1f4e1e950adb36675dfd8f9d0f4be644f3f3aaf22a5677a4f5c81282b662e",
"md5": "dee05246d56521783cc529827e6acf82",
"sha256": "d924204a3dbe50b75630bd16f821ebda6a5f729928df30f582fb5aade90c818a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "dee05246d56521783cc529827e6acf82",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 2436682,
"upload_time": "2024-04-17T21:37:12",
"upload_time_iso_8601": "2024-04-17T21:37:12.966124Z",
"url": "https://files.pythonhosted.org/packages/74/d1/f4e1e950adb36675dfd8f9d0f4be644f3f3aaf22a5677a4f5c81282b662e/tokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ed3089b321a16c58d233e301ec15072c0d3ed5014825e72da98604cd3ab2fba1",
"md5": "a6f947435d87b448a65e8299795e3194",
"sha256": "4f3fefdc0446b1a1e6d81cd4c07088ac015665d2e812f6dbba4a06267d1a2c95"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "a6f947435d87b448a65e8299795e3194",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 3693494,
"upload_time": "2024-04-17T21:37:14",
"upload_time_iso_8601": "2024-04-17T21:37:14.755386Z",
"url": "https://files.pythonhosted.org/packages/ed/30/89b321a16c58d233e301ec15072c0d3ed5014825e72da98604cd3ab2fba1/tokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0540fa899f32de483500fbc78befd378fd7afba4270f17db707d1a78c0a4ddc3",
"md5": "31eb9eab587a57ff1941a9f58ac0e402",
"sha256": "9620b78e0b2d52ef07b0d428323fb34e8ea1219c5eac98c2596311f20f1f9266"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "31eb9eab587a57ff1941a9f58ac0e402",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 3566541,
"upload_time": "2024-04-17T21:37:17",
"upload_time_iso_8601": "2024-04-17T21:37:17.067978Z",
"url": "https://files.pythonhosted.org/packages/05/40/fa899f32de483500fbc78befd378fd7afba4270f17db707d1a78c0a4ddc3/tokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "6714e7da32ae5fb4971830f1ef335932fae3fa57e76b537e852f146c850aefdf",
"md5": "5cc446d41ca886ff63f5ddbce27587fd",
"sha256": "04ce49e82d100594715ac1b2ce87d1a36e61891a91de774755f743babcd0dd52"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "5cc446d41ca886ff63f5ddbce27587fd",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 3430792,
"upload_time": "2024-04-17T21:37:19",
"upload_time_iso_8601": "2024-04-17T21:37:19.055085Z",
"url": "https://files.pythonhosted.org/packages/67/14/e7da32ae5fb4971830f1ef335932fae3fa57e76b537e852f146c850aefdf/tokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f24baae61bdb6ab584d2612170801703982ee0e35f8b6adacbeefe5a3b277621",
"md5": "d813622799dcb2d682af016dd5a4b055",
"sha256": "c5c2ff13d157afe413bf7e25789879dd463e5a4abfb529a2d8f8473d8042e28f"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "d813622799dcb2d682af016dd5a4b055",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 3962812,
"upload_time": "2024-04-17T21:37:21",
"upload_time_iso_8601": "2024-04-17T21:37:21.008448Z",
"url": "https://files.pythonhosted.org/packages/f2/4b/aae61bdb6ab584d2612170801703982ee0e35f8b6adacbeefe5a3b277621/tokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0ab6f7b7ef89c4da7b20256e6eab23d3835f05d1ca8f451d31c16cbfe3cd9eb6",
"md5": "43ed77468fee2374194754d98a3821be",
"sha256": "3174c76efd9d08f836bfccaca7cfec3f4d1c0a4cf3acbc7236ad577cc423c840"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "43ed77468fee2374194754d98a3821be",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 4024688,
"upload_time": "2024-04-17T21:37:23",
"upload_time_iso_8601": "2024-04-17T21:37:23.659461Z",
"url": "https://files.pythonhosted.org/packages/0a/b6/f7b7ef89c4da7b20256e6eab23d3835f05d1ca8f451d31c16cbfe3cd9eb6/tokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "805412047a69f5b382d7ee72044dc89151a2dd0d13b2c9bdcc22654883704d31",
"md5": "ffe0493b2b926d9b416a3953c173824c",
"sha256": "7c9d5b6c0e7a1e979bec10ff960fae925e947aab95619a6fdb4c1d8ff3708ce3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "ffe0493b2b926d9b416a3953c173824c",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 3610961,
"upload_time": "2024-04-17T21:37:26",
"upload_time_iso_8601": "2024-04-17T21:37:26.234790Z",
"url": "https://files.pythonhosted.org/packages/80/54/12047a69f5b382d7ee72044dc89151a2dd0d13b2c9bdcc22654883704d31/tokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "52b71e8a913d18ac28feeda42d4d2d51781874398fb59cd1c1e2653a4b5742ed",
"md5": "d419c0c78b571a261dbcd383664e961b",
"sha256": "a179856d1caee06577220ebcfa332af046d576fb73454b8f4d4b0ba8324423ea"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "d419c0c78b571a261dbcd383664e961b",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 9631367,
"upload_time": "2024-04-17T21:37:28",
"upload_time_iso_8601": "2024-04-17T21:37:28.752985Z",
"url": "https://files.pythonhosted.org/packages/52/b7/1e8a913d18ac28feeda42d4d2d51781874398fb59cd1c1e2653a4b5742ed/tokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ac3d2284f6d99f8f21d09352b88b8cfefa24ab88468d962aeb0aa15c20d76b32",
"md5": "67705fd9613c8926205a8d93be12254f",
"sha256": "952b80dac1a6492170f8c2429bd11fcaa14377e097d12a1dbe0ef2fb2241e16c"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "67705fd9613c8926205a8d93be12254f",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 9950121,
"upload_time": "2024-04-17T21:37:31",
"upload_time_iso_8601": "2024-04-17T21:37:31.741548Z",
"url": "https://files.pythonhosted.org/packages/ac/3d/2284f6d99f8f21d09352b88b8cfefa24ab88468d962aeb0aa15c20d76b32/tokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2a94ec3369dbc9b7200c14c8c7a1a04c78b7a7398d0c001e1b7d1ffe30eb93a0",
"md5": "959a1f66ab8e0cb8e172dfb674cdfdc8",
"sha256": "01d62812454c188306755c94755465505836fd616f75067abcae529c35edeb57"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-none-win32.whl",
"has_sig": false,
"md5_digest": "959a1f66ab8e0cb8e172dfb674cdfdc8",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 2044069,
"upload_time": "2024-04-17T21:37:35",
"upload_time_iso_8601": "2024-04-17T21:37:35.672159Z",
"url": "https://files.pythonhosted.org/packages/2a/94/ec3369dbc9b7200c14c8c7a1a04c78b7a7398d0c001e1b7d1ffe30eb93a0/tokenizers-0.19.1-cp312-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0c9780bff6937e0c67d30c0facacd4f0bcf4254e581aa4995c73cef8c8640e56",
"md5": "b655c2e82880368cbecd02933322cdd8",
"sha256": "b70bfbe3a82d3e3fb2a5e9b22a39f8d1740c96c68b6ace0086b39074f08ab89a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp312-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "b655c2e82880368cbecd02933322cdd8",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.7",
"size": 2214527,
"upload_time": "2024-04-17T21:37:39",
"upload_time_iso_8601": "2024-04-17T21:37:39.190060Z",
"url": "https://files.pythonhosted.org/packages/0c/97/80bff6937e0c67d30c0facacd4f0bcf4254e581aa4995c73cef8c8640e56/tokenizers-0.19.1-cp312-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3f16fbef1dabec1a5e83aad7aa28d19863c5ab9db3cf714bc96df5531a0e94db",
"md5": "74c0a5166e8a3ac6adc316d3a7067cc9",
"sha256": "bb9dfe7dae85bc6119d705a76dc068c062b8b575abe3595e3c6276480e67e3f1"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "74c0a5166e8a3ac6adc316d3a7067cc9",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 2534664,
"upload_time": "2024-04-17T21:37:41",
"upload_time_iso_8601": "2024-04-17T21:37:41.142728Z",
"url": "https://files.pythonhosted.org/packages/3f/16/fbef1dabec1a5e83aad7aa28d19863c5ab9db3cf714bc96df5531a0e94db/tokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ca0c76f2340099c3058eb3ca72a33f1b74a545ad4f9445c894faff574eb5e8e5",
"md5": "867cc6ce8c083f1675dd38d93cc9da5e",
"sha256": "1f0360cbea28ea99944ac089c00de7b2e3e1c58f479fb8613b6d8d511ce98267"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "867cc6ce8c083f1675dd38d93cc9da5e",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 2441016,
"upload_time": "2024-04-17T21:37:43",
"upload_time_iso_8601": "2024-04-17T21:37:43.734186Z",
"url": "https://files.pythonhosted.org/packages/ca/0c/76f2340099c3058eb3ca72a33f1b74a545ad4f9445c894faff574eb5e8e5/tokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "02b43961dd02ed16ade7c667409ec7f71be52a36d5d55c5aa35611320bcf4ea0",
"md5": "27e9a318e3a9c3c516ed7abd5cd68bd5",
"sha256": "71e3ec71f0e78780851fef28c2a9babe20270404c921b756d7c532d280349214"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "27e9a318e3a9c3c516ed7abd5cd68bd5",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 3686107,
"upload_time": "2024-04-17T21:37:45",
"upload_time_iso_8601": "2024-04-17T21:37:45.753393Z",
"url": "https://files.pythonhosted.org/packages/02/b4/3961dd02ed16ade7c667409ec7f71be52a36d5d55c5aa35611320bcf4ea0/tokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9cb8747bc61ac331c551429a373621bfa3ba506474a7205504cd06cf718fceed",
"md5": "bc24491f9548a4c8daee291c7dacbed5",
"sha256": "b82931fa619dbad979c0ee8e54dd5278acc418209cc897e42fac041f5366d626"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "bc24491f9548a4c8daee291c7dacbed5",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 3569791,
"upload_time": "2024-04-17T21:37:48",
"upload_time_iso_8601": "2024-04-17T21:37:48.060995Z",
"url": "https://files.pythonhosted.org/packages/9c/b8/747bc61ac331c551429a373621bfa3ba506474a7205504cd06cf718fceed/tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ddd187b954f3ab1f28e158bbe2afbf854c2850b60b199cd6a7d790895ab15639",
"md5": "41005ba653848163eaeb2d414b5715a8",
"sha256": "e8ff5b90eabdcdaa19af697885f70fe0b714ce16709cf43d4952f1f85299e73a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "41005ba653848163eaeb2d414b5715a8",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 3424961,
"upload_time": "2024-04-17T21:37:50",
"upload_time_iso_8601": "2024-04-17T21:37:50.096703Z",
"url": "https://files.pythonhosted.org/packages/dd/d1/87b954f3ab1f28e158bbe2afbf854c2850b60b199cd6a7d790895ab15639/tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9085e0c86a7d1e51db5ef2635cc80466dc6e830bb35fcafec104718437b2b9a4",
"md5": "759247d117c738caffa10d3b1f47ee02",
"sha256": "e742d76ad84acbdb1a8e4694f915fe59ff6edc381c97d6dfdd054954e3478ad4"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "759247d117c738caffa10d3b1f47ee02",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 3962627,
"upload_time": "2024-04-17T21:37:52",
"upload_time_iso_8601": "2024-04-17T21:37:52.642473Z",
"url": "https://files.pythonhosted.org/packages/90/85/e0c86a7d1e51db5ef2635cc80466dc6e830bb35fcafec104718437b2b9a4/tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "17b3beb7b8e6e2e104029e0fb4c3d073f0b70e24c7b1464349e255a7f30502e7",
"md5": "2816239592dcc1d30fb504450f3600ae",
"sha256": "d8c5d59d7b59885eab559d5bc082b2985555a54cda04dda4c65528d90ad252ad"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "2816239592dcc1d30fb504450f3600ae",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 4057441,
"upload_time": "2024-04-17T21:37:55",
"upload_time_iso_8601": "2024-04-17T21:37:55.202367Z",
"url": "https://files.pythonhosted.org/packages/17/b3/beb7b8e6e2e104029e0fb4c3d073f0b70e24c7b1464349e255a7f30502e7/tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b8c2e9c23c9263d0d0b0c366400325b5f472ae7cf8d54cdec3c74f96ab5309ae",
"md5": "eaf0b8a5692af8771a3ff9b9e99a80e1",
"sha256": "6b2da5c32ed869bebd990c9420df49813709e953674c0722ff471a116d97b22d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "eaf0b8a5692af8771a3ff9b9e99a80e1",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 3611217,
"upload_time": "2024-04-17T21:37:57",
"upload_time_iso_8601": "2024-04-17T21:37:57.260073Z",
"url": "https://files.pythonhosted.org/packages/b8/c2/e9c23c9263d0d0b0c366400325b5f472ae7cf8d54cdec3c74f96ab5309ae/tokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c1afd209248152647cc3f007d0614d25177feb503346aeec4b658a1b47068571",
"md5": "f42221cf4b3768378ef0115007017fde",
"sha256": "638e43936cc8b2cbb9f9d8dde0fe5e7e30766a3318d2342999ae27f68fdc9bd6"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "f42221cf4b3768378ef0115007017fde",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 9633766,
"upload_time": "2024-04-17T21:37:59",
"upload_time_iso_8601": "2024-04-17T21:37:59.771999Z",
"url": "https://files.pythonhosted.org/packages/c1/af/d209248152647cc3f007d0614d25177feb503346aeec4b658a1b47068571/tokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c6138ffe956006673030cf69f1e2e696ecb20a4b1feecde3abf085508323df91",
"md5": "138507936173bd1d9548a3c1fa385807",
"sha256": "78e769eb3b2c79687d9cb0f89ef77223e8e279b75c0a968e637ca7043a84463f"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "138507936173bd1d9548a3c1fa385807",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 9948193,
"upload_time": "2024-04-17T21:38:03",
"upload_time_iso_8601": "2024-04-17T21:38:03.112652Z",
"url": "https://files.pythonhosted.org/packages/c6/13/8ffe956006673030cf69f1e2e696ecb20a4b1feecde3abf085508323df91/tokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b919320fcad0a094a2d3621725a23d08750fa33adc460cd2aaec009b267db0d1",
"md5": "b492b1c79cf0d7d2b2f20132a0856278",
"sha256": "72791f9bb1ca78e3ae525d4782e85272c63faaef9940d92142aa3eb79f3407a3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-none-win32.whl",
"has_sig": false,
"md5_digest": "b492b1c79cf0d7d2b2f20132a0856278",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 2039491,
"upload_time": "2024-04-17T21:38:05",
"upload_time_iso_8601": "2024-04-17T21:38:05.911464Z",
"url": "https://files.pythonhosted.org/packages/b9/19/320fcad0a094a2d3621725a23d08750fa33adc460cd2aaec009b267db0d1/tokenizers-0.19.1-cp37-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cbeae9bf17a3f492d756b54c87ffcb99a606078c3224e276c8263c5eb69db423",
"md5": "9164af0378c107c372b2b5f5cf4a3f36",
"sha256": "f3bbb7a0c5fcb692950b041ae11067ac54826204318922da754f908d95619fbc"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp37-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "9164af0378c107c372b2b5f5cf4a3f36",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.7",
"size": 2219496,
"upload_time": "2024-04-17T21:38:08",
"upload_time_iso_8601": "2024-04-17T21:38:08.439474Z",
"url": "https://files.pythonhosted.org/packages/cb/ea/e9bf17a3f492d756b54c87ffcb99a606078c3224e276c8263c5eb69db423/tokenizers-0.19.1-cp37-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "6759477125f604cffd2f272301634d3426e258164aebf20b9631eb8141311794",
"md5": "b56c8d21b9568d0f2d44c9a1c72c5301",
"sha256": "07f9295349bbbcedae8cefdbcfa7f686aa420be8aca5d4f7d1ae6016c128c0c5"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "b56c8d21b9568d0f2d44c9a1c72c5301",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 2534014,
"upload_time": "2024-04-17T21:38:11",
"upload_time_iso_8601": "2024-04-17T21:38:11.057006Z",
"url": "https://files.pythonhosted.org/packages/67/59/477125f604cffd2f272301634d3426e258164aebf20b9631eb8141311794/tokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "85de5e53efc7ba183e89ed73d6cc3bc1a08f0ee73770574694c8fb361dbb35e9",
"md5": "108bc85b4109540c45fa0be23f132907",
"sha256": "10a707cc6c4b6b183ec5dbfc5c34f3064e18cf62b4a938cb41699e33a99e03c1"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "108bc85b4109540c45fa0be23f132907",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 2440229,
"upload_time": "2024-04-17T21:38:12",
"upload_time_iso_8601": "2024-04-17T21:38:12.999289Z",
"url": "https://files.pythonhosted.org/packages/85/de/5e53efc7ba183e89ed73d6cc3bc1a08f0ee73770574694c8fb361dbb35e9/tokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d48e6da0899098ee6b8358f80bf6507241d38f7afbe46a93df6c97f5cc2f8bbc",
"md5": "837d15ad7ec8b57687247dca0c9808b9",
"sha256": "6309271f57b397aa0aff0cbbe632ca9d70430839ca3178bf0f06f825924eca22"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "837d15ad7ec8b57687247dca0c9808b9",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 3685955,
"upload_time": "2024-04-17T21:38:15",
"upload_time_iso_8601": "2024-04-17T21:38:15.292934Z",
"url": "https://files.pythonhosted.org/packages/d4/8e/6da0899098ee6b8358f80bf6507241d38f7afbe46a93df6c97f5cc2f8bbc/tokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2c9615fe0fa8637bbd4467cf05f67958afc148a1edcac33f2966ac71a2923958",
"md5": "3b2a8bcce7a64a7bff8bfbab9009df05",
"sha256": "4ad23d37d68cf00d54af184586d79b84075ada495e7c5c0f601f051b162112dc"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "3b2a8bcce7a64a7bff8bfbab9009df05",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 3570281,
"upload_time": "2024-04-17T21:38:17",
"upload_time_iso_8601": "2024-04-17T21:38:17.457986Z",
"url": "https://files.pythonhosted.org/packages/2c/96/15fe0fa8637bbd4467cf05f67958afc148a1edcac33f2966ac71a2923958/tokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2b6eeb5a943dbe04ffe3970df2f44aaf936d4facd3daa36704ef356190005de5",
"md5": "1920365808914e8f3014a5b40adc72b3",
"sha256": "427c4f0f3df9109314d4f75b8d1f65d9477033e67ffaec4bca53293d3aca286d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "1920365808914e8f3014a5b40adc72b3",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 3425037,
"upload_time": "2024-04-17T21:38:19",
"upload_time_iso_8601": "2024-04-17T21:38:19.805154Z",
"url": "https://files.pythonhosted.org/packages/2b/6e/eb5a943dbe04ffe3970df2f44aaf936d4facd3daa36704ef356190005de5/tokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "bbab26810f92b3db96c73f184fa9199910ec80c1b371023e3f29a5effc61c951",
"md5": "c1301883c1ce3c62e16d8ae78a04aa28",
"sha256": "e83a31c9cf181a0a3ef0abad2b5f6b43399faf5da7e696196ddd110d332519ee"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "c1301883c1ce3c62e16d8ae78a04aa28",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 3966908,
"upload_time": "2024-04-17T21:38:23",
"upload_time_iso_8601": "2024-04-17T21:38:23.216578Z",
"url": "https://files.pythonhosted.org/packages/bb/ab/26810f92b3db96c73f184fa9199910ec80c1b371023e3f29a5effc61c951/tokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "6dc39148e2053d3910eab319bb8052964d7af2b6f622192642ef13c2095c4a21",
"md5": "89ec01aa2cba894e781a080654d71cda",
"sha256": "c27b99889bd58b7e301468c0838c5ed75e60c66df0d4db80c08f43462f82e0d3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "89ec01aa2cba894e781a080654d71cda",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 4049276,
"upload_time": "2024-04-17T21:38:25",
"upload_time_iso_8601": "2024-04-17T21:38:25.629800Z",
"url": "https://files.pythonhosted.org/packages/6d/c3/9148e2053d3910eab319bb8052964d7af2b6f622192642ef13c2095c4a21/tokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "180dee99f50407788149bc9eddae6af0b4016865d67fb687730d151683b13b80",
"md5": "72a3d825eb342578782e1f6a10df80cc",
"sha256": "bac0b0eb952412b0b196ca7a40e7dce4ed6f6926489313414010f2e6b9ec2adf"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "72a3d825eb342578782e1f6a10df80cc",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 3608449,
"upload_time": "2024-04-17T21:38:27",
"upload_time_iso_8601": "2024-04-17T21:38:27.964347Z",
"url": "https://files.pythonhosted.org/packages/18/0d/ee99f50407788149bc9eddae6af0b4016865d67fb687730d151683b13b80/tokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "5583b02cb52e580672f23141f5c0aba433395187327904063606ad870586fa8e",
"md5": "9bc7fd2a77eb04282e50da814e0c492a",
"sha256": "8a6298bde623725ca31c9035a04bf2ef63208d266acd2bed8c2cb7d2b7d53ce6"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "9bc7fd2a77eb04282e50da814e0c492a",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 9634741,
"upload_time": "2024-04-17T21:38:30",
"upload_time_iso_8601": "2024-04-17T21:38:30.351926Z",
"url": "https://files.pythonhosted.org/packages/55/83/b02cb52e580672f23141f5c0aba433395187327904063606ad870586fa8e/tokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f66b37bad4b34cc5892a2784e291bcbae197ccc8935a3b64e761d1ef5c009333",
"md5": "deb8d8b5e958474ef0982b1134c211eb",
"sha256": "08a44864e42fa6d7d76d7be4bec62c9982f6f6248b4aa42f7302aa01e0abfd26"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "deb8d8b5e958474ef0982b1134c211eb",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 9951044,
"upload_time": "2024-04-17T21:38:33",
"upload_time_iso_8601": "2024-04-17T21:38:33.769115Z",
"url": "https://files.pythonhosted.org/packages/f6/6b/37bad4b34cc5892a2784e291bcbae197ccc8935a3b64e761d1ef5c009333/tokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7ed644b91c8bcfb41677c62f1b3d1d12017b702382ad3b1c0c87da8e3cc34c34",
"md5": "13a43bdfad2cae057afcbc6afdd7a65d",
"sha256": "1de5bc8652252d9357a666e609cb1453d4f8e160eb1fb2830ee369dd658e8975"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-none-win32.whl",
"has_sig": false,
"md5_digest": "13a43bdfad2cae057afcbc6afdd7a65d",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 2040528,
"upload_time": "2024-04-17T21:38:36",
"upload_time_iso_8601": "2024-04-17T21:38:36.825776Z",
"url": "https://files.pythonhosted.org/packages/7e/d6/44b91c8bcfb41677c62f1b3d1d12017b702382ad3b1c0c87da8e3cc34c34/tokenizers-0.19.1-cp38-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "850e9ac0883a0f76d07de4d45be6442bb23febb26e5f4e22fdc0445d45d4ef24",
"md5": "2d82c67ce5a09a0006ea63fa4eea6179",
"sha256": "0bcce02bf1ad9882345b34d5bd25ed4949a480cf0e656bbd468f4d8986f7a3f1"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp38-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "2d82c67ce5a09a0006ea63fa4eea6179",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.7",
"size": 2219969,
"upload_time": "2024-04-17T21:38:39",
"upload_time_iso_8601": "2024-04-17T21:38:39.831504Z",
"url": "https://files.pythonhosted.org/packages/85/0e/9ac0883a0f76d07de4d45be6442bb23febb26e5f4e22fdc0445d45d4ef24/tokenizers-0.19.1-cp38-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "1aed42801618bab16c79d6bd222977c212dba5770e6c935ba53728b731653a3d",
"md5": "8994c7bff7f995d4baa9903ffa97b88a",
"sha256": "0b9394bd204842a2a1fd37fe29935353742be4a3460b6ccbaefa93f58a8df43d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "8994c7bff7f995d4baa9903ffa97b88a",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 2533937,
"upload_time": "2024-04-17T21:38:41",
"upload_time_iso_8601": "2024-04-17T21:38:41.827465Z",
"url": "https://files.pythonhosted.org/packages/1a/ed/42801618bab16c79d6bd222977c212dba5770e6c935ba53728b731653a3d/tokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0a2b4e5718e806ff23e5e758e02bd4b34967b5218f085b0c189335fd27c14dc1",
"md5": "e552628b554f83116e79ac227e72f4d5",
"sha256": "4692ab92f91b87769d950ca14dbb61f8a9ef36a62f94bad6c82cc84a51f76f6a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "e552628b554f83116e79ac227e72f4d5",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 2440312,
"upload_time": "2024-04-17T21:38:44",
"upload_time_iso_8601": "2024-04-17T21:38:44.514924Z",
"url": "https://files.pythonhosted.org/packages/0a/2b/4e5718e806ff23e5e758e02bd4b34967b5218f085b0c189335fd27c14dc1/tokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c528ac2a277bd23b631e1ff986182c4fcb9028ccc7ff7c07743ef906fa5389e7",
"md5": "a5f4812ee1713ec04b51965458e779f7",
"sha256": "6258c2ef6f06259f70a682491c78561d492e885adeaf9f64f5389f78aa49a051"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "a5f4812ee1713ec04b51965458e779f7",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 3686532,
"upload_time": "2024-04-17T21:38:47",
"upload_time_iso_8601": "2024-04-17T21:38:47.506503Z",
"url": "https://files.pythonhosted.org/packages/c5/28/ac2a277bd23b631e1ff986182c4fcb9028ccc7ff7c07743ef906fa5389e7/tokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ba26139bd2371228a0e203da7b3e3eddcb02f45b2b7edd91df00e342e4b55e13",
"md5": "304a600a99bab6bc38838244cd10dc14",
"sha256": "c85cf76561fbd01e0d9ea2d1cbe711a65400092bc52b5242b16cfd22e51f0c58"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "304a600a99bab6bc38838244cd10dc14",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 3570575,
"upload_time": "2024-04-17T21:38:52",
"upload_time_iso_8601": "2024-04-17T21:38:52.368836Z",
"url": "https://files.pythonhosted.org/packages/ba/26/139bd2371228a0e203da7b3e3eddcb02f45b2b7edd91df00e342e4b55e13/tokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3b6b98383dff29416127c73dc196844ed23e29d790f1ad4b4ecf69d45e03841d",
"md5": "446c98e46a1bfa6e3a28b68a554518ef",
"sha256": "670b802d4d82bbbb832ddb0d41df7015b3e549714c0e77f9bed3e74d42400fbe"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"has_sig": false,
"md5_digest": "446c98e46a1bfa6e3a28b68a554518ef",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 3425806,
"upload_time": "2024-04-17T21:38:54",
"upload_time_iso_8601": "2024-04-17T21:38:54.602760Z",
"url": "https://files.pythonhosted.org/packages/3b/6b/98383dff29416127c73dc196844ed23e29d790f1ad4b4ecf69d45e03841d/tokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3374fa1f86d161db482e10c92d83e924600b691210c5d676fa323738c91d8dba",
"md5": "800ea08dc597180eda49b47fbe6c4474",
"sha256": "85aa3ab4b03d5e99fdd31660872249df5e855334b6c333e0bc13032ff4469c4a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"has_sig": false,
"md5_digest": "800ea08dc597180eda49b47fbe6c4474",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 3965120,
"upload_time": "2024-04-17T21:38:57",
"upload_time_iso_8601": "2024-04-17T21:38:57.444094Z",
"url": "https://files.pythonhosted.org/packages/33/74/fa1f86d161db482e10c92d83e924600b691210c5d676fa323738c91d8dba/tokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e04a59a0aa37b8bfe1888a72f75bbf24b94c888a1aa333aab2910ae22c369e23",
"md5": "f5b838fd44a769380e63ab83d34e28a9",
"sha256": "cbf001afbbed111a79ca47d75941e9e5361297a87d186cbfc11ed45e30b5daba"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"has_sig": false,
"md5_digest": "f5b838fd44a769380e63ab83d34e28a9",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 4048157,
"upload_time": "2024-04-17T21:38:59",
"upload_time_iso_8601": "2024-04-17T21:38:59.667494Z",
"url": "https://files.pythonhosted.org/packages/e0/4a/59a0aa37b8bfe1888a72f75bbf24b94c888a1aa333aab2910ae22c369e23/tokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0fcb8fc733c8f251bac1e5c4ae52458c353b3faa98f41d734c226cad3783da03",
"md5": "c2bc45a39179f702ddae9c0fd06e188e",
"sha256": "b4c89aa46c269e4e70c4d4f9d6bc644fcc39bb409cb2a81227923404dd6f5227"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "c2bc45a39179f702ddae9c0fd06e188e",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 3608229,
"upload_time": "2024-04-17T21:39:02",
"upload_time_iso_8601": "2024-04-17T21:39:02.510757Z",
"url": "https://files.pythonhosted.org/packages/0f/cb/8fc733c8f251bac1e5c4ae52458c353b3faa98f41d734c226cad3783da03/tokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7605badd3a66571ad257270b38c33b9a7470afd2ae12e409c7c74baedf16f2ef",
"md5": "9b70100369d6a0b4475890530f904ad6",
"sha256": "39c1ec76ea1027438fafe16ecb0fb84795e62e9d643444c1090179e63808c69d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "9b70100369d6a0b4475890530f904ad6",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 9634933,
"upload_time": "2024-04-17T21:39:05",
"upload_time_iso_8601": "2024-04-17T21:39:05.491548Z",
"url": "https://files.pythonhosted.org/packages/76/05/badd3a66571ad257270b38c33b9a7470afd2ae12e409c7c74baedf16f2ef/tokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d94697f8e84ba6a9133e34b148631d2933fda2a6ad8e0767b6e07ad0af9d83c2",
"md5": "bfbefe22000444ce3f39eab0032a4dc9",
"sha256": "c2a0d47a89b48d7daa241e004e71fb5a50533718897a4cd6235cb846d511a478"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "bfbefe22000444ce3f39eab0032a4dc9",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 9950957,
"upload_time": "2024-04-17T21:39:08",
"upload_time_iso_8601": "2024-04-17T21:39:08.451600Z",
"url": "https://files.pythonhosted.org/packages/d9/46/97f8e84ba6a9133e34b148631d2933fda2a6ad8e0767b6e07ad0af9d83c2/tokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "81b2bf9a0f9136964df5e94dd9854ba071480c5425ff0db6d1ad9a6a8e683d55",
"md5": "78531090857eb9bc58955ab39dd32c5c",
"sha256": "61b7fe8886f2e104d4caf9218b157b106207e0f2a4905c9c7ac98890688aabeb"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-none-win32.whl",
"has_sig": false,
"md5_digest": "78531090857eb9bc58955ab39dd32c5c",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 2040628,
"upload_time": "2024-04-17T21:39:11",
"upload_time_iso_8601": "2024-04-17T21:39:11.344334Z",
"url": "https://files.pythonhosted.org/packages/81/b2/bf9a0f9136964df5e94dd9854ba071480c5425ff0db6d1ad9a6a8e683d55/tokenizers-0.19.1-cp39-none-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "25aac6992cdc0a74bcbb666e7c00ada6826f5b49fc4cbdafc50db0d1369503fe",
"md5": "702e2fc944c5244a1a764396256a2b86",
"sha256": "f97660f6c43efd3e0bfd3f2e3e5615bf215680bad6ee3d469df6454b8c6e8256"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-cp39-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "702e2fc944c5244a1a764396256a2b86",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.7",
"size": 2220919,
"upload_time": "2024-04-17T21:39:13",
"upload_time_iso_8601": "2024-04-17T21:39:13.591176Z",
"url": "https://files.pythonhosted.org/packages/25/aa/c6992cdc0a74bcbb666e7c00ada6826f5b49fc4cbdafc50db0d1369503fe/tokenizers-0.19.1-cp39-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cf7b38fb7207cde3d1dc5272411cd18178e6437cdc1ef08cac5d0e8cfd57f38c",
"md5": "aafe41d67c39a1e96c85347ddfa155b5",
"sha256": "3b11853f17b54c2fe47742c56d8a33bf49ce31caf531e87ac0d7d13d327c9334"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "aafe41d67c39a1e96c85347ddfa155b5",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 2532668,
"upload_time": "2024-04-17T21:39:15",
"upload_time_iso_8601": "2024-04-17T21:39:15.866728Z",
"url": "https://files.pythonhosted.org/packages/cf/7b/38fb7207cde3d1dc5272411cd18178e6437cdc1ef08cac5d0e8cfd57f38c/tokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "1d0d2c452fe17fc17f0cdb713acb811eebb1f714b8c21d497c4672af4f491229",
"md5": "69c2a33b81c7fb7f147baaf38973f183",
"sha256": "d26194ef6c13302f446d39972aaa36a1dda6450bc8949f5eb4c27f51191375bd"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "69c2a33b81c7fb7f147baaf38973f183",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 2438321,
"upload_time": "2024-04-17T21:39:17",
"upload_time_iso_8601": "2024-04-17T21:39:17.887466Z",
"url": "https://files.pythonhosted.org/packages/1d/0d/2c452fe17fc17f0cdb713acb811eebb1f714b8c21d497c4672af4f491229/tokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "19e0f9e915d028b45798723eab59c253da28040aa66b9f31dcb7cfc3be88fa37",
"md5": "a47d0f0778ac8c800fe30ae114d4f448",
"sha256": "e8d1ed93beda54bbd6131a2cb363a576eac746d5c26ba5b7556bc6f964425594"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "a47d0f0778ac8c800fe30ae114d4f448",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 3682304,
"upload_time": "2024-04-17T21:39:20",
"upload_time_iso_8601": "2024-04-17T21:39:20.388592Z",
"url": "https://files.pythonhosted.org/packages/19/e0/f9e915d028b45798723eab59c253da28040aa66b9f31dcb7cfc3be88fa37/tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ce2bdb8a94608c392752681c2ca312487b7cd5bcc4f77e24a90daa4916138271",
"md5": "9487252d2dda7e2c4113097f6eaac26f",
"sha256": "ca407133536f19bdec44b3da117ef0d12e43f6d4b56ac4c765f37eca501c7bda"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "9487252d2dda7e2c4113097f6eaac26f",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 3566208,
"upload_time": "2024-04-17T21:39:23",
"upload_time_iso_8601": "2024-04-17T21:39:23.122487Z",
"url": "https://files.pythonhosted.org/packages/ce/2b/db8a94608c392752681c2ca312487b7cd5bcc4f77e24a90daa4916138271/tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d8582e998462677c4c0eb5123ce386bcb488a155664d273d0283122866515f09",
"md5": "1421e174545e7637d20512037af4ad7e",
"sha256": "ce05fde79d2bc2e46ac08aacbc142bead21614d937aac950be88dc79f9db9022"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "1421e174545e7637d20512037af4ad7e",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 3605791,
"upload_time": "2024-04-17T21:39:26",
"upload_time_iso_8601": "2024-04-17T21:39:26.195773Z",
"url": "https://files.pythonhosted.org/packages/d8/58/2e998462677c4c0eb5123ce386bcb488a155664d273d0283122866515f09/tokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "83ac26bc2e2bb2a054dc2e51699628936f5474e093b68da6ccdde04b2fc39ab8",
"md5": "ed8b89c80e552637b23d6db010ad46d1",
"sha256": "35583cd46d16f07c054efd18b5d46af4a2f070a2dd0a47914e66f3ff5efb2b1e"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "ed8b89c80e552637b23d6db010ad46d1",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 9632867,
"upload_time": "2024-04-17T21:39:28",
"upload_time_iso_8601": "2024-04-17T21:39:28.637877Z",
"url": "https://files.pythonhosted.org/packages/83/ac/26bc2e2bb2a054dc2e51699628936f5474e093b68da6ccdde04b2fc39ab8/tokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "45b636c1bb106bbe96012c9367df89ed01599cada036c0b96d38fbbdbeb75c9f",
"md5": "782036f040226dbf8ed0f4132db295e0",
"sha256": "43350270bfc16b06ad3f6f07eab21f089adb835544417afda0f83256a8bf8b75"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "782036f040226dbf8ed0f4132db295e0",
"packagetype": "bdist_wheel",
"python_version": "pp310",
"requires_python": ">=3.7",
"size": 9945103,
"upload_time": "2024-04-17T21:39:32",
"upload_time_iso_8601": "2024-04-17T21:39:32.522167Z",
"url": "https://files.pythonhosted.org/packages/45/b6/36c1bb106bbe96012c9367df89ed01599cada036c0b96d38fbbdbeb75c9f/tokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cc61e36885f692b4bd15644593b18bfaf26167c97e023ea5d66c548ea4a3783f",
"md5": "c8536c0cc456707a41f938ebd51fac88",
"sha256": "b4399b59d1af5645bcee2072a463318114c39b8547437a7c2d6a186a1b5a0e2d"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "c8536c0cc456707a41f938ebd51fac88",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 2535889,
"upload_time": "2024-04-17T21:39:35",
"upload_time_iso_8601": "2024-04-17T21:39:35.202565Z",
"url": "https://files.pythonhosted.org/packages/cc/61/e36885f692b4bd15644593b18bfaf26167c97e023ea5d66c548ea4a3783f/tokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "fd6b10cc91903b97a4fb8f5813b4793684c3e4e25317d0ec2a2fc3ab9a762664",
"md5": "39cfb91bc3bd6eff3166b287cdba9ea5",
"sha256": "6852c5b2a853b8b0ddc5993cd4f33bfffdca4fcc5d52f89dd4b8eada99379285"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "39cfb91bc3bd6eff3166b287cdba9ea5",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 3687873,
"upload_time": "2024-04-17T21:39:38",
"upload_time_iso_8601": "2024-04-17T21:39:38.158966Z",
"url": "https://files.pythonhosted.org/packages/fd/6b/10cc91903b97a4fb8f5813b4793684c3e4e25317d0ec2a2fc3ab9a762664/tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0b1dd745cb583aba94094923eba9117879d6e7d1a2182e76395f9292c6582acf",
"md5": "23a56debf295f8075c41f9b194b4edfb",
"sha256": "bcd266ae85c3d39df2f7e7d0e07f6c41a55e9a3123bb11f854412952deacd828"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "23a56debf295f8075c41f9b194b4edfb",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 3572176,
"upload_time": "2024-04-17T21:39:40",
"upload_time_iso_8601": "2024-04-17T21:39:40.879664Z",
"url": "https://files.pythonhosted.org/packages/0b/1d/d745cb583aba94094923eba9117879d6e7d1a2182e76395f9292c6582acf/tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "58b26545bc89e5686b6f6d31fef88bc65c22379e4afe998132362c83c191942c",
"md5": "ad24b469da60abe191cb8661b6027ab9",
"sha256": "ecb2651956eea2aa0a2d099434134b1b68f1c31f9a5084d6d53f08ed43d45ff2"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "ad24b469da60abe191cb8661b6027ab9",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 3612875,
"upload_time": "2024-04-17T21:39:44",
"upload_time_iso_8601": "2024-04-17T21:39:44.161254Z",
"url": "https://files.pythonhosted.org/packages/58/b2/6545bc89e5686b6f6d31fef88bc65c22379e4afe998132362c83c191942c/tokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3e1a24d27c8a8a55589277923c760e6e15e6a9745beb94a64039c89cf4375331",
"md5": "f66e9c438cf0dead865fed4f610aaf5f",
"sha256": "b279ab506ec4445166ac476fb4d3cc383accde1ea152998509a94d82547c8e2a"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "f66e9c438cf0dead865fed4f610aaf5f",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 9637284,
"upload_time": "2024-04-17T21:39:47",
"upload_time_iso_8601": "2024-04-17T21:39:47.219744Z",
"url": "https://files.pythonhosted.org/packages/3e/1a/24d27c8a8a55589277923c760e6e15e6a9745beb94a64039c89cf4375331/tokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d4c2de9ca55958ce750dddd309fdb1af65e8b5459d20e358fdc7abbb69d65c7d",
"md5": "e6e0a6bcdaf02ed0f902da794a4de0e3",
"sha256": "89183e55fb86e61d848ff83753f64cded119f5d6e1f553d14ffee3700d0a4a49"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "e6e0a6bcdaf02ed0f902da794a4de0e3",
"packagetype": "bdist_wheel",
"python_version": "pp37",
"requires_python": ">=3.7",
"size": 9951820,
"upload_time": "2024-04-17T21:39:50",
"upload_time_iso_8601": "2024-04-17T21:39:50.161823Z",
"url": "https://files.pythonhosted.org/packages/d4/c2/de9ca55958ce750dddd309fdb1af65e8b5459d20e358fdc7abbb69d65c7d/tokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "53ed0f8d5b3913ad21688bf7070a928be81320db3a5b2e46bf508daffb24ec52",
"md5": "1f0f21361e11882f9b1eb2a40902e135",
"sha256": "b2edbc75744235eea94d595a8b70fe279dd42f3296f76d5a86dde1d46e35f574"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "1f0f21361e11882f9b1eb2a40902e135",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 2533823,
"upload_time": "2024-04-17T21:39:54",
"upload_time_iso_8601": "2024-04-17T21:39:54.012899Z",
"url": "https://files.pythonhosted.org/packages/53/ed/0f8d5b3913ad21688bf7070a928be81320db3a5b2e46bf508daffb24ec52/tokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d9db81d0b09855d09b658eeed3ba4d22ad0c6a3e38bfc6a92d339f0a7be5613a",
"md5": "b34576f26c87c114406a3e763a38c34c",
"sha256": "0e64bfde9a723274e9a71630c3e9494ed7b4c0f76a1faacf7fe294cd26f7ae7c"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "b34576f26c87c114406a3e763a38c34c",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 2439292,
"upload_time": "2024-04-17T21:39:56",
"upload_time_iso_8601": "2024-04-17T21:39:56.389813Z",
"url": "https://files.pythonhosted.org/packages/d9/db/81d0b09855d09b658eeed3ba4d22ad0c6a3e38bfc6a92d339f0a7be5613a/tokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "61fbed3aa4f0ffeb177a72394c99cd642fb5b257eb103829ff2858ba523b7bd5",
"md5": "f885bd602f16c94fbc6feeb6d3462a5c",
"sha256": "0b5ca92bfa717759c052e345770792d02d1f43b06f9e790ca0a1db62838816f3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "f885bd602f16c94fbc6feeb6d3462a5c",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 3684021,
"upload_time": "2024-04-17T21:39:59",
"upload_time_iso_8601": "2024-04-17T21:39:59.410459Z",
"url": "https://files.pythonhosted.org/packages/61/fb/ed3aa4f0ffeb177a72394c99cd642fb5b257eb103829ff2858ba523b7bd5/tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cd2f40d26e0e9426be4ab95255088224640a012a47cb0469e91eade16243e8db",
"md5": "f1504b83c4650a54dba2a0cc3905340b",
"sha256": "6f8a20266e695ec9d7a946a019c1d5ca4eddb6613d4f466888eee04f16eedb85"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "f1504b83c4650a54dba2a0cc3905340b",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 3567485,
"upload_time": "2024-04-17T21:40:03",
"upload_time_iso_8601": "2024-04-17T21:40:03.275598Z",
"url": "https://files.pythonhosted.org/packages/cd/2f/40d26e0e9426be4ab95255088224640a012a47cb0469e91eade16243e8db/tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9d36df75fc03b4cfd3b35c818e3e8e8134485f1e1041a065671bc3be7fd38e60",
"md5": "030b8834843ea7c96b2b3dd11d4e04c0",
"sha256": "63c38f45d8f2a2ec0f3a20073cccb335b9f99f73b3c69483cd52ebc75369d8a1"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "030b8834843ea7c96b2b3dd11d4e04c0",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 3608325,
"upload_time": "2024-04-17T21:40:07",
"upload_time_iso_8601": "2024-04-17T21:40:07.543414Z",
"url": "https://files.pythonhosted.org/packages/9d/36/df75fc03b4cfd3b35c818e3e8e8134485f1e1041a065671bc3be7fd38e60/tokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "11710f11a0d21ebaa968a90f09623f9c9bad563fed03ad47361854c657824424",
"md5": "4c95d87ea7c2fe15ce8aa0136c4bbf68",
"sha256": "dd26e3afe8a7b61422df3176e06664503d3f5973b94f45d5c45987e1cb711876"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "4c95d87ea7c2fe15ce8aa0136c4bbf68",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 9634246,
"upload_time": "2024-04-17T21:40:10",
"upload_time_iso_8601": "2024-04-17T21:40:10.976604Z",
"url": "https://files.pythonhosted.org/packages/11/71/0f11a0d21ebaa968a90f09623f9c9bad563fed03ad47361854c657824424/tokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9d0f4ddf31367eb45f32a66d8f2649cbbe7ae4a393679e35ff26c670736e1fa6",
"md5": "80615f9666c557c65b6bfc48c5d3744d",
"sha256": "eddd5783a4a6309ce23432353cdb36220e25cbb779bfa9122320666508b44b88"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "80615f9666c557c65b6bfc48c5d3744d",
"packagetype": "bdist_wheel",
"python_version": "pp38",
"requires_python": ">=3.7",
"size": 9947797,
"upload_time": "2024-04-17T21:40:15",
"upload_time_iso_8601": "2024-04-17T21:40:15.150718Z",
"url": "https://files.pythonhosted.org/packages/9d/0f/4ddf31367eb45f32a66d8f2649cbbe7ae4a393679e35ff26c670736e1fa6/tokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "aa9cdeed1e549b767832cc4ee5b386d1660bde3408bbd6d1ab48352fb61c54e2",
"md5": "f33873c60347f02cea5e0d3acfe5a524",
"sha256": "56ae39d4036b753994476a1b935584071093b55c7a72e3b8288e68c313ca26e7"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "f33873c60347f02cea5e0d3acfe5a524",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 2533737,
"upload_time": "2024-04-17T21:40:18",
"upload_time_iso_8601": "2024-04-17T21:40:18.445167Z",
"url": "https://files.pythonhosted.org/packages/aa/9c/deed1e549b767832cc4ee5b386d1660bde3408bbd6d1ab48352fb61c54e2/tokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c8594dbebca9ef6b61d10a94cbf404d3abf509dfedb52cdcf2fe7ed1fb52460d",
"md5": "48fe0a85854aa09a24c73b0023584f5c",
"sha256": "f9939ca7e58c2758c01b40324a59c034ce0cebad18e0d4563a9b1beab3018243"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "48fe0a85854aa09a24c73b0023584f5c",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 2439981,
"upload_time": "2024-04-17T21:40:21",
"upload_time_iso_8601": "2024-04-17T21:40:21.253208Z",
"url": "https://files.pythonhosted.org/packages/c8/59/4dbebca9ef6b61d10a94cbf404d3abf509dfedb52cdcf2fe7ed1fb52460d/tokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7242e18b67ab9fd31e433171cf447d85bf5dede8009db04a46f3905bff5ca715",
"md5": "d254ecbed7a18300fb7ece8c54275686",
"sha256": "6c330c0eb815d212893c67a032e9dc1b38a803eccb32f3e8172c19cc69fbb439"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"has_sig": false,
"md5_digest": "d254ecbed7a18300fb7ece8c54275686",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 3683158,
"upload_time": "2024-04-17T21:40:24",
"upload_time_iso_8601": "2024-04-17T21:40:24.034653Z",
"url": "https://files.pythonhosted.org/packages/72/42/e18b67ab9fd31e433171cf447d85bf5dede8009db04a46f3905bff5ca715/tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "085c54419545d61c085d7adcbd54f5711815ffbb1164d6132209172c984320be",
"md5": "cfe9e46eb48a588da3b65638ca71faf4",
"sha256": "ec11802450a2487cdf0e634b750a04cbdc1c4d066b97d94ce7dd2cb51ebb325b"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "cfe9e46eb48a588da3b65638ca71faf4",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 3568486,
"upload_time": "2024-04-17T21:40:27",
"upload_time_iso_8601": "2024-04-17T21:40:27.515245Z",
"url": "https://files.pythonhosted.org/packages/08/5c/54419545d61c085d7adcbd54f5711815ffbb1164d6132209172c984320be/tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "6d61f8b59cc2580297ca78a7b5b2cefc8996b8417dc6cb9abb6a1d303973156b",
"md5": "2c847be827a8a40b3695c55a5fcdaf30",
"sha256": "a2b718f316b596f36e1dae097a7d5b91fc5b85e90bf08b01ff139bd8953b25af"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "2c847be827a8a40b3695c55a5fcdaf30",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 3608836,
"upload_time": "2024-04-17T21:40:30",
"upload_time_iso_8601": "2024-04-17T21:40:30.760808Z",
"url": "https://files.pythonhosted.org/packages/6d/61/f8b59cc2580297ca78a7b5b2cefc8996b8417dc6cb9abb6a1d303973156b/tokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "a5024944f51c7248ae78c9758266f4e92d72fe98cf58f3c973949bcdede0313a",
"md5": "058462a54ed949d247ec654de5b5b247",
"sha256": "ed69af290c2b65169f0ba9034d1dc39a5db9459b32f1dd8b5f3f32a3fcf06eab"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl",
"has_sig": false,
"md5_digest": "058462a54ed949d247ec654de5b5b247",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 9634426,
"upload_time": "2024-04-17T21:40:34",
"upload_time_iso_8601": "2024-04-17T21:40:34.431255Z",
"url": "https://files.pythonhosted.org/packages/a5/02/4944f51c7248ae78c9758266f4e92d72fe98cf58f3c973949bcdede0313a/tokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f12a5ac32ef70d6f9464155c4c4239139dc5aa9297052180b171f5ae22fd7b7a",
"md5": "e0624d0fd1ca5eabf499f4a5a477da90",
"sha256": "f8a9c828277133af13f3859d1b6bf1c3cb6e9e1637df0e45312e6b7c2e622b1f"
},
"downloads": -1,
"filename": "tokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl",
"has_sig": false,
"md5_digest": "e0624d0fd1ca5eabf499f4a5a477da90",
"packagetype": "bdist_wheel",
"python_version": "pp39",
"requires_python": ">=3.7",
"size": 9947379,
"upload_time": "2024-04-17T21:40:38",
"upload_time_iso_8601": "2024-04-17T21:40:38.141170Z",
"url": "https://files.pythonhosted.org/packages/f1/2a/5ac32ef70d6f9464155c4c4239139dc5aa9297052180b171f5ae22fd7b7a/tokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "48042071c150f374aab6d5e92aaec38d0f3c368d227dd9e0469a1f0966ac68d1",
"md5": "d2d6ec7d3b16f8d1ce2d859a17ef52fb",
"sha256": "ee59e6680ed0fdbe6b724cf38bd70400a0c1dd623b07ac729087270caeac88e3"
},
"downloads": -1,
"filename": "tokenizers-0.19.1.tar.gz",
"has_sig": false,
"md5_digest": "d2d6ec7d3b16f8d1ce2d859a17ef52fb",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7",
"size": 321039,
"upload_time": "2024-04-17T21:40:41",
"upload_time_iso_8601": "2024-04-17T21:40:41.849219Z",
"url": "https://files.pythonhosted.org/packages/48/04/2071c150f374aab6d5e92aaec38d0f3c368d227dd9e0469a1f0966ac68d1/tokenizers-0.19.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-17 21:40:41",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "huggingface",
"github_project": "tokenizers",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "tokenizers"
}
JSON
