| Name | Version | Summary | date |
|---|---|---|---|
| ultra-tokenizer | 0.1.3 | Advanced tokenizer with support for BPE, WordPiece, and Unigram algorithms | 2025-08-16 09:58:51 |
| rs-bpe | 0.1.0 | A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust | 2025-03-19 05:58:24 |
| kitoken | 0.10.1 | Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization | 2024-12-20 03:07:14 |
| hour | day | week | total |
|---|---|---|---|
| 94 | 1440 | 10283 | 312408 |