| Name | Version | Summary | date |
|---|---|---|---|
| QuickBPE | 2.1 | A fast BPE implementation in C | 2024-12-05 11:37:29 |
| tokenizers-gt | 0.15.2.post0 | None | 2024-02-19 01:41:23 |
| code-tokenizers | 0.0.5 | Aligning BPE and AST | 2023-02-06 03:46:53 |
| pyonmttok | 1.36.0 | Fast and customizable text tokenization library with BPE and SentencePiece support | 2023-01-11 13:46:07 |
| hour | day | week | total |
|---|---|---|---|
| 31 | 1244 | 9554 | 274384 |