| Name | Version | Summary | date |
|---|---|---|---|
| pgn-tokenizer | 0.1.3 | A byte pair encoding tokenizer for chess portable game notation (PGN) | 2025-01-25 15:02:55 |
| QuickBPE | 2.1 | A fast BPE implementation in C | 2024-12-05 11:37:29 |
| tokenizers-gt | 0.15.2.post0 | None | 2024-02-19 01:41:23 |
| code-tokenizers | 0.0.5 | Aligning BPE and AST | 2023-02-06 03:46:53 |
| pyonmttok | 1.36.0 | Fast and customizable text tokenization library with BPE and SentencePiece support | 2023-01-11 13:46:07 |
| hour | day | week | total |
|---|---|---|---|
| 85 | 1359 | 10363 | 303103 |