Name | Version | Summary | date |
---|---|---|---|
nepalitokenizers | 0.0.1 | Pre-trained Tokenizers for the Nepali language with an interface to HuggingFace's tokenizers library for customizability. | 2023-06-23 22:51:43 |
pyonmttok | 1.36.0 | Fast and customizable text tokenization library with BPE and SentencePiece support | 2023-01-11 13:46:07 |
hour | day | week | total |
---|---|---|---|
32 | 1563 | 10499 | 206832 |