| Name | Version | Summary | date |
|---|---|---|---|
| asttokens | 2.4.0 | Annotate AST trees with source code positions | 2023-09-04 16:55:16 |
| thai-segmenter | 0.4.2 | Thai tokenizer, POS-tagger and sentence segmenter. | 2023-08-21 11:13:48 |
| razdel | 0.5.0 | Splits russian text into tokens, sentences, section. Rule-based | 2020-03-26 04:27:54 |
| sentence-splitter | 1.4 | Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder | 2019-01-14 17:11:25 |
| untokenize | 0.1.1 | Transforms tokens into original source code (while preserving whitespace). | 2014-02-08 16:30:40 |
| hour | day | week | total |
|---|---|---|---|
| 25 | 1892 | 10294 | 201599 |