Name | Version | Summary | date |
---|---|---|---|
Protego | 0.3.0 | Pure-Python robots.txt parser with support for modern conventions | 2023-08-09 17:41:22 |
robotsparser | 0.0.11 | Parse robots.txt files and find indexed urls | 2023-02-07 22:05:28 |
robotexclusionrulesparser | 1.7.1 | A robots.txt parser alternative to Python's robotparser module | 2016-08-12 15:53:17 |
hour | day | week | total |
---|---|---|---|
84 | 2082 | 9581 | 192599 |