| Name | Version | Summary | date |
| AyugeSpiderTools |
3.13.3 |
scrapy 扩展库：用于扩展 Scrapy 功能来解放双手。 |
2025-10-26 08:21:39 |
| linkwalker |
0.9.0 |
Deep URL crawler for Python supporting dynamic and static content, domain restrictions, and callbacks. |
2025-10-21 18:33:14 |
| nadf |
0.1.30 |
NamuWiki crawler & PDF utilities |
2025-10-21 03:12:06 |
| gallery-dl |
1.30.7 |
Command-line program to download image galleries and collections from several image hosting sites |
2025-09-14 07:37:22 |
| pydatamax |
0.2.0 |
Advanced Data Crawling and Processing Framework |
2025-09-03 17:39:42 |
| hget-audio |
2025.7.24a0 |
Comprehensive audio scraping tool for websites. |
2025-07-24 12:47:05 |
| Cr0wl3r |
1.1.1 |
This module implements a crawler to find all links and resources on the target web site. |
2025-07-19 13:37:46 |
| crawl-youtube-channel |
0.0.1 |
A package to crawl a youtube channel |
2025-07-11 02:21:29 |
| crawlerdetect |
0.3.2 |
CrawlerDetect is a Python library designed to identify bots, crawlers, and spiders by analyzing their user agents. |
2025-07-09 16:54:18 |
| gallery-dl-bytes |
2.4.0 |
API to download files directly to memory with gallery-dl |
2025-02-17 19:41:09 |
| icrawler |
0.6.10 |
A multi-thread crawler framework with many builtin image crawlers provided. |
2025-02-11 14:09:29 |
| gzspidertools |
0.0.27 |
魔改使用工具库 |
2024-12-12 09:08:48 |
| botasaurus |
4.0.75 |
The All in One Web Scraping Framework |
2024-11-10 06:01:50 |
| geckordp |
1.0.3 |
A client implementation of Firefox DevTools over remote debug protocol. |
2024-09-03 09:22:12 |
| scrapoxy |
2.0.4 |
Python API for Scrapoxy |
2024-08-31 09:58:59 |
| news-please |
1.6.12 |
news-please is an open source easy-to-use news extractor that just works. |
2024-07-08 07:53:44 |
| dns-crawler |
1.6.5 |
A distributed crawler for getting info about DNS domains and services attached to them. |
2024-07-02 07:16:38 |
| pyseoanalyzer |
2024.4.21 |
An SEO tool that analyzes the structure of a site, crawls the site, count words in the body of the site and warns of any technical SEO issues. |
2024-04-21 17:58:53 |
| cprex |
0.3.0 |
Chemical Properties Relation Extraction |
2024-03-08 16:47:08 |
| gzSpiderTools |
0.0.2 |
scrapy 扩展库：用于扩展 Scrapy 功能来解放双手。 |
2024-02-21 15:53:02 |