| Name | Version | Summary | date |
| gallery-dl |
1.28.4 |
Command-line program to download image galleries and collections from several image hosting sites |
2025-01-12 16:22:07 |
| gzspidertools |
0.0.27 |
魔改使用工具库 |
2024-12-12 09:08:48 |
| AyugeSpiderTools |
3.11.0 |
scrapy 扩展库：用于扩展 Scrapy 功能来解放双手。 |
2024-11-29 14:11:08 |
| crawlerdetect |
0.3.0 |
CrawlerDetect is a Python library designed to identify bots, crawlers, and spiders by analyzing their user agents. |
2024-11-15 08:02:23 |
| botasaurus |
4.0.75 |
The All in One Web Scraping Framework |
2024-11-10 06:01:50 |
| geckordp |
1.0.3 |
A client implementation of Firefox DevTools over remote debug protocol. |
2024-09-03 09:22:12 |
| scrapoxy |
2.0.4 |
Python API for Scrapoxy |
2024-08-31 09:58:59 |
| news-please |
1.6.12 |
news-please is an open source easy-to-use news extractor that just works. |
2024-07-08 07:53:44 |
| dns-crawler |
1.6.5 |
A distributed crawler for getting info about DNS domains and services attached to them. |
2024-07-02 07:16:38 |
| Cr0wl3r |
1.1.0 |
This module implements a crawler to find all links and resources |
2024-06-18 10:26:00 |
| icrawler |
0.6.8 |
A multi-thread crawler framework with many builtin image crawlers provided. |
2024-05-15 04:20:29 |
| pyseoanalyzer |
2024.4.21 |
An SEO tool that analyzes the structure of a site, crawls the site, count words in the body of the site and warns of any technical SEO issues. |
2024-04-21 17:58:53 |
| cprex |
0.3.0 |
Chemical Properties Relation Extraction |
2024-03-08 16:47:08 |
| gzSpiderTools |
0.0.2 |
scrapy 扩展库：用于扩展 Scrapy 功能来解放双手。 |
2024-02-21 15:53:02 |
| shopee-api-wrapper |
0.2.1 |
A simple library that communicates with the Shopee website API. |
2024-02-10 17:59:52 |
| new-frontera |
0.9.0 |
A scalable frontier for web crawlers |
2024-01-28 04:00:54 |
| OACrawler |
1.8.0 |
crawler oa(oi, acm) competition info |
2024-01-22 07:06:11 |
| taiwanlottery |
1.5.1 |
Taiwan Lottery Crawler 台灣彩券爬蟲 |
2024-01-04 14:26:50 |
| deadlinks |
0.3.5 |
Health checks for your documentation links. |
2023-12-31 15:19:54 |
| gpt-web-crawler |
0.0.2 |
A web crawler for GPTs to build knowledge bases |
2023-12-29 08:39:51 |