爬虫IP代理池
=======
[](https://travis-ci.org/jhao104/proxy_pool)
[](http://www.spiderpy.cn/blog/)
[](https://requires.io/github/jhao104/proxy_pool/requirements/?branch=master)
[](https://github.com/jhao104/proxy_pool/blob/master/LICENSE)
[](https://github.com/jhao104/proxy_pool/graphs/contributors)
[](https://github.com/jhao104/proxy_pool)
______ ______ _
| ___ \_ | ___ \ | |
| |_/ / \__ __ __ _ __ _ | |_/ /___ ___ | |
| __/| _// _ \ \ \/ /| | | || __// _ \ / _ \ | |
| | | | | (_) | > < \ |_| || | | (_) | (_) || |___
\_| |_| \___/ /_/\_\ \__ |\_| \___/ \___/ \_____\
__ / /
/___ /
##### [介绍文档](https://github.com/jhao104/proxy_pool/blob/master/doc/introduce.md)
* 支持版本:  
* 测试地址: http://118.24.52.95:5010 (单机勿压。感谢)
### 下载安装
* 下载源码:
```shell
git clone git@github.com:jhao104/proxy_pool.git
或者直接到https://github.com/jhao104/proxy_pool 下载zip文件
```
* 安装依赖:
```shell
pip install -r requirements.txt
```
* 配置Config/setting.py:
```shell
# Config/setting.py 为项目配置文件
# 配置DB
DATABASES = {
"default": {
"TYPE": "SSDB", # 如果使用SSDB或redis数据库，均配置为SSDB
"HOST": "127.0.0.1", # db host
"PORT": 8888, # db port
"NAME": "proxy", # 默认配置
"PASSWORD": "" # db password
}
}
# 配置 ProxyGetter
PROXY_GETTER = [
"freeProxyFirst", # 这里是启用的代理抓取函数名，可在ProxyGetter/getFreeProxy.py 扩展
"freeProxySecond",
....
]
# 配置 API服务
SERVER_API = {
"HOST": "0.0.0.0", # 监听ip, 0.0.0.0 监听所有IP
"PORT": 5010 # 监听端口
}
# 上面配置启动后，代理池访问地址为 http://127.0.0.1:5010
```
* 启动:
```shell
# 如果你的依赖已经安全完成并且具备运行条件,可以直接在Run下运行main.py
# 到Run目录下:
>>>python main.py
# 如果运行成功你应该看到有4个main.py进程
# 你也可以分别运行他们,
# 依次到Api下启动ProxyApi.py,Schedule下启动ProxyRefreshSchedule.py和ProxyValidSchedule.py即可.
```
* 生产环境 Docker/docker-compose
```shell
# Workdir proxy_pool
docker build -t proxy_pool .
pip install docker-compose
docker-compose -f Docker/docker-compose.yml up -d
```
* 开发环境 Docker
```shell
# Workdir proxy_pool
docker build -t proxy_pool .
docker run -it --rm -v $(pwd):/usr/src/app -p 5010:5010 proxy_pool
```
### 使用
启动过几分钟后就能看到抓取到的代理IP，你可以直接到数据库中查看，推荐一个[SSDB可视化工具](https://github.com/jhao104/SSDBAdmin)。
也可以通过api访问http://127.0.0.1:5010 查看。
* Api
| api | method | Description | arg|
| ----| ---- | ---- | ----|
| / | GET | api介绍 | None |
| /get | GET | 随机获取一个代理 | None|
| /get_all | GET | 获取所有代理 |None|
| /get_status | GET | 查看代理数量 |None|
| /delete | GET | 删除代理 |proxy=host:ip|
* 爬虫使用
如果要在爬虫代码中使用的话， 可以将此api封装成函数直接使用，例如：
```python
import requests
def get_proxy():
return requests.get("http://127.0.0.1:5010/get/").content
def delete_proxy(proxy):
requests.get("http://127.0.0.1:5010/delete/?proxy={}".format(proxy))
# your spider code
def getHtml():
# ....
retry_count = 5
proxy = get_proxy()
while retry_count > 0:
try:
html = requests.get('https://www.example.com', proxies={"http": "http://{}".format(proxy)})
# 使用代理访问
return html
except Exception:
retry_count -= 1
# 出错5次, 删除代理池中代理
delete_proxy(proxy)
return None
```
### 扩展代理
项目默认包含几个免费的代理获取方法，但是免费的毕竟质量不好，所以如果直接运行可能拿到的代理质量不理想。所以，提供了代理获取的扩展方法。
添加一个新的代理获取方法如下:
* 1、首先在[GetFreeProxy](https://github.com/jhao104/proxy_pool/blob/b9ccdfaada51b57cfb1bbd0c01d4258971bc8352/ProxyGetter/getFreeProxy.py#L32)类中添加你的获取代理的静态方法，
该方法需要以生成器(yield)形式返回`host:ip`格式的代理，例如:
```python
class GetFreeProxy(object):
# ....
# 你自己的方法
@staticmethod
def freeProxyCustom(): # 命名不和已有重复即可
# 通过某网站或者某接口或某数据库获取代理 任意你喜欢的姿势都行
# 假设你拿到了一个代理列表
proxies = ["139.129.166.68:3128", "139.129.166.61:3128", ...]
for proxy in proxies:
yield proxy
# 确保每个proxy都是 host:ip正确的格式就行
```
* 2、添加好方法后，修改Config/setting.py文件中的`PROXY_GETTER`项：
在`PROXY_GETTER`下添加自定义的方法的名字:
```shell
PROXY_GETTER = [
"freeProxyFirst",
"freeProxySecond",
....
"freeProxyCustom" # # 确保名字和你添加方法名字一致
]
```
`ProxyRefreshSchedule`会每隔一段时间抓取一次代理，下次抓取时会自动识别调用你定义的方法。
### 代理采集
目前实现的采集免费代理网站有(排名不分先后, 下面仅是对其发布的免费代理情况, 付费代理测评可以参考[这里](https://zhuanlan.zhihu.com/p/33576641)):
| 厂商名称 | 状态 | 更新速度 | 可用率 | 是否被墙 | 地址 |
| ----- | ---- | -------- | ------ | --------- | ----- |
| 无忧代理 | 可用 | 几分钟一次 | * | 否 | [地址](http://www.data5u.com/free/index.html) |
| 66代理 | 可用 | 更新很慢 | * | 否 | [地址](http://www.66ip.cn/) |
| 西刺代理 | 可用 | 几分钟一次 | * | 否 | [地址](http://www.xicidaili.com)|
| 全网代理 | 可用 | 几分钟一次 | * | 否 | [地址](http://www.goubanjia.com/)|
| 训代理 | 已关闭免费代理 | * | * | 否 | [地址](http://www.xdaili.cn/)|
| 快代理 | 可用 |几分钟一次| * | 否 | [地址](https://www.kuaidaili.com/)|
| 云代理 | 可用 |几分钟一次| * | 否 | [地址](http://www.ip3366.net/)|
| IP海 | 可用 |几小时一次| * | 否 | [地址](http://www.iphai.com/)|
| 免费IP代理库 | 可用 |快| * | 否 | [地址](http://ip.jiangxianli.com/)|
| 中国IP地址 | 可用 |几分钟一次| * | 是 | [地址](http://cn-proxy.com/)|
| Proxy List | 可用 |几分钟一次| * | 是 | [地址](https://proxy-list.org/chinese/index.php)|
| ProxyList+ | 可用 |几分钟一次| * | 是 | [地址](https://list.proxylistplus.com/Fresh-HTTP-Proxy-List-1)|
如果还有其他好的免费代理网站, 可以在提交在[issues](https://github.com/jhao104/proxy_pool/issues/71), 下次更新时会考虑在项目中支持。
### 问题反馈
任何问题欢迎在[Issues](https://github.com/jhao104/proxy_pool/issues) 中反馈，如果没有账号可以去 我的[博客](http://www.spiderpy.cn/blog/message)中留言。
你的反馈会让此项目变得更加完美。
### 贡献代码
本项目仅作为基本的通用的代理池架构，不接收特有功能(当然,不限于特别好的idea)。
本项目依然不够完善，如果发现bug或有新的功能添加，请在[Issues](https://github.com/jhao104/proxy_pool/issues)中提交bug(或新功能)描述，在确认后提交你的代码。
这里感谢以下contributor的无私奉献：
[@kangnwh](https://github.com/kangnwh)| [@bobobo80](https://github.com/bobobo80)| [@halleywj](https://github.com/halleywj)| [@newlyedward](https://github.com/newlyedward)| [@wang-ye](https://github.com/wang-ye)| [@gladmo](https://github.com/gladmo)| [@bernieyangmh](https://github.com/bernieyangmh)| [@PythonYXY](https://github.com/PythonYXY)| [@zuijiawoniu](https://github.com/zuijiawoniu)| [@netAir](https://github.com/netAir)| [@scil](https://github.com/scil)| [@tangrela](https://github.com/tangrela)| [@highroom](https://github.com/highroom)| [@luocaodan](https://github.com/luocaodan)| [@vc5](https://github.com/vc5)| [@1again](https://github.com/1again)
### Release Notes
[release notes](https://github.com/jhao104/proxy_pool/blob/master/doc/release_notes.md)
Raw data
{
"_id": null,
"home_page": "https://github.com/yanjlee/proxy_pool",
"name": "proxy-pool-pro",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": null,
"keywords": null,
"author": "yanjlee",
"author_email": "yanjlee@163.com",
"download_url": "https://files.pythonhosted.org/packages/0f/ec/b9bd94845627dc4698686362831771056c4ede727a19b76140242156afe7/proxy_pool_pro-1.3.5.tar.gz",
"platform": null,
"description": "\r\n\u722c\u866bIP\u4ee3\u7406\u6c60\r\n=======\r\n[](https://travis-ci.org/jhao104/proxy_pool)\r\n[](http://www.spiderpy.cn/blog/)\r\n[](https://requires.io/github/jhao104/proxy_pool/requirements/?branch=master)\r\n[](https://github.com/jhao104/proxy_pool/blob/master/LICENSE)\r\n[](https://github.com/jhao104/proxy_pool/graphs/contributors)\r\n[](https://github.com/jhao104/proxy_pool)\r\n\r\n ______ ______ _\r\n | ___ \\_ | ___ \\ | |\r\n | |_/ / \\__ __ __ _ __ _ | |_/ /___ ___ | |\r\n | __/| _// _ \\ \\ \\/ /| | | || __// _ \\ / _ \\ | |\r\n | | | | | (_) | > < \\ |_| || | | (_) | (_) || |___\r\n \\_| |_| \\___/ /_/\\_\\ \\__ |\\_| \\___/ \\___/ \\_____\\\r\n __ / /\r\n /___ /\r\n\r\n##### [\u4ecb\u7ecd\u6587\u6863](https://github.com/jhao104/proxy_pool/blob/master/doc/introduce.md)\r\n\r\n* \u652f\u6301\u7248\u672c:  \r\n\r\n* \u6d4b\u8bd5\u5730\u5740: http://118.24.52.95:5010 (\u5355\u673a\u52ff\u538b\u3002\u611f\u8c22)\r\n\r\n### \u4e0b\u8f7d\u5b89\u88c5\r\n\r\n* \u4e0b\u8f7d\u6e90\u7801:\r\n\r\n```shell\r\ngit clone git@github.com:jhao104/proxy_pool.git\r\n\r\n\u6216\u8005\u76f4\u63a5\u5230https://github.com/jhao104/proxy_pool \u4e0b\u8f7dzip\u6587\u4ef6\r\n```\r\n\r\n* \u5b89\u88c5\u4f9d\u8d56:\r\n\r\n```shell\r\npip install -r requirements.txt\r\n```\r\n\r\n* \u914d\u7f6eConfig/setting.py:\r\n\r\n```shell\r\n# Config/setting.py \u4e3a\u9879\u76ee\u914d\u7f6e\u6587\u4ef6\r\n\r\n# \u914d\u7f6eDB \r\nDATABASES = {\r\n \"default\": {\r\n \"TYPE\": \"SSDB\", # \u5982\u679c\u4f7f\u7528SSDB\u6216redis\u6570\u636e\u5e93\uff0c\u5747\u914d\u7f6e\u4e3aSSDB\r\n \"HOST\": \"127.0.0.1\", # db host\r\n \"PORT\": 8888, # db port\r\n \"NAME\": \"proxy\", # \u9ed8\u8ba4\u914d\u7f6e\r\n \"PASSWORD\": \"\" # db password\r\n\r\n }\r\n}\r\n\r\n\r\n# \u914d\u7f6e ProxyGetter\r\n\r\nPROXY_GETTER = [\r\n \"freeProxyFirst\", # \u8fd9\u91cc\u662f\u542f\u7528\u7684\u4ee3\u7406\u6293\u53d6\u51fd\u6570\u540d\uff0c\u53ef\u5728ProxyGetter/getFreeProxy.py \u6269\u5c55\r\n \"freeProxySecond\",\r\n ....\r\n]\r\n\r\n\r\n# \u914d\u7f6e API\u670d\u52a1\r\n\r\nSERVER_API = {\r\n \"HOST\": \"0.0.0.0\", # \u76d1\u542cip, 0.0.0.0 \u76d1\u542c\u6240\u6709IP\r\n \"PORT\": 5010 # \u76d1\u542c\u7aef\u53e3\r\n}\r\n \r\n# \u4e0a\u9762\u914d\u7f6e\u542f\u52a8\u540e\uff0c\u4ee3\u7406\u6c60\u8bbf\u95ee\u5730\u5740\u4e3a http://127.0.0.1:5010\r\n\r\n```\r\n\r\n* \u542f\u52a8:\r\n\r\n```shell\r\n# \u5982\u679c\u4f60\u7684\u4f9d\u8d56\u5df2\u7ecf\u5b89\u5168\u5b8c\u6210\u5e76\u4e14\u5177\u5907\u8fd0\u884c\u6761\u4ef6,\u53ef\u4ee5\u76f4\u63a5\u5728Run\u4e0b\u8fd0\u884cmain.py\r\n# \u5230Run\u76ee\u5f55\u4e0b:\r\n>>>python main.py\r\n\r\n# \u5982\u679c\u8fd0\u884c\u6210\u529f\u4f60\u5e94\u8be5\u770b\u5230\u67094\u4e2amain.py\u8fdb\u7a0b\r\n\r\n# \u4f60\u4e5f\u53ef\u4ee5\u5206\u522b\u8fd0\u884c\u4ed6\u4eec,\r\n# \u4f9d\u6b21\u5230Api\u4e0b\u542f\u52a8ProxyApi.py,Schedule\u4e0b\u542f\u52a8ProxyRefreshSchedule.py\u548cProxyValidSchedule.py\u5373\u53ef.\r\n```\r\n\r\n* \u751f\u4ea7\u73af\u5883 Docker/docker-compose\r\n\r\n```shell\r\n# Workdir proxy_pool\r\ndocker build -t proxy_pool .\r\npip install docker-compose\r\ndocker-compose -f Docker/docker-compose.yml up -d\r\n```\r\n\r\n* \u5f00\u53d1\u73af\u5883 Docker\r\n\r\n```shell\r\n# Workdir proxy_pool\r\ndocker build -t proxy_pool .\r\ndocker run -it --rm -v $(pwd):/usr/src/app -p 5010:5010 proxy_pool\r\n```\r\n\r\n### \u4f7f\u7528\r\n\r\n\u3000\u3000\u542f\u52a8\u8fc7\u51e0\u5206\u949f\u540e\u5c31\u80fd\u770b\u5230\u6293\u53d6\u5230\u7684\u4ee3\u7406IP\uff0c\u4f60\u53ef\u4ee5\u76f4\u63a5\u5230\u6570\u636e\u5e93\u4e2d\u67e5\u770b\uff0c\u63a8\u8350\u4e00\u4e2a[SSDB\u53ef\u89c6\u5316\u5de5\u5177](https://github.com/jhao104/SSDBAdmin)\u3002\r\n\r\n\u3000\u3000\u4e5f\u53ef\u4ee5\u901a\u8fc7api\u8bbf\u95eehttp://127.0.0.1:5010 \u67e5\u770b\u3002\r\n\r\n* Api\r\n\r\n| api | method | Description | arg|\r\n| ----| ---- | ---- | ----|\r\n| / | GET | api\u4ecb\u7ecd | None |\r\n| /get | GET | \u968f\u673a\u83b7\u53d6\u4e00\u4e2a\u4ee3\u7406 | None|\r\n| /get_all | GET | \u83b7\u53d6\u6240\u6709\u4ee3\u7406 |None|\r\n| /get_status | GET | \u67e5\u770b\u4ee3\u7406\u6570\u91cf |None|\r\n| /delete | GET | \u5220\u9664\u4ee3\u7406 |proxy=host:ip|\r\n\r\n* \u722c\u866b\u4f7f\u7528\r\n\r\n\u3000\u3000\u5982\u679c\u8981\u5728\u722c\u866b\u4ee3\u7801\u4e2d\u4f7f\u7528\u7684\u8bdd\uff0c \u53ef\u4ee5\u5c06\u6b64api\u5c01\u88c5\u6210\u51fd\u6570\u76f4\u63a5\u4f7f\u7528\uff0c\u4f8b\u5982\uff1a\r\n\r\n```python\r\nimport requests\r\n\r\ndef get_proxy():\r\n return requests.get(\"http://127.0.0.1:5010/get/\").content\r\n\r\ndef delete_proxy(proxy):\r\n requests.get(\"http://127.0.0.1:5010/delete/?proxy={}\".format(proxy))\r\n\r\n# your spider code\r\n\r\ndef getHtml():\r\n # ....\r\n retry_count = 5\r\n proxy = get_proxy()\r\n while retry_count > 0:\r\n try:\r\n html = requests.get('https://www.example.com', proxies={\"http\": \"http://{}\".format(proxy)})\r\n # \u4f7f\u7528\u4ee3\u7406\u8bbf\u95ee\r\n return html\r\n except Exception:\r\n retry_count -= 1\r\n # \u51fa\u95195\u6b21, \u5220\u9664\u4ee3\u7406\u6c60\u4e2d\u4ee3\u7406\r\n delete_proxy(proxy)\r\n return None\r\n```\r\n\r\n### \u6269\u5c55\u4ee3\u7406\r\n\r\n\u3000\u3000\u9879\u76ee\u9ed8\u8ba4\u5305\u542b\u51e0\u4e2a\u514d\u8d39\u7684\u4ee3\u7406\u83b7\u53d6\u65b9\u6cd5\uff0c\u4f46\u662f\u514d\u8d39\u7684\u6bd5\u7adf\u8d28\u91cf\u4e0d\u597d\uff0c\u6240\u4ee5\u5982\u679c\u76f4\u63a5\u8fd0\u884c\u53ef\u80fd\u62ff\u5230\u7684\u4ee3\u7406\u8d28\u91cf\u4e0d\u7406\u60f3\u3002\u6240\u4ee5\uff0c\u63d0\u4f9b\u4e86\u4ee3\u7406\u83b7\u53d6\u7684\u6269\u5c55\u65b9\u6cd5\u3002\r\n\r\n\u3000\u3000\u6dfb\u52a0\u4e00\u4e2a\u65b0\u7684\u4ee3\u7406\u83b7\u53d6\u65b9\u6cd5\u5982\u4e0b:\r\n\r\n* 1\u3001\u9996\u5148\u5728[GetFreeProxy](https://github.com/jhao104/proxy_pool/blob/b9ccdfaada51b57cfb1bbd0c01d4258971bc8352/ProxyGetter/getFreeProxy.py#L32)\u7c7b\u4e2d\u6dfb\u52a0\u4f60\u7684\u83b7\u53d6\u4ee3\u7406\u7684\u9759\u6001\u65b9\u6cd5\uff0c\r\n\u8be5\u65b9\u6cd5\u9700\u8981\u4ee5\u751f\u6210\u5668(yield)\u5f62\u5f0f\u8fd4\u56de`host:ip`\u683c\u5f0f\u7684\u4ee3\u7406\uff0c\u4f8b\u5982:\r\n\r\n```python\r\n\r\nclass GetFreeProxy(object):\r\n # ....\r\n\r\n # \u4f60\u81ea\u5df1\u7684\u65b9\u6cd5\r\n @staticmethod\r\n def freeProxyCustom(): # \u547d\u540d\u4e0d\u548c\u5df2\u6709\u91cd\u590d\u5373\u53ef\r\n\r\n # \u901a\u8fc7\u67d0\u7f51\u7ad9\u6216\u8005\u67d0\u63a5\u53e3\u6216\u67d0\u6570\u636e\u5e93\u83b7\u53d6\u4ee3\u7406 \u4efb\u610f\u4f60\u559c\u6b22\u7684\u59ff\u52bf\u90fd\u884c\r\n # \u5047\u8bbe\u4f60\u62ff\u5230\u4e86\u4e00\u4e2a\u4ee3\u7406\u5217\u8868\r\n proxies = [\"139.129.166.68:3128\", \"139.129.166.61:3128\", ...]\r\n for proxy in proxies:\r\n yield proxy\r\n # \u786e\u4fdd\u6bcf\u4e2aproxy\u90fd\u662f host:ip\u6b63\u786e\u7684\u683c\u5f0f\u5c31\u884c\r\n```\r\n\r\n* 2\u3001\u6dfb\u52a0\u597d\u65b9\u6cd5\u540e\uff0c\u4fee\u6539Config/setting.py\u6587\u4ef6\u4e2d\u7684`PROXY_GETTER`\u9879\uff1a\r\n\r\n\u3000\u3000\u5728`PROXY_GETTER`\u4e0b\u6dfb\u52a0\u81ea\u5b9a\u4e49\u7684\u65b9\u6cd5\u7684\u540d\u5b57:\r\n\r\n```shell\r\nPROXY_GETTER = [\r\n \"freeProxyFirst\", \r\n \"freeProxySecond\",\r\n ....\r\n \"freeProxyCustom\" # # \u786e\u4fdd\u540d\u5b57\u548c\u4f60\u6dfb\u52a0\u65b9\u6cd5\u540d\u5b57\u4e00\u81f4\r\n]\r\n```\r\n\r\n\r\n\u3000\u3000`ProxyRefreshSchedule`\u4f1a\u6bcf\u9694\u4e00\u6bb5\u65f6\u95f4\u6293\u53d6\u4e00\u6b21\u4ee3\u7406\uff0c\u4e0b\u6b21\u6293\u53d6\u65f6\u4f1a\u81ea\u52a8\u8bc6\u522b\u8c03\u7528\u4f60\u5b9a\u4e49\u7684\u65b9\u6cd5\u3002\r\n\r\n### \u4ee3\u7406\u91c7\u96c6\r\n\r\n \u76ee\u524d\u5b9e\u73b0\u7684\u91c7\u96c6\u514d\u8d39\u4ee3\u7406\u7f51\u7ad9\u6709(\u6392\u540d\u4e0d\u5206\u5148\u540e, \u4e0b\u9762\u4ec5\u662f\u5bf9\u5176\u53d1\u5e03\u7684\u514d\u8d39\u4ee3\u7406\u60c5\u51b5, \u4ed8\u8d39\u4ee3\u7406\u6d4b\u8bc4\u53ef\u4ee5\u53c2\u8003[\u8fd9\u91cc](https://zhuanlan.zhihu.com/p/33576641)): \r\n \r\n | \u5382\u5546\u540d\u79f0 | \u72b6\u6001 | \u66f4\u65b0\u901f\u5ea6 | \u53ef\u7528\u7387 | \u662f\u5426\u88ab\u5899 | \u5730\u5740 |\r\n | ----- | ---- | -------- | ------ | --------- | ----- |\r\n | \u65e0\u5fe7\u4ee3\u7406 | \u53ef\u7528 | \u51e0\u5206\u949f\u4e00\u6b21 | * | \u5426 | [\u5730\u5740](http://www.data5u.com/free/index.html) |\r\n | 66\u4ee3\u7406 | \u53ef\u7528 | \u66f4\u65b0\u5f88\u6162 | * | \u5426 | [\u5730\u5740](http://www.66ip.cn/) |\r\n | \u897f\u523a\u4ee3\u7406 | \u53ef\u7528 | \u51e0\u5206\u949f\u4e00\u6b21 | * | \u5426 | [\u5730\u5740](http://www.xicidaili.com)|\r\n | \u5168\u7f51\u4ee3\u7406 | \u53ef\u7528 | \u51e0\u5206\u949f\u4e00\u6b21 | * | \u5426 | [\u5730\u5740](http://www.goubanjia.com/)|\r\n | \u8bad\u4ee3\u7406 | \u5df2\u5173\u95ed\u514d\u8d39\u4ee3\u7406 | * | * | \u5426 | [\u5730\u5740](http://www.xdaili.cn/)|\r\n | \u5feb\u4ee3\u7406 | \u53ef\u7528 |\u51e0\u5206\u949f\u4e00\u6b21| * | \u5426 | [\u5730\u5740](https://www.kuaidaili.com/)|\r\n | \u4e91\u4ee3\u7406 | \u53ef\u7528 |\u51e0\u5206\u949f\u4e00\u6b21| * | \u5426 | [\u5730\u5740](http://www.ip3366.net/)|\r\n | IP\u6d77 | \u53ef\u7528 |\u51e0\u5c0f\u65f6\u4e00\u6b21| * | \u5426 | [\u5730\u5740](http://www.iphai.com/)|\r\n | \u514d\u8d39IP\u4ee3\u7406\u5e93 | \u53ef\u7528 |\u5feb| * | \u5426 | [\u5730\u5740](http://ip.jiangxianli.com/)|\r\n | \u4e2d\u56fdIP\u5730\u5740 | \u53ef\u7528 |\u51e0\u5206\u949f\u4e00\u6b21| * | \u662f | [\u5730\u5740](http://cn-proxy.com/)|\r\n | Proxy List | \u53ef\u7528 |\u51e0\u5206\u949f\u4e00\u6b21| * | \u662f | [\u5730\u5740](https://proxy-list.org/chinese/index.php)|\r\n | ProxyList+ | \u53ef\u7528 |\u51e0\u5206\u949f\u4e00\u6b21| * | \u662f | [\u5730\u5740](https://list.proxylistplus.com/Fresh-HTTP-Proxy-List-1)|\r\n \r\n \u5982\u679c\u8fd8\u6709\u5176\u4ed6\u597d\u7684\u514d\u8d39\u4ee3\u7406\u7f51\u7ad9, \u53ef\u4ee5\u5728\u63d0\u4ea4\u5728[issues](https://github.com/jhao104/proxy_pool/issues/71), \u4e0b\u6b21\u66f4\u65b0\u65f6\u4f1a\u8003\u8651\u5728\u9879\u76ee\u4e2d\u652f\u6301\u3002\r\n\r\n### \u95ee\u9898\u53cd\u9988\r\n\r\n\u3000\u3000\u4efb\u4f55\u95ee\u9898\u6b22\u8fce\u5728[Issues](https://github.com/jhao104/proxy_pool/issues) \u4e2d\u53cd\u9988\uff0c\u5982\u679c\u6ca1\u6709\u8d26\u53f7\u53ef\u4ee5\u53bb \u6211\u7684[\u535a\u5ba2](http://www.spiderpy.cn/blog/message)\u4e2d\u7559\u8a00\u3002\r\n\r\n\u3000\u3000\u4f60\u7684\u53cd\u9988\u4f1a\u8ba9\u6b64\u9879\u76ee\u53d8\u5f97\u66f4\u52a0\u5b8c\u7f8e\u3002\r\n\r\n### \u8d21\u732e\u4ee3\u7801\r\n\r\n\u3000\u3000\u672c\u9879\u76ee\u4ec5\u4f5c\u4e3a\u57fa\u672c\u7684\u901a\u7528\u7684\u4ee3\u7406\u6c60\u67b6\u6784\uff0c\u4e0d\u63a5\u6536\u7279\u6709\u529f\u80fd(\u5f53\u7136,\u4e0d\u9650\u4e8e\u7279\u522b\u597d\u7684idea)\u3002\r\n\r\n\u3000\u3000\u672c\u9879\u76ee\u4f9d\u7136\u4e0d\u591f\u5b8c\u5584\uff0c\u5982\u679c\u53d1\u73b0bug\u6216\u6709\u65b0\u7684\u529f\u80fd\u6dfb\u52a0\uff0c\u8bf7\u5728[Issues](https://github.com/jhao104/proxy_pool/issues)\u4e2d\u63d0\u4ea4bug(\u6216\u65b0\u529f\u80fd)\u63cf\u8ff0\uff0c\u5728\u786e\u8ba4\u540e\u63d0\u4ea4\u4f60\u7684\u4ee3\u7801\u3002\r\n\r\n\u3000\u3000\u8fd9\u91cc\u611f\u8c22\u4ee5\u4e0bcontributor\u7684\u65e0\u79c1\u5949\u732e\uff1a\r\n\r\n\u3000\u3000[@kangnwh](https://github.com/kangnwh)| [@bobobo80](https://github.com/bobobo80)| [@halleywj](https://github.com/halleywj)| [@newlyedward](https://github.com/newlyedward)| [@wang-ye](https://github.com/wang-ye)| [@gladmo](https://github.com/gladmo)| [@bernieyangmh](https://github.com/bernieyangmh)| [@PythonYXY](https://github.com/PythonYXY)| [@zuijiawoniu](https://github.com/zuijiawoniu)| [@netAir](https://github.com/netAir)| [@scil](https://github.com/scil)| [@tangrela](https://github.com/tangrela)| [@highroom](https://github.com/highroom)| [@luocaodan](https://github.com/luocaodan)| [@vc5](https://github.com/vc5)| [@1again](https://github.com/1again)\r\n\r\n\r\n### Release Notes\r\n\r\n [release notes](https://github.com/jhao104/proxy_pool/blob/master/doc/release_notes.md)\r\n\r\n",
"bugtrack_url": null,
"license": null,
"summary": "\u722c\u866bIP\u4ee3\u7406\u6c60",
"version": "1.3.5",
"project_urls": {
"Homepage": "https://github.com/yanjlee/proxy_pool"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b7d8f54d6aff90cbee19b4265b1c0609ed162526cc741761c820254f5c51cd51",
"md5": "661108d41f8f64d0edf18e58c3da36f4",
"sha256": "4e3254e678018bdfca027831011c1a9ac9193f8fbe23856bed89110927caccad"
},
"downloads": -1,
"filename": "proxy_pool_pro-1.3.5-py3-none-any.whl",
"has_sig": false,
"md5_digest": "661108d41f8f64d0edf18e58c3da36f4",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 31781,
"upload_time": "2024-06-01T08:11:07",
"upload_time_iso_8601": "2024-06-01T08:11:07.959338Z",
"url": "https://files.pythonhosted.org/packages/b7/d8/f54d6aff90cbee19b4265b1c0609ed162526cc741761c820254f5c51cd51/proxy_pool_pro-1.3.5-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0fecb9bd94845627dc4698686362831771056c4ede727a19b76140242156afe7",
"md5": "f1247c738a86e39487c4556d7773a318",
"sha256": "d14930c3043b8a4cc58c086d3471a0900b077358827fc80e5919f066ee7854f1"
},
"downloads": -1,
"filename": "proxy_pool_pro-1.3.5.tar.gz",
"has_sig": false,
"md5_digest": "f1247c738a86e39487c4556d7773a318",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 26430,
"upload_time": "2024-06-01T08:11:10",
"upload_time_iso_8601": "2024-06-01T08:11:10.167027Z",
"url": "https://files.pythonhosted.org/packages/0f/ec/b9bd94845627dc4698686362831771056c4ede727a19b76140242156afe7/proxy_pool_pro-1.3.5.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-06-01 08:11:10",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "yanjlee",
"github_project": "proxy_pool",
"travis_ci": true,
"coveralls": false,
"github_actions": false,
"requirements": [
{
"name": "APScheduler",
"specs": [
[
"==",
"3.2.0"
]
]
},
{
"name": "werkzeug",
"specs": [
[
"==",
"0.11.15"
]
]
},
{
"name": "Flask",
"specs": [
[
"==",
"0.12"
]
]
},
{
"name": "requests",
"specs": [
[
"==",
"2.20.0"
]
]
},
{
"name": "lxml",
"specs": [
[
"==",
"3.7.2"
]
]
},
{
"name": "pymongo",
"specs": []
},
{
"name": "redis",
"specs": []
}
],
"lcname": "proxy-pool-pro"
}
JSON
