Name | batchdownload JSON |
Version |
0.1.2
JSON |
| download |
home_page | None |
Summary | Asynchronous batch directory crawler & downloader |
upload_time | 2025-09-04 10:26:04 |
maintainer | None |
docs_url | None |
author | None |
requires_python | >=3.8 |
license | MIT |
keywords |
async
download
crawler
scraper
|
VCS |
 |
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# Batch Download 网页批量文件下载工具
异步批量目录爬虫,支持断点续传、深度限制、扩展名过滤等功能。
开源地址:https://github.com/PIKACHUIM/BatchDownload
## Install 安装方法
```shell
pip install aiohttp aiofiles playwright tqdm
```
首次使用前需安装浏览器依赖:
```shell
playwright install chromium
```
## Usage 使用示例
```python
import asyncio
from batchdownload import BatchDownload
async def main():
crawler = BatchDownload(
url="https://example.com/files",
depth=2,
store_dir="downloads",
ext={".zip", ".pdf"}
)
links = await crawler.fetch()
await crawler.download(max_workers=5)
if __name__ == "__main__":
asyncio.run(main())
```
## GUI App 图形化客户端下载
https://github.com/PIKACHUIM/BatchDownload/releases
Raw data
{
"_id": null,
"home_page": null,
"name": "batchdownload",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "async, download, crawler, scraper",
"author": null,
"author_email": "Pikachu Ren <pikachuim@foxmail.com>",
"download_url": "https://files.pythonhosted.org/packages/12/79/0f4ded2f2a80ea9b4fea53abffc32507b32fd96b59f2f11c6f11874fc90d/batchdownload-0.1.2.tar.gz",
"platform": null,
"description": "# Batch Download \u7f51\u9875\u6279\u91cf\u6587\u4ef6\u4e0b\u8f7d\u5de5\u5177\r\n\r\n\u5f02\u6b65\u6279\u91cf\u76ee\u5f55\u722c\u866b\uff0c\u652f\u6301\u65ad\u70b9\u7eed\u4f20\u3001\u6df1\u5ea6\u9650\u5236\u3001\u6269\u5c55\u540d\u8fc7\u6ee4\u7b49\u529f\u80fd\u3002\r\n\u5f00\u6e90\u5730\u5740\uff1ahttps://github.com/PIKACHUIM/BatchDownload\r\n\r\n## Install \u5b89\u88c5\u65b9\u6cd5\r\n```shell\r\npip install aiohttp aiofiles playwright tqdm\r\n```\r\n\r\n\u9996\u6b21\u4f7f\u7528\u524d\u9700\u5b89\u88c5\u6d4f\u89c8\u5668\u4f9d\u8d56\uff1a\r\n```shell\r\nplaywright install chromium\r\n```\r\n\r\n## Usage \u4f7f\u7528\u793a\u4f8b\r\n\r\n```python\r\nimport asyncio\r\nfrom batchdownload import BatchDownload\r\n\r\nasync def main():\r\n crawler = BatchDownload(\r\n url=\"https://example.com/files\",\r\n depth=2,\r\n store_dir=\"downloads\",\r\n ext={\".zip\", \".pdf\"}\r\n )\r\n links = await crawler.fetch()\r\n await crawler.download(max_workers=5)\r\n\r\nif __name__ == \"__main__\":\r\n asyncio.run(main())\r\n```\r\n\r\n## GUI App \u56fe\u5f62\u5316\u5ba2\u6237\u7aef\u4e0b\u8f7d\r\nhttps://github.com/PIKACHUIM/BatchDownload/releases\r\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Asynchronous batch directory crawler & downloader",
"version": "0.1.2",
"project_urls": {
"Homepage": "https://github.com/yourname/batchdownload",
"Issues": "https://github.com/yourname/batchdownload/issues",
"Repository": "https://github.com/yourname/batchdownload"
},
"split_keywords": [
"async",
" download",
" crawler",
" scraper"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "3b64ea1381c19c3529371d53835e994a9cb68a97af7866b842e054f13c5899ed",
"md5": "0520eff809b2c1e0672d8de35d4036b7",
"sha256": "d4de5bc919f2f5dd5cd508b459f020cfdcd64e605884e9dc6daecf36e1371d2e"
},
"downloads": -1,
"filename": "batchdownload-0.1.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "0520eff809b2c1e0672d8de35d4036b7",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 17917,
"upload_time": "2025-09-04T10:26:02",
"upload_time_iso_8601": "2025-09-04T10:26:02.727420Z",
"url": "https://files.pythonhosted.org/packages/3b/64/ea1381c19c3529371d53835e994a9cb68a97af7866b842e054f13c5899ed/batchdownload-0.1.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "12790f4ded2f2a80ea9b4fea53abffc32507b32fd96b59f2f11c6f11874fc90d",
"md5": "6f308d36b82c58989a8c82eca73acc43",
"sha256": "7d61ba3ad83fde59488a79cbdf3c6a530717c10ce1292de4f0db99c8dc4b525a"
},
"downloads": -1,
"filename": "batchdownload-0.1.2.tar.gz",
"has_sig": false,
"md5_digest": "6f308d36b82c58989a8c82eca73acc43",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 17520,
"upload_time": "2025-09-04T10:26:04",
"upload_time_iso_8601": "2025-09-04T10:26:04.372335Z",
"url": "https://files.pythonhosted.org/packages/12/79/0f4ded2f2a80ea9b4fea53abffc32507b32fd96b59f2f11c6f11874fc90d/batchdownload-0.1.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-09-04 10:26:04",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "yourname",
"github_project": "batchdownload",
"github_not_found": true,
"lcname": "batchdownload"
}