# Pump
## Concurrent file downloader written in Python
Downloads file in parts using multiple concurrent threads
## Installation
Install the tool using pip
```
$ pip install pump-downloader
```
## Usage
Use as `pump` through shell
```bash
$ pump --help
Usage: pump [OPTIONS] URL
Multithreaded Downloader for concurrent downloads
Options:
-s, --csize INTEGER Chunk size to use, defaults to size/#chunks
-c, --ccount INTEGER Number of Chunks to download concurrently
-o, --output-path TEXT Path to write the downloaded output file
-q, --quiet Disable verbose
-f, --force Suppress confirmation for filename
-H, --header TEXT Pass each request header (as in curl)
--help Show this message and exit.
```
## Example
```bash
$ pump 'https://storage.googleapis.com/kaggle-data-sets/705300/1231826/compressed/multinli_1.0_train.txt.zip' \
-H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:98.0) Gecko/20100101 Firefox/98.0' \
-H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8' \
-H 'Accept-Language: en-US,en;q=0.5' -H 'Accept-Encoding: gzip, deflate, br' \
-H 'Referer: https://www.kaggle.com/' -H 'Alt-Used: storage.googleapis.com' \
-H 'Connection: keep-alive' -H 'Upgrade-Insecure-Requests: 1' -H 'Sec-Fetch-Dest: document' \
-H 'Sec-Fetch-Mode: navigate' -H 'Sec-Fetch-Site: cross-site' -H 'Sec-Fetch-User: ?1' \
-H 'Pragma: no-cache' -H 'Cache-Control: no-cache'
File will be saved as multinli_1.0_train.txt.zip
Do you want to change the name? [y/N]: n
Fetching 102.88 MiBs in 8 chunks
```
Raw data
{
"_id": null,
"home_page": "https://github.com/thevarunsharma/pump-downloader",
"name": "pump-downloader",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "download pump curl wget concurrent parallel",
"author": "Varun Sharma",
"author_email": "",
"download_url": "https://files.pythonhosted.org/packages/9f/16/94263023b94889400b07659fa3483b29aa28313d76d8e371aef2a5d5ba7a/pump-downloader-0.2.2.tar.gz",
"platform": null,
"description": "# Pump\n## Concurrent file downloader written in Python\n\nDownloads file in parts using multiple concurrent threads\n\n## Installation\nInstall the tool using pip\n```\n$ pip install pump-downloader\n```\n## Usage\nUse as `pump` through shell\n```bash\n$ pump --help\nUsage: pump [OPTIONS] URL\n\n Multithreaded Downloader for concurrent downloads\n\nOptions:\n -s, --csize INTEGER Chunk size to use, defaults to size/#chunks\n -c, --ccount INTEGER Number of Chunks to download concurrently\n -o, --output-path TEXT Path to write the downloaded output file\n -q, --quiet Disable verbose\n -f, --force Suppress confirmation for filename\n -H, --header TEXT Pass each request header (as in curl)\n --help Show this message and exit.\n```\n\n## Example\n```bash\n$ pump 'https://storage.googleapis.com/kaggle-data-sets/705300/1231826/compressed/multinli_1.0_train.txt.zip' \\\n-H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:98.0) Gecko/20100101 Firefox/98.0' \\\n-H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8' \\\n-H 'Accept-Language: en-US,en;q=0.5' -H 'Accept-Encoding: gzip, deflate, br' \\\n-H 'Referer: https://www.kaggle.com/' -H 'Alt-Used: storage.googleapis.com' \\\n-H 'Connection: keep-alive' -H 'Upgrade-Insecure-Requests: 1' -H 'Sec-Fetch-Dest: document' \\\n-H 'Sec-Fetch-Mode: navigate' -H 'Sec-Fetch-Site: cross-site' -H 'Sec-Fetch-User: ?1' \\\n-H 'Pragma: no-cache' -H 'Cache-Control: no-cache'\nFile will be saved as multinli_1.0_train.txt.zip\nDo you want to change the name? [y/N]: n\nFetching 102.88 MiBs in 8 chunks\n```\n",
"bugtrack_url": null,
"license": "",
"summary": "Multithreaded downloader for faster downloads",
"version": "0.2.2",
"split_keywords": [
"download",
"pump",
"curl",
"wget",
"concurrent",
"parallel"
],
"urls": [
{
"comment_text": "",
"digests": {
"md5": "4ca7f369426a91c262c5c8e9b662544f",
"sha256": "5f05cb1ddfb4c13e2d1687f930ae251a5bc7331f8e3d9699b90fa55a0531375b"
},
"downloads": -1,
"filename": "pump_downloader-0.2.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "4ca7f369426a91c262c5c8e9b662544f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 11301,
"upload_time": "2023-01-01T08:42:21",
"upload_time_iso_8601": "2023-01-01T08:42:21.175455Z",
"url": "https://files.pythonhosted.org/packages/cc/40/4f77951f1f99481fb96964e8c6fc5cfc182b24f910b20309a0cf3376de56/pump_downloader-0.2.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"md5": "bca6dde402778f4a0020637ffb082b32",
"sha256": "5d5180719884bea18690e003e5012abaf6903f4446cc48b9342cf4a5c9e761a4"
},
"downloads": -1,
"filename": "pump-downloader-0.2.2.tar.gz",
"has_sig": false,
"md5_digest": "bca6dde402778f4a0020637ffb082b32",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 10241,
"upload_time": "2023-01-01T08:42:22",
"upload_time_iso_8601": "2023-01-01T08:42:22.922787Z",
"url": "https://files.pythonhosted.org/packages/9f/16/94263023b94889400b07659fa3483b29aa28313d76d8e371aef2a5d5ba7a/pump-downloader-0.2.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-01-01 08:42:22",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "thevarunsharma",
"github_project": "pump-downloader",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "pump-downloader"
}
JSON
