# Downloaders
![PyPI version](https://badge.fury.io/py/downloaders.svg)
![Downloads](https://pepy.tech/badge/downloaders)
![GitHub Actions](https://github.com/lucacappelletti94/downloaders/actions/workflows/python.yml/badge.svg)
Python package to handle the download of multiple types of files.
## How do I install this package?
As usual, just download it using pip:
```shell
pip install downloaders
```
## Usage examples
```python
from downloaders import BaseDownloader
downloader = BaseDownloader()
urls = [...]
downloader.download(urls)
```
## Troubleshooting
### MacOS multiprocessing nightmare fuel
Cupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:
```bash
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.
```
Apparently, this can be easily fixed by changing the way multiprocessing spawns processes:
```python
import platform, multiprocessing
if platform.system() == "Darwin":
multiprocessing.set_start_method('spawn')
```
The aforementioned solution was proposed on [this StackOverflow question](https://stackoverflow.com/questions/30669659/multiproccesing-and-error-the-process-has-forked-and-you-cannot-use-this-corefou).
Raw data
{
"_id": null,
"home_page": "https://github.com/LucaCappelletti94/downloaders",
"name": "downloaders",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": "LucaCappelletti94",
"author_email": "cappelletti.luca94@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/d6/bc/49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55/downloaders-1.0.22.tar.gz",
"platform": null,
"description": "# Downloaders\n\n![PyPI version](https://badge.fury.io/py/downloaders.svg)\n![Downloads](https://pepy.tech/badge/downloaders)\n![GitHub Actions](https://github.com/lucacappelletti94/downloaders/actions/workflows/python.yml/badge.svg)\n\nPython package to handle the download of multiple types of files.\n\n## How do I install this package?\n\nAs usual, just download it using pip:\n\n```shell\npip install downloaders\n```\n\n## Usage examples\n\n```python\nfrom downloaders import BaseDownloader\n\ndownloader = BaseDownloader()\nurls = [...]\ndownloader.download(urls)\n```\n\n## Troubleshooting\n\n### MacOS multiprocessing nightmare fuel\n\nCupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:\n\n```bash\nThe process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().\nBreak on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.\n```\n\nApparently, this can be easily fixed by changing the way multiprocessing spawns processes:\n\n```python\nimport platform, multiprocessing\n\nif platform.system() == \"Darwin\":\n multiprocessing.set_start_method('spawn')\n```\n\nThe aforementioned solution was proposed on [this StackOverflow question](https://stackoverflow.com/questions/30669659/multiproccesing-and-error-the-process-has-forked-and-you-cannot-use-this-corefou).\n\n\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Python package to handle download of multiple types of files.",
"version": "1.0.22",
"project_urls": {
"Homepage": "https://github.com/LucaCappelletti94/downloaders"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "d6bc49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55",
"md5": "bd95028ced0dd251404fd85893ab6702",
"sha256": "5bc676d0221a009fcad18257e058dbf50d04aa2337e57b215d25de36c14e6ec3"
},
"downloads": -1,
"filename": "downloaders-1.0.22.tar.gz",
"has_sig": false,
"md5_digest": "bd95028ced0dd251404fd85893ab6702",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 11732,
"upload_time": "2024-10-27T09:13:23",
"upload_time_iso_8601": "2024-10-27T09:13:23.337734Z",
"url": "https://files.pythonhosted.org/packages/d6/bc/49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55/downloaders-1.0.22.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-10-27 09:13:23",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "LucaCappelletti94",
"github_project": "downloaders",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "downloaders"
}