downloaders

Name	downloaders JSON
Version	1.0.22 JSON
	download
home_page	https://github.com/LucaCappelletti94/downloaders
Summary	Python package to handle download of multiple types of files.
upload_time	2024-10-27 09:13:23
maintainer	None
docs_url	None
author	LucaCappelletti94
requires_python	>=3.8
license	MIT
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # Downloaders

![PyPI version](https://badge.fury.io/py/downloaders.svg)
![Downloads](https://pepy.tech/badge/downloaders)
![GitHub Actions](https://github.com/lucacappelletti94/downloaders/actions/workflows/python.yml/badge.svg)

Python package to handle the download of multiple types of files.

## How do I install this package?

As usual, just download it using pip:

```shell
pip install downloaders
```

## Usage examples

```python
from downloaders import BaseDownloader

downloader = BaseDownloader()
urls = [...]
downloader.download(urls)
```

## Troubleshooting

### MacOS multiprocessing nightmare fuel

Cupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:

```bash
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.
```

Apparently, this can be easily fixed by changing the way multiprocessing spawns processes:

```python
import platform, multiprocessing

if platform.system() == "Darwin":
    multiprocessing.set_start_method('spawn')
```

The aforementioned solution was proposed on [this StackOverflow question](https://stackoverflow.com/questions/30669659/multiproccesing-and-error-the-process-has-forked-and-you-cannot-use-this-corefou).



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/LucaCappelletti94/downloaders",
    "name": "downloaders",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": null,
    "author": "LucaCappelletti94",
    "author_email": "cappelletti.luca94@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/d6/bc/49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55/downloaders-1.0.22.tar.gz",
    "platform": null,
    "description": "# Downloaders\n\n![PyPI version](https://badge.fury.io/py/downloaders.svg)\n![Downloads](https://pepy.tech/badge/downloaders)\n![GitHub Actions](https://github.com/lucacappelletti94/downloaders/actions/workflows/python.yml/badge.svg)\n\nPython package to handle the download of multiple types of files.\n\n## How do I install this package?\n\nAs usual, just download it using pip:\n\n```shell\npip install downloaders\n```\n\n## Usage examples\n\n```python\nfrom downloaders import BaseDownloader\n\ndownloader = BaseDownloader()\nurls = [...]\ndownloader.download(urls)\n```\n\n## Troubleshooting\n\n### MacOS multiprocessing nightmare fuel\n\nCupertino has a gift for us: somehow, under certain specific astral configurations on MacOS (which I have yet to fully understand), multiprocessing will crash with the following error:\n\n```bash\nThe process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().\nBreak on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.\n```\n\nApparently, this can be easily fixed by changing the way multiprocessing spawns processes:\n\n```python\nimport platform, multiprocessing\n\nif platform.system() == \"Darwin\":\n    multiprocessing.set_start_method('spawn')\n```\n\nThe aforementioned solution was proposed on [this StackOverflow question](https://stackoverflow.com/questions/30669659/multiproccesing-and-error-the-process-has-forked-and-you-cannot-use-this-corefou).\n\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Python package to handle download of multiple types of files.",
    "version": "1.0.22",
    "project_urls": {
        "Homepage": "https://github.com/LucaCappelletti94/downloaders"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d6bc49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55",
                "md5": "bd95028ced0dd251404fd85893ab6702",
                "sha256": "5bc676d0221a009fcad18257e058dbf50d04aa2337e57b215d25de36c14e6ec3"
            },
            "downloads": -1,
            "filename": "downloaders-1.0.22.tar.gz",
            "has_sig": false,
            "md5_digest": "bd95028ced0dd251404fd85893ab6702",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 11732,
            "upload_time": "2024-10-27T09:13:23",
            "upload_time_iso_8601": "2024-10-27T09:13:23.337734Z",
            "url": "https://files.pythonhosted.org/packages/d6/bc/49aaa2ab42600420a8ed2d79682f3eca176d4a947478126007f9795f6b55/downloaders-1.0.22.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-10-27 09:13:23",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "LucaCappelletti94",
    "github_project": "downloaders",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "downloaders"
}