smartscoutscrape


Namesmartscoutscrape JSON
Version 0.2.1 PyPI version JSON
download
home_pagehttps://github.com/regulad/smartscout-scrape
SummaryLightweight data-extraction & general use library for smartscout.com
upload_time2023-07-09 04:20:09
maintainerParker Wahle
docs_urlNone
authorParker Wahle
requires_python>=3.11,<4.0
licenseApache-2.0
keywords scraper data science requests python data
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Smartscout-scrape

[![Version status](https://img.shields.io/pypi/status/smartscout-scrape)](https://pypi.org/project/smartscout-scrape)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Python version compatibility](https://img.shields.io/pypi/pyversions/smartscout-scrape)](https://pypi.org/project/smartscout-scrape)
[![Version on Docker Hub](https://img.shields.io/docker/v/regulad/smartscout-scrape?color=green&label=Docker%20Hub)](https://hub.docker.com/repository/docker/regulad/smartscout-scrape)
[![Version on GitHub](https://img.shields.io/github/v/release/regulad/smartscout-scrape?include_prereleases&label=GitHub)](https://github.com/regulad/smartscout-scrape/releases)
[![Version on PyPi](https://img.shields.io/pypi/v/smartscoutscrape)](https://pypi.org/project/smartscoutscrape)
[![Version on Conda-Forge](https://img.shields.io/conda/vn/conda-forge/smartscout-scrape?label=Conda-Forge)](https://anaconda.org/conda-forge/smartscout-scrape)
[![Documentation status](https://readthedocs.org/projects/smartscout-scrape/badge)](https://smartscout-scrape.readthedocs.io/en/stable)
[![Build (GitHub Actions)](https://img.shields.io/github/workflow/status/regulad/smartscout-scrape/Build%20&%20test?label=Build%20&%20test)](https://github.com/regulad/smartscout-scrape/actions)
[![Build (Travis)](https://img.shields.io/travis/regulad/smartscout-scrape?label=Travis)](https://travis-ci.com/regulad/smartscout-scrape)
[![Build (Azure)](https://img.shields.io/azure-devops/build/regulad/<<key>>/<<defid>>?label=Azure)](https://dev.azure.com/regulad/smartscout-scrape/_build?definitionId=1&_a=summary)
[![Build (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/build.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/build-status/main)
[![Test coverage (coveralls)](https://coveralls.io/repos/github/regulad/smartscout-scrape/badge.svg?branch=main&service=github)](https://coveralls.io/github/regulad/smartscout-scrape?branch=main)
[![Test coverage (codecov)](https://codecov.io/github/regulad/smartscout-scrape/coverage.svg)](https://codecov.io/gh/regulad/smartscout-scrape)
[![Test coverage (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/coverage.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/?branch=main)
[![Maintainability (Code Climate)](https://api.codeclimate.com/v1/badges/<<apikey>>/maintainability)](https://codeclimate.com/github/regulad/smartscout-scrape/maintainability)
[![CodeFactor](https://www.codefactor.io/repository/github/dmyersturnbull/tyrannosaurus/badge)](https://www.codefactor.io/repository/github/dmyersturnbull/tyrannosaurus)
[![Code Quality (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/quality-score.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/?branch=main)
[![Created with Tyrannosaurus](https://img.shields.io/badge/Created_with-Tyrannosaurus-0000ff.svg)](https://github.com/dmyersturnbull/tyrannosaurus)

Lightweight data-extraction & general use library for smartscout.com.

## Proxy

Included is a simple Tailscale configuration that serves a SOCKS5 proxy on your local machine.

Copy the contents of `.env-example` into `.env`, populate the fields and then perform the following command on a machine that has docker installed:

```bash
docker-compose up -d
```

Then, you can use the `--proxy` flag to use the proxy.

```bash
poetry run amzscout-scrape --proxy socks5://localhost:1055
```

And itโ€™s further described in this paragraph.
[See the docs ๐Ÿ“š](https://smartscout-scrape.readthedocs.io/en/stable/) for more info.

Licensed under the terms of the [Apache License 2.0](https://spdx.org/licenses/Apache-2.0.html).
[New issues](https://github.com/regulad/smartscout-scrape/issues) and pull requests are welcome.
Please refer to the [contributing guide](https://github.com/regulad/smartscout-scrape/blob/main/CONTRIBUTING.md)
and [security policy](https://github.com/regulad/smartscout-scrape/blob/main/SECURITY.md).
Generated with [Tyrannosaurus](https://github.com/dmyersturnbull/tyrannosaurus).

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/regulad/smartscout-scrape",
    "name": "smartscoutscrape",
    "maintainer": "Parker Wahle",
    "docs_url": null,
    "requires_python": ">=3.11,<4.0",
    "maintainer_email": "regulad@regulad.xyz",
    "keywords": "scraper,data science,requests,python,data",
    "author": "Parker Wahle",
    "author_email": "regulad@regulad.xyz",
    "download_url": "https://files.pythonhosted.org/packages/c1/72/0a9c8c98d8f4c56b7a5e44a434df5cd59877ac75af350262ce7e1c68501f/smartscoutscrape-0.2.1.tar.gz",
    "platform": null,
    "description": "# Smartscout-scrape\n\n[![Version status](https://img.shields.io/pypi/status/smartscout-scrape)](https://pypi.org/project/smartscout-scrape)\n[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\n[![Python version compatibility](https://img.shields.io/pypi/pyversions/smartscout-scrape)](https://pypi.org/project/smartscout-scrape)\n[![Version on Docker Hub](https://img.shields.io/docker/v/regulad/smartscout-scrape?color=green&label=Docker%20Hub)](https://hub.docker.com/repository/docker/regulad/smartscout-scrape)\n[![Version on GitHub](https://img.shields.io/github/v/release/regulad/smartscout-scrape?include_prereleases&label=GitHub)](https://github.com/regulad/smartscout-scrape/releases)\n[![Version on PyPi](https://img.shields.io/pypi/v/smartscoutscrape)](https://pypi.org/project/smartscoutscrape)\n[![Version on Conda-Forge](https://img.shields.io/conda/vn/conda-forge/smartscout-scrape?label=Conda-Forge)](https://anaconda.org/conda-forge/smartscout-scrape)\n[![Documentation status](https://readthedocs.org/projects/smartscout-scrape/badge)](https://smartscout-scrape.readthedocs.io/en/stable)\n[![Build (GitHub Actions)](https://img.shields.io/github/workflow/status/regulad/smartscout-scrape/Build%20&%20test?label=Build%20&%20test)](https://github.com/regulad/smartscout-scrape/actions)\n[![Build (Travis)](https://img.shields.io/travis/regulad/smartscout-scrape?label=Travis)](https://travis-ci.com/regulad/smartscout-scrape)\n[![Build (Azure)](https://img.shields.io/azure-devops/build/regulad/<<key>>/<<defid>>?label=Azure)](https://dev.azure.com/regulad/smartscout-scrape/_build?definitionId=1&_a=summary)\n[![Build (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/build.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/build-status/main)\n[![Test coverage (coveralls)](https://coveralls.io/repos/github/regulad/smartscout-scrape/badge.svg?branch=main&service=github)](https://coveralls.io/github/regulad/smartscout-scrape?branch=main)\n[![Test coverage (codecov)](https://codecov.io/github/regulad/smartscout-scrape/coverage.svg)](https://codecov.io/gh/regulad/smartscout-scrape)\n[![Test coverage (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/coverage.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/?branch=main)\n[![Maintainability (Code Climate)](https://api.codeclimate.com/v1/badges/<<apikey>>/maintainability)](https://codeclimate.com/github/regulad/smartscout-scrape/maintainability)\n[![CodeFactor](https://www.codefactor.io/repository/github/dmyersturnbull/tyrannosaurus/badge)](https://www.codefactor.io/repository/github/dmyersturnbull/tyrannosaurus)\n[![Code Quality (Scrutinizer)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/badges/quality-score.png?b=main)](https://scrutinizer-ci.com/g/regulad/smartscout-scrape/?branch=main)\n[![Created with Tyrannosaurus](https://img.shields.io/badge/Created_with-Tyrannosaurus-0000ff.svg)](https://github.com/dmyersturnbull/tyrannosaurus)\n\nLightweight data-extraction & general use library for smartscout.com.\n\n## Proxy\n\nIncluded is a simple Tailscale configuration that serves a SOCKS5 proxy on your local machine.\n\nCopy the contents of `.env-example` into `.env`, populate the fields and then perform the following command on a machine that has docker installed:\n\n```bash\ndocker-compose up -d\n```\n\nThen, you can use the `--proxy` flag to use the proxy.\n\n```bash\npoetry run amzscout-scrape --proxy socks5://localhost:1055\n```\n\nAnd it\u2019s further described in this paragraph.\n[See the docs \ud83d\udcda](https://smartscout-scrape.readthedocs.io/en/stable/) for more info.\n\nLicensed under the terms of the [Apache License 2.0](https://spdx.org/licenses/Apache-2.0.html).\n[New issues](https://github.com/regulad/smartscout-scrape/issues) and pull requests are welcome.\nPlease refer to the [contributing guide](https://github.com/regulad/smartscout-scrape/blob/main/CONTRIBUTING.md)\nand [security policy](https://github.com/regulad/smartscout-scrape/blob/main/SECURITY.md).\nGenerated with [Tyrannosaurus](https://github.com/dmyersturnbull/tyrannosaurus).\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Lightweight data-extraction & general use library for smartscout.com",
    "version": "0.2.1",
    "project_urls": {
        "CI": "https://github.com/regulad/smartscout-scrape/actions",
        "Documentation": "https://smartscout-scrape.readthedocs.io",
        "Download": "https://pypi.org/project/smartscoutscrape/",
        "Homepage": "https://github.com/regulad/smartscout-scrape",
        "Issues": "https://github.com/regulad/smartscout-scrape/issues",
        "Repository": "https://github.com/regulad/smartscout-scrape"
    },
    "split_keywords": [
        "scraper",
        "data science",
        "requests",
        "python",
        "data"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "4d996e980bf647a08713a34cf2dfc50a7fd8c3c4dcdd53392b7a66b8845201d6",
                "md5": "8791c863990ca6b9070f9f1af827a05d",
                "sha256": "75cbc11c64781167fba6491edee23302f29ce9dc306cd0173996d6e37c2e186e"
            },
            "downloads": -1,
            "filename": "smartscoutscrape-0.2.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "8791c863990ca6b9070f9f1af827a05d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.11,<4.0",
            "size": 26422,
            "upload_time": "2023-07-09T04:20:07",
            "upload_time_iso_8601": "2023-07-09T04:20:07.702802Z",
            "url": "https://files.pythonhosted.org/packages/4d/99/6e980bf647a08713a34cf2dfc50a7fd8c3c4dcdd53392b7a66b8845201d6/smartscoutscrape-0.2.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c1720a9c8c98d8f4c56b7a5e44a434df5cd59877ac75af350262ce7e1c68501f",
                "md5": "b2281faf8f7d296bfe418b38d9e70760",
                "sha256": "27e425e13fb05f7a8984b7e87fcb325c7acd7aa15325fc591f0317758a3099dd"
            },
            "downloads": -1,
            "filename": "smartscoutscrape-0.2.1.tar.gz",
            "has_sig": false,
            "md5_digest": "b2281faf8f7d296bfe418b38d9e70760",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.11,<4.0",
            "size": 28137,
            "upload_time": "2023-07-09T04:20:09",
            "upload_time_iso_8601": "2023-07-09T04:20:09.143206Z",
            "url": "https://files.pythonhosted.org/packages/c1/72/0a9c8c98d8f4c56b7a5e44a434df5cd59877ac75af350262ce7e1c68501f/smartscoutscrape-0.2.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-07-09 04:20:09",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "regulad",
    "github_project": "smartscout-scrape",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "tox": true,
    "lcname": "smartscoutscrape"
}
        
Elapsed time: 0.08545s