amazon-description-scraper


Nameamazon-description-scraper JSON
Version 0.1.0 PyPI version JSON
download
home_pageNone
SummaryWebscrape project to get Amazon products' descriptions
upload_time2025-08-08 11:16:04
maintainerNone
docs_urlNone
authorNone
requires_python>=3.9
licenseNone
keywords amazon scraping
VCS
bugtrack_url
requirements bs4 fake-useragent pandas requests selenium
Travis-CI No Travis.
coveralls test coverage No coveralls.
            Amazon Description Scraper
==========================

.. image:: https://img.shields.io/pypi/v/amazon-description-scraper.svg?logo=python&logoColor=white
   :target: https://pypi.org/project/amazon-description-scraper/

.. image:: https://github.com/ryzanbui02/amazon-description-scraper/actions/workflows/test-and-deploy.yaml/badge.svg
    :target: https://github.com/ryzanbui02/amazon-description-scraper/actions/workflows/test-and-deploy.yaml

.. image:: https://codecov.io/gh/ryzanbui02/amazon-description-scraper/branch/main/graph/badge.svg
  :target: https://codecov.io/gh/ryzanbui02/amazon-description-scraper

Webscrape project to get Amazon products' descriptions.


Requirements
------------

This library is compatible with Python >= 3.9 and requires:

- ``bs4``
- ``fake-useragent``
- ``pandas``
- ``requests``
- ``selenium``


Installation
------------
Module can be installed from `PyPI <https://pypi.org/project/amazon-description-scraper>`_ with:

.. code::

  pip install amazon-description-scraper


Brief Example
-------------

.. code:: python

  from amzsc import AmazonScraper
  
  proxy_key = "XXXXXXXXXXX" # enter real proxy key here
  client = AmazonScraper(proxy_key=proxy_key, jsonl_output_path="data/output.jsonl")
  asins = ["B07WC4TDJJ"]
  results = client.scrape(asins=asins, marketplace="US")
  print(results)


Contributing
------------
Contribute to this repository by forking this repository and installing in
development mode with::

  git clone https://github.com/<USERNAME>/amazon-description-scraper
  pip install -e .[test]

You can then add your feature or commit your bug fix and then run your unit
testing with::

  pytest

Unit testing will automatically enforce minimum code coverage standards.

Next, to ensure your code meets minimum code styling standards, run::

  pre-commit run --all-files

Finally, `create a pull request <https://github.com/ryzanbui02/amazon-description-scraper/pulls>`_ from your fork and I'll be sure to review it.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "amazon-description-scraper",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": null,
    "keywords": "amazon, scraping",
    "author": null,
    "author_email": "Ryzan Bui <ryzan.b@zendom.co.uk>",
    "download_url": "https://files.pythonhosted.org/packages/f1/15/8843adba977053f034e381aa465f63ceb1beb943d64ce04b1098446e2ff6/amazon_description_scraper-0.1.0.tar.gz",
    "platform": null,
    "description": "Amazon Description Scraper\n==========================\n\n.. image:: https://img.shields.io/pypi/v/amazon-description-scraper.svg?logo=python&logoColor=white\n   :target: https://pypi.org/project/amazon-description-scraper/\n\n.. image:: https://github.com/ryzanbui02/amazon-description-scraper/actions/workflows/test-and-deploy.yaml/badge.svg\n    :target: https://github.com/ryzanbui02/amazon-description-scraper/actions/workflows/test-and-deploy.yaml\n\n.. image:: https://codecov.io/gh/ryzanbui02/amazon-description-scraper/branch/main/graph/badge.svg\n  :target: https://codecov.io/gh/ryzanbui02/amazon-description-scraper\n\nWebscrape project to get Amazon products' descriptions.\n\n\nRequirements\n------------\n\nThis library is compatible with Python >= 3.9 and requires:\n\n- ``bs4``\n- ``fake-useragent``\n- ``pandas``\n- ``requests``\n- ``selenium``\n\n\nInstallation\n------------\nModule can be installed from `PyPI <https://pypi.org/project/amazon-description-scraper>`_ with:\n\n.. code::\n\n  pip install amazon-description-scraper\n\n\nBrief Example\n-------------\n\n.. code:: python\n\n  from amzsc import AmazonScraper\n  \n  proxy_key = \"XXXXXXXXXXX\" # enter real proxy key here\n  client = AmazonScraper(proxy_key=proxy_key, jsonl_output_path=\"data/output.jsonl\")\n  asins = [\"B07WC4TDJJ\"]\n  results = client.scrape(asins=asins, marketplace=\"US\")\n  print(results)\n\n\nContributing\n------------\nContribute to this repository by forking this repository and installing in\ndevelopment mode with::\n\n  git clone https://github.com/<USERNAME>/amazon-description-scraper\n  pip install -e .[test]\n\nYou can then add your feature or commit your bug fix and then run your unit\ntesting with::\n\n  pytest\n\nUnit testing will automatically enforce minimum code coverage standards.\n\nNext, to ensure your code meets minimum code styling standards, run::\n\n  pre-commit run --all-files\n\nFinally, `create a pull request <https://github.com/ryzanbui02/amazon-description-scraper/pulls>`_ from your fork and I'll be sure to review it.\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Webscrape project to get Amazon products' descriptions",
    "version": "0.1.0",
    "project_urls": {
        "Source": "https://github.com/ryzanbui02/amazon-description-scraper"
    },
    "split_keywords": [
        "amazon",
        " scraping"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "daceac19ff541044c92181e1fb349851fe706119d471b75ee5e7da374f4a7d0f",
                "md5": "1394116b2c5f8e75d596a55bad07f1fe",
                "sha256": "69f876a0c87c6d2a632de3586e82b98a3a8e2f74bf2b2fd71c659649a1c9dc87"
            },
            "downloads": -1,
            "filename": "amazon_description_scraper-0.1.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "1394116b2c5f8e75d596a55bad07f1fe",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 11970,
            "upload_time": "2025-08-08T11:16:02",
            "upload_time_iso_8601": "2025-08-08T11:16:02.904426Z",
            "url": "https://files.pythonhosted.org/packages/da/ce/ac19ff541044c92181e1fb349851fe706119d471b75ee5e7da374f4a7d0f/amazon_description_scraper-0.1.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "f1158843adba977053f034e381aa465f63ceb1beb943d64ce04b1098446e2ff6",
                "md5": "65e084ada12035d3b83aa36fcb5cf4f5",
                "sha256": "39db4a16b1dc599eaade139537050b0ccbd7068c1b80c1864f8dd69ad40375c5"
            },
            "downloads": -1,
            "filename": "amazon_description_scraper-0.1.0.tar.gz",
            "has_sig": false,
            "md5_digest": "65e084ada12035d3b83aa36fcb5cf4f5",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 12863,
            "upload_time": "2025-08-08T11:16:04",
            "upload_time_iso_8601": "2025-08-08T11:16:04.361980Z",
            "url": "https://files.pythonhosted.org/packages/f1/15/8843adba977053f034e381aa465f63ceb1beb943d64ce04b1098446e2ff6/amazon_description_scraper-0.1.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-08-08 11:16:04",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "ryzanbui02",
    "github_project": "amazon-description-scraper",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [
        {
            "name": "bs4",
            "specs": []
        },
        {
            "name": "fake-useragent",
            "specs": []
        },
        {
            "name": "pandas",
            "specs": []
        },
        {
            "name": "requests",
            "specs": []
        },
        {
            "name": "selenium",
            "specs": []
        }
    ],
    "lcname": "amazon-description-scraper"
}
        
Elapsed time: 0.99048s