craiglist-scraper-api


Namecraiglist-scraper-api JSON
Version 1.0.0 PyPI version JSON
download
home_pagehttps://oxylabs.io/products/scraper-api/web/craigslist
SummaryeBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
upload_time2023-12-18 13:17:08
maintainer
docs_urlNone
authorOxylabs
requires_python>=3.6
licenseMIT
keywords craiglist-scraper scraping-craiglist craiglist-web-scraper craiglist-web-scraping
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Craigslist Scraper
[![Oxylabs promo code](https://user-images.githubusercontent.com/129506779/250792357-8289e25e-9c36-4dc0-a5e2-2706db797bb5.png)](https://oxylabs.go2cloud.org/aff_c?offer_id=7&aff_id=877&url_id=112)

[<u>Craigslist
Scraper</u>](https://oxylabs.io/products/scraper-api/web/craigslist) is
a scraping tool that overcomes advanced anti-bot systems and helps you
gather public data from Craigslist on any scale you need. This guide
will show you how to scrape Craigslist using Oxylabs’ [<u>Scraper
API</u>](https://oxylabs.io/products/scraper-api).

## How it works

You can get Craigslist data by sending a request to our API with the
URLs you want to access and scrape. The API will return the HTML of any
public Craigslist page.

### Python code example

The below code sample sends a request to our service, which uses a
headless browser to execute JavaScript and sends back the HTML of a
Craigslist page:

```python
import requests
from pprint import pprint

# Structure payload.
payload = {
   'source': 'universal',
   'url': 'https://berlin.craigslist.org/search/ela#search=1~gallery~0~0',
   'geo_location': 'Germany',
   'render': 'html'
}

# Get a response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('USERNAME', 'PASSWORD'), #Your credentials go here
    json=payload
)

# Instead of response with job status and results URL, this will return the
# JSON response with results.
pprint(response.json())
```

Visit the
[<u>documentation</u>](https://developers.oxylabs.io/scraper-apis/web-scraper-api/all-domains)
to find more payload parameters and other details.

### Output sample

```json
{
  "results": [
    {
      "content": "<!doctype html>
<html lang="en">
<head>
      ...
      </script></body>
</html>
",
      "created_at": "2023-09-21 14:26:52",
      "updated_at": "2023-09-21 14:27:10",
      "page": 1,
      "url": "https://berlin.craigslist.org/search/ela#search=1~gallery~0~0",
      "job_id": "7110630468831163393",
      "status_code": 200
    }
  ]
}
```

Oxylabs Craigslist Scraper API will ease your scraping processes
significantly. Use it to gather public data, such as jobs, items,
services, and ads. If you have any questions, feel free to get in touch
with us via [<u>live chat</u>](https://oxylabs.io/) or
[<u>email</u>](mailto:support@oxylabs.io).

            

Raw data

            {
    "_id": null,
    "home_page": "https://oxylabs.io/products/scraper-api/web/craigslist",
    "name": "craiglist-scraper-api",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.6",
    "maintainer_email": "",
    "keywords": "craiglist-scraper,scraping-craiglist,craiglist-web-scraper,craiglist-web-scraping",
    "author": "Oxylabs",
    "author_email": "marketing@oxylabs.io",
    "download_url": "https://files.pythonhosted.org/packages/0c/e0/4fbffbe017c6810fe9d844784229065f300675b805da00d41ff70bd9c45a/craiglist-scraper-api-1.0.0.tar.gz",
    "platform": null,
    "description": "# Craigslist Scraper\n[![Oxylabs promo code](https://user-images.githubusercontent.com/129506779/250792357-8289e25e-9c36-4dc0-a5e2-2706db797bb5.png)](https://oxylabs.go2cloud.org/aff_c?offer_id=7&aff_id=877&url_id=112)\n\n[<u>Craigslist\nScraper</u>](https://oxylabs.io/products/scraper-api/web/craigslist) is\na scraping tool that overcomes advanced anti-bot systems and helps you\ngather public data from Craigslist on any scale you need. This guide\nwill show you how to scrape Craigslist using Oxylabs\u2019 [<u>Scraper\nAPI</u>](https://oxylabs.io/products/scraper-api).\n\n## How it works\n\nYou can get Craigslist data by sending a request to our API with the\nURLs you want to access and scrape. The API will return the HTML of any\npublic Craigslist page.\n\n### Python code example\n\nThe below code sample sends a request to our service, which uses a\nheadless browser to execute JavaScript and sends back the HTML of a\nCraigslist page:\n\n```python\nimport requests\nfrom pprint import pprint\n\n# Structure payload.\npayload = {\n   'source': 'universal',\n   'url': 'https://berlin.craigslist.org/search/ela#search=1~gallery~0~0',\n   'geo_location': 'Germany',\n   'render': 'html'\n}\n\n# Get a response.\nresponse = requests.request(\n    'POST',\n    'https://realtime.oxylabs.io/v1/queries',\n    auth=('USERNAME', 'PASSWORD'), #Your credentials go here\n    json=payload\n)\n\n# Instead of response with job status and results URL, this will return the\n# JSON response with results.\npprint(response.json())\n```\n\nVisit the\n[<u>documentation</u>](https://developers.oxylabs.io/scraper-apis/web-scraper-api/all-domains)\nto find more payload parameters and other details.\n\n### Output sample\n\n```json\n{\n  \"results\": [\n    {\n      \"content\": \"<!doctype html>\n<html lang=\"en\">\n<head>\n      ...\n      </script></body>\n</html>\n\",\n      \"created_at\": \"2023-09-21 14:26:52\",\n      \"updated_at\": \"2023-09-21 14:27:10\",\n      \"page\": 1,\n      \"url\": \"https://berlin.craigslist.org/search/ela#search=1~gallery~0~0\",\n      \"job_id\": \"7110630468831163393\",\n      \"status_code\": 200\n    }\n  ]\n}\n```\n\nOxylabs Craigslist Scraper API will ease your scraping processes\nsignificantly. Use it to gather public data, such as jobs, items,\nservices, and ads. If you have any questions, feel free to get in touch\nwith us via [<u>live chat</u>](https://oxylabs.io/) or\n[<u>email</u>](mailto:support@oxylabs.io).\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay",
    "version": "1.0.0",
    "project_urls": {
        "Bug Reports": "https://github.com/oxylabs/craigslist-scraper/issues",
        "Documentation": "https://developers.oxylabs.io/scraper-apis/web-scraper-api",
        "Homepage": "https://oxylabs.io/products/scraper-api/web/craigslist",
        "Source": "https://github.com/oxylabs/craigslist-scraper"
    },
    "split_keywords": [
        "craiglist-scraper",
        "scraping-craiglist",
        "craiglist-web-scraper",
        "craiglist-web-scraping"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "a479b0059f9a299cc59b6b0896eb2232cd1508d2d9004839e536e761327c6cee",
                "md5": "17ab891a98e8739ae7dd3be156b5bb59",
                "sha256": "53f5767338b1ace27595109085bd0ff96de9037017e102cc0d478b2f893afb13"
            },
            "downloads": -1,
            "filename": "craiglist_scraper_api-1.0.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "17ab891a98e8739ae7dd3be156b5bb59",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.6",
            "size": 2492,
            "upload_time": "2023-12-18T13:17:06",
            "upload_time_iso_8601": "2023-12-18T13:17:06.063041Z",
            "url": "https://files.pythonhosted.org/packages/a4/79/b0059f9a299cc59b6b0896eb2232cd1508d2d9004839e536e761327c6cee/craiglist_scraper_api-1.0.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0ce04fbffbe017c6810fe9d844784229065f300675b805da00d41ff70bd9c45a",
                "md5": "5c094d3c51cb60600a399655da8d8532",
                "sha256": "c41403d77b6a81029e151d23e27e5686800becce8b681dbfa33b388041f4c9ab"
            },
            "downloads": -1,
            "filename": "craiglist-scraper-api-1.0.0.tar.gz",
            "has_sig": false,
            "md5_digest": "5c094d3c51cb60600a399655da8d8532",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6",
            "size": 2483,
            "upload_time": "2023-12-18T13:17:08",
            "upload_time_iso_8601": "2023-12-18T13:17:08.007887Z",
            "url": "https://files.pythonhosted.org/packages/0c/e0/4fbffbe017c6810fe9d844784229065f300675b805da00d41ff70bd9c45a/craiglist-scraper-api-1.0.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-12-18 13:17:08",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "oxylabs",
    "github_project": "craigslist-scraper",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "craiglist-scraper-api"
}
        
Elapsed time: 0.16229s