w3lib

Name	w3lib JSON
Version	2.3.1 JSON
	download
home_page	https://github.com/scrapy/w3lib
Summary	Library of web-related functions
upload_time	2025-01-27 14:22:10
maintainer	None
docs_url	None
author	Scrapy project
requires_python	>=3.9
license	BSD
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage

            =====
w3lib
=====

.. image:: https://github.com/scrapy/w3lib/actions/workflows/tests.yml/badge.svg
   :target: https://github.com/scrapy/w3lib/actions

.. image:: https://img.shields.io/codecov/c/github/scrapy/w3lib/master.svg
   :target: http://codecov.io/github/scrapy/w3lib?branch=master
   :alt: Coverage report


Overview
========

This is a Python library of web-related functions, such as:

* remove comments, or tags from HTML snippets
* extract base url from HTML snippets
* translate entites on HTML strings
* convert raw HTTP headers to dicts and vice-versa
* construct HTTP auth header
* converting HTML pages to unicode
* sanitize urls (like browsers do)
* extract arguments from urls

Requirements
============

Python 3.9+

Install
=======

``pip install w3lib``

Documentation
=============

See http://w3lib.readthedocs.org/

License
=======

The w3lib library is licensed under the BSD license.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/scrapy/w3lib",
    "name": "w3lib",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "Scrapy project",
    "author_email": "info@scrapy.org",
    "download_url": "https://files.pythonhosted.org/packages/bf/7d/1172cfaa1e29beb9bf938e484c122b3bdc82e8e37b17a4f753ba6d6e009f/w3lib-2.3.1.tar.gz",
    "platform": "Any",
    "description": "=====\nw3lib\n=====\n\n.. image:: https://github.com/scrapy/w3lib/actions/workflows/tests.yml/badge.svg\n   :target: https://github.com/scrapy/w3lib/actions\n\n.. image:: https://img.shields.io/codecov/c/github/scrapy/w3lib/master.svg\n   :target: http://codecov.io/github/scrapy/w3lib?branch=master\n   :alt: Coverage report\n\n\nOverview\n========\n\nThis is a Python library of web-related functions, such as:\n\n* remove comments, or tags from HTML snippets\n* extract base url from HTML snippets\n* translate entites on HTML strings\n* convert raw HTTP headers to dicts and vice-versa\n* construct HTTP auth header\n* converting HTML pages to unicode\n* sanitize urls (like browsers do)\n* extract arguments from urls\n\nRequirements\n============\n\nPython 3.9+\n\nInstall\n=======\n\n``pip install w3lib``\n\nDocumentation\n=============\n\nSee http://w3lib.readthedocs.org/\n\nLicense\n=======\n\nThe w3lib library is licensed under the BSD license.\n",
    "bugtrack_url": null,
    "license": "BSD",
    "summary": "Library of web-related functions",
    "version": "2.3.1",
    "project_urls": {
        "Documentation": "https://w3lib.readthedocs.io/en/latest/",
        "Homepage": "https://github.com/scrapy/w3lib",
        "Issue Tracker": "https://github.com/scrapy/w3lib/issues",
        "Source Code": "https://github.com/scrapy/w3lib"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "58dd56f0d8af71e475ed194d702f8b4cf9cea812c95e82ad823d239023c6558c",
                "md5": "ac9c4dcca8a30f43a56fc4ad2fb53229",
                "sha256": "9ccd2ae10c8c41c7279cd8ad4fe65f834be894fe7bfdd7304b991fd69325847b"
            },
            "downloads": -1,
            "filename": "w3lib-2.3.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "ac9c4dcca8a30f43a56fc4ad2fb53229",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 21751,
            "upload_time": "2025-01-27T14:22:09",
            "upload_time_iso_8601": "2025-01-27T14:22:09.421525Z",
            "url": "https://files.pythonhosted.org/packages/58/dd/56f0d8af71e475ed194d702f8b4cf9cea812c95e82ad823d239023c6558c/w3lib-2.3.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "bf7d1172cfaa1e29beb9bf938e484c122b3bdc82e8e37b17a4f753ba6d6e009f",
                "md5": "7ef432898835f79a3c11100a992dbd03",
                "sha256": "5c8ac02a3027576174c2b61eb9a2170ba1b197cae767080771b6f1febda249a4"
            },
            "downloads": -1,
            "filename": "w3lib-2.3.1.tar.gz",
            "has_sig": false,
            "md5_digest": "7ef432898835f79a3c11100a992dbd03",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 49531,
            "upload_time": "2025-01-27T14:22:10",
            "upload_time_iso_8601": "2025-01-27T14:22:10.453561Z",
            "url": "https://files.pythonhosted.org/packages/bf/7d/1172cfaa1e29beb9bf938e484c122b3bdc82e8e37b17a4f753ba6d6e009f/w3lib-2.3.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-01-27 14:22:10",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "scrapy",
    "github_project": "w3lib",
    "travis_ci": false,
    "coveralls": true,
    "github_actions": true,
    "tox": true,
    "lcname": "w3lib"
}