| Name | scrapy-ja3 JSON |
| Version |
0.1.3
JSON |
| download |
| home_page | None |
| Summary | Scrapy download handler for JA3 fingerprinting |
| upload_time | 2024-08-13 02:59:57 |
| maintainer | None |
| docs_url | None |
| author | ChenWei Zhao |
| requires_python | >=3.6 |
| license | MIT |
| keywords |
scrapy-ja3
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
============
Scrapy-JA3
============
Scrapy-JA3 is used to forge JA3 fingerprints in Scrapy, by modifying DEFAULT_CIPHERS, which is used in the packaging of Scrapy TLS
LICENSE
------------
MIT license
Requirements
------------
* ``Python`` >= 3.6.0
* ``Scrapy`` >= 2.6.0
* Works on Linux, Windows, macOS
Installation
------------
From pip
.. code-block:: bash
pip install scrapy-ja3
From GitHub
Uninstall
------------
.. code-block:: bash
pip uninstall scrapy-ja3
Usage
------------
.. code-block:: Python
from scrapy import Request, Spider
class Ja3TestSpider(Spider):
name = 'ja3_test'
custom_settings = {
'DOWNLOAD_HANDLERS': {
'http': 'scrapy_ja3.download_handler.JA3DownloadHandler',
'https': 'scrapy_ja3.download_handler.JA3DownloadHandler',
}
}
def start_requests(self):
start_urls = [
'https://tls.browserleaks.com/json',
]
for url in start_urls:
yield Request(url=url, callback=self.parse_ja3)
def parse_ja3(self, response):
self.logger.info(response.text)
self.logger.info("ja3_hash: " + response.json()['ja3_hash'])
=======
History
=======
.. bumpversion marker
0.1.2 (2024-08-13)
------------------
* Fix file not found bug
0.1.1 (2024-08-13)
------------------
* Optimize Readme file
0.1.0 (2024-08-13)
------------------
* First release on PyPI.
Raw data
{
"_id": null,
"home_page": null,
"name": "scrapy-ja3",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": null,
"keywords": "scrapy-ja3",
"author": "ChenWei Zhao",
"author_email": "chenwei.zhaozhao@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/92/b7/10cb221b53868d63e80942044890c4e1983617ca5d4a0c6652c9a771a069/scrapy-ja3-0.1.3.tar.gz",
"platform": null,
"description": "============\r\nScrapy-JA3\r\n============\r\n\r\n\r\nScrapy-JA3 is used to forge JA3 fingerprints in Scrapy, by modifying DEFAULT_CIPHERS, which is used in the packaging of Scrapy TLS\r\n\r\n\r\nLICENSE\r\n------------\r\nMIT license\r\n\r\n\r\nRequirements\r\n------------\r\n\r\n* ``Python`` >= 3.6.0\r\n* ``Scrapy`` >= 2.6.0\r\n* Works on Linux, Windows, macOS\r\n\r\n\r\nInstallation\r\n------------\r\n\r\nFrom pip \r\n\r\n.. code-block:: bash\r\n\r\n pip install scrapy-ja3\r\n\r\nFrom GitHub\r\n\r\nUninstall\r\n------------\r\n\r\n.. code-block:: bash\r\n\r\n pip uninstall scrapy-ja3\r\n\r\nUsage\r\n------------\r\n\r\n.. code-block:: Python\r\n\r\n from scrapy import Request, Spider\r\n\r\n\r\n class Ja3TestSpider(Spider):\r\n name = 'ja3_test'\r\n\r\n custom_settings = {\r\n 'DOWNLOAD_HANDLERS': {\r\n 'http': 'scrapy_ja3.download_handler.JA3DownloadHandler',\r\n 'https': 'scrapy_ja3.download_handler.JA3DownloadHandler',\r\n }\r\n }\r\n\r\n def start_requests(self):\r\n start_urls = [\r\n 'https://tls.browserleaks.com/json',\r\n ]\r\n for url in start_urls:\r\n yield Request(url=url, callback=self.parse_ja3)\r\n\r\n def parse_ja3(self, response):\r\n self.logger.info(response.text)\r\n self.logger.info(\"ja3_hash: \" + response.json()['ja3_hash'])\r\n\r\n=======\r\nHistory\r\n=======\r\n\r\n.. bumpversion marker\r\n\r\n0.1.2 (2024-08-13)\r\n------------------\r\n* Fix file not found bug\r\n\r\n\r\n0.1.1 (2024-08-13)\r\n------------------\r\n* Optimize Readme file\r\n\r\n\r\n0.1.0 (2024-08-13)\r\n------------------\r\n* First release on PyPI.\r\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Scrapy download handler for JA3 fingerprinting",
"version": "0.1.3",
"project_urls": null,
"split_keywords": [
"scrapy-ja3"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "92b710cb221b53868d63e80942044890c4e1983617ca5d4a0c6652c9a771a069",
"md5": "6d94af82cb9cf70961baeacc936f5a80",
"sha256": "b3e9d4c378b96c02e0dbcfb45819de851020cb54fcad1212c064745df9e33d8c"
},
"downloads": -1,
"filename": "scrapy-ja3-0.1.3.tar.gz",
"has_sig": false,
"md5_digest": "6d94af82cb9cf70961baeacc936f5a80",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 3415,
"upload_time": "2024-08-13T02:59:57",
"upload_time_iso_8601": "2024-08-13T02:59:57.235802Z",
"url": "https://files.pythonhosted.org/packages/92/b7/10cb221b53868d63e80942044890c4e1983617ca5d4a0c6652c9a771a069/scrapy-ja3-0.1.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-08-13 02:59:57",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "scrapy-ja3"
}
