# WebTech
Identify technologies used on websites. [More info on the release's blogpost](https://www.shielder.it/blog/webtech-identify-technologies-used-on-websites/).
## CLI Installation
WebTech is available on pip:
```
pip install webtech
```
It can be also installed via setup.py:
```
python setup.py install --user
```
## Burp Integration
Download Jython 2.7.0 standalone and install it into Burp.
In "Extender" > "Options" > "Python Environment":
- Select the Jython jar location
Finally, in "Extender" > "Extension":
- Click "Add"
- Select "py" or "Python" as extension format
- Select the `Burp-WebTech.py` file in this folder
## Usage
Scan a website:
```
$ webtech -u https://example.com/
Target URL: https://example.com
...
$ webtech -u file://response.txt
Target URL:
...
```
Full usage:
```
$ webtech -h
Usage: webtech [options]
Options:
-h, --help show this help message and exit
-u URLS, --urls=URLS url(s) to scan
--ul=URLS_FILE, --urls-file=URLS_FILE
url(s) list file to scan
--ua=USER_AGENT, --user-agent=USER_AGENT
use this user agent
--rua, --random-user-agent
use a random user agent
--db=DB_FILE, --database-file=DB_FILE
custom database file
--oj, --json output json-encoded report
--og, --grep output grepable report
--udb, --update-db force update of remote db files
```
## Use WebTech as a library
```
import webtech
# you can use options, same as from the command line
wt = webtech.WebTech(options={'json': True})
# scan a single website
try:
report = wt.start_from_url('https://shielder.it')
print(report)
except webtech.utils.ConnectionException:
print("Connection error")
```
For more examples see `webtech_example.py`.
## Resources for database matching
HTTP Headers information - http://netinfo.link/http/headers.html
Cookie names - https://webcookies.org/top-cookie-names
Raw data
{
"_id": null,
"home_page": "https://github.com/ShielderSec/webtech",
"name": "webtech",
"maintainer": "",
"docs_url": null,
"requires_python": ">=2.7.0",
"maintainer_email": "",
"keywords": "",
"author": "thezero, polict",
"author_email": "info@shielder.it",
"download_url": "https://files.pythonhosted.org/packages/dc/85/8dfb49688c94a4807f51399666259ddc8eb5d74c20984eaae84e3a1051d9/webtech-1.3.4.tar.gz",
"platform": null,
"description": "\n# WebTech\nIdentify technologies used on websites. [More info on the release's blogpost](https://www.shielder.it/blog/webtech-identify-technologies-used-on-websites/).\n\n## CLI Installation\n\nWebTech is available on pip:\n\n```\npip install webtech\n```\n\nIt can be also installed via setup.py:\n\n```\npython setup.py install --user\n```\n\n## Burp Integration\n\nDownload Jython 2.7.0 standalone and install it into Burp.\n\nIn \"Extender\" > \"Options\" > \"Python Environment\":\n- Select the Jython jar location\n\nFinally, in \"Extender\" > \"Extension\":\n- Click \"Add\"\n- Select \"py\" or \"Python\" as extension format\n- Select the `Burp-WebTech.py` file in this folder\n\n\n## Usage\n\nScan a website:\n\n```\n$ webtech -u https://example.com/\n\nTarget URL: https://example.com\n...\n\n$ webtech -u file://response.txt\n\nTarget URL:\n...\n```\n\nFull usage:\n\n```\n$ webtech -h\n\nUsage: webtech [options]\n\nOptions:\n -h, --help show this help message and exit\n -u URLS, --urls=URLS url(s) to scan\n --ul=URLS_FILE, --urls-file=URLS_FILE\n url(s) list file to scan\n --ua=USER_AGENT, --user-agent=USER_AGENT\n use this user agent\n --rua, --random-user-agent\n use a random user agent\n --db=DB_FILE, --database-file=DB_FILE\n custom database file\n --oj, --json output json-encoded report\n --og, --grep output grepable report\n --udb, --update-db force update of remote db files\n\n```\n\n## Use WebTech as a library\n\n```\nimport webtech\n\n# you can use options, same as from the command line\nwt = webtech.WebTech(options={'json': True})\n\n# scan a single website\ntry:\n report = wt.start_from_url('https://shielder.it')\n print(report)\nexcept webtech.utils.ConnectionException:\n print(\"Connection error\")\n```\n\nFor more examples see `webtech_example.py`.\n\n\n## Resources for database matching\n\nHTTP Headers information - http://netinfo.link/http/headers.html \nCookie names - https://webcookies.org/top-cookie-names \n",
"bugtrack_url": null,
"license": "GPLv3",
"summary": "Identify technologies used on websites",
"version": "1.3.4",
"project_urls": {
"Homepage": "https://github.com/ShielderSec/webtech"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "24eb7a5b3e2e9e3ec1c872b53ea08b6c9d95f45e6346996ce8c2922b2fdbeca7",
"md5": "dff279e3bcc41136c4f76b08edf81b87",
"sha256": "b7473bbcf9a3691cb268beacbf08368d836b83535c43795a708fe4e03f83ff75"
},
"downloads": -1,
"filename": "webtech-1.3.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "dff279e3bcc41136c4f76b08edf81b87",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=2.7.0",
"size": 165052,
"upload_time": "2023-10-12T10:28:23",
"upload_time_iso_8601": "2023-10-12T10:28:23.546351Z",
"url": "https://files.pythonhosted.org/packages/24/eb/7a5b3e2e9e3ec1c872b53ea08b6c9d95f45e6346996ce8c2922b2fdbeca7/webtech-1.3.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "dc858dfb49688c94a4807f51399666259ddc8eb5d74c20984eaae84e3a1051d9",
"md5": "94edcc1415d34784164a1a2ba891ad70",
"sha256": "c652d44eb0ee40e2a98aefd4006ccb0af6e58486a3c41ad3ea5ea86a27aa244b"
},
"downloads": -1,
"filename": "webtech-1.3.4.tar.gz",
"has_sig": false,
"md5_digest": "94edcc1415d34784164a1a2ba891ad70",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=2.7.0",
"size": 150475,
"upload_time": "2023-10-12T10:28:25",
"upload_time_iso_8601": "2023-10-12T10:28:25.560645Z",
"url": "https://files.pythonhosted.org/packages/dc/85/8dfb49688c94a4807f51399666259ddc8eb5d74c20984eaae84e3a1051d9/webtech-1.3.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-10-12 10:28:25",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "ShielderSec",
"github_project": "webtech",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [
{
"name": "requests",
"specs": []
}
],
"lcname": "webtech"
}
JSON
