<h1 align="center">Kunyu(坤舆) - More efficient corporate asset collection</h1>
[](https://github.com/knownsec/Kunyu) [](https://github.com/knownsec/Kunyu/issues) [](https://github.com/knownsec/Kunyu/releases) [](https://github.com/wikiZ) [](https://github.com/wikiZ)
--------------
English | [中文文档](./doc/README_CN.md)
# 0x00 Introduce
## Tool introduction
Kunyu (kunyu), whose name is taken from <Knuyu Wanguo Quantu>, is actually a professional subject related to geographic information, which counts the geographic information of the sea, land, and sky. The same applies to cyberspace. The same is true for discovering unknown and fragile assets. It is more like a cyberspace map, which is used to comprehensively describe and display cyberspace assets, various elements of cyberspace and the relationship between elements, as well as cyberspace and real space. The mapping relationship. So I think "Kun Yu" still fits this concept.
Kunyu aims to make corporate asset collection more efficient and enable more security-related practitioners to understand and use cyberspace surveying and mapping technology.
## Application scenario
For the use of kunyu, there can be many application scenarios, such as:
* Forgotten and isolated assets in the enterprise are identified and added to security management.
* Perform quick investigation and statistics on externally exposed assets of the enterprise.
* Red and blue are used against related requirements, and batch inspections of captured IPs are performed.
* Collect vulnerable assets in batches (0day/1day) for equipment and terminals within the impact.
* Information on sites involved in new-type cybercrime cases is quickly collected and merged for more efficient research, judgment, and analysis.
* Statistic and reproduce the fragile assets on the Internet that are affected by related vulnerabilities.
* .......
# 0x01 Install
**Need Python3 or higher support**
```
git clone https://github.com/knownsec/Kunyu.git
cd Kunyu
pip3 install -r requirements.txt
Linux:
python3 setup.py install
kunyu console
Windows:
cd kunyu
python3 console.py
PYPI:
pip3 install kunyu
P.S. Windows also supports python3 setup.py install.
```
# 0x02 Configuration instructions
When you run the program for the first time, you can initialize by entering the following command. Other login methods are provided. However, it is recommended to use the API method. Because the user name/password login requires an additional request, the API method is theoretically more efficient.
```
kunyu init --apikey <your zoomeye key> --seebug <your seebug key>
```
The first time you use it, you need to use the ZoomEye login credentials to use this tool to collect information.Currently, ZoomEye registered users are given 1w query quota every month, which is enough for daily work.
ZoomEye access address: https://www.zoomeye.org/
Seebug access address: https://www.seebug.org/
The output file path can be customized by the following command,The default output path is: C:/Users/active user/kunyu/output/ or /active user/kunyu/output
```
kunyu init --output C:\Users\风起\kunyu\output
```
# 0x03 Tool instructions
## Detailed command
```
kunyu console
```
**ZoomEye**
```
Global commands:
info Print User Info
Search <Query> Comprehensive Information Search
SearchIcon <File>/<URL> Query Based On Icon Image
SearchBatch <File> Batch Query Assets In Files
SearchCert <Domain> SSL Certificate Search
SearchDomain <Domain> Domain Name Associated/Subdomain Search
EncodeHash <Encryption> <Query> Encryption Method Interface (Base64/HEX/MD5/mmh3)
HostCrash <IP> <Domain> Host Header Scan Hidden Assets
show <config>/<rule> Show Can Set Options Or Kunyu Config
Seebug <Query> Search Seebug Vulnerability Information
set <Option> Set Global Arguments Values
view/views <ID> Look Over Banner Row Data Information
Cscan <IP>/<Port> Scans Port Information About CobaltStrike
PupilSearch <URL>/<ID> Example Query Sensitive Interfaces And Information
CDNAnalysis <Domain> Identify Whether The Domain Name Is a CDN Asset
Pocsuite3 Invoke The Pocsuite Component
ExportPath Returns The Path Of The Output File
CreateMap Generate An IP Distribution Heat Map
AliveScan The Viability Of The Last Retrieval
clear Clear The Console Screen
help Print Help Info
exit Exit KunYu &
```
**OPTIONS**
```
ZoomEye:
page <Number> The number of pages returned by the query (default:1)
size <Number>. Set the number of searches per page (default:10)
fields <fields> Set the response field information
dtype <0/1> Query associated domain name/subdomain name
stype <v4/v6> stype <v4/v6> Set to get data type IPV4 or IPV6
btype <host/web> Set the API interface for batch query
timeout <num> Set the timeout period of Kunyu HTTP request
thread Set PupilSearch Thread Number(default is 10)
deep Set PupilSearch Search Deep(default is 2)
all PupilSearch Add All Url To Check List
fuzz PupilSearch Add Api To Check List
proxy PupilSearch HTTP Proxy
```
## Use case introduction
*Kunyu usage tutorial is as follows *
**User information query**
**Comprehensive search（NEW）**
**Custom output fields（NEW）**
For specific supported output custom fields, please refer to the following:
| Field Name | Type | Description | Permission |
| ------------------ | ------- | ------------------------------------------------------------ | --------------------------- |
| ip | string | IP address (used when the web asset is incomplete) | All users |
| domain | string | Domain | All users |
| url | string | Full URL of the asset (for web assets) | All users |
| ssl.jarm | string | SSL JARM fingerprint | All users |
| ssl.ja3s | string | SSL JA3S fingerprint | All users |
| iconhash_md5 | string | MD5 value of the icon image | Professional plan and above |
| robots_md5 | string | MD5 value of the robots.txt file | Business plan and above |
| security_md5 | string | MD5 value of the security settings file | Business plan and above |
| hostname | string | Hostname information | All users |
| os | string | Operating system information | All users |
| port | integer | Port number | All users |
| service | string | Provided application protocol (e.g., HTTP, SSH) | All users |
| title | list | Webpage title | All users |
| version | string | Component version information | All users |
| device | string | Device name | All users |
| rdns | string | Reverse DNS information | All users |
| product | string | Product component information | All users |
| header | string | HTTP response header information | All users |
| header_hash | string | Hash calculated from HTTP response header | Professional plan and above |
| banner | string | Service banner information | All users |
| body | string | HTML Body content | Business plan and above |
| body_hash | string | Hash calculated from the HTML body | Professional plan and above |
| update_time | string | Asset update time | All users |
| header.server.name | string | Server name in the HTTP response header | All users |
| continent.name | string | Name of the continent | All users |
| country.name | string | Name of the country | All users |
| province.name | string | Name of the province | All users |
| city.name | string | Name of the city | All users |
| isp.name | string | ISP name | All users |
| organization.name | string | Organization name | All users |
| zipcode | integer | Postal code | All users |
| idc | string | Is it an IDC (0 for no, 1 for yes) | All users |
| lon | string | Geolocation longitude | All users |
| lat | string | Geolocation latitude | All users |
| asn | string | Autonomous System Number | All users |
| protocol | string | Transport layer protocol (e.g., TCP, UDP) | All users |
| honeypot | integer | Is it a honeypot (0 for no, 1 for yes) | All users |
| ssl | string | SSL x509 certificate information | All users |
| primary_industry | string | Primary industry information | Business plan and above |
| sub_industry | string | Sub-industry information | Business plan and above |
| rank | integer | Asset importance ranking, the higher the score, the more important. | Business plan and above |
**Settings to change default output fields**
```
Set fields = ip,port
```
**Batch IP search**
**Icon Search**
When collecting corporate assets, we can use this method to retrieve the same ico icon assets, which usually has a good effect when associating related corporate assets. But it should be noted that if some sites also use this ico icon, irrelevant assets may be associated (but people who are bored with other people's ico icons are always in the minority). Support url or local file search.
**Command format:**
```
SearchIocn https://www.baidu.com/favicon.ico
SearchIcon /root/favicon.ico
```
**SSL certificate search**
Query through the serial number of the SSL certificate, so that the associated assets are more accurate, and services that use the same certificate can be searched. When you encounter an https site, you can use this method.
**Multi-factor query**
Similarly, Kunyu also supports multi-factor conditional query related assets, which can be realized through ZoomEye logic operation syntax.
**Feature Search**
Through HTTP request packet features or website-related features, the same framework assets can be concatenated more accurately
**Associated Domain/Subdomain Search**
Search for associated domain names and subdomains, and query associated domain names by default. You can set **associated domain name/subdomain name** two modes by setting the dtype parameter.
Command format: **SearchDomain Domain**
**Set the type of data to be obtained**
After the V1.6.1 version, the user can set the data type obtained through the stype parameter to IPV4 or IPV6 to realize the application scenario, and the default parameter is v4.
Command format: **set stype = v6**
**View Banner Information**
The user can view the banner corresponding to the specified serial number through the view command, so as to further analyze the front-end code and Header header, and the user can intercept the banner information for further association matching.
Command format: **view ID**
The user can also view the SSL certificate information of the specified serial number through the views command, and further associate it by extracting the sensitive information in the SLL certificate information.
Command format: **views ID**
**Cscan Scans port information about cobaltStrike**
Cscan, a new feature in Kunyu version 1.7.2, allows you to use this command to identify whether a network asset is cobaltStrike and to enumerate configuration file details.
**Command format:**
```
Cscan 1.1.1.1 443
Cscan 1.1.1.1 443,80
```
**CDNAnalysis（NEW）**
**Command format:**
```
CDNAnalysis --file ip.txt
CDNAnalysis --domain www.baidu.com
```
**PupilSearch Sensitive Information Collection**
After Kunyu v1.7.0, the KeyWord command was removed and replaced with PupilSearch, which is the function of extracting sensitive data. Of course, it also supports the extraction of historical banner information through spatial mapping. For example, such as accesskey, the banner in historical data leaks sensitive data. Information, even if the service is changed now, but the AK/SK has not expired, it can still be used directly, understand everything, and support the extraction of sensitive information **(ID number, IP, JWT, API interface, appid, appkey, GithubAccessKey, default username \password, email, etc.)**.
**Command format:**
PupilSearch https://www.domain.com/
PupilSearch ID (extract sensitive information from the banner returned by spatial mapping)
**System command execution**
After Kunyu v1.6.0, support for the execution of system commands has been added. You can debug surveying and mapping data more conveniently and effectively by executing some commonly used system commands. For a list of specific executable commands, see Article 11 in the Issue of the README file.
**Example One**
**Example two **
**Encoding hash calculation**
In some scenarios, you can use this command to perform common HASH encryption/encoding, such as BASE64, MD5, mmh3, HEX encoding, and debug in this way.
**Command format:**
```
EncodeHash hex 7239dcc9beb5c9cd795415f9
EncodeHash md5 https://www.baidu.com/favicon.ico
EncodeHash md5 /root/favicon.ico
EncodeHash mmh3 https://www.baidu.com/favicon.ico
EncodeHash mmh3 /root/favicon.ico
EncodeHash base64 dasdasdsa
```
**Asset Survival Scan**
After Kunyu V1.6.5, the survivability scan of the last retrieval result is added, and the result is output in real time by polling.
**Seebug vulnerability query**
You can query historical related vulnerabilities by entering information about the framework and equipment you want to find, but you need to note that only English is supported, and improvements and upgrades will be made later.
Command format: **Seebug tongda**
**Load fingerprint file**
Kunyu V1.6.4 adds the function of loading an external fingerprint library. Kunyu provides 5 fingerprint files as a reference by default. Users can write their own fingerprint files to load or share, and retrieve them more flexibly, which is convenient for traceability and security. Resource sharing in research and red team offense and defense, enhance teamwork.
You can view the information of the currently loaded fingerprint library through the **show rule** command.
The default read fingerprint file directory is under **project directory/kunyu/rule**, you can customize the read fingerprint file path setting through **kunyu init --rule C:\风起\rule**.
You can use the **show config** command to view the information of the Kunyu configuration file.
When faced with complex fingerprint information, you can generate a yaml file through **project directory/kunyu/createrule.py**
The format of the yaml fingerprint file is as follows. Please note that the following standard format must be strictly followed, and no fields are missing.
```bash
KXID: kx-2022-07
author: 风起
createDate: 2022-1-4
description: 查找公网部署的ngrok反向代理
kx_name: ngrok代理工具指纹
kx_query: '''Server: beegoServer:1.12.0'' +''<a href="/login/index">Found</a>.'''
source: https://github.com/wikiZ/Kunyu
```
**Setting parameters**
When set page = 2, the returned results are 40. You can modify the page parameter to set the number of pages to be queried. Note that 1 page = 20/items. You can modify the value according to your needs to get more returned results.
The configurable parameters and the current values of the parameters are displayed through show.
**Pocsuite linkage**
In versions after v1.3.1, you can use kunyu to link the console mode of pocsuite3 for integrated use.
**HOSTS head collision**
Through HOSTS collision, the hidden assets in the intranet can be effectively collided. According to the ServerName domain name and IP configured in the middleware httpf.conf, the access can be directly connected to the intranet business system! Follow-up by setting the local hosts file to achieve local DNS resolution, because the priority of the local hosts file is higher than the DNS server resolution. Support reverse check through ZoomEye domain name library or read TXT file to get the list of domain names.
**Command format:**
```
HostCrash C:\ip.txt C:\host.txt
HostCrash C:\ip.txt baidu.com
HostCrash 1.1.1.1 baidu.com
HostCrash 1.1.1.1 G:\host.txt
```
**Example One**
**Example Two**
**Serverless HostCrash Scan**
Kunyu v1.6.2 adds an interesting feature that combines the cloud function to perform HOSTS collisions on the target. In this way, our scanned IP is effectively hidden to prevent it from being captured by the target situational awareness, and it also prevents WAF from banning the real IP. , And conceal the features. Through the following scanning effect, it can be found that the scanned IPs are all cloud service vendors and each scan is a random IP address. You can choose whether to enable it by configuring the cloud function address during initialization.
**Configuration Guide:** [Configuration Method of Cloud Function](./doc/Serverless_EN.md)
**Related technology:**https://www.anquanke.com/post/id/261551
**Situational Awareness Scanning Effect:**
**Asset distribution map**
v1.6.2 adds the CreateMap command, which can generate a geographic location distribution map for the assets retrieved last time, and more vividly describe the mapping relationship between network space and real space. It is located in the same output directory as Excel, and the generated asset map is the same as the last time. The number of search results is related.
**Generate distribution map**
**Web page**
**Data result**
All search results are saved in the user's root directory, and the directory is created based on the current timestamp. All query results of a single start are stored in an Excel format under one directory, giving a more intuitive experience. The output path can be returned through the ExportPath command.
# 0x04 Loading
In fact, there are still many ideas, but as an Alpha version, this is the case, and it will continue to be improved in the later period. I hope that Kunyu can be known to more security practitioners. Thank you for your support.
The tool framework has reference to Kunlun Mirror and Pocsuite3, which are all very good works.
About the developer Fengqi(风起) Related articles: https://www.anquanke.com/member.html?memberId=148652
Thanks to all the friends of KnownSec 404 Team.
> "Seeing clearly" is the embodiment of ability, which is "tool", while "seeing" is the embodiment of thought, and the last thing it is related to is "Tao". ——SuperHei（黑哥）
# 0x05 Issue
**1. Multi-factor search**
ZoomEye search can use multi-factor search, dork: cisco +port:80 (note the space) can search for all data that meets the cisco and port:80 conditions. If there is no space in the middle, it is the same search condition, that is, all data that meets cisco and port 80. Kunyu's dork does not need quotation marks, **The new version 2.0 syntax has changed. **
**2. High-precision geographic location**
ZoomEye gives privileged users high-precision geographic location data, but it should be noted that ordinary users do not have this function, please be aware.
**3. Username/password login**
If you use username/password as the initialization condition, the token obtained will be valid for 12 hours. If you find that your search cannot return data, you may as well info it. If the session times out, the initialization command prompt will be returned. In most cases, we recommend that you use the API KEY method, and there will be no expiration problem. This design is also for the security of your account and password. After all, the API KEY can be reset and the token will become invalid, but with the account and password, it is possible to log in to your ZoomEye account.
**4. Cert certificate search**
It should be noted that according to conventional logic, you need to encode the serial number of the target SSL certificate in hexadecimal before searching with the statement, but Kunyu only needs to provide the Domain address to search. The principle is to make a request to the target station to obtain the serial number and process it, but if your host cannot access the target to be searched, it cannot be retrieved. At this time, you can also use the conventional method to search with the statement.
**5. Favicon icon search**
ico icon search supports both URL search and local ico icon file search, which has better scalability and compatibility.
**6. Query data storage path**
By default, your query data is in the Kunyu folder under the user directory. You can also use the ExportPath command in console mode to query the path.
**7. Auto-completion**
Kunyu's auto-completion supports uppercase and lowercase letters, command records, etc. Use Tab to complete. For usage, please refer to Metasploit.
**8. About the error when using pip install kunyu**
When using pip install kunyu, the following error is reported:
`File "C:\Users\风起\AppData\Local\Programs\Python\Python37\Scripts\kunyu-script.py", line 1 SyntaxError: Non-UTF-8 code starting with '\xb7' in file C:\Users\风起\AppData\Local\Programs\Python\Python37\Scripts\kunyu-script.py on line 1, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details`
Solution:
Modify the C:\Users\风起\AppData\Local\Programs\Python\Python37\Scripts\kunyu-script.py file and add # encoding: utf-8 at the beginning of the file
Then save it and it can be used normally. The reason for this bug is that there is a Chinese name in the user directory path, which usually appears on Windows.
**9. Pocsuite3 module POC storage directory**
When using the pocsuite3 module, if you want to add a new POC module, you can add the POC file in **project directory/pocsuite3/pocs/**. It should be noted that when using the packaged Kunyu console command, the POC should be added to the directory, and the kunyu program should be repackaged to load the POC normally.
**10. Pocsuite3 module POC missing problem**
When using the Pocsuite command linkage, if it is a packaged Kunyu version, the poc has been fixed. At this time, modifying the poc directory cannot add a new module. At this time, you can repackage it or use **project directory/kunyu/console.py** to run kunyu to update the poc module in real time.
**11. Kunyu executable system commands are as follows. **
**Windows:**
OS_SYSTEM = [**"ipconfig", "dir", "whoami", "ping", "telnet", "cd", "findstr", "chdir","find", "mysql", "type", "curl", "netstat", "tasklist", "taskkill", "tracert", "del", "ver","nmap","ls"**]
**Linux/Mac:**
OS_SYSTEM = [**"ifconfig", "ls", "cat", "pwd", "whoami", "ping", "find", "grep", "telnet", "mysql", "cd", "vi", "more", "less", "curl", "ps", "netstat", "rm", "touch", "mkdir", "uname","nmap"**]
**12. Kunyu operating environment**
It is recommended to use Python3.2 - 3.12. Other versions of Python3 may have unknown errors. **Python2 cannot be used**.
**13. Set timeout**
If the HTTP request is not responded to in time, you can solve it by increasing the timeout time, such as: set timeout = 50
**14. Kunyu client startup time is long**
Since Kunyu2.0 will identify and use domestic and foreign interfaces during the initialization phase, it may take a while to start and use, the time is 5-10 seconds.
**15. RULE fingerprint storage location**
The RULE fingerprint storage location can be configured and modified under ~/.kunyu.ini, and the default is under the compiled and run kunyu path.
**16. View function cannot be used**
The view function is in the ZoomEye update, and the business version membership is required to use it normally. The views function is not affected.
**17. Abnormal BUG**
Since the test environment is MAC OS, there may be incompatibility issues in other operating systems. Please feedback the ISSUE or contact the operation in time.
**18. Antivirus software check**
Kunyu may fail to start due to antivirus software checking files, please pay attention to this problem
**19. I haven't decided yet ^_^**
# 0x06 Contributions
[风起@knownsec 404](https://github.com/wikiZ)
[wh0am1i@knownsec 404](https://github.com/wh0am1i)
[fenix@knownsec 404](https://github.com/13ph03nix)
[0x7F@knownsec 404](https://github.com/0x7Fancy)
# 0x07 Events
**WHC 2021 (补天白帽大会) Best Weapon of the Year Award **
**KCON 2021 Arsenal**
## 404Starlink
<img src="https://github.com/knownsec/404StarLink-Project/raw/master/logo.png" width="30%">
Kunyu has joined [404Starlink](https://github.com/knownsec/404StarLink)
# 0x08 Community
If you have any questions, you can submit an issue under the project, or contact us through the following methods.
1、Scan the Wechat QR code to add ZoomEye operation Wechat, and comment on Kunyu, which will draw everyone to the ZoomEye Cyberspace Surveying and Mapping Exchange Group for communication.
Raw data
{
"_id": null,
"home_page": null,
"name": "kunyu",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": null,
"keywords": "Cyberspace Resources, zoomeye, kunyu",
"author": "\u98ce\u8d77 <onlyzaliks@gmail.com>",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/4f/76/270da73f90ffee6beb081b79991c2debcb41fff247b8304c13d422c0221e/kunyu-2.1.tar.gz",
"platform": null,
"description": "<h1 align=\"center\">Kunyu(\u5764\u8206) - More efficient corporate asset collection</h1>\n\n[](https://github.com/knownsec/Kunyu) [](https://github.com/knownsec/Kunyu/issues) [](https://github.com/knownsec/Kunyu/releases) [](https://github.com/wikiZ) [](https://github.com/wikiZ)\n\n--------------\nEnglish | [\u4e2d\u6587\u6587\u6863](./doc/README_CN.md)\n\n\n\n# 0x00 Introduce\n\n## Tool introduction\n\nKunyu (kunyu), whose name is taken from <Knuyu Wanguo Quantu>, is actually a professional subject related to geographic information, which counts the geographic information of the sea, land, and sky. The same applies to cyberspace. The same is true for discovering unknown and fragile assets. It is more like a cyberspace map, which is used to comprehensively describe and display cyberspace assets, various elements of cyberspace and the relationship between elements, as well as cyberspace and real space. The mapping relationship. So I think \"Kun Yu\" still fits this concept.\n\nKunyu aims to make corporate asset collection more efficient and enable more security-related practitioners to understand and use cyberspace surveying and mapping technology. \n\n## Application scenario\n\nFor the use of kunyu, there can be many application scenarios, such as:\n\n* Forgotten and isolated assets in the enterprise are identified and added to security management.\n* Perform quick investigation and statistics on externally exposed assets of the enterprise.\n* Red and blue are used against related requirements, and batch inspections of captured IPs are performed.\n* Collect vulnerable assets in batches (0day/1day) for equipment and terminals within the impact.\n* Information on sites involved in new-type cybercrime cases is quickly collected and merged for more efficient research, judgment, and analysis.\n* Statistic and reproduce the fragile assets on the Internet that are affected by related vulnerabilities.\n* .......\n\n# 0x01 Install\n\n**Need Python3 or higher support**\n\n```\ngit clone https://github.com/knownsec/Kunyu.git\ncd Kunyu\npip3 install -r requirements.txt\n\nLinux:\n\tpython3 setup.py install\n\tkunyu console\n\nWindows:\n\tcd kunyu\n\tpython3 console.py\n\nPYPI:\n\tpip3 install kunyu\n\t\nP.S. Windows also supports python3 setup.py install.\n```\n\n# 0x02 Configuration instructions\nWhen you run the program for the first time, you can initialize by entering the following command. Other login methods are provided. However, it is recommended to use the API method. Because the user name/password login requires an additional request, the API method is theoretically more efficient. \n```\nkunyu init --apikey <your zoomeye key> --seebug <your seebug key>\n```\n\n\nThe first time you use it, you need to use the ZoomEye login credentials to use this tool to collect information.Currently, ZoomEye registered users are given 1w query quota every month, which is enough for daily work.\n\nZoomEye access address: https://www.zoomeye.org/\n\nSeebug access address: https://www.seebug.org/\n\nThe output file path can be customized by the following command,The default output path is: C:/Users/active user/kunyu/output/ or /active user/kunyu/output\n\n```\nkunyu init --output C:\\Users\\\u98ce\u8d77\\kunyu\\output\n```\n\n\n\n# 0x03 Tool instructions\n\n## Detailed command\n\n```\nkunyu console\n```\n\n\n**ZoomEye**\n\n```\nGlobal commands:\n\t\t\t\tinfo Print User Info\n Search <Query> Comprehensive Information Search\n SearchIcon <File>/<URL> Query Based On Icon Image\n SearchBatch <File> Batch Query Assets In Files\n SearchCert <Domain> SSL Certificate Search\n SearchDomain <Domain> Domain Name Associated/Subdomain Search\n EncodeHash <Encryption> <Query> Encryption Method Interface (Base64/HEX/MD5/mmh3)\n HostCrash <IP> <Domain> Host Header Scan Hidden Assets\n show <config>/<rule> Show Can Set Options Or Kunyu Config\n Seebug <Query> Search Seebug Vulnerability Information\n set <Option> Set Global Arguments Values\n view/views <ID> Look Over Banner Row Data Information\n Cscan <IP>/<Port> Scans Port Information About CobaltStrike\n PupilSearch <URL>/<ID> Example Query Sensitive Interfaces And Information\n CDNAnalysis <Domain> Identify Whether The Domain Name Is a CDN Asset\n Pocsuite3 Invoke The Pocsuite Component\n ExportPath Returns The Path Of The Output File\n CreateMap Generate An IP Distribution Heat Map\n AliveScan The Viability Of The Last Retrieval\n clear Clear The Console Screen\n help Print Help Info\n exit Exit KunYu & \n```\n\n**OPTIONS**\n\n```\nZoomEye:\n page <Number> \t\t\t\tThe number of pages returned by the query (default:1)\n size <Number>. \t\t\t\tSet the number of searches per page (default:10)\n fields <fields> \t\t\t\tSet the response field information\n dtype <0/1> \t\t\t\tQuery associated domain name/subdomain name\n stype <v4/v6> \t\t\t\tstype <v4/v6> Set to get data type IPV4 or IPV6\n btype <host/web> \t\t\t\tSet the API interface for batch query\n timeout <num> \t\t\t\tSet the timeout period of Kunyu HTTP request\n thread \t\t\t\tSet PupilSearch Thread Number(default is 10)\n deep \t\t\t\tSet PupilSearch Search Deep(default is 2)\n all \t\t\t\tPupilSearch Add All Url To Check List\n fuzz \t\t\t\tPupilSearch Add Api To Check List\n proxy \t\t\t\tPupilSearch HTTP Proxy\n\t\n```\n\n## Use case introduction\n\n*Kunyu usage tutorial is as follows * \n\n**User information query**\n\n\n\n**Comprehensive search\uff08NEW\uff09**\n\n\n\n**Custom output fields\uff08NEW\uff09**\n\nFor specific supported output custom fields, please refer to the following:\n\n| Field Name | Type | Description | Permission |\n| ------------------ | ------- | ------------------------------------------------------------ | --------------------------- |\n| ip | string | IP address (used when the web asset is incomplete) | All users |\n| domain | string | Domain | All users |\n| url | string | Full URL of the asset (for web assets) | All users |\n| ssl.jarm | string | SSL JARM fingerprint | All users |\n| ssl.ja3s | string | SSL JA3S fingerprint | All users |\n| iconhash_md5 | string | MD5 value of the icon image | Professional plan and above |\n| robots_md5 | string | MD5 value of the robots.txt file | Business plan and above |\n| security_md5 | string | MD5 value of the security settings file | Business plan and above |\n| hostname | string | Hostname information | All users |\n| os | string | Operating system information | All users |\n| port | integer | Port number | All users |\n| service | string | Provided application protocol (e.g., HTTP, SSH) | All users |\n| title | list | Webpage title | All users |\n| version | string | Component version information | All users |\n| device | string | Device name | All users |\n| rdns | string | Reverse DNS information | All users |\n| product | string | Product component information | All users |\n| header | string | HTTP response header information | All users |\n| header_hash | string | Hash calculated from HTTP response header | Professional plan and above |\n| banner | string | Service banner information | All users |\n| body | string | HTML Body content | Business plan and above |\n| body_hash | string | Hash calculated from the HTML body | Professional plan and above |\n| update_time | string | Asset update time | All users |\n| header.server.name | string | Server name in the HTTP response header | All users |\n| continent.name | string | Name of the continent | All users |\n| country.name | string | Name of the country | All users |\n| province.name | string | Name of the province | All users |\n| city.name | string | Name of the city | All users |\n| isp.name | string | ISP name | All users |\n| organization.name | string | Organization name | All users |\n| zipcode | integer | Postal code | All users |\n| idc | string | Is it an IDC (0 for no, 1 for yes) | All users |\n| lon | string | Geolocation longitude | All users |\n| lat | string | Geolocation latitude | All users |\n| asn | string | Autonomous System Number | All users |\n| protocol | string | Transport layer protocol (e.g., TCP, UDP) | All users |\n| honeypot | integer | Is it a honeypot (0 for no, 1 for yes) | All users |\n| ssl | string | SSL x509 certificate information | All users |\n| primary_industry | string | Primary industry information | Business plan and above |\n| sub_industry | string | Sub-industry information | Business plan and above |\n| rank | integer | Asset importance ranking, the higher the score, the more important. | Business plan and above |\n\n**Settings to change default output fields**\n\n```\nSet fields = ip,port\n```\n\n\n\n**Batch IP search**\n\n\n\n**Icon Search**\n\nWhen collecting corporate assets, we can use this method to retrieve the same ico icon assets, which usually has a good effect when associating related corporate assets. But it should be noted that if some sites also use this ico icon, irrelevant assets may be associated (but people who are bored with other people's ico icons are always in the minority). Support url or local file search. \n\n**Command format:** \n\n```\nSearchIocn https://www.baidu.com/favicon.ico \nSearchIcon /root/favicon.ico \n```\n\n\n\n**SSL certificate search**\n\nQuery through the serial number of the SSL certificate, so that the associated assets are more accurate, and services that use the same certificate can be searched. When you encounter an https site, you can use this method.\n\n\n\n**Multi-factor query**\n\nSimilarly, Kunyu also supports multi-factor conditional query related assets, which can be realized through ZoomEye logic operation syntax.\n\n\n\n**Feature Search**\n\nThrough HTTP request packet features or website-related features, the same framework assets can be concatenated more accurately\n\n\n\n**Associated Domain/Subdomain Search**\n\nSearch for associated domain names and subdomains, and query associated domain names by default. You can set **associated domain name/subdomain name** two modes by setting the dtype parameter. \n\nCommand format: **SearchDomain Domain** \n\n\n\n**Set the type of data to be obtained**\n\nAfter the V1.6.1 version, the user can set the data type obtained through the stype parameter to IPV4 or IPV6 to realize the application scenario, and the default parameter is v4.\n\nCommand format: **set stype = v6**\n\n\n\n**View Banner Information** \n\nThe user can view the banner corresponding to the specified serial number through the view command, so as to further analyze the front-end code and Header header, and the user can intercept the banner information for further association matching. \n\nCommand format: **view ID** \n\n\n\nThe user can also view the SSL certificate information of the specified serial number through the views command, and further associate it by extracting the sensitive information in the SLL certificate information.\n\nCommand format: **views ID**\n\n\n\n**Cscan Scans port information about cobaltStrike**\n\nCscan, a new feature in Kunyu version 1.7.2, allows you to use this command to identify whether a network asset is cobaltStrike and to enumerate configuration file details.\n\n**Command format:**\n\n```\nCscan 1.1.1.1 443\nCscan 1.1.1.1 443,80\n```\n\n\n\n**CDNAnalysis\uff08NEW\uff09**\n\n**Command format:**\n\n```\nCDNAnalysis --file ip.txt\nCDNAnalysis --domain www.baidu.com\n```\n\n\n\n**PupilSearch Sensitive Information Collection**\n\nAfter Kunyu v1.7.0, the KeyWord command was removed and replaced with PupilSearch, which is the function of extracting sensitive data. Of course, it also supports the extraction of historical banner information through spatial mapping. For example, such as accesskey, the banner in historical data leaks sensitive data. Information, even if the service is changed now, but the AK/SK has not expired, it can still be used directly, understand everything, and support the extraction of sensitive information **(ID number, IP, JWT, API interface, appid, appkey, GithubAccessKey, default username \\password, email, etc.)**.\n\n**Command format:**\n\nPupilSearch https://www.domain.com/\n\nPupilSearch ID (extract sensitive information from the banner returned by spatial mapping)\n\n\n\n\n\n\n\n**System command execution** \n\nAfter Kunyu v1.6.0, support for the execution of system commands has been added. You can debug surveying and mapping data more conveniently and effectively by executing some commonly used system commands. For a list of specific executable commands, see Article 11 in the Issue of the README file. \n\n**Example One** \n\n\n\n**Example two **\n\n\n\n**Encoding hash calculation**\n\nIn some scenarios, you can use this command to perform common HASH encryption/encoding, such as BASE64, MD5, mmh3, HEX encoding, and debug in this way.\n\n**Command format:** \n\n```\nEncodeHash hex 7239dcc9beb5c9cd795415f9\nEncodeHash md5 https://www.baidu.com/favicon.ico\nEncodeHash md5 /root/favicon.ico\nEncodeHash mmh3 https://www.baidu.com/favicon.ico\nEncodeHash mmh3 /root/favicon.ico\nEncodeHash base64 dasdasdsa\n```\n\n\n\n**Asset Survival Scan**\n\nAfter Kunyu V1.6.5, the survivability scan of the last retrieval result is added, and the result is output in real time by polling.\n\n\n\n**Seebug vulnerability query**\n\nYou can query historical related vulnerabilities by entering information about the framework and equipment you want to find, but you need to note that only English is supported, and improvements and upgrades will be made later.\n\nCommand format: **Seebug tongda** \n\n\n\n**Load fingerprint file**\n\nKunyu V1.6.4 adds the function of loading an external fingerprint library. Kunyu provides 5 fingerprint files as a reference by default. Users can write their own fingerprint files to load or share, and retrieve them more flexibly, which is convenient for traceability and security. Resource sharing in research and red team offense and defense, enhance teamwork.\n\nYou can view the information of the currently loaded fingerprint library through the **show rule** command.\n\n\n\nThe default read fingerprint file directory is under **project directory/kunyu/rule**, you can customize the read fingerprint file path setting through **kunyu init --rule C:\\\u98ce\u8d77\\rule**.\n\nYou can use the **show config** command to view the information of the Kunyu configuration file.\n\n\n\nWhen faced with complex fingerprint information, you can generate a yaml file through **project directory/kunyu/createrule.py**\n\n\n\nThe format of the yaml fingerprint file is as follows. Please note that the following standard format must be strictly followed, and no fields are missing.\n\n```bash\nKXID: kx-2022-07\nauthor: \u98ce\u8d77\ncreateDate: 2022-1-4\ndescription: \u67e5\u627e\u516c\u7f51\u90e8\u7f72\u7684ngrok\u53cd\u5411\u4ee3\u7406\nkx_name: ngrok\u4ee3\u7406\u5de5\u5177\u6307\u7eb9\nkx_query: '''Server: beegoServer:1.12.0'' +''<a href=\"/login/index\">Found</a>.'''\nsource: https://github.com/wikiZ/Kunyu\n```\n\n**Setting parameters**\n\nWhen set page = 2, the returned results are 40. You can modify the page parameter to set the number of pages to be queried. Note that 1 page = 20/items. You can modify the value according to your needs to get more returned results. \n\nThe configurable parameters and the current values of the parameters are displayed through show. \n\n\n\n\n\n**Pocsuite linkage**\n\nIn versions after v1.3.1, you can use kunyu to link the console mode of pocsuite3 for integrated use.\n\n\n\n**HOSTS head collision**\n\nThrough HOSTS collision, the hidden assets in the intranet can be effectively collided. According to the ServerName domain name and IP configured in the middleware httpf.conf, the access can be directly connected to the intranet business system! Follow-up by setting the local hosts file to achieve local DNS resolution, because the priority of the local hosts file is higher than the DNS server resolution. Support reverse check through ZoomEye domain name library or read TXT file to get the list of domain names. \n\n**Command format:** \n\n```\nHostCrash C:\\ip.txt C:\\host.txt \nHostCrash C:\\ip.txt baidu.com \nHostCrash 1.1.1.1 baidu.com \nHostCrash 1.1.1.1 G:\\host.txt \n```\n\n**Example One** \n\n\n\n**Example Two** \n\n\n\n**Serverless HostCrash Scan**\n\nKunyu v1.6.2 adds an interesting feature that combines the cloud function to perform HOSTS collisions on the target. In this way, our scanned IP is effectively hidden to prevent it from being captured by the target situational awareness, and it also prevents WAF from banning the real IP. , And conceal the features. Through the following scanning effect, it can be found that the scanned IPs are all cloud service vendors and each scan is a random IP address. You can choose whether to enable it by configuring the cloud function address during initialization.\n\n**Configuration Guide:** [Configuration Method of Cloud Function](./doc/Serverless_EN.md)\n\n**Related technology:**https://www.anquanke.com/post/id/261551\n\n**Situational Awareness Scanning Effect:**\n\n\n\n**Asset distribution map**\n\nv1.6.2 adds the CreateMap command, which can generate a geographic location distribution map for the assets retrieved last time, and more vividly describe the mapping relationship between network space and real space. It is located in the same output directory as Excel, and the generated asset map is the same as the last time. The number of search results is related.\n\n**Generate distribution map**\n\n\n\n**Web page**\n\n\n\n**Data result**\n\nAll search results are saved in the user's root directory, and the directory is created based on the current timestamp. All query results of a single start are stored in an Excel format under one directory, giving a more intuitive experience. The output path can be returned through the ExportPath command.\n\n\n\n\n# 0x04 Loading\n\n\u200b In fact, there are still many ideas, but as an Alpha version, this is the case, and it will continue to be improved in the later period. I hope that Kunyu can be known to more security practitioners. Thank you for your support.\n\n\u200b The tool framework has reference to Kunlun Mirror and Pocsuite3, which are all very good works.\n\n\u200b\tAbout the developer Fengqi(\u98ce\u8d77) Related articles: https://www.anquanke.com/member.html?memberId=148652 \n\n\u200b Thanks to all the friends of KnownSec 404 Team.\n\n> \"Seeing clearly\" is the embodiment of ability, which is \"tool\", while \"seeing\" is the embodiment of thought, and the last thing it is related to is \"Tao\".\t\u2014\u2014SuperHei\uff08\u9ed1\u54e5\uff09\n\n# 0x05 Issue\n\n**1. Multi-factor search**\n\nZoomEye search can use multi-factor search, dork: cisco +port:80 (note the space) can search for all data that meets the cisco and port:80 conditions. If there is no space in the middle, it is the same search condition, that is, all data that meets cisco and port 80. Kunyu's dork does not need quotation marks, **The new version 2.0 syntax has changed. **\n\n**2. High-precision geographic location**\n\nZoomEye gives privileged users high-precision geographic location data, but it should be noted that ordinary users do not have this function, please be aware.\n\n**3. Username/password login**\n\nIf you use username/password as the initialization condition, the token obtained will be valid for 12 hours. If you find that your search cannot return data, you may as well info it. If the session times out, the initialization command prompt will be returned. In most cases, we recommend that you use the API KEY method, and there will be no expiration problem. This design is also for the security of your account and password. After all, the API KEY can be reset and the token will become invalid, but with the account and password, it is possible to log in to your ZoomEye account.\n\n**4. Cert certificate search**\n\nIt should be noted that according to conventional logic, you need to encode the serial number of the target SSL certificate in hexadecimal before searching with the statement, but Kunyu only needs to provide the Domain address to search. The principle is to make a request to the target station to obtain the serial number and process it, but if your host cannot access the target to be searched, it cannot be retrieved. At this time, you can also use the conventional method to search with the statement.\n\n**5. Favicon icon search**\n\nico icon search supports both URL search and local ico icon file search, which has better scalability and compatibility.\n\n**6. Query data storage path**\n\nBy default, your query data is in the Kunyu folder under the user directory. You can also use the ExportPath command in console mode to query the path.\n\n**7. Auto-completion**\n\nKunyu's auto-completion supports uppercase and lowercase letters, command records, etc. Use Tab to complete. For usage, please refer to Metasploit.\n\n**8. About the error when using pip install kunyu**\n\nWhen using pip install kunyu, the following error is reported:\n`File \"C:\\Users\\\u98ce\u8d77\\AppData\\Local\\Programs\\Python\\Python37\\Scripts\\kunyu-script.py\", line 1 SyntaxError: Non-UTF-8 code starting with '\\xb7' in file C:\\Users\\\u98ce\u8d77\\AppData\\Local\\Programs\\Python\\Python37\\Scripts\\kunyu-script.py on line 1, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details`\n\nSolution:\nModify the C:\\Users\\\u98ce\u8d77\\AppData\\Local\\Programs\\Python\\Python37\\Scripts\\kunyu-script.py file and add # encoding: utf-8 at the beginning of the file\nThen save it and it can be used normally. The reason for this bug is that there is a Chinese name in the user directory path, which usually appears on Windows.\n\n**9. Pocsuite3 module POC storage directory**\n\nWhen using the pocsuite3 module, if you want to add a new POC module, you can add the POC file in **project directory/pocsuite3/pocs/**. It should be noted that when using the packaged Kunyu console command, the POC should be added to the directory, and the kunyu program should be repackaged to load the POC normally.\n\n**10. Pocsuite3 module POC missing problem**\n\nWhen using the Pocsuite command linkage, if it is a packaged Kunyu version, the poc has been fixed. At this time, modifying the poc directory cannot add a new module. At this time, you can repackage it or use **project directory/kunyu/console.py** to run kunyu to update the poc module in real time.\n\n**11. Kunyu executable system commands are as follows. **\n\n**Windows:**\nOS_SYSTEM = [**\"ipconfig\", \"dir\", \"whoami\", \"ping\", \"telnet\", \"cd\", \"findstr\", \"chdir\",\"find\", \"mysql\", \"type\", \"curl\", \"netstat\", \"tasklist\", \"taskkill\", \"tracert\", \"del\", \"ver\",\"nmap\",\"ls\"**]\n\n**Linux/Mac:**\n\n OS_SYSTEM = [**\"ifconfig\", \"ls\", \"cat\", \"pwd\", \"whoami\", \"ping\", \"find\", \"grep\", \"telnet\", \"mysql\", \"cd\", \"vi\", \"more\", \"less\", \"curl\", \"ps\", \"netstat\", \"rm\", \"touch\", \"mkdir\", \"uname\",\"nmap\"**]\n\n**12. Kunyu operating environment**\n\nIt is recommended to use Python3.2 - 3.12. Other versions of Python3 may have unknown errors. **Python2 cannot be used**.\n\n**13. Set timeout**\n\nIf the HTTP request is not responded to in time, you can solve it by increasing the timeout time, such as: set timeout = 50\n\n**14. Kunyu client startup time is long**\n\nSince Kunyu2.0 will identify and use domestic and foreign interfaces during the initialization phase, it may take a while to start and use, the time is 5-10 seconds.\n\n**15. RULE fingerprint storage location**\n\nThe RULE fingerprint storage location can be configured and modified under ~/.kunyu.ini, and the default is under the compiled and run kunyu path.\n\n**16. View function cannot be used**\n\nThe view function is in the ZoomEye update, and the business version membership is required to use it normally. The views function is not affected.\n\n**17. Abnormal BUG**\n\nSince the test environment is MAC OS, there may be incompatibility issues in other operating systems. Please feedback the ISSUE or contact the operation in time.\n\n**18. Antivirus software check**\n\nKunyu may fail to start due to antivirus software checking files, please pay attention to this problem\n\n**19. I haven't decided yet ^_^**\n\n# 0x06 Contributions\n\n[\u98ce\u8d77@knownsec 404](https://github.com/wikiZ) \n[wh0am1i@knownsec 404](https://github.com/wh0am1i) \n[fenix@knownsec 404](https://github.com/13ph03nix) \n[0x7F@knownsec 404](https://github.com/0x7Fancy)\n\n# 0x07 Events\n\n **WHC 2021 (\u8865\u5929\u767d\u5e3d\u5927\u4f1a) Best Weapon of the Year Award **\n\n **KCON 2021 Arsenal**\n\n## 404Starlink\n<img src=\"https://github.com/knownsec/404StarLink-Project/raw/master/logo.png\" width=\"30%\">\n\nKunyu has joined [404Starlink](https://github.com/knownsec/404StarLink)\n\n\n# 0x08 Community\n\nIf you have any questions, you can submit an issue under the project, or contact us through the following methods.\n\n1\u3001Scan the Wechat QR code to add ZoomEye operation Wechat, and comment on Kunyu, which will draw everyone to the ZoomEye Cyberspace Surveying and Mapping Exchange Group for communication. \n\n\n",
"bugtrack_url": null,
"license": null,
"summary": "kunyu is Cyberspace Resources Surveying and Mapping auxiliary tools",
"version": "2.1",
"project_urls": null,
"split_keywords": [
"cyberspace resources",
" zoomeye",
" kunyu"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "4f76270da73f90ffee6beb081b79991c2debcb41fff247b8304c13d422c0221e",
"md5": "713da7ac5753ed604b6cca603f6d53b8",
"sha256": "4502c9f50ecb85cbdb5142ddaebc76a8afef87abca1dfba4f94167ff63873557"
},
"downloads": -1,
"filename": "kunyu-2.1.tar.gz",
"has_sig": false,
"md5_digest": "713da7ac5753ed604b6cca603f6d53b8",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 16572603,
"upload_time": "2025-01-20T06:42:52",
"upload_time_iso_8601": "2025-01-20T06:42:52.217198Z",
"url": "https://files.pythonhosted.org/packages/4f/76/270da73f90ffee6beb081b79991c2debcb41fff247b8304c13d422c0221e/kunyu-2.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-01-20 06:42:52",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "kunyu"
}
JSON