[](https://github.com/opencybersecurityalliance/stix-shifter/actions)
[](https://codecov.io/gh/opencybersecurityalliance/stix-shifter)
# Introduction to STIX-Shifter
STIX-shifter is an open source python library allowing software to connect to products that house data repositories by using STIX Patterning, and return results as STIX Observations.
This library takes in STIX 2 Patterns as input, and "finds" data that matches the patterns inside various products that house repositories of cybersecurity data. Examples of such products include SIEM systems, endpoint management systems, threat intelligence platforms, orchestration platforms, network control points, data lakes, and more.
In addition to "finding" the data by using these patterns, STIX-Shifter also _transforms the output_ into STIX 2 Observations. Why would we do that you ask? To put it simply - so that all of the security data, regardless of the source, mostly looks and behaves the same.
[## Project Overview and CLI Commands](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/OVERVIEW.md)
For general information about STIX, this project, and the command line utilities, see the [STIX-shifter Overview](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/OVERVIEW.md)
# Installation
The recommended method for installing stix-shifter is via pip. Two prerequisite packages needs to be installed inlcuding the package of stix-shifter connector module to complete a stix-shifter connector installation. Run the below commands to install all the packages:
1. Main stix-shifter package: `pip install stix-shifter`
2. Stix-shifter Utility package: `pip install stix-shifter-utils`
3. Desired stix-shifter connector module package: `pip install stix-shifter-modules-<module name> `
Example: `pip install stix-shifter-modules-qradar`
## Dependencies
STIX-shifter requries Python 3.8 or greater. See the [requirements file](stix_shifter/requirements.txt) for library dependencies.
# Usage
STIX-Shifter can use used the following ways:
## 1. As a command line utility
The STIX-Shifter comes with a bundled script which you can use to translate STIX Pattern to a native datasource query. It can also be used to translate a JSON data source query result to a STIX bundle of observable objects. You can also send query to a datasource by using a transmission option.
More details of the command line option can be found [here](https://github.com/opencybersecurityalliance/stix-shifter/blob/master/OVERVIEW.md#how-to-use)
```
$ stix-shifter translate <MODULE NAME> query "<STIX IDENTITY OBJECT>" "<STIX PATTERN>" "<OPTIONS>"
```
Example:
```
$ stix-shifter translate qradar query {} "[ipv4-addr:value = '127.0.0.1']" {}
```
In order to build `stix-shifter` packages from source follow the below prerequisite steps:
1. Go to the stix-shifter parent directory
2. Optionally, you can create a Python 3 virtual environemnt:
`virtualenv -p python3 virtualenv && source virtualenv/bin/activate`
3. Run setup: `python3 setup.py install`
## 2. Running from the source
You may also use the `python3 main.py` script. All the options are the same as the command line utility described above.
Example:
```
python3 main.py translate qradar query {} "[ipv4-addr:value = '127.0.0.1']" {}
```
In order to run `python3 main.py` from the source follow the below prerequisite steps:
1. Go to the stix-shifter parent directory
2. Optionally, you can create a Python 3 virtual environemnt:
`virtualenv -p python3 virtualenv && source virtualenv/bin/activate`
3. Run setup to install dependancies: `INSTALL_REQUIREMENTS_ONLY=1 python3 setup.py install`.
**Note:** setup.py only installs dependencies when INSTALL_REQUIREMENTS_ONLY=1 directive is used. This option is similar to `python3 generate_requirements.py && pip install -r requirements.txt`
## 3. As a library
You can also use this library to integrate STIX Shifter into your own tools. You can translate a STIX Pattern:
```
from stix_shifter.stix_translation import stix_translation
translation = stix_translation.StixTranslation()
response = translation.translate('<MODULE NAME>', 'query', '{}', '<STIX PATTERN>', '<OPTIONS>')
print(response)
```
### Use of custom mappings
If a connector has been installed using pip, the process for editing the STIX mappings is different than if you have pulled-down the project. When working locally, you can edit the mapping files directly. See the [mapping files for the MySQL connector](stix_shifter_modules/mysql/stix_translation/json) as an example. Editing the mapping files won't work if the connector has been installed with pip; the setup script of the stix-shifter package includes the mapppings inside `config.json`. This allows stix-shifter to injest custom mappings as part of the connector's configuration.
Refer to [Use of custom mappings](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/custom_mappings.md) for more details on how to edit the mappings in the configuration.
# Contributing
We are thrilled you are considering contributing! We welcome all contributors.
Please read our [guidelines for contributing](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/CONTRIBUTING.md).
## [Connector Developer Guide](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/develop-stix-adapter.md)
<!-- If you want to create a new connector for STIX-shifter, see the [developer guide](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/develop-stix-adapter.md) -->
## [Jupyter Notebook Development Labs](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/lab)
<!-- There are also a few [Jupyter Notebook labs](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/lab) that cover the CLI commands and dev process. -->
# Licensing
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
# More Resources
## Join us on Slack!
[Click here](https://docs.google.com/forms/d/1vEAqg9SKBF3UMtmbJJ9qqLarrXN5zeVG3_obedA3DKs) and fill out the form to receive an invite to the Open Cybersecurity Alliance slack instance, then join the #stix-shifter channel, to meet and discuss usage with the team.
## Introduction Webinar!
[Click here](https://ibm.biz/BdzTyA) to view an introduction webinar on STIX Shifter and the use cases it solves for.
## Changelog
- [Changelog](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/CHANGELOG.md)
Raw data
{
"_id": null,
"home_page": "https://github.com/opencybersecurityalliance/stix-shifter",
"name": "stix-shifter-modules-threat-q",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "datasource stix translate transform transmit",
"author": "ibm",
"author_email": "",
"download_url": "",
"platform": null,
"description": "[](https://github.com/opencybersecurityalliance/stix-shifter/actions)\n[](https://codecov.io/gh/opencybersecurityalliance/stix-shifter)\n\n# Introduction to STIX-Shifter\n\nSTIX-shifter is an open source python library allowing software to connect to products that house data repositories by using STIX Patterning, and return results as STIX Observations.\n\nThis library takes in STIX 2 Patterns as input, and \"finds\" data that matches the patterns inside various products that house repositories of cybersecurity data. Examples of such products include SIEM systems, endpoint management systems, threat intelligence platforms, orchestration platforms, network control points, data lakes, and more.\n\nIn addition to \"finding\" the data by using these patterns, STIX-Shifter also _transforms the output_ into STIX 2 Observations. Why would we do that you ask? To put it simply - so that all of the security data, regardless of the source, mostly looks and behaves the same.\n\n[## Project Overview and CLI Commands](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/OVERVIEW.md)\n\nFor general information about STIX, this project, and the command line utilities, see the [STIX-shifter Overview](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/OVERVIEW.md)\n\n\n# Installation\n\nThe recommended method for installing stix-shifter is via pip. Two prerequisite packages needs to be installed inlcuding the package of stix-shifter connector module to complete a stix-shifter connector installation. Run the below commands to install all the packages:\n\n1. Main stix-shifter package: `pip install stix-shifter`\n\n2. Stix-shifter Utility package: `pip install stix-shifter-utils`\n\n3. Desired stix-shifter connector module package: `pip install stix-shifter-modules-<module name> `\n Example: `pip install stix-shifter-modules-qradar`\n\n## Dependencies\n\nSTIX-shifter requries Python 3.8 or greater. See the [requirements file](stix_shifter/requirements.txt) for library dependencies. \n\n# Usage\n\nSTIX-Shifter can use used the following ways:\n\n## 1. As a command line utility\n\nThe STIX-Shifter comes with a bundled script which you can use to translate STIX Pattern to a native datasource query. It can also be used to translate a JSON data source query result to a STIX bundle of observable objects. You can also send query to a datasource by using a transmission option. \n\nMore details of the command line option can be found [here](https://github.com/opencybersecurityalliance/stix-shifter/blob/master/OVERVIEW.md#how-to-use)\n\n```\n$ stix-shifter translate <MODULE NAME> query \"<STIX IDENTITY OBJECT>\" \"<STIX PATTERN>\" \"<OPTIONS>\"\n```\nExample:\n```\n$ stix-shifter translate qradar query {} \"[ipv4-addr:value = '127.0.0.1']\" {}\n```\n\nIn order to build `stix-shifter` packages from source follow the below prerequisite steps:\n 1. Go to the stix-shifter parent directory\n 2. Optionally, you can create a Python 3 virtual environemnt:\n `virtualenv -p python3 virtualenv && source virtualenv/bin/activate`\n 3. Run setup: `python3 setup.py install`\n\n\n## 2. Running from the source\n\nYou may also use the `python3 main.py` script. All the options are the same as the command line utility described above.\n\nExample:\n\n```\npython3 main.py translate qradar query {} \"[ipv4-addr:value = '127.0.0.1']\" {}\n```\n\nIn order to run `python3 main.py` from the source follow the below prerequisite steps:\n 1. Go to the stix-shifter parent directory\n 2. Optionally, you can create a Python 3 virtual environemnt:\n `virtualenv -p python3 virtualenv && source virtualenv/bin/activate`\n 3. Run setup to install dependancies: `INSTALL_REQUIREMENTS_ONLY=1 python3 setup.py install`. \n\n**Note:** setup.py only installs dependencies when INSTALL_REQUIREMENTS_ONLY=1 directive is used. This option is similar to `python3 generate_requirements.py && pip install -r requirements.txt`\n\n## 3. As a library\n\nYou can also use this library to integrate STIX Shifter into your own tools. You can translate a STIX Pattern:\n\n```\nfrom stix_shifter.stix_translation import stix_translation\n\ntranslation = stix_translation.StixTranslation()\nresponse = translation.translate('<MODULE NAME>', 'query', '{}', '<STIX PATTERN>', '<OPTIONS>')\n\nprint(response)\n```\n### Use of custom mappings\n\nIf a connector has been installed using pip, the process for editing the STIX mappings is different than if you have pulled-down the project. When working locally, you can edit the mapping files directly. See the [mapping files for the MySQL connector](stix_shifter_modules/mysql/stix_translation/json) as an example. Editing the mapping files won't work if the connector has been installed with pip; the setup script of the stix-shifter package includes the mapppings inside `config.json`. This allows stix-shifter to injest custom mappings as part of the connector's configuration.\n\nRefer to [Use of custom mappings](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/custom_mappings.md) for more details on how to edit the mappings in the configuration.\n\n# Contributing\n\nWe are thrilled you are considering contributing! We welcome all contributors.\nPlease read our [guidelines for contributing](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/CONTRIBUTING.md).\n\n## [Connector Developer Guide](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/develop-stix-adapter.md)\n\n<!-- If you want to create a new connector for STIX-shifter, see the [developer guide](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/adapter-guide/develop-stix-adapter.md) -->\n\n## [Jupyter Notebook Development Labs](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/lab)\n\n<!-- There are also a few [Jupyter Notebook labs](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/lab) that cover the CLI commands and dev process. -->\n\n# Licensing\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n\n# More Resources\n\n## Join us on Slack!\n\n[Click here](https://docs.google.com/forms/d/1vEAqg9SKBF3UMtmbJJ9qqLarrXN5zeVG3_obedA3DKs) and fill out the form to receive an invite to the Open Cybersecurity Alliance slack instance, then join the #stix-shifter channel, to meet and discuss usage with the team.\n\n## Introduction Webinar!\n\n[Click here](https://ibm.biz/BdzTyA) to view an introduction webinar on STIX Shifter and the use cases it solves for.\n\n## Changelog\n\n- [Changelog](https://github.com/opencybersecurityalliance/stix-shifter/blob/develop/CHANGELOG.md)\n",
"bugtrack_url": null,
"license": "",
"summary": "Tools and interface to translate STIX formatted results and queries to different data source formats and to set up appropriate connection strings for invoking and triggering actions in openwhisk",
"version": "5.3.1",
"project_urls": {
"Homepage": "https://github.com/opencybersecurityalliance/stix-shifter",
"Source": "https://github.com/opencybersecurityalliance/stix-shifter"
},
"split_keywords": [
"datasource",
"stix",
"translate",
"transform",
"transmit"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0fabb36bf0f8830a52c9947981237cbfe4191add38a2bedb48edabfeff483b10",
"md5": "adb26c36b0ad133d9733166e647c2a05",
"sha256": "3ff47c92ce2b6026a16479c6252351c619763051dc9f815adfbc2bf3d91c62f3"
},
"downloads": -1,
"filename": "stix_shifter_modules_threat_q-5.3.1-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "adb26c36b0ad133d9733166e647c2a05",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": null,
"size": 34900,
"upload_time": "2023-06-15T14:09:13",
"upload_time_iso_8601": "2023-06-15T14:09:13.341919Z",
"url": "https://files.pythonhosted.org/packages/0f/ab/b36bf0f8830a52c9947981237cbfe4191add38a2bedb48edabfeff483b10/stix_shifter_modules_threat_q-5.3.1-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-06-15 14:09:13",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "opencybersecurityalliance",
"github_project": "stix-shifter",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "stix-shifter-modules-threat-q"
}
JSON
