| Name | pytest-fluent JSON |
| Version |
0.3.0
JSON |
| download |
| home_page | None |
| Summary | A pytest plugin in order to provide logs via fluentd |
| upload_time | 2024-05-14 08:51:40 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.8 |
| license | MIT |
| keywords |
pytest
logging
fluent
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# pytest-fluent
[](https://pytest-fluent.readthedocs.io/) [](https://github.com/Rohde-Schwarz/pytest-fluent/actions/) [](https://pypi.python.org/pypi/pytest-fluent)  [](https://pypi.python.org/pypi/pytest-fluent) [](LICENSE)
_pytest-fluent_ is a Python package in order to extend _pytest_ using _Fluentd_ for logging test results.
## Description
_pytest_ is one of the most powerful testing suites with a lot of functionality and many plugins. _Fluentd_ is a well-established log collector which is used in many modern web architectures. So, why not putting both worlds together in order to gain real-time log access to your distributed test runs?
_pytest-fluent_ enables you to forward your test data immediately to your preferred log-sink from any node spread around your infrastructure. The streamed data are available for each pytest stage and formatted in JSON.
Each _pytest_ session gets an unique identifier (UID) assigned as well as each executed test case. With these UIDs, you can easily filter sessions and testcase data entries, for instance in your favorite database.
## Installation
The package is available at [pypi.org](https://pypi.org/project/pytest-fluent/) and can be installed by typing
```shell
pip install pytest-fluent
```
## Usage
_pytest-fluent-logging_ forwards meta data from _pytest_ to _Fluentd_ for further processing. The meta data are
* unique session ID
* unique test ID
* status of the session respectively test case
* test case name
* test results
* `record_property` entries
* custom testcase information
* custom session information
* timestamps
Furthermore, the Python logging instance can be extended in order to forward test case runtime logging:
```python
from logging import getLogger
def test_my_runtime_log():
value = 1
getLogger().info("Setting value to %s", value)
assert value == 1
```
or:
```python
from logging import getLogger
def test_my_runtime_log():
value = 1
getLogger('fluent').info("Setting value to %s", value)
assert value == 1
```
### Fixtures
In order to create your own logger, request the fixture `get_logger` as follows:
```python
def test_my_runtime_log(get_logger):
logger = get_logger('my.Logger')
value = 1
logger.info("Setting value to %s", value)
assert value == 1
```
If you want to get the current UIDs, use the `session_uid` and `test_uid` fixtures as follows:
```python
def test_unique_identifier(get_logger, session_uid, test_uid):
logger = get_logger('fluent')
logger.info("Session ID: %s", session_uid)
logger.info("Test ID: %s", test_uid)
value = 1
assert value == 1
```
### Callbacks
If you want to add custom data to the datasets of the `pytest_sessionstart` and `pytest_runtest_logstart` stages, decorate your callback functions with the following decorators:
```python
from pytest_fluent import (
additional_session_information_callback,
additional_test_information_callback
)
@additional_session_information_callback
def provide_more_session_information() -> dict:
return {
"more": "session information"
}
@additional_test_information_callback
def provide_more_test_information() -> dict:
return {
"more": "test information"
}
```
### _pytest_ CLI extensions
The _pytest_ CLI application can be called with the following arguments in order to configure _fluent-logging_.
| argument | description | default |
| ------------------- | ------------------------------------------------------------------------------------------------------------------------------------ | -------- |
| --session-uuid | Use a custom externally created UUID, e.g. link a CI job with the pytest session. | |
| --fluentd-host | Fluentd host address. If not provided, a local Fluentd instance will be called. | |
| --fluentd-port | Fluent host port | 24224 |
| --fluentd-tag | Set a custom Fluentd tag | 'test' |
| --fluentd-label | Set a custom Fluentd label | 'pytest' |
| --fluentd-timestamp | Specify a Fluentd timestamp | None |
| --extend-logging | Extend the Python logging with a Fluent handler | False |
| --add-docstrings | Add test docstrings to testcase call messages | |
| --stage-settings | Use custom stage settings file. See [documentation](https://pytest-fluent.readthedocs.io/en/latest/usage.html#custom-stage-settings) | |
### Ini Configuration Support
Default values of the CLI arguments for a project could also be defined in one of the following ini configuration files:
1. `pytest.ini`: Arguments are defined under the `pytest` section in the file. This file takes precedence over all other configuration files even if it's empty.
```python
[pytest]
addopts= --session-uuid="ac2f7600-a079-46cf-a7e0-6408b166364c" --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='dummytest' --fluentd-label='pytest' --extend-logging
```
2. `pyproject.toml`: are considered for configuration when they contain a `tool.pytest.ini_options` section is available
```python
[tool.pytest.ini_options]
addopts="--fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='test' --fluentd-label='pytest' --extend-logging"
```
3. `tox.ini`: can also be used to hold pytest configuration if they have a [pytest] section.
```python
[pytest]
addopts= --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='test' --fluentd-label='pytest'
```
If the same option is specified in both CLI and _ini_ file, then CLI option would have higher priority and override the _ini_ file values.
### What data are sent?
_pytest-fluent_ sends any information, e.g. stage information or logging from a test case, as a single chunk. For instance, the data collection from `test_addoptions.py` test looks as following
```json
[
{
"status": "start",
"stage": "session",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0"
},
{
"status": "start",
"stage": "testcase",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0",
"name": "test_fluentd_logged_parameters.py::test_base"
},
{
"type": "logging",
"host": "myComputer",
"where": "test_fluentd_logged_parameters.test_base",
"level": "INFO",
"stack_trace": "None",
"message": "Logged from test_base",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0",
"stage": "testcase"
},
{
"type": "logging",
"host": "myComputer",
"where": "test_fluentd_logged_parameters.test_base",
"level": "INFO",
"stack_trace": "None",
"message": "Logged from test_base",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0",
"stage": "testcase"
},
{
"name": "test_fluentd_logged_parameters.py::test_base",
"outcome": "passed",
"duration": 0.0013457999999999526,
"markers": {
"test_base": 1,
"test_fluentd_logged_parameters.py": 1,
"test_fluentd_logged_parameters0": 1
},
"stage": "testcase",
"when": "call",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0"
},
{
"status": "finish",
"stage": "testcase",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0",
"name": "test_fluentd_logged_parameters.py::test_base"
},
{
"status": "finish",
"duration": 0.00297708511352539,
"stage": "session",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0"
}
]
```
whereat each object in the array is sent independently via _Fluentd_.
### Specifying a timestamp
Timestamps are added to the information if the ``--fluentd-timestamp`` option is enabled:
```python
[pytest]
addopts= --session-uuid="ac2f7600-a079-46cf-a7e0-6408b166364c" --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='dummytest' --fluentd-label='pytest' --fluentd-timestamp='@timestamp' --extend-logging
```
The timestamp is added to each message. The value is in ISO 8601 format. A sample
of the data collection from `test_addoptions.py` (as above) would look as below:
```json
[
{
"status": "start",
"stage": "session",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"@timestamp": "2022-12-25T03:00:00.000000Z"
},
{
"status": "start",
"stage": "testcase",
"sessionId": "d8f01de3-8416-4801-9406-0ea3d5cfe3c0",
"testId": "6b444275-4450-4eff-b5d9-8355f0f99ab0",
"name": "test_fluentd_logged_parameters.py::test_base",
"@timestamp": "2022-12-25T03:00:00.100000Z"
}
]
```
## Changelog
The changelog.
## Contributing
We welcome any contributions, enhancements, and bug-fixes. Open an [issue](https://github.com/Rohde-Schwarz/pytest-fluent/issues) on [Github](https://github.com) and [submit a pull request](https://github.com/Rohde-Schwarz/pytest-fluent/pulls).
Raw data
{
"_id": null,
"home_page": null,
"name": "pytest-fluent",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "Carsten Sauerbrey <carsten.sauerbrey@rohde-schwarz.com>, Nicola Lambiase <nicola.lambiase@rohde-schwarz.com>",
"keywords": "pytest, logging, fluent",
"author": null,
"author_email": "\"Rohde & Schwarz GmbH & Co. KG\" <info@rohde-schwarz.com>",
"download_url": "https://files.pythonhosted.org/packages/53/d9/ae0280c2775e6ac2f4495055096887fe8607d629d4f83e865cb6802b9668/pytest_fluent-0.3.0.tar.gz",
"platform": "Unix",
"description": "# pytest-fluent\n\n[](https://pytest-fluent.readthedocs.io/) [](https://github.com/Rohde-Schwarz/pytest-fluent/actions/) [](https://pypi.python.org/pypi/pytest-fluent)  [](https://pypi.python.org/pypi/pytest-fluent) [](LICENSE)\n\n_pytest-fluent_ is a Python package in order to extend _pytest_ using _Fluentd_ for logging test results.\n\n## Description\n\n_pytest_ is one of the most powerful testing suites with a lot of functionality and many plugins. _Fluentd_ is a well-established log collector which is used in many modern web architectures. So, why not putting both worlds together in order to gain real-time log access to your distributed test runs?\n\n_pytest-fluent_ enables you to forward your test data immediately to your preferred log-sink from any node spread around your infrastructure. The streamed data are available for each pytest stage and formatted in JSON.\n\nEach _pytest_ session gets an unique identifier (UID) assigned as well as each executed test case. With these UIDs, you can easily filter sessions and testcase data entries, for instance in your favorite database.\n\n## Installation\n\nThe package is available at [pypi.org](https://pypi.org/project/pytest-fluent/) and can be installed by typing\n\n```shell\npip install pytest-fluent\n```\n\n## Usage\n\n_pytest-fluent-logging_ forwards meta data from _pytest_ to _Fluentd_ for further processing. The meta data are\n\n* unique session ID\n* unique test ID\n* status of the session respectively test case\n* test case name\n* test results\n* `record_property` entries\n* custom testcase information\n* custom session information\n* timestamps\n\nFurthermore, the Python logging instance can be extended in order to forward test case runtime logging:\n\n```python\nfrom logging import getLogger\n\ndef test_my_runtime_log():\n value = 1\n getLogger().info(\"Setting value to %s\", value)\n assert value == 1\n```\n\nor:\n\n```python\nfrom logging import getLogger\n\ndef test_my_runtime_log():\n value = 1\n getLogger('fluent').info(\"Setting value to %s\", value)\n assert value == 1\n```\n\n### Fixtures\n\nIn order to create your own logger, request the fixture `get_logger` as follows:\n\n```python\ndef test_my_runtime_log(get_logger):\n logger = get_logger('my.Logger')\n value = 1\n logger.info(\"Setting value to %s\", value)\n assert value == 1\n```\n\nIf you want to get the current UIDs, use the `session_uid` and `test_uid` fixtures as follows:\n\n```python\ndef test_unique_identifier(get_logger, session_uid, test_uid):\n logger = get_logger('fluent')\n logger.info(\"Session ID: %s\", session_uid)\n logger.info(\"Test ID: %s\", test_uid)\n value = 1\n assert value == 1\n```\n\n### Callbacks\n\nIf you want to add custom data to the datasets of the `pytest_sessionstart` and `pytest_runtest_logstart` stages, decorate your callback functions with the following decorators:\n\n```python\nfrom pytest_fluent import (\n additional_session_information_callback,\n additional_test_information_callback\n)\n\n@additional_session_information_callback\ndef provide_more_session_information() -> dict:\n return {\n \"more\": \"session information\"\n }\n\n@additional_test_information_callback\ndef provide_more_test_information() -> dict:\n return {\n \"more\": \"test information\"\n }\n```\n\n### _pytest_ CLI extensions\n\nThe _pytest_ CLI application can be called with the following arguments in order to configure _fluent-logging_.\n\n| argument | description | default |\n| ------------------- | ------------------------------------------------------------------------------------------------------------------------------------ | -------- |\n| --session-uuid | Use a custom externally created UUID, e.g. link a CI job with the pytest session. | |\n| --fluentd-host | Fluentd host address. If not provided, a local Fluentd instance will be called. | |\n| --fluentd-port | Fluent host port | 24224 |\n| --fluentd-tag | Set a custom Fluentd tag | 'test' |\n| --fluentd-label | Set a custom Fluentd label | 'pytest' |\n| --fluentd-timestamp | Specify a Fluentd timestamp | None |\n| --extend-logging | Extend the Python logging with a Fluent handler | False |\n| --add-docstrings | Add test docstrings to testcase call messages | |\n| --stage-settings | Use custom stage settings file. See [documentation](https://pytest-fluent.readthedocs.io/en/latest/usage.html#custom-stage-settings) | |\n\n### Ini Configuration Support\n\nDefault values of the CLI arguments for a project could also be defined in one of the following ini configuration files:\n\n1. `pytest.ini`: Arguments are defined under the `pytest` section in the file. This file takes precedence over all other configuration files even if it's empty.\n\n```python\n[pytest]\naddopts= --session-uuid=\"ac2f7600-a079-46cf-a7e0-6408b166364c\" --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='dummytest' --fluentd-label='pytest' --extend-logging\n```\n\n2. `pyproject.toml`: are considered for configuration when they contain a `tool.pytest.ini_options` section is available\n\n```python\n[tool.pytest.ini_options]\naddopts=\"--fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='test' --fluentd-label='pytest' --extend-logging\"\n```\n\n3. `tox.ini`: can also be used to hold pytest configuration if they have a [pytest] section.\n\n```python\n[pytest]\naddopts= --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='test' --fluentd-label='pytest'\n```\n\nIf the same option is specified in both CLI and _ini_ file, then CLI option would have higher priority and override the _ini_ file values.\n\n### What data are sent?\n\n_pytest-fluent_ sends any information, e.g. stage information or logging from a test case, as a single chunk. For instance, the data collection from `test_addoptions.py` test looks as following\n\n```json\n[\n {\n \"status\": \"start\",\n \"stage\": \"session\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\"\n },\n {\n \"status\": \"start\",\n \"stage\": \"testcase\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\",\n \"name\": \"test_fluentd_logged_parameters.py::test_base\"\n },\n {\n \"type\": \"logging\",\n \"host\": \"myComputer\",\n \"where\": \"test_fluentd_logged_parameters.test_base\",\n \"level\": \"INFO\",\n \"stack_trace\": \"None\",\n \"message\": \"Logged from test_base\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\",\n \"stage\": \"testcase\"\n },\n {\n \"type\": \"logging\",\n \"host\": \"myComputer\",\n \"where\": \"test_fluentd_logged_parameters.test_base\",\n \"level\": \"INFO\",\n \"stack_trace\": \"None\",\n \"message\": \"Logged from test_base\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\",\n \"stage\": \"testcase\"\n },\n {\n \"name\": \"test_fluentd_logged_parameters.py::test_base\",\n \"outcome\": \"passed\",\n \"duration\": 0.0013457999999999526,\n \"markers\": {\n \"test_base\": 1,\n \"test_fluentd_logged_parameters.py\": 1,\n \"test_fluentd_logged_parameters0\": 1\n },\n \"stage\": \"testcase\",\n \"when\": \"call\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\"\n },\n {\n \"status\": \"finish\",\n \"stage\": \"testcase\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\",\n \"name\": \"test_fluentd_logged_parameters.py::test_base\"\n },\n {\n \"status\": \"finish\",\n \"duration\": 0.00297708511352539,\n \"stage\": \"session\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\"\n }\n]\n```\n\nwhereat each object in the array is sent independently via _Fluentd_.\n\n### Specifying a timestamp\n\nTimestamps are added to the information if the ``--fluentd-timestamp`` option is enabled:\n\n```python\n[pytest]\naddopts= --session-uuid=\"ac2f7600-a079-46cf-a7e0-6408b166364c\" --fluentd-port=24224 --fluentd-host=localhost --fluentd-tag='dummytest' --fluentd-label='pytest' --fluentd-timestamp='@timestamp' --extend-logging\n```\n\nThe timestamp is added to each message. The value is in ISO 8601 format. A sample\nof the data collection from `test_addoptions.py` (as above) would look as below:\n\n```json\n[\n {\n \"status\": \"start\",\n \"stage\": \"session\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"@timestamp\": \"2022-12-25T03:00:00.000000Z\"\n },\n {\n \"status\": \"start\",\n \"stage\": \"testcase\",\n \"sessionId\": \"d8f01de3-8416-4801-9406-0ea3d5cfe3c0\",\n \"testId\": \"6b444275-4450-4eff-b5d9-8355f0f99ab0\",\n \"name\": \"test_fluentd_logged_parameters.py::test_base\",\n \"@timestamp\": \"2022-12-25T03:00:00.100000Z\"\n }\n]\n```\n\n## Changelog\n\nThe changelog.\n\n## Contributing\n\nWe welcome any contributions, enhancements, and bug-fixes. Open an [issue](https://github.com/Rohde-Schwarz/pytest-fluent/issues) on [Github](https://github.com) and [submit a pull request](https://github.com/Rohde-Schwarz/pytest-fluent/pulls).\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A pytest plugin in order to provide logs via fluentd",
"version": "0.3.0",
"project_urls": {
"project": "https://github.com/Rohde-Schwarz/pytest-fluent"
},
"split_keywords": [
"pytest",
" logging",
" fluent"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "875041fd4ffaf725a8128551f9881bb78cb46c3b47558ff680698dc6607777ec",
"md5": "d33a4c729df312f9af2c5fe97b1575e8",
"sha256": "bef742b3251fd1b7ac189cbc0b502bc290b86906932cba48e651ceb7b8fb9203"
},
"downloads": -1,
"filename": "pytest_fluent-0.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "d33a4c729df312f9af2c5fe97b1575e8",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 19066,
"upload_time": "2024-05-14T08:51:38",
"upload_time_iso_8601": "2024-05-14T08:51:38.353543Z",
"url": "https://files.pythonhosted.org/packages/87/50/41fd4ffaf725a8128551f9881bb78cb46c3b47558ff680698dc6607777ec/pytest_fluent-0.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "53d9ae0280c2775e6ac2f4495055096887fe8607d629d4f83e865cb6802b9668",
"md5": "da8fbbd155627c93b15cd7b9605e5beb",
"sha256": "3d9d9714ab20fc4f3c430e8a69e02d035ab307b4eb4f3a44e340af03dae05fd2"
},
"downloads": -1,
"filename": "pytest_fluent-0.3.0.tar.gz",
"has_sig": false,
"md5_digest": "da8fbbd155627c93b15cd7b9605e5beb",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 36114,
"upload_time": "2024-05-14T08:51:40",
"upload_time_iso_8601": "2024-05-14T08:51:40.008590Z",
"url": "https://files.pythonhosted.org/packages/53/d9/ae0280c2775e6ac2f4495055096887fe8607d629d4f83e865cb6802b9668/pytest_fluent-0.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-14 08:51:40",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Rohde-Schwarz",
"github_project": "pytest-fluent",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "pytest-fluent"
}
