| Name | tsperf JSON |
| Version |
1.2.1
JSON |
| download |
| home_page | https://github.com/crate/tsperf |
| Summary | A tool to test performance of time-series databases |
| upload_time | 2024-05-20 23:02:06 |
| maintainer | None |
| docs_url | None |
| author | Crate.io |
| requires_python | >=3.8 |
| license | None |
| keywords |
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# TSPERF Time Series Database Benchmark Suite
TSPERF is a tool for evaluating and comparing the performance of time series databases,
in the spirit of TimescaleDB's Time Series Benchmark Suite (TSBS).
» [Documentation]
| [Changelog]
| [PyPI]
| [Issues]
| [Source code]
| [License]
[![CI][badge-tests]][project-tests]
[![Coverage Status][badge-coverage]][project-codecov]
[![License][badge-license]][project-license]
[![Downloads per month][badge-downloads-per-month]][project-downloads]
[![Supported Python versions][badge-python-versions]][project-pypi]
[![Status][badge-status]][project-pypi]
[![Package version][badge-package-version]][project-pypi]
## About
The `tsperf` program includes both a database workload generator, and a query
timer. That effectively spans two domains, one for writing data, and another
one for reading.
- [Data Generator]: Generate time series data and feed it into database.
Use `tsperf write --help` to explore its options.
- [Query Timer]: Probe responsiveness of database on the read path.
Use `tsperf read --help` to explore its options.
For the purpose of capacity testing, both domains try to simulate the generation and querying of
time-series data. As the program is easy to use, it provides instant reward without the need to
set up a whole data ingestion chain.
## Features
### General
* Generate random data which follows a statistical model to better reflect real world scenarios,
real world data is almost never truly random.
* The "steady load"-mode can simulate a constant load of a defined number of messages per second.
* Ready-made to deploy and scale data generators with Docker containers. In order to maximize
performance, multiple instances of the data generator can be run in parallel.
This can be achieved by [parallelizing using Kubernetes].
* Metrics are exposed for consumption by Prometheus.
### Data Generator
* Capability to [define your own schema].
* Full control on how many values will be inserted.
* Scale out to multiple clients is a core concept.
* Huge sets of data can be inserted without creating files as intermediate storage.
### Database Coverage
* CrateDB
* InfluxDB
* Microsoft SQL Server
* MongoDB
* PostgreSQL
* TimescaleDB
* Timestream
## Install
### Python package
```shell
pip install --user tsperf
```
### Docker image
```shell
alias tsperf="docker run -it --rm --network=host ghcr.io/crate/tsperf:latest tsperf"
tsperf --help
```
## Usage
Please refer to the [usage] documentation.
## Prior Art
### cr8 + mkjson
`mkjson` combined with `cr8 insert-json` makes it easy to generate random entries into a table.
See [generate data sets using mkjson] for an example how to use `cr8` together with `mkjson`.
### TSBS
The [Time Series Benchmark Suite (TSBS)] is a collection of Go programs that are used to generate
datasets and then benchmark read and write performance of various databases.
## Project Information
### Contributing
We are always happy to receive code contributions, ideas, suggestions and
problem reports from the community.
So, if you’d like to contribute you’re most welcome. Spend some time taking
a look around, locate a bug, design issue or spelling mistake and then send
us a pull request or open an issue on GitHub.
Thanks in advance for your efforts, we really appreciate any help or feedback.
### Acknowledgements
Thanks to all the contributors who helped to co-create and conceive `tsperf`
in one way or another and kudos to all authors of the foundational libraries.
### License
This project is licensed under the terms of the Apache 2.0 license.
[Data Generator]: https://tsperf.readthedocs.io/data-generator.html
[define your own schema]: https://tsperf.readthedocs.io/data-generator.html#data-generator-schemas
[generate data sets using mkjson]: https://zignar.net/2020/05/01/generating-data-sets-using-mkjson/
[parallelizing using Kubernetes]: https://tsperf.readthedocs.io/performance.html
[Query Timer]: https://tsperf.readthedocs.io/query-timer.html
[Time Series Benchmark Suite (TSBS)]: https://github.com/timescale/tsbs
[Usage]: https://tsperf.readthedocs.io/usage.html
[Changelog]: https://github.com/crate/tsperf/blob/main/CHANGES.md
[Documentation]: https://tsperf.readthedocs.io/
[Issues]: https://github.com/crate/tsperf/issues
[License]: https://github.com/crate/tsperf/blob/main/LICENSE
[PyPI]: https://pypi.org/project/tsperf/
[Source code]: https://github.com/crate/tsperf
[badge-coverage]: https://codecov.io/gh/crate/tsperf/branch/main/graph/badge.svg
[badge-downloads-per-month]: https://pepy.tech/badge/tsperf/month
[badge-license]: https://img.shields.io/github/license/crate/tsperf.svg
[badge-package-version]: https://img.shields.io/pypi/v/tsperf.svg
[badge-python-versions]: https://img.shields.io/pypi/pyversions/tsperf.svg
[badge-status]: https://img.shields.io/pypi/status/tsperf.svg
[badge-tests]: https://github.com/crate/tsperf/actions/workflows/tests.yml/badge.svg
[project-codecov]: https://codecov.io/gh/crate/tsperf
[project-downloads]: https://pepy.tech/project/tsperf/
[project-license]: https://github.com/crate/tsperf/blob/main/LICENSE
[project-pypi]: https://pypi.org/project/tsperf
[project-tests]: https://github.com/crate/tsperf/actions/workflows/tests.yml
Raw data
{
"_id": null,
"home_page": "https://github.com/crate/tsperf",
"name": "tsperf",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": "Crate.io",
"author_email": "office@crate.at",
"download_url": "https://files.pythonhosted.org/packages/62/51/20d11407825d4e385d724496df8c5091c63a03ef1cc981085188a0c28068/tsperf-1.2.1.tar.gz",
"platform": null,
"description": "# TSPERF Time Series Database Benchmark Suite\n\nTSPERF is a tool for evaluating and comparing the performance of time series databases,\nin the spirit of TimescaleDB's Time Series Benchmark Suite (TSBS). \n\n\u00bb [Documentation]\n| [Changelog]\n| [PyPI]\n| [Issues]\n| [Source code]\n| [License]\n\n\n[![CI][badge-tests]][project-tests]\n[![Coverage Status][badge-coverage]][project-codecov]\n[![License][badge-license]][project-license]\n[![Downloads per month][badge-downloads-per-month]][project-downloads]\n\n[![Supported Python versions][badge-python-versions]][project-pypi]\n[![Status][badge-status]][project-pypi]\n[![Package version][badge-package-version]][project-pypi]\n\n\n## About\n\nThe `tsperf` program includes both a database workload generator, and a query\ntimer. That effectively spans two domains, one for writing data, and another\none for reading.\n\n- [Data Generator]: Generate time series data and feed it into database.\n Use `tsperf write --help` to explore its options.\n- [Query Timer]: Probe responsiveness of database on the read path.\n Use `tsperf read --help` to explore its options.\n\nFor the purpose of capacity testing, both domains try to simulate the generation and querying of\ntime-series data. As the program is easy to use, it provides instant reward without the need to\nset up a whole data ingestion chain.\n\n\n## Features\n\n### General\n* Generate random data which follows a statistical model to better reflect real world scenarios,\n real world data is almost never truly random.\n* The \"steady load\"-mode can simulate a constant load of a defined number of messages per second.\n* Ready-made to deploy and scale data generators with Docker containers. In order to maximize\n performance, multiple instances of the data generator can be run in parallel.\n This can be achieved by [parallelizing using Kubernetes].\n* Metrics are exposed for consumption by Prometheus.\n\n### Data Generator\n* Capability to [define your own schema].\n* Full control on how many values will be inserted.\n* Scale out to multiple clients is a core concept.\n* Huge sets of data can be inserted without creating files as intermediate storage.\n\n### Database Coverage\n* CrateDB\n* InfluxDB\n* Microsoft SQL Server\n* MongoDB\n* PostgreSQL\n* TimescaleDB\n* Timestream\n\n\n## Install\n\n### Python package\n```shell\npip install --user tsperf\n```\n\n### Docker image\n```shell\nalias tsperf=\"docker run -it --rm --network=host ghcr.io/crate/tsperf:latest tsperf\"\ntsperf --help\n```\n\n## Usage\n\nPlease refer to the [usage] documentation.\n\n\n## Prior Art\n\n### cr8 + mkjson\n`mkjson` combined with `cr8 insert-json` makes it easy to generate random entries into a table.\nSee [generate data sets using mkjson] for an example how to use `cr8` together with `mkjson`.\n\n### TSBS\nThe [Time Series Benchmark Suite (TSBS)] is a collection of Go programs that are used to generate\ndatasets and then benchmark read and write performance of various databases.\n\n\n## Project Information\n\n### Contributing\nWe are always happy to receive code contributions, ideas, suggestions and\nproblem reports from the community.\n\nSo, if you\u2019d like to contribute you\u2019re most welcome. Spend some time taking\na look around, locate a bug, design issue or spelling mistake and then send\nus a pull request or open an issue on GitHub.\n\nThanks in advance for your efforts, we really appreciate any help or feedback.\n\n### Acknowledgements\nThanks to all the contributors who helped to co-create and conceive `tsperf`\nin one way or another and kudos to all authors of the foundational libraries.\n\n### License\nThis project is licensed under the terms of the Apache 2.0 license.\n\n\n[Data Generator]: https://tsperf.readthedocs.io/data-generator.html\n[define your own schema]: https://tsperf.readthedocs.io/data-generator.html#data-generator-schemas\n[generate data sets using mkjson]: https://zignar.net/2020/05/01/generating-data-sets-using-mkjson/\n[parallelizing using Kubernetes]: https://tsperf.readthedocs.io/performance.html\n[Query Timer]: https://tsperf.readthedocs.io/query-timer.html\n[Time Series Benchmark Suite (TSBS)]: https://github.com/timescale/tsbs\n[Usage]: https://tsperf.readthedocs.io/usage.html\n\n[Changelog]: https://github.com/crate/tsperf/blob/main/CHANGES.md\n[Documentation]: https://tsperf.readthedocs.io/\n[Issues]: https://github.com/crate/tsperf/issues\n[License]: https://github.com/crate/tsperf/blob/main/LICENSE\n[PyPI]: https://pypi.org/project/tsperf/\n[Source code]: https://github.com/crate/tsperf\n\n[badge-coverage]: https://codecov.io/gh/crate/tsperf/branch/main/graph/badge.svg\n[badge-downloads-per-month]: https://pepy.tech/badge/tsperf/month\n[badge-license]: https://img.shields.io/github/license/crate/tsperf.svg\n[badge-package-version]: https://img.shields.io/pypi/v/tsperf.svg\n[badge-python-versions]: https://img.shields.io/pypi/pyversions/tsperf.svg\n[badge-status]: https://img.shields.io/pypi/status/tsperf.svg\n[badge-tests]: https://github.com/crate/tsperf/actions/workflows/tests.yml/badge.svg\n[project-codecov]: https://codecov.io/gh/crate/tsperf\n[project-downloads]: https://pepy.tech/project/tsperf/\n[project-license]: https://github.com/crate/tsperf/blob/main/LICENSE\n[project-pypi]: https://pypi.org/project/tsperf\n[project-tests]: https://github.com/crate/tsperf/actions/workflows/tests.yml\n",
"bugtrack_url": null,
"license": null,
"summary": "A tool to test performance of time-series databases",
"version": "1.2.1",
"project_urls": {
"Homepage": "https://github.com/crate/tsperf"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "43d1f5cd361705208266ea6b8b109c3191bd430da91e8a62586e5862ec23a00d",
"md5": "f4e7c488fc21c9b5c518c77ae2683b57",
"sha256": "5127f487eba219cf4f8782dc3977752aaa36c60b8e5810baa48412f2355a3dc0"
},
"downloads": -1,
"filename": "tsperf-1.2.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f4e7c488fc21c9b5c518c77ae2683b57",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 93011,
"upload_time": "2024-05-20T23:02:04",
"upload_time_iso_8601": "2024-05-20T23:02:04.497363Z",
"url": "https://files.pythonhosted.org/packages/43/d1/f5cd361705208266ea6b8b109c3191bd430da91e8a62586e5862ec23a00d/tsperf-1.2.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "625120d11407825d4e385d724496df8c5091c63a03ef1cc981085188a0c28068",
"md5": "dc482997b22e3b43b11b5b032c2d124e",
"sha256": "51ec301efee6a5b28b8267647fda24552b76fc59b86f34ec545ff908a21d35f9"
},
"downloads": -1,
"filename": "tsperf-1.2.1.tar.gz",
"has_sig": false,
"md5_digest": "dc482997b22e3b43b11b5b032c2d124e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 60420,
"upload_time": "2024-05-20T23:02:06",
"upload_time_iso_8601": "2024-05-20T23:02:06.604517Z",
"url": "https://files.pythonhosted.org/packages/62/51/20d11407825d4e385d724496df8c5091c63a03ef1cc981085188a0c28068/tsperf-1.2.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-20 23:02:06",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "crate",
"github_project": "tsperf",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "tsperf"
}
