# Whisper
[![Codacy Badge](https://api.codacy.com/project/badge/Grade/f00d0b65802742e29de56f3744503ab0)](https://www.codacy.com/app/graphite-project/whisper?utm_source=github.com&utm_medium=referral&utm_content=graphite-project/whisper&utm_campaign=badger)
[![Build Status](https://secure.travis-ci.org/graphite-project/whisper.png)](http://travis-ci.org/graphite-project/whisper)
[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bhttps%3A%2F%2Fgithub.com%2Fgraphite-project%2Fwhisper.svg?type=shield)](https://app.fossa.io/projects/git%2Bhttps%3A%2F%2Fgithub.com%2Fgraphite-project%2Fwhisper?ref=badge_shield)
## Overview
Whisper is one of three components within the Graphite project:
1. [Graphite-Web](https://github.com/graphite-project/graphite-web), a Django-based web application that renders graphs and dashboards
2. The [Carbon](https://github.com/graphite-project/carbon) metric processing daemons
3. The Whisper time-series database library
![Graphite Components](https://github.com/graphite-project/graphite-web/raw/master/webapp/content/img/overview.png "Graphite Components")
Whisper is a fixed-size database, similar in design and purpose to RRD (round-robin-database). It provides fast, reliable storage of numeric data over time. Whisper allows for higher resolution (seconds per point) of recent data to degrade into lower resolutions for long-term retention of historical data.
## Installation, Configuration and Usage
Please refer to the instructions at [readthedocs](http://graphite.readthedocs.org/).
## Whisper Scripts
rrd2whisper.py
--------------
Convert a rrd file into a whisper (.wsp) file.
```
Usage: rrd2whisper.py rrd_path
Options:
-h, --help show this help message and exit
--xFilesFactor=XFILESFACTOR
The xFilesFactor to use in the output file. Defaults
to the input RRD's xFilesFactor
--aggregationMethod=AGGREGATIONMETHOD
The consolidation function to fetch from on input and
aggregationMethod to set on output. One of: average,
last, max, min, avg_zero, absmax, absmin
--destinationPath=DESTINATIONPATH
Path to place created whisper file. Defaults to the
RRD file's source path.
```
whisper-create.py
-----------------
Create a new whisper database file.
```
Usage: whisper-create.py path timePerPoint:timeToStore [timePerPoint:timeToStore]*
whisper-create.py --estimate timePerPoint:timeToStore [timePerPoint:timeToStore]*
timePerPoint and timeToStore specify lengths of time, for example:
60:1440 60 seconds per datapoint, 1440 datapoints = 1 day of retention
15m:8 15 minutes per datapoint, 8 datapoints = 2 hours of retention
1h:7d 1 hour per datapoint, 7 days of retention
12h:2y 12 hours per datapoint, 2 years of retention
Options:
-h, --help show this help message and exit
--xFilesFactor=XFILESFACTOR
--aggregationMethod=AGGREGATIONMETHOD
Function to use when aggregating values (average, sum,
last, max, min, avg_zero, absmax, absmin)
--overwrite
--estimate Don't create a whisper file, estimate storage requirements based on archive definitions
```
whisper-dump.py
---------------
Dump the whole whisper file content to stdout.
```
Usage: whisper-dump.py path
Options:
-h, --help show this help message and exit
--pretty Show human-readable timestamps instead of unix times
-t TIME_FORMAT, --time-format=TIME_FORMAT
Time format to use with --pretty; see time.strftime()
-r, --raw Dump value only in the same format for whisper-update
(UTC timestamps)
```
whisper-fetch.py
----------------
Fetch all the metrics stored in a whisper file to stdout.
```
Usage: whisper-fetch.py [options] path
Options:
-h, --help show this help message and exit
--from=_FROM Unix epoch time of the beginning of your requested interval
(default: 24 hours ago)
--until=UNTIL Unix epoch time of the end of your requested interval
(default: now)
--json Output results in JSON form
--pretty Show human-readable timestamps instead of unix times
-t TIME_FORMAT, --time-format=TIME_FORMAT
Time format to use with --pretty; see time.strftime()
--drop=DROP Specify 'nulls' to drop all null values. Specify 'zeroes' to
drop all zero values. Specify 'empty' to drop both null and
zero values.
```
whisper-info.py
---------------
Dump the metadata about a whisper file to stdout.
```
Usage: whisper-info.py [options] path [field]
Options:
-h, --help show this help message and exit
--json Output results in JSON form
```
whisper-merge.py
----------------
Join two existing whisper files together.
```
Usage: whisper-merge.py [options] from_path to_path
Options:
-h, --help show this help message and exit
```
whisper-fill.py
----------------
Copies data from src in dst, if missing.
Unlike whisper-merge, don't overwrite data that's
already present in the target file, but instead, only add the missing
data (e.g. where the gaps in the target file are). Because no values
are overwritten, no data or precision gets lost. Also, unlike
whisper-merge, try to take the highest-precision archive to provide
the data, instead of the one with the largest retention.
```
Usage: whisper-fill.py [options] src_path dst_path
Options:
-h, --help show this help message and exit
```
whisper-resize.py
-----------------
Change the retention rates of an existing whisper file.
```
Usage: whisper-resize.py path timePerPoint:timeToStore [timePerPoint:timeToStore]*
timePerPoint and timeToStore specify lengths of time, for example:
60:1440 60 seconds per datapoint, 1440 datapoints = 1 day of retention
15m:8 15 minutes per datapoint, 8 datapoints = 2 hours of retention
1h:7d 1 hour per datapoint, 7 days of retention
12h:2y 12 hours per datapoint, 2 years of retention
Options:
-h, --help show this help message and exit
--xFilesFactor=XFILESFACTOR
Change the xFilesFactor
--aggregationMethod=AGGREGATIONMETHOD
Change the aggregation function (average, sum, last,
max, min, avg_zero, absmax, absmin)
--force Perform a destructive change
--newfile=NEWFILE Create a new database file without removing the
existing one
--nobackup Delete the .bak file after successful execution
--aggregate Try to aggregate the values to fit the new archive
better. Note that this will make things slower and use
more memory.
```
whisper-set-aggregation-method.py
---------------------------------
Change the aggregation method of an existing whisper file.
```
Usage: whisper-set-aggregation-method.py path <average|sum|last|max|min|avg_zero|absmax|absmin>
Options:
-h, --help show this help message and exit
```
whisper-update.py
-----------------
Update a whisper file with 1 or many values, must provide a time stamp with the value.
```
Usage: whisper-update.py [options] path timestamp:value [timestamp:value]*
Options:
-h, --help show this help message and exit
```
whisper-diff.py
---------------
Check the differences between whisper files. Use sanity check before merging.
```
Usage: whisper-diff.py [options] path_a path_b
Options:
-h, --help show this help message and exit
--summary show summary of differences
--ignore-empty skip comparison if either value is undefined
--columns print output in simple columns
--no-headers do not print column headers
--until=UNTIL Unix epoch time of the end of your requested interval
(default: now)
--json Output results in JSON form
```
## License
Whisper is licensed under version 2.0 of the Apache License. See the [LICENSE](https://github.com/graphite-project/carbon/blob/master/LICENSE) file for details.
Raw data
{
"_id": null,
"home_page": "http://graphiteapp.org/",
"name": "whisper",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "",
"author": "Chris Davis",
"author_email": "chrismd@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/b4/c3/913cdd13ef3d882fa483981378a08cd0f018fd8dd95b6bf006b9bf1cfbc9/whisper-1.1.10.tar.gz",
"platform": null,
"description": "# Whisper\n\n[![Codacy Badge](https://api.codacy.com/project/badge/Grade/f00d0b65802742e29de56f3744503ab0)](https://www.codacy.com/app/graphite-project/whisper?utm_source=github.com&utm_medium=referral&utm_content=graphite-project/whisper&utm_campaign=badger)\n[![Build Status](https://secure.travis-ci.org/graphite-project/whisper.png)](http://travis-ci.org/graphite-project/whisper)\n[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bhttps%3A%2F%2Fgithub.com%2Fgraphite-project%2Fwhisper.svg?type=shield)](https://app.fossa.io/projects/git%2Bhttps%3A%2F%2Fgithub.com%2Fgraphite-project%2Fwhisper?ref=badge_shield)\n\n## Overview\n\nWhisper is one of three components within the Graphite project:\n\n1. [Graphite-Web](https://github.com/graphite-project/graphite-web), a Django-based web application that renders graphs and dashboards\n2. The [Carbon](https://github.com/graphite-project/carbon) metric processing daemons\n3. The Whisper time-series database library\n\n![Graphite Components](https://github.com/graphite-project/graphite-web/raw/master/webapp/content/img/overview.png \"Graphite Components\")\n\nWhisper is a fixed-size database, similar in design and purpose to RRD (round-robin-database). It provides fast, reliable storage of numeric data over time. Whisper allows for higher resolution (seconds per point) of recent data to degrade into lower resolutions for long-term retention of historical data.\n\n## Installation, Configuration and Usage\n\nPlease refer to the instructions at [readthedocs](http://graphite.readthedocs.org/).\n\n## Whisper Scripts\n\nrrd2whisper.py\n--------------\nConvert a rrd file into a whisper (.wsp) file.\n\n```\nUsage: rrd2whisper.py rrd_path\n\nOptions:\n -h, --help show this help message and exit\n --xFilesFactor=XFILESFACTOR\n The xFilesFactor to use in the output file. Defaults\n to the input RRD's xFilesFactor\n --aggregationMethod=AGGREGATIONMETHOD\n The consolidation function to fetch from on input and\n aggregationMethod to set on output. One of: average,\n last, max, min, avg_zero, absmax, absmin\n --destinationPath=DESTINATIONPATH\n Path to place created whisper file. Defaults to the\n RRD file's source path.\n\n```\n\nwhisper-create.py\n-----------------\nCreate a new whisper database file.\n\n```\nUsage: whisper-create.py path timePerPoint:timeToStore [timePerPoint:timeToStore]*\n whisper-create.py --estimate timePerPoint:timeToStore [timePerPoint:timeToStore]*\n\ntimePerPoint and timeToStore specify lengths of time, for example:\n\n60:1440 60 seconds per datapoint, 1440 datapoints = 1 day of retention\n15m:8 15 minutes per datapoint, 8 datapoints = 2 hours of retention\n1h:7d 1 hour per datapoint, 7 days of retention\n12h:2y 12 hours per datapoint, 2 years of retention\n\n\nOptions:\n -h, --help show this help message and exit\n --xFilesFactor=XFILESFACTOR\n --aggregationMethod=AGGREGATIONMETHOD\n Function to use when aggregating values (average, sum,\n last, max, min, avg_zero, absmax, absmin)\n --overwrite\n --estimate Don't create a whisper file, estimate storage requirements based on archive definitions\n```\n\nwhisper-dump.py\n---------------\nDump the whole whisper file content to stdout.\n\n```\nUsage: whisper-dump.py path\n\nOptions:\n -h, --help show this help message and exit\n --pretty Show human-readable timestamps instead of unix times\n -t TIME_FORMAT, --time-format=TIME_FORMAT\n Time format to use with --pretty; see time.strftime()\n -r, --raw Dump value only in the same format for whisper-update\n (UTC timestamps)\n```\n\nwhisper-fetch.py\n----------------\nFetch all the metrics stored in a whisper file to stdout.\n\n```\nUsage: whisper-fetch.py [options] path\n\nOptions:\n -h, --help show this help message and exit\n --from=_FROM Unix epoch time of the beginning of your requested interval\n (default: 24 hours ago)\n --until=UNTIL Unix epoch time of the end of your requested interval\n (default: now)\n --json Output results in JSON form\n --pretty Show human-readable timestamps instead of unix times\n -t TIME_FORMAT, --time-format=TIME_FORMAT\n Time format to use with --pretty; see time.strftime()\n --drop=DROP Specify 'nulls' to drop all null values. Specify 'zeroes' to\n drop all zero values. Specify 'empty' to drop both null and\n zero values.\n```\n\nwhisper-info.py\n---------------\nDump the metadata about a whisper file to stdout.\n\n```\nUsage: whisper-info.py [options] path [field]\n\nOptions:\n -h, --help show this help message and exit\n --json Output results in JSON form\n```\n\nwhisper-merge.py\n----------------\nJoin two existing whisper files together.\n\n```\nUsage: whisper-merge.py [options] from_path to_path\n\nOptions:\n -h, --help show this help message and exit\n```\n\nwhisper-fill.py\n----------------\nCopies data from src in dst, if missing.\nUnlike whisper-merge, don't overwrite data that's\nalready present in the target file, but instead, only add the missing\ndata (e.g. where the gaps in the target file are). Because no values\nare overwritten, no data or precision gets lost. Also, unlike\nwhisper-merge, try to take the highest-precision archive to provide\nthe data, instead of the one with the largest retention.\n\n```\nUsage: whisper-fill.py [options] src_path dst_path\n\nOptions:\n -h, --help show this help message and exit\n```\n\nwhisper-resize.py\n-----------------\nChange the retention rates of an existing whisper file.\n\n```\nUsage: whisper-resize.py path timePerPoint:timeToStore [timePerPoint:timeToStore]*\n\ntimePerPoint and timeToStore specify lengths of time, for example:\n\n60:1440 60 seconds per datapoint, 1440 datapoints = 1 day of retention\n15m:8 15 minutes per datapoint, 8 datapoints = 2 hours of retention\n1h:7d 1 hour per datapoint, 7 days of retention\n12h:2y 12 hours per datapoint, 2 years of retention\n\n\nOptions:\n -h, --help show this help message and exit\n --xFilesFactor=XFILESFACTOR\n Change the xFilesFactor\n --aggregationMethod=AGGREGATIONMETHOD\n Change the aggregation function (average, sum, last,\n max, min, avg_zero, absmax, absmin)\n --force Perform a destructive change\n --newfile=NEWFILE Create a new database file without removing the\n existing one\n --nobackup Delete the .bak file after successful execution\n --aggregate Try to aggregate the values to fit the new archive\n better. Note that this will make things slower and use\n more memory.\n```\n\nwhisper-set-aggregation-method.py\n---------------------------------\nChange the aggregation method of an existing whisper file.\n\n```\nUsage: whisper-set-aggregation-method.py path <average|sum|last|max|min|avg_zero|absmax|absmin>\n\nOptions:\n -h, --help show this help message and exit\n```\n\nwhisper-update.py\n-----------------\nUpdate a whisper file with 1 or many values, must provide a time stamp with the value.\n\n```\nUsage: whisper-update.py [options] path timestamp:value [timestamp:value]*\n\nOptions:\n -h, --help show this help message and exit\n```\n\nwhisper-diff.py\n---------------\nCheck the differences between whisper files. Use sanity check before merging.\n\n```\nUsage: whisper-diff.py [options] path_a path_b\n\nOptions:\n -h, --help show this help message and exit\n --summary show summary of differences\n --ignore-empty skip comparison if either value is undefined\n --columns print output in simple columns\n --no-headers do not print column headers\n --until=UNTIL Unix epoch time of the end of your requested interval\n (default: now)\n --json Output results in JSON form\n```\n\n## License\n\nWhisper is licensed under version 2.0 of the Apache License. See the [LICENSE](https://github.com/graphite-project/carbon/blob/master/LICENSE) file for details.\n",
"bugtrack_url": null,
"license": "Apache Software License 2.0",
"summary": "Fixed size round-robin style database",
"version": "1.1.10",
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b4c3913cdd13ef3d882fa483981378a08cd0f018fd8dd95b6bf006b9bf1cfbc9",
"md5": "b58d43967ea86f19bdd4fa1261d350fe",
"sha256": "435b4fb843c4c752719bdf0511a652d5be710e9bb35ad9ebe3b133268ee31c44"
},
"downloads": -1,
"filename": "whisper-1.1.10.tar.gz",
"has_sig": false,
"md5_digest": "b58d43967ea86f19bdd4fa1261d350fe",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 42835,
"upload_time": "2022-05-22T18:19:54",
"upload_time_iso_8601": "2022-05-22T18:19:54.839171Z",
"url": "https://files.pythonhosted.org/packages/b4/c3/913cdd13ef3d882fa483981378a08cd0f018fd8dd95b6bf006b9bf1cfbc9/whisper-1.1.10.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2022-05-22 18:19:54",
"github": false,
"gitlab": false,
"bitbucket": false,
"lcname": "whisper"
}