# mETRICS - rEproducible sofTware peRformance analysIs in perfeCt Simplicity
[](LICENSE.md)
## Authors
- Thibault Falque - Exakis Nelite
- [Romain Wallon - CRIL, Univ Artois & CNRS](https://www.cril.univ-artois.fr/~wallon)
- [Hugues Wattez - Laboratoire d'Informatique de l'X (LIX), École Polytechnique](https://hwattez.github.io/markdown-cv/)
## About *Metrics*
*Metrics* is an open-source Python library developed at
[CRIL](http://www.cril.fr), designed to facilitate the conduction of
experiments and their analysis.
The main objective of *Metrics* is to provide a complete toolchain from
the execution of software programs to the analysis of their performance.
In particular, the development of *Metrics* started with the observation
that, in the SAT community, the process of experimenting solver remains
mostly the same: everybody collects almost the same statistics about the
solver execution.
However, there are probably as many scripts as researchers in the domain
for retrieving experimental data and drawing figures.
There is thus clearly a need for a tool that unifies and makes easier the
analysis of solver experiments.
The ambition of Metrics is thus to simplify the retrieval of experimental data
from many different kinds of inputs (including the solver's output), and
provide a nice interface for drawing commonly used plots, computing statistics
about the execution of the solver, and effortlessly organizing them.
In the end, the main purpose of Metrics is to favor the sharing and
reproducibility of experimental results and their analysis.
## Installation
To execute *Metrics* on your computer, you first need to install
[Python](https://www.python.org/downloads/) (at least version **3.8**).
You may install *Metrics* using `pip`, as the `metrics` library is
[available on PyPI](https://pypi.org/project/crillab-metrics/).
```bash
pip install crillab-metrics
```
Note that, depending on your Python installation, you may need to use `pip3`
to install it, or to execute `pip` as a module, as follows.
```bash
python3 -m pip install crillab-metrics
```
To improve the reproducibility of the experiments, we highly recommend to use
a [*virtual environment*](https://docs.python.org/3/tutorial/venv.html) for
each analysis you create with *Metrics*, and thus to install the `metrics`
library in this virtual environment rather than with a system-wide
installation.
## Using *Metrics*
You may find more information on how to use *Metrics* in the
[documentation](https://metrics.readthedocs.io) we provide for the package.
## Citing *Metrics*
If you are using *Metrics* in your papers, we kindly ask you to either refer to
this repository or to one of the following papers:
+ [*Metrics : Mission Expérimentations*.](https://hal.archives-ouvertes.fr/hal-03295285/document)
Thibault Falque, Romain Wallon and Hugues Wattez.
16es Journées Francophones de Programmation par Contraintes (JFPC'21), 2021.
+ *Metrics: Towards a Unified Library for Experimenting Solvers*.
Thibault Falque, Romain Wallon and Hugues Wattez.
11th International Workshop on Pragmatics of SAT (POS'20), 2020.
Raw data
{
"_id": null,
"home_page": "",
"name": "crillab-metrics",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": "",
"keywords": "reproducible software performance analysis",
"author": "Thibault Falque, Romain Wallon, Hugues Wattez",
"author_email": "Unknown <metrics@cril.fr>",
"download_url": "https://files.pythonhosted.org/packages/40/ea/354373b0f54f157123f225525323ec6b5692ee8730a807ef20b3a5475ad2/crillab_metrics-1.3.0.tar.gz",
"platform": null,
"description": "# mETRICS - rEproducible sofTware peRformance analysIs in perfeCt Simplicity\n\n[](LICENSE.md)\n\n\n\n\n\n\n## Authors\n\n- Thibault Falque - Exakis Nelite\n- [Romain Wallon - CRIL, Univ Artois & CNRS](https://www.cril.univ-artois.fr/~wallon) \n- [Hugues Wattez - Laboratoire d'Informatique de l'X (LIX), \u00c9cole Polytechnique](https://hwattez.github.io/markdown-cv/)\n\n## About *Metrics*\n\n*Metrics* is an open-source Python library developed at\n[CRIL](http://www.cril.fr), designed to facilitate the conduction of\nexperiments and their analysis.\n\nThe main objective of *Metrics* is to provide a complete toolchain from\nthe execution of software programs to the analysis of their performance.\nIn particular, the development of *Metrics* started with the observation\nthat, in the SAT community, the process of experimenting solver remains\nmostly the same: everybody collects almost the same statistics about the\nsolver execution.\nHowever, there are probably as many scripts as researchers in the domain\nfor retrieving experimental data and drawing figures.\nThere is thus clearly a need for a tool that unifies and makes easier the\nanalysis of solver experiments.\n\nThe ambition of Metrics is thus to simplify the retrieval of experimental data\nfrom many different kinds of inputs (including the solver's output), and\nprovide a nice interface for drawing commonly used plots, computing statistics\nabout the execution of the solver, and effortlessly organizing them.\nIn the end, the main purpose of Metrics is to favor the sharing and\nreproducibility of experimental results and their analysis.\n\n## Installation\n\nTo execute *Metrics* on your computer, you first need to install\n[Python](https://www.python.org/downloads/) (at least version **3.8**).\n\nYou may install *Metrics* using `pip`, as the `metrics` library is\n[available on PyPI](https://pypi.org/project/crillab-metrics/).\n\n```bash\npip install crillab-metrics\n```\n\nNote that, depending on your Python installation, you may need to use `pip3`\nto install it, or to execute `pip` as a module, as follows.\n\n```bash\npython3 -m pip install crillab-metrics\n```\n\nTo improve the reproducibility of the experiments, we highly recommend to use\na [*virtual environment*](https://docs.python.org/3/tutorial/venv.html) for\neach analysis you create with *Metrics*, and thus to install the `metrics`\nlibrary in this virtual environment rather than with a system-wide\ninstallation.\n\n## Using *Metrics*\n\nYou may find more information on how to use *Metrics* in the\n[documentation](https://metrics.readthedocs.io) we provide for the package.\n\n## Citing *Metrics*\n\nIf you are using *Metrics* in your papers, we kindly ask you to either refer to\nthis repository or to one of the following papers:\n\n+ [*Metrics : Mission Exp\u00e9rimentations*.](https://hal.archives-ouvertes.fr/hal-03295285/document)\n Thibault Falque, Romain Wallon and Hugues Wattez.\n 16es Journ\u00e9es Francophones de Programmation par Contraintes (JFPC'21), 2021.\n+ *Metrics: Towards a Unified Library for Experimenting Solvers*.\n Thibault Falque, Romain Wallon and Hugues Wattez.\n 11th International Workshop on Pragmatics of SAT (POS'20), 2020.\n",
"bugtrack_url": null,
"license": "LGPLv3+",
"summary": "rEproducible sofTware peRformance analysIs in perfeCt Simplicity",
"version": "1.3.0",
"project_urls": {
"Homepage": "https://github.com/crillab/metrics"
},
"split_keywords": [
"reproducible",
"software",
"performance",
"analysis"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b440ea18731fef7790f5890af753ded993174cd62f10ce2f71de622bbdca4cf7",
"md5": "ad417388935deeccaa1bc454c66cfae2",
"sha256": "a8fb9c3347f7f67c005da0c25839b989b81393d529d6cf76fb8e334fedd05014"
},
"downloads": -1,
"filename": "crillab_metrics-1.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "ad417388935deeccaa1bc454c66cfae2",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 103682,
"upload_time": "2023-06-06T12:21:31",
"upload_time_iso_8601": "2023-06-06T12:21:31.527842Z",
"url": "https://files.pythonhosted.org/packages/b4/40/ea18731fef7790f5890af753ded993174cd62f10ce2f71de622bbdca4cf7/crillab_metrics-1.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "40ea354373b0f54f157123f225525323ec6b5692ee8730a807ef20b3a5475ad2",
"md5": "96d6acf7bf4b99f59ead0aac7a2baf7e",
"sha256": "84bbd601c0dd983ec83a62ce891ae2bb6270c354fde3352170c30015359b28bb"
},
"downloads": -1,
"filename": "crillab_metrics-1.3.0.tar.gz",
"has_sig": false,
"md5_digest": "96d6acf7bf4b99f59ead0aac7a2baf7e",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 2522754,
"upload_time": "2023-06-06T12:21:33",
"upload_time_iso_8601": "2023-06-06T12:21:33.346946Z",
"url": "https://files.pythonhosted.org/packages/40/ea/354373b0f54f157123f225525323ec6b5692ee8730a807ef20b3a5475ad2/crillab_metrics-1.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-06-06 12:21:33",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "crillab",
"github_project": "metrics",
"travis_ci": true,
"coveralls": false,
"github_actions": false,
"requirements": [],
"lcname": "crillab-metrics"
}
JSON
