| Name | extrap JSON |
| Version |
4.2.1
JSON |
| download |
| home_page | https://github.com/extra-p/extrap |
| Summary | Extra-P, automated performance modeling for HPC applications |
| upload_time | 2024-07-05 16:32:26 |
| maintainer | None |
| docs_url | None |
| author | Extra-P project |
| requires_python | >=3.8 |
| license | None |
| keywords |
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# Extra-P
**Automated performance modeling for HPC applications**
[](https://badge.fury.io/py/extrap)
[](https://badge.fury.io/py/extrap)
[](https://badge.fury.io/py/extrap)
[<img alt="Screenshot of Extra-P" src="https://github.com/extra-p/extrap/raw/master/docs/images/extra-p-2d.png" height="200" align="right" title="Screenshot of Extra-P"/>](docs/images/extra-p-2d.png)
Extra-P is an automatic performance-modeling tool that supports the user in the identification of *scalability bugs*.
A scalability bug is a part of the program whose scaling behavior is unintentionally poor,
that is, much worse than expected. A performance model is a formula that expresses a performance metric of interest
such as execution time or energy consumption as a function of one or more execution parameters such as the size of the
input problem or the number of processors.
Extra-P uses measurements of various performance metrics at different execution configurations as input to generate
performance models of code regions (including their calling context) as a function of the execution parameters.
All it takes to search for scalability issues even in full-blown codes is to run a manageable number of small-scale
performance experiments, launch Extra-P, and compare the asymptotic or extrapolated performance of the worst instances
to the expectations.
Extra-P generates not only a list of potential scalability bugs but also human-readable models for all
performance metrics available such as floating-point operations or bytes sent by MPI calls that can be further
analyzed and compared to identify the root causes of scalability issues.
The following video on the Laboratory for Parallel Programming @ TUDa [YouTube](
https://www.youtube.com/@parallel_tuda) channel provides a quick introduction to Extra-P.
<a href="https://www.youtube.com/watch?v=Cv2YRCMWqBM"><img src="https://img.youtube.com/vi/Cv2YRCMWqBM/0.jpg"
alt="IMAGE ALT TEXT HERE" width="240" height="180" border="10" /></a>
Extra-P is developed by [TU Darmstadt](https://www.parallel.informatik.tu-darmstadt.de/) –
in collaboration with [ETH Zurich](https://spcl.inf.ethz.ch/).
*For questions regarding Extra-P, please send a message to <extra-p-support@lists.parallel.informatik.tu-darmstadt.de>.*
--------------------------------------------------------------------------------------------
### Table of Contents
1. [Requirements](#Requirements)
2. [Installation](#Installation)
3. [How to use it](#Usage)
4. [License](#License)
5. [Citation](#Citation)
6. [Publications](#Publications)
--------------------------------------------------------------------------------------------
### Requirements
* Python 3.8 or higher
* numpy
* pycubexr
* marshmallow
* packaging
* tqdm
* sklearn
* PySide6 (for GUI)
* matplotlib (for GUI)
* pyobjc-framework-Cocoa (only for GUI on macOS)
### Installation
Use the following command to install Extra-P and all required packages via `pip`.
```
python -m pip install extrap --upgrade
```
The `--upgrade` forces the installation of a new version if a previous version is already installed.
### Usage
Extra-P can be used in two ways, either using the command-line interface or the graphical user interface. More
information about the usage of Extra-P with both interfaces can be found in
the [quick start guide](docs/quick-start.md).
> **Note**
> Extra-P is designed for weak-scaling, therefore, directly modeling of strong-scaling behaviour is not supported.
> Instead of modeling the runtime of your strong-scaling experiment, you can model the resource consumption, i.e.,
> the runtime *times* the number of processors. Extra-P automatically offers this conversion, if it detects that
> strong-scaling data was loaded. If you are loading files that contain per-thread/per-rank data you should select
> the scaling-type upfront to run the conversion already during the import.
#### Graphical user interface
The graphical user interface can be started by executing the `extrap-gui` command.
#### Command line interface
The command line interface is available under the `extrap` command:
`extrap` _OPTIONS_ (`--cube` | `--text` | `--talpas` | `--json` | `--extra-p-3` | `--experiment`) _FILEPATH_
You can use different input formats as shown in the examples below:
* Text files: `extrap --text test/data/text/one_parameter_1.txt`
* JSON files: `extrap --json test/data/json/input_1.JSON`
* Talpas files: `extrap --talpas test/data/talpas/talpas_1.txt`
* Create model and save it to text file at the given
path: `extrap --out test.txt --text test/data/text/one_parameter_1.txt`
You can find an overview about all command line options under [docs/command-line-options.md](docs/command-line-options.md).
### License
[BSD 3-Clause "New" or "Revised" License](LICENSE)
### Citation
Please cite Extra-P in your publications if it helps your research:
@inproceedings{calotoiu_ea:2013:modeling,
author = {Calotoiu, Alexandru and Hoefler, Torsten and Poke, Marius and Wolf, Felix},
month = {November},
title = {Using Automated Performance Modeling to Find Scalability Bugs in Complex Codes},
booktitle = {Proc. of the ACM/IEEE Conference on Supercomputing (SC13), Denver, CO, USA},
year = {2013},
pages = {1--12},
publisher = {ACM},
isbn = {978-1-4503-2378-9},
doi = {10.1145/2503210.2503277}
}
### Publications
1. Alexandru Calotoiu, David Beckingsale, Christopher W. Earl, Torsten Hoefler, Ian Karlin, Martin Schulz, Felix Wolf:
Fast Multi-Parameter Performance Modeling. In Proc. of the 2016 IEEE International Conference on Cluster Computing (
CLUSTER), Taipei, Taiwan, pages 172–181, IEEE, September
2016. [PDF](https://apps.fz-juelich.de/jsc-pubsystem/aigaion/attachments/fastmultiparam.pdf-f839eba376c6d61a8c4cab9860b6b3bf.pdf)
2. Marcus Ritter, Alexandru Calotoiu, Sebastian Rinke, Thorsten Reimann, Torsten Hoefler, Felix Wolf: *Learning
Cost-Effective Sampling Strategies for Empirical Performance Modeling.* In Proc. of the 34th IEEE International
Parallel and Distributed Processing Symposium (IPDPS), New Orleans, LA, USA, pages 884–895, IEEE, May
2020. [PDF](https://apps.fz-juelich.de/jsc-pubsystem/aigaion/attachments/ritter_ea_2020_ipdps.pdf-01cbe96f7a170aba7c7ef941f966d292.pdf)
3. Marcus Ritter, Alexander Geiß, Johannes Wehrstein, Alexandru Calotoiu, Thorsten Reimann, Torsten Hoefler, Felix Wolf:
*Noise-Resilient Empirical Performance Modeling with Deep Neural Networks.* In Proc. of the 35th IEEE International
Parallel and Distributed Processing Symposium (IPDPS), Portland, Oregon, USA, pages 23–34, IEEE, May
2021. [PDF](http://htor.inf.ethz.ch/publications/img/noiseresilientmodeling.pdf)
Raw data
{
"_id": null,
"home_page": "https://github.com/extra-p/extrap",
"name": "extrap",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": null,
"author": "Extra-P project",
"author_email": "extra-p@lists.parallel.informatik.tu-darmstadt.de",
"download_url": "https://files.pythonhosted.org/packages/dd/d7/dcbf0f60139d0597d0615c25814175bcbe4c29dde7dbd7cde88998c2693f/extrap-4.2.1.tar.gz",
"platform": null,
"description": "# Extra-P\n\n**Automated performance modeling for HPC applications**\n\n[](https://badge.fury.io/py/extrap)\n\n[](https://badge.fury.io/py/extrap)\n[](https://badge.fury.io/py/extrap)\n\n\n\n\n[<img alt=\"Screenshot of Extra-P\" src=\"https://github.com/extra-p/extrap/raw/master/docs/images/extra-p-2d.png\" height=\"200\" align=\"right\" title=\"Screenshot of Extra-P\"/>](docs/images/extra-p-2d.png)\nExtra-P is an automatic performance-modeling tool that supports the user in the identification of *scalability bugs*.\nA scalability bug is a part of the program whose scaling behavior is unintentionally poor,\nthat is, much worse than expected. A performance model is a formula that expresses a performance metric of interest\nsuch as execution time or energy consumption as a function of one or more execution parameters such as the size of the\ninput problem or the number of processors.\n\nExtra-P uses measurements of various performance metrics at different execution configurations as input to generate\nperformance models of code regions (including their calling context) as a function of the execution parameters.\nAll it takes to search for scalability issues even in full-blown codes is to run a manageable number of small-scale\nperformance experiments, launch Extra-P, and compare the asymptotic or extrapolated performance of the worst instances\nto the expectations.\n\nExtra-P generates not only a list of potential scalability bugs but also human-readable models for all\nperformance metrics available such as floating-point operations or bytes sent by MPI calls that can be further\nanalyzed and compared to identify the root causes of scalability issues.\n\nThe following video on the Laboratory for Parallel Programming @ TUDa [YouTube](\nhttps://www.youtube.com/@parallel_tuda) channel provides a quick introduction to Extra-P.\n\n<a href=\"https://www.youtube.com/watch?v=Cv2YRCMWqBM\"><img src=\"https://img.youtube.com/vi/Cv2YRCMWqBM/0.jpg\"\nalt=\"IMAGE ALT TEXT HERE\" width=\"240\" height=\"180\" border=\"10\" /></a>\n\nExtra-P is developed by [TU Darmstadt](https://www.parallel.informatik.tu-darmstadt.de/) \u2013\nin collaboration with [ETH Zurich](https://spcl.inf.ethz.ch/).\n\n*For questions regarding Extra-P, please send a message to <extra-p-support@lists.parallel.informatik.tu-darmstadt.de>.*\n\n--------------------------------------------------------------------------------------------\n\n### Table of Contents\n\n1. [Requirements](#Requirements)\n2. [Installation](#Installation)\n3. [How to use it](#Usage)\n4. [License](#License)\n5. [Citation](#Citation)\n6. [Publications](#Publications)\n\n--------------------------------------------------------------------------------------------\n\n### Requirements\n\n* Python 3.8 or higher\n* numpy\n* pycubexr\n* marshmallow\n* packaging\n* tqdm\n* sklearn\n* PySide6 (for GUI)\n* matplotlib (for GUI)\n* pyobjc-framework-Cocoa (only for GUI on macOS)\n\n### Installation\n\nUse the following command to install Extra-P and all required packages via `pip`.\n\n```\npython -m pip install extrap --upgrade\n``` \n\nThe `--upgrade` forces the installation of a new version if a previous version is already installed.\n\n### Usage\n\nExtra-P can be used in two ways, either using the command-line interface or the graphical user interface. More\ninformation about the usage of Extra-P with both interfaces can be found in\nthe [quick start guide](docs/quick-start.md).\n\n> **Note** \n> Extra-P is designed for weak-scaling, therefore, directly modeling of strong-scaling behaviour is not supported.\n> Instead of modeling the runtime of your strong-scaling experiment, you can model the resource consumption, i.e.,\n> the runtime *times* the number of processors. Extra-P automatically offers this conversion, if it detects that\n> strong-scaling data was loaded. If you are loading files that contain per-thread/per-rank data you should select\n> the scaling-type upfront to run the conversion already during the import.\n\n#### Graphical user interface\n\nThe graphical user interface can be started by executing the `extrap-gui` command.\n\n#### Command line interface\n\nThe command line interface is available under the `extrap` command:\n\n`extrap` _OPTIONS_ (`--cube` | `--text` | `--talpas` | `--json` | `--extra-p-3` | `--experiment`) _FILEPATH_\n\nYou can use different input formats as shown in the examples below:\n\n* Text files: `extrap --text test/data/text/one_parameter_1.txt`\n* JSON files: `extrap --json test/data/json/input_1.JSON`\n* Talpas files: `extrap --talpas test/data/talpas/talpas_1.txt`\n* Create model and save it to text file at the given\n path: `extrap --out test.txt --text test/data/text/one_parameter_1.txt`\n\nYou can find an overview about all command line options under [docs/command-line-options.md](docs/command-line-options.md).\n\n### License\n\n[BSD 3-Clause \"New\" or \"Revised\" License](LICENSE)\n\n### Citation\n\nPlease cite Extra-P in your publications if it helps your research:\n\n @inproceedings{calotoiu_ea:2013:modeling,\n author = {Calotoiu, Alexandru and Hoefler, Torsten and Poke, Marius and Wolf, Felix},\n month = {November},\n title = {Using Automated Performance Modeling to Find Scalability Bugs in Complex Codes},\n booktitle = {Proc. of the ACM/IEEE Conference on Supercomputing (SC13), Denver, CO, USA},\n year = {2013},\n pages = {1--12},\n publisher = {ACM},\n isbn = {978-1-4503-2378-9},\n doi = {10.1145/2503210.2503277}\n }\n\n### Publications\n\n1. Alexandru Calotoiu, David Beckingsale, Christopher W. Earl, Torsten Hoefler, Ian Karlin, Martin Schulz, Felix Wolf:\n Fast Multi-Parameter Performance Modeling. In Proc. of the 2016 IEEE International Conference on Cluster Computing (\n CLUSTER), Taipei, Taiwan, pages 172\u2013181, IEEE, September\n 2016. [PDF](https://apps.fz-juelich.de/jsc-pubsystem/aigaion/attachments/fastmultiparam.pdf-f839eba376c6d61a8c4cab9860b6b3bf.pdf)\n\n2. Marcus Ritter, Alexandru Calotoiu, Sebastian Rinke, Thorsten Reimann, Torsten Hoefler, Felix Wolf: *Learning\n Cost-Effective Sampling Strategies for Empirical Performance Modeling.* In Proc. of the 34th IEEE International\n Parallel and Distributed Processing Symposium (IPDPS), New Orleans, LA, USA, pages 884\u2013895, IEEE, May\n 2020. [PDF](https://apps.fz-juelich.de/jsc-pubsystem/aigaion/attachments/ritter_ea_2020_ipdps.pdf-01cbe96f7a170aba7c7ef941f966d292.pdf)\n\n3. Marcus Ritter, Alexander Gei\u00df, Johannes Wehrstein, Alexandru Calotoiu, Thorsten Reimann, Torsten Hoefler, Felix Wolf:\n *Noise-Resilient Empirical Performance Modeling with Deep Neural Networks.* In Proc. of the 35th IEEE International\n Parallel and Distributed Processing Symposium (IPDPS), Portland, Oregon, USA, pages 23\u201334, IEEE, May\n 2021. [PDF](http://htor.inf.ethz.ch/publications/img/noiseresilientmodeling.pdf)\n",
"bugtrack_url": null,
"license": null,
"summary": "Extra-P, automated performance modeling for HPC applications",
"version": "4.2.1",
"project_urls": {
"Homepage": "https://github.com/extra-p/extrap"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "931f0a1714b71935d1629ba5d41f03f174786ba35c4c16bbbb4acf6f7c06cc67",
"md5": "f6b93f231a5207c840dd3e790376a09f",
"sha256": "8bea5287c5469ede3df3ff8ad501b9860cafc3bbc7eabb6f556bfefbd1827160"
},
"downloads": -1,
"filename": "extrap-4.2.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f6b93f231a5207c840dd3e790376a09f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 206528,
"upload_time": "2024-07-05T16:32:24",
"upload_time_iso_8601": "2024-07-05T16:32:24.717683Z",
"url": "https://files.pythonhosted.org/packages/93/1f/0a1714b71935d1629ba5d41f03f174786ba35c4c16bbbb4acf6f7c06cc67/extrap-4.2.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "ddd7dcbf0f60139d0597d0615c25814175bcbe4c29dde7dbd7cde88998c2693f",
"md5": "406c60b5fcf949d29575e37ecfab6b1a",
"sha256": "7e62ee7dab1c0b4ea489b53f05e8494819a84132a123dfae2e322275cab4a2b5"
},
"downloads": -1,
"filename": "extrap-4.2.1.tar.gz",
"has_sig": false,
"md5_digest": "406c60b5fcf949d29575e37ecfab6b1a",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 180328,
"upload_time": "2024-07-05T16:32:26",
"upload_time_iso_8601": "2024-07-05T16:32:26.538552Z",
"url": "https://files.pythonhosted.org/packages/dd/d7/dcbf0f60139d0597d0615c25814175bcbe4c29dde7dbd7cde88998c2693f/extrap-4.2.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-07-05 16:32:26",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "extra-p",
"github_project": "extrap",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "extrap"
}
