heat


Nameheat JSON
Version 1.6.0 PyPI version JSON
download
home_pageNone
SummaryA framework for high-performance data analytics and machine learning.
upload_time2025-09-03 11:33:42
maintainerNone
docs_urlNone
authorNone
requires_python>=3.10
licenseNone
keywords data analytics tensors distributed gpu
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            <div align="center">
  <img src="https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/logo.png">
</div>

---

Heat is a distributed tensor framework for high performance data analytics.

# Project Status

[![CPU/CUDA/ROCm tests](https://codebase.helmholtz.cloud/helmholtz-analytics/ci/badges/heat/base/pipeline.svg)](https://codebase.helmholtz.cloud/helmholtz-analytics/ci/-/commits/heat/base)
[![Documentation Status](https://readthedocs.org/projects/heat/badge/?version=latest)](https://heat.readthedocs.io/en/latest/?badge=latest)
[![coverage](https://codecov.io/gh/helmholtz-analytics/heat/branch/main/graph/badge.svg)](https://codecov.io/gh/helmholtz-analytics/heat)
[![license: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
[![PyPI Version](https://img.shields.io/pypi/v/heat)](https://pypi.org/project/heat/)
[![Downloads](https://pepy.tech/badge/heat)](https://pepy.tech/project/heat)
[![Anaconda-Server Badge](https://anaconda.org/conda-forge/heat/badges/version.svg)](https://anaconda.org/conda-forge/heat)
[![fair-software.eu](https://img.shields.io/badge/fair--software.eu-%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F-green)](https://fair-software.eu)
[![OpenSSF Scorecard](https://api.securityscorecards.dev/projects/github.com/helmholtz-analytics/heat/badge)](https://securityscorecards.dev/viewer/?uri=github.com/helmholtz-analytics/heat)
[![OpenSSF Best Practices](https://bestpractices.coreinfrastructure.org/projects/7688/badge)](https://bestpractices.coreinfrastructure.org/projects/7688)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.2531472.svg)](https://doi.org/10.5281/zenodo.2531472)
[![Benchmarks](https://img.shields.io/badge/Grafana-Benchmarks-2ea44f)](https://57bc8d92-72f2-4869-accd-435ec06365cb.ka.bw-cloud-instance.org:3000/d/adjpqduq9r7k0a/heat-cb?orgId=1)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
[![JuRSE Code Pick of the Month](https://img.shields.io/badge/JuRSE_Code_Pick-August_2024-blue)](https://www.fz-juelich.de/en/rse/jurse-community/jurse-code-of-the-month/august-2024)

# Table of Contents
  - [What is Heat for?](#what-is-heat-for)
  - [Features](#features)
  - [Getting Started](#getting-started)
  - [Installation](#installation)
    - [Requirements](#requirements)
    - [pip](#pip)
    - [conda](#conda)
  - [Support Channels](#support-channels)
  - [Contribution guidelines](#contribution-guidelines)
    - [Resources](#resources)
  - [License](#license)
  - [Citing Heat](#citing-heat)
  - [FAQ](#faq)
  - [Acknowledgements](#acknowledgements)


# What is Heat for?

Heat builds on [PyTorch](https://pytorch.org/) and [mpi4py](https://mpi4py.readthedocs.io) to provide high-performance computing infrastructure for memory-intensive applications within the NumPy/SciPy ecosystem.


With Heat you can:
- port existing NumPy/SciPy code from single-CPU to multi-node clusters with minimal coding effort;
- exploit the entire, cumulative RAM of your many nodes for memory-intensive operations and algorithms;
- run your NumPy/SciPy code on GPUs (CUDA, ROCm, coming up: Apple MPS).

For a example that highlights the benefits of multi-node parallelism, hardware acceleration, and how easy this can be done with the help of Heat, see, e.g., our [blog post on trucated SVD of a 200GB data set](https://helmholtz-analytics.github.io/heat/2023/06/16/new-feature-hsvd.html).

Check out our [coverage tables](coverage_tables.md) to see which NumPy, SciPy, scikit-learn functions are already supported.

 If you need a functionality that is not yet supported:
  - [search existing issues](https://github.com/helmholtz-analytics/heat/issues) and make sure to leave a comment if someone else already requested it;
  - [open a new issue](https://github.com/helmholtz-analytics/heat/issues/new/choose).


Check out our [features](#features) and the [Heat API Reference](https://heat.readthedocs.io/en/latest/autoapi/index.html) for a complete list of functionalities.

# Features

* High-performance n-dimensional arrays
* CPU, GPU, and distributed computation using MPI
* Powerful data analytics and machine learning methods
* Seamless integration with the NumPy/SciPy ecosystem
* Python array API (work in progress)


# Getting Started

Go to [Quick Start](quick_start.md) for a quick overview. For more details, see [Installation](#installation).

**You can test your setup** by running the [`heat_test.py`](https://github.com/helmholtz-analytics/heat/blob/main/scripts/heat_test.py) script:

```shell
mpirun -n 2 python heat_test.py
```

It should print something like this:

```shell
x is distributed:  True
Global DNDarray x:  DNDarray([0, 1, 2, 3, 4, 5, 6, 7, 8, 9], dtype=ht.int32, device=cpu:0, split=0)
Global DNDarray x:
Local torch tensor on rank  0 :  tensor([0, 1, 2, 3, 4], dtype=torch.int32)
Local torch tensor on rank  1 :  tensor([5, 6, 7, 8, 9], dtype=torch.int32)
```

Check out our Jupyter Notebook [**Tutorials**](https://github.com/helmholtz-analytics/heat/blob/main/tutorials/), choose `local` to try things out on your machine, or `hpc` if you have access to an HPC system.

The complete documentation of the latest version is always deployed on
[Read the Docs](https://heat.readthedocs.io/).


<!-- # Goals

Heat is a flexible and seamless open-source software for high performance data
analytics and machine learning. It provides highly optimized algorithms and data structures for tensor computations using CPUs, GPUs, and distributed cluster systems on top of MPI. The goal of Heat is to fill the gap between single-node data analytics and machine learning libraries, and  high-performance computing (HPC). Heat's interface integrates seamlessly with the existing data science ecosystem and makes  writing scalable
scientific and data science applications as effortless as using NumPy.

Heat allows you to tackle your actual Big Data challenges that go beyond the
computational and memory needs of your laptop and desktop.
 -->
# Installation

## Requirements

### Basics
- python >= 3.10
- MPI (OpenMPI, MPICH, Intel MPI, etc.)
- mpi4py >= 3.0.0
- pytorch >= 2.0.0

### Parallel I/O
- h5py
- netCDF4

### GPU support
In order to do computations on your GPU(s):
- your CUDA or ROCm installation must match your hardware and its drivers;
- your [PyTorch installation](https://pytorch.org/get-started/locally/) must be compiled with CUDA/ROCm support.

### HPC systems
On most HPC-systems you will not be able to install/compile MPI or CUDA/ROCm yourself. Instead, you will most likely need to load a pre-installed MPI and/or CUDA/ROCm module from the module system. Maybe, you will even find PyTorch, h5py, or mpi4py as (part of) such a module. Note that for optimal performance on GPU, you need to usa an MPI library that has been compiled with CUDA/ROCm support (e.g., so-called "CUDA-aware MPI").


## pip
Install the latest version with

```bash
pip install heat[hdf5,netcdf]
```
where the part in brackets is a list of optional dependencies. You can omit
it, if you do not need HDF5 or NetCDF support.

## **conda**

The conda build includes all dependencies **including OpenMPI**.
```bash
 conda install -c conda-forge heat
 ```

# Support Channels

Go ahead and ask questions on [GitHub Discussions](https://github.com/helmholtz-analytics/heat/discussions). If you found a bug or are missing a feature, then please file a new [issue](https://github.com/helmholtz-analytics/heat/issues/new/choose). You can also get in touch with us on [Mattermost](https://mattermost.hzdr.de/signup_user_complete/?id=3sixwk9okpbzpjyfrhen5jpqfo) (sign up with your GitHub credentials). Once you log in, you can introduce yourself on the `Town Square` channel.


# Contribution guidelines

**We welcome contributions from the community, if you want to contribute to Heat, be sure to review the [Contribution Guidelines](contributing.md) and [Resources](#resources)  before getting started!**

We use [GitHub issues](https://github.com/helmholtz-analytics/heat/issues) for tracking requests and bugs, please see [Discussions](https://github.com/helmholtz-analytics/heat/discussions) for general questions and discussion. You can also get in touch with us on [Mattermost](https://mattermost.hzdr.de/signup_user_complete/?id=3sixwk9okpbzpjyfrhen5jpqfo) (sign up with your GitHub credentials). Once you log in, you can introduce yourself on the `Town Square` channel.

If you’re unsure where to start or how your skills fit in, reach out! You can ask us here on GitHub, by leaving a comment on a relevant issue that is already open.

**If you are new to contributing to open source, [this guide](https://opensource.guide/how-to-contribute/) helps explain why, what, and how to get involved.**


## Resources

* [Heat Tutorials](https://github.com/helmholtz-analytics/heat/tree/main/tutorials)
* [Heat API Reference](https://heat.readthedocs.io/en/latest/autoapi/index.html)

### Parallel Computing and MPI:

* David Henty's [course](https://www.archer2.ac.uk/training/courses/200514-mpi/)
* Wes Kendall's [Tutorials](https://mpitutorial.com/tutorials/)
* Rolf Rabenseifner's [MPI course material](https://www.hlrs.de/training/self-study-materials/mpi-course-material) (including C, Fortran **and** Python via `mpi4py`)

### mpi4py

* [mpi4py docs](https://mpi4py.readthedocs.io/en/stable/tutorial.html)
* [Tutorial](https://www.kth.se/blogs/pdc/2019/08/parallel-programming-in-python-mpi4py-part-1/)
# License

Heat is distributed under the MIT license, see our
[LICENSE](LICENSE) file.

# Citing Heat

<!-- If you find Heat helpful for your research, please mention it in your publications. You can cite: -->

If Heat contributed to a publication, please cite our main paper.

**Preferred Citation:**

Götz, M., Debus, C., Coquelin, D., et al. (2020). HeAT - a Distributed and GPU-accelerated Tensor Framework for Data Analytics. In *2020 IEEE International Conference on Big Data (Big Data)* (pp. 276-287). IEEE. DOI: 10.1109/BigData50022.2020.9378050.

```bibtex
@inproceedings{heat2020,
    title={{HeAT -- a Distributed and GPU-accelerated Tensor Framework for Data Analytics}},
    author={Markus Götz and Charlotte Debus and Daniel Coquelin and Kai Krajsek and Claudia Comito and Philipp Knechtges and Björn Hagemeier and Michael Tarnawa and Simon Hanselmann and Martin Siggel and Achim Basermann and Achim Streit},
    booktitle={2020 IEEE International Conference on Big Data (Big Data)},
    year={2020},
    pages={276-287},
    publisher={IEEE},
    doi={10.1109/BigData50022.2020.9378050}
}
```

### Other Relevant Publications

**For the RSE perspective and latest benchmarks:**

Hoppe, F., et al. (2025). *Engineering a large-scale data analytics and array computing library for research: Heat*. Electronic Communications of the EASST, 83.

```bibtex
@article{heat2025rse,
  title={Engineering a large-scale data analytics and array computing library for research: Heat},
  volume={83},
  url={[https://eceasst.org/index.php/eceasst/article/view/2626](https://eceasst.org/index.php/eceasst/article/view/2626)},
  DOI={10.14279/eceasst.v83.2626},
  journal={Electronic Communications of the EASST},
  author={Hoppe, Fabian and Gutiérrez Hermosillo Muriedas, Juan Pedro and Tarnawa, Michael and Knechtges, Philipp and Hagemeier, Björn and Krajsek, Kai and Rüttgers, Alexander and Götz, Markus and Comito, Claudia},
  year={2025}
}
```

**For the neural networks module (DASO):**

Coquelin, D., et al. (2022). *Accelerating neural network training with distributed asynchronous and selective optimization (DASO)*. J Big Data 9, 14.

```bibtex
@Article{DASO2022,
    author={Coquelin, Daniel and Debus, Charlotte and G{\"o}tz, Markus and von der Lehr, Fabrice and Kahn, James and Siggel, Martin and Streit, Achim},
    title={Accelerating neural network training with distributed asynchronous and selective optimization (DASO)},
    journal={Journal of Big Data},
    year={2022},
    volume={9},
    number={1},
    pages={14},
    doi={10.1186/s40537-021-00556-1}
}
```


**For specific software versions:**
Please use the [Zenodo DOI]([10.5281/zenodo.2531472](https://doi.org/10.5281/zenodo.2531472).) provided with each release.




# FAQ
Work in progress...

  <!-- - Users
  - Developers
  - Students
  - system administrators -->

## Acknowledgements

*This work is supported by the [Helmholtz Association Initiative and
Networking Fund](https://www.helmholtz.de/en/about_us/the_association/initiating_and_networking/)
under project number ZT-I-0003 and the Helmholtz AI platform grant.*

*This project has received funding from Google Summer of Code (GSoC) in 2022.*

*This work is partially carried out under a [programme](https://activities.esa.int/index.php/4000144045) of, and funded by, the European Space Agency.
Any view expressed in this repository or related publications can in no way be taken to reflect the official opinion of the European Space Agency.*

---

<div align="center">
  <a href="https://www.dlr.de/EN/Home/home_node.html"><img src="https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/dlr_logo.svg" height="50px" hspace="3%" vspace="20px"></a><a href="https://www.fz-juelich.de/portal/EN/Home/home_node.html"><img src="https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/fzj_logo.svg" height="40px" hspace="3%" vspace="20px"></a><a href="http://www.kit.edu/english/index.php"><img src="https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/kit_logo.svg" height="40px" hspace="3%" vspace="5px"></a><a href="https://www.helmholtz.de/en/"><img src="https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/helmholtz_logo.svg" height="50px" hspace="3%" vspace="5px"></a><a href="https://www.esa.int/"><img src="https://github.com/user-attachments/assets/2ee251b4-733e-44ea-8d1c-8b75928eef55" height="45px" hspace="3%" vspace="20px"></a>

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "heat",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.10",
    "maintainer_email": "Claudia Comito <c.comito@fz-juelich.de>, Michael Tarnawa <m.tarnawa@fz-juelich.de>, Fabian Hoppe <f.hoppe@dlr.de>, Juan Pedro Guti\u00e9rrez Hermosillo Muriedas <juan.muriedas@kit.edu>, Hakan Akdag <hakan.akdag@dlr.de>, Berkant Palazoglu <b.palazoglu@fz-juelich.de>",
    "keywords": "data, analytics, tensors, distributed, gpu",
    "author": null,
    "author_email": "Markus G\u00f6tz <markus.goetz@kit.edu>, Charlotte Debus <charlotte.debus@kit.edu>, Daniel Coquelin <daniel.coquelin@kit.edu>, Kai Krajsek <k.krajsek@fz-juelich.de>, Claudia Comito <c.comito@fz-juelich.de>, Philipp Knechtges <philipp.knechtges@dlr.de>, Bj\u00f6rn Hagemeier <b.hagemeier@fz-juelich.de>, Martin Siggel <martin.siggel@dlr.de>, Achim Basermann <achim.basermann@dlr.de>, Achim Streit <achim.streit@kit.de>",
    "download_url": "https://files.pythonhosted.org/packages/77/76/a1fbc6584b90816a4767eed2a7e9aa282c8264583a1cab2d70cd1a298407/heat-1.6.0.tar.gz",
    "platform": null,
    "description": "<div align=\"center\">\n  <img src=\"https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/logo.png\">\n</div>\n\n---\n\nHeat is a distributed tensor framework for high performance data analytics.\n\n# Project Status\n\n[![CPU/CUDA/ROCm tests](https://codebase.helmholtz.cloud/helmholtz-analytics/ci/badges/heat/base/pipeline.svg)](https://codebase.helmholtz.cloud/helmholtz-analytics/ci/-/commits/heat/base)\n[![Documentation Status](https://readthedocs.org/projects/heat/badge/?version=latest)](https://heat.readthedocs.io/en/latest/?badge=latest)\n[![coverage](https://codecov.io/gh/helmholtz-analytics/heat/branch/main/graph/badge.svg)](https://codecov.io/gh/helmholtz-analytics/heat)\n[![license: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)\n[![PyPI Version](https://img.shields.io/pypi/v/heat)](https://pypi.org/project/heat/)\n[![Downloads](https://pepy.tech/badge/heat)](https://pepy.tech/project/heat)\n[![Anaconda-Server Badge](https://anaconda.org/conda-forge/heat/badges/version.svg)](https://anaconda.org/conda-forge/heat)\n[![fair-software.eu](https://img.shields.io/badge/fair--software.eu-%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F%20%20%E2%97%8F-green)](https://fair-software.eu)\n[![OpenSSF Scorecard](https://api.securityscorecards.dev/projects/github.com/helmholtz-analytics/heat/badge)](https://securityscorecards.dev/viewer/?uri=github.com/helmholtz-analytics/heat)\n[![OpenSSF Best Practices](https://bestpractices.coreinfrastructure.org/projects/7688/badge)](https://bestpractices.coreinfrastructure.org/projects/7688)\n[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.2531472.svg)](https://doi.org/10.5281/zenodo.2531472)\n[![Benchmarks](https://img.shields.io/badge/Grafana-Benchmarks-2ea44f)](https://57bc8d92-72f2-4869-accd-435ec06365cb.ka.bw-cloud-instance.org:3000/d/adjpqduq9r7k0a/heat-cb?orgId=1)\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n[![JuRSE Code Pick of the Month](https://img.shields.io/badge/JuRSE_Code_Pick-August_2024-blue)](https://www.fz-juelich.de/en/rse/jurse-community/jurse-code-of-the-month/august-2024)\n\n# Table of Contents\n  - [What is Heat for?](#what-is-heat-for)\n  - [Features](#features)\n  - [Getting Started](#getting-started)\n  - [Installation](#installation)\n    - [Requirements](#requirements)\n    - [pip](#pip)\n    - [conda](#conda)\n  - [Support Channels](#support-channels)\n  - [Contribution guidelines](#contribution-guidelines)\n    - [Resources](#resources)\n  - [License](#license)\n  - [Citing Heat](#citing-heat)\n  - [FAQ](#faq)\n  - [Acknowledgements](#acknowledgements)\n\n\n# What is Heat for?\n\nHeat builds on [PyTorch](https://pytorch.org/) and [mpi4py](https://mpi4py.readthedocs.io) to provide high-performance computing infrastructure for memory-intensive applications within the NumPy/SciPy ecosystem.\n\n\nWith Heat you can:\n- port existing NumPy/SciPy code from single-CPU to multi-node clusters with minimal coding effort;\n- exploit the entire, cumulative RAM of your many nodes for memory-intensive operations and algorithms;\n- run your NumPy/SciPy code on GPUs (CUDA, ROCm, coming up: Apple MPS).\n\nFor a example that highlights the benefits of multi-node parallelism, hardware acceleration, and how easy this can be done with the help of Heat, see, e.g., our [blog post on trucated SVD of a 200GB data set](https://helmholtz-analytics.github.io/heat/2023/06/16/new-feature-hsvd.html).\n\nCheck out our [coverage tables](coverage_tables.md) to see which NumPy, SciPy, scikit-learn functions are already supported.\n\n If you need a functionality that is not yet supported:\n  - [search existing issues](https://github.com/helmholtz-analytics/heat/issues) and make sure to leave a comment if someone else already requested it;\n  - [open a new issue](https://github.com/helmholtz-analytics/heat/issues/new/choose).\n\n\nCheck out our [features](#features) and the [Heat API Reference](https://heat.readthedocs.io/en/latest/autoapi/index.html) for a complete list of functionalities.\n\n# Features\n\n* High-performance n-dimensional arrays\n* CPU, GPU, and distributed computation using MPI\n* Powerful data analytics and machine learning methods\n* Seamless integration with the NumPy/SciPy ecosystem\n* Python array API (work in progress)\n\n\n# Getting Started\n\nGo to [Quick Start](quick_start.md) for a quick overview. For more details, see [Installation](#installation).\n\n**You can test your setup** by running the [`heat_test.py`](https://github.com/helmholtz-analytics/heat/blob/main/scripts/heat_test.py) script:\n\n```shell\nmpirun -n 2 python heat_test.py\n```\n\nIt should print something like this:\n\n```shell\nx is distributed:  True\nGlobal DNDarray x:  DNDarray([0, 1, 2, 3, 4, 5, 6, 7, 8, 9], dtype=ht.int32, device=cpu:0, split=0)\nGlobal DNDarray x:\nLocal torch tensor on rank  0 :  tensor([0, 1, 2, 3, 4], dtype=torch.int32)\nLocal torch tensor on rank  1 :  tensor([5, 6, 7, 8, 9], dtype=torch.int32)\n```\n\nCheck out our Jupyter Notebook [**Tutorials**](https://github.com/helmholtz-analytics/heat/blob/main/tutorials/), choose `local` to try things out on your machine, or `hpc` if you have access to an HPC system.\n\nThe complete documentation of the latest version is always deployed on\n[Read the Docs](https://heat.readthedocs.io/).\n\n\n<!-- # Goals\n\nHeat is a flexible and seamless open-source software for high performance data\nanalytics and machine learning. It provides highly optimized algorithms and data structures for tensor computations using CPUs, GPUs, and distributed cluster systems on top of MPI. The goal of Heat is to fill the gap between single-node data analytics and machine learning libraries, and  high-performance computing (HPC). Heat's interface integrates seamlessly with the existing data science ecosystem and makes  writing scalable\nscientific and data science applications as effortless as using NumPy.\n\nHeat allows you to tackle your actual Big Data challenges that go beyond the\ncomputational and memory needs of your laptop and desktop.\n -->\n# Installation\n\n## Requirements\n\n### Basics\n- python >= 3.10\n- MPI (OpenMPI, MPICH, Intel MPI, etc.)\n- mpi4py >= 3.0.0\n- pytorch >= 2.0.0\n\n### Parallel I/O\n- h5py\n- netCDF4\n\n### GPU support\nIn order to do computations on your GPU(s):\n- your CUDA or ROCm installation must match your hardware and its drivers;\n- your [PyTorch installation](https://pytorch.org/get-started/locally/) must be compiled with CUDA/ROCm support.\n\n### HPC systems\nOn most HPC-systems you will not be able to install/compile MPI or CUDA/ROCm yourself. Instead, you will most likely need to load a pre-installed MPI and/or CUDA/ROCm module from the module system. Maybe, you will even find PyTorch, h5py, or mpi4py as (part of) such a module. Note that for optimal performance on GPU, you need to usa an MPI library that has been compiled with CUDA/ROCm support (e.g., so-called \"CUDA-aware MPI\").\n\n\n## pip\nInstall the latest version with\n\n```bash\npip install heat[hdf5,netcdf]\n```\nwhere the part in brackets is a list of optional dependencies. You can omit\nit, if you do not need HDF5 or NetCDF support.\n\n## **conda**\n\nThe conda build includes all dependencies **including OpenMPI**.\n```bash\n conda install -c conda-forge heat\n ```\n\n# Support Channels\n\nGo ahead and ask questions on [GitHub Discussions](https://github.com/helmholtz-analytics/heat/discussions). If you found a bug or are missing a feature, then please file a new [issue](https://github.com/helmholtz-analytics/heat/issues/new/choose). You can also get in touch with us on [Mattermost](https://mattermost.hzdr.de/signup_user_complete/?id=3sixwk9okpbzpjyfrhen5jpqfo) (sign up with your GitHub credentials). Once you log in, you can introduce yourself on the `Town Square` channel.\n\n\n# Contribution guidelines\n\n**We welcome contributions from the community, if you want to contribute to Heat, be sure to review the [Contribution Guidelines](contributing.md) and [Resources](#resources)  before getting started!**\n\nWe use [GitHub issues](https://github.com/helmholtz-analytics/heat/issues) for tracking requests and bugs, please see [Discussions](https://github.com/helmholtz-analytics/heat/discussions) for general questions and discussion. You can also get in touch with us on [Mattermost](https://mattermost.hzdr.de/signup_user_complete/?id=3sixwk9okpbzpjyfrhen5jpqfo) (sign up with your GitHub credentials). Once you log in, you can introduce yourself on the `Town Square` channel.\n\nIf you\u2019re unsure where to start or how your skills fit in, reach out! You can ask us here on GitHub, by leaving a comment on a relevant issue that is already open.\n\n**If you are new to contributing to open source, [this guide](https://opensource.guide/how-to-contribute/) helps explain why, what, and how to get involved.**\n\n\n## Resources\n\n* [Heat Tutorials](https://github.com/helmholtz-analytics/heat/tree/main/tutorials)\n* [Heat API Reference](https://heat.readthedocs.io/en/latest/autoapi/index.html)\n\n### Parallel Computing and MPI:\n\n* David Henty's [course](https://www.archer2.ac.uk/training/courses/200514-mpi/)\n* Wes Kendall's [Tutorials](https://mpitutorial.com/tutorials/)\n* Rolf Rabenseifner's [MPI course material](https://www.hlrs.de/training/self-study-materials/mpi-course-material) (including C, Fortran **and** Python via `mpi4py`)\n\n### mpi4py\n\n* [mpi4py docs](https://mpi4py.readthedocs.io/en/stable/tutorial.html)\n* [Tutorial](https://www.kth.se/blogs/pdc/2019/08/parallel-programming-in-python-mpi4py-part-1/)\n# License\n\nHeat is distributed under the MIT license, see our\n[LICENSE](LICENSE) file.\n\n# Citing Heat\n\n<!-- If you find Heat helpful for your research, please mention it in your publications. You can cite: -->\n\nIf Heat contributed to a publication, please cite our main paper.\n\n**Preferred Citation:**\n\nG\u00f6tz, M., Debus, C., Coquelin, D., et al. (2020). HeAT - a Distributed and GPU-accelerated Tensor Framework for Data Analytics. In *2020 IEEE International Conference on Big Data (Big Data)* (pp. 276-287). IEEE. DOI: 10.1109/BigData50022.2020.9378050.\n\n```bibtex\n@inproceedings{heat2020,\n    title={{HeAT -- a Distributed and GPU-accelerated Tensor Framework for Data Analytics}},\n    author={Markus G\u00f6tz and Charlotte Debus and Daniel Coquelin and Kai Krajsek and Claudia Comito and Philipp Knechtges and Bj\u00f6rn Hagemeier and Michael Tarnawa and Simon Hanselmann and Martin Siggel and Achim Basermann and Achim Streit},\n    booktitle={2020 IEEE International Conference on Big Data (Big Data)},\n    year={2020},\n    pages={276-287},\n    publisher={IEEE},\n    doi={10.1109/BigData50022.2020.9378050}\n}\n```\n\n### Other Relevant Publications\n\n**For the RSE perspective and latest benchmarks:**\n\nHoppe, F., et al. (2025). *Engineering a large-scale data analytics and array computing library for research: Heat*. Electronic Communications of the EASST, 83.\n\n```bibtex\n@article{heat2025rse,\n  title={Engineering a large-scale data analytics and array computing library for research: Heat},\n  volume={83},\n  url={[https://eceasst.org/index.php/eceasst/article/view/2626](https://eceasst.org/index.php/eceasst/article/view/2626)},\n  DOI={10.14279/eceasst.v83.2626},\n  journal={Electronic Communications of the EASST},\n  author={Hoppe, Fabian and Guti\u00e9rrez Hermosillo Muriedas, Juan Pedro and Tarnawa, Michael and Knechtges, Philipp and Hagemeier, Bj\u00f6rn and Krajsek, Kai and R\u00fcttgers, Alexander and G\u00f6tz, Markus and Comito, Claudia},\n  year={2025}\n}\n```\n\n**For the neural networks module (DASO):**\n\nCoquelin, D., et al. (2022). *Accelerating neural network training with distributed asynchronous and selective optimization (DASO)*. J Big Data 9, 14.\n\n```bibtex\n@Article{DASO2022,\n    author={Coquelin, Daniel and Debus, Charlotte and G{\\\"o}tz, Markus and von der Lehr, Fabrice and Kahn, James and Siggel, Martin and Streit, Achim},\n    title={Accelerating neural network training with distributed asynchronous and selective optimization (DASO)},\n    journal={Journal of Big Data},\n    year={2022},\n    volume={9},\n    number={1},\n    pages={14},\n    doi={10.1186/s40537-021-00556-1}\n}\n```\n\n\n**For specific software versions:**\nPlease use the [Zenodo DOI]([10.5281/zenodo.2531472](https://doi.org/10.5281/zenodo.2531472).) provided with each release.\n\n\n\n\n# FAQ\nWork in progress...\n\n  <!-- - Users\n  - Developers\n  - Students\n  - system administrators -->\n\n## Acknowledgements\n\n*This work is supported by the [Helmholtz Association Initiative and\nNetworking Fund](https://www.helmholtz.de/en/about_us/the_association/initiating_and_networking/)\nunder project number ZT-I-0003 and the Helmholtz AI platform grant.*\n\n*This project has received funding from Google Summer of Code (GSoC) in 2022.*\n\n*This work is partially carried out under a [programme](https://activities.esa.int/index.php/4000144045) of, and funded by, the European Space Agency.\nAny view expressed in this repository or related publications can in no way be taken to reflect the official opinion of the European Space Agency.*\n\n---\n\n<div align=\"center\">\n  <a href=\"https://www.dlr.de/EN/Home/home_node.html\"><img src=\"https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/dlr_logo.svg\" height=\"50px\" hspace=\"3%\" vspace=\"20px\"></a><a href=\"https://www.fz-juelich.de/portal/EN/Home/home_node.html\"><img src=\"https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/fzj_logo.svg\" height=\"40px\" hspace=\"3%\" vspace=\"20px\"></a><a href=\"http://www.kit.edu/english/index.php\"><img src=\"https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/kit_logo.svg\" height=\"40px\" hspace=\"3%\" vspace=\"5px\"></a><a href=\"https://www.helmholtz.de/en/\"><img src=\"https://raw.githubusercontent.com/helmholtz-analytics/heat/main/doc/source/_static/images/helmholtz_logo.svg\" height=\"50px\" hspace=\"3%\" vspace=\"5px\"></a><a href=\"https://www.esa.int/\"><img src=\"https://github.com/user-attachments/assets/2ee251b4-733e-44ea-8d1c-8b75928eef55\" height=\"45px\" hspace=\"3%\" vspace=\"20px\"></a>\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "A framework for high-performance data analytics and machine learning.",
    "version": "1.6.0",
    "project_urls": {
        "Changelog": "https://github.com/helmholtz-analytics/heat/blob/main/CHANGELOG.md",
        "Documentation": "https://heat.readthedocs.io/",
        "Homepage": "https://github.com/helmholtz-analytics/heat",
        "Issues": "https://github.com/helmholtz-analytics/heat/issues",
        "Repository": "https://github.com/helmholtz-analytics/heat"
    },
    "split_keywords": [
        "data",
        " analytics",
        " tensors",
        " distributed",
        " gpu"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "eab2f5881a10109347be62a5d26d472ec2580a55382f902a3ee6a056fe19a85f",
                "md5": "17b1fb35b864205450e8db531d5c059c",
                "sha256": "9272b06f71e6029f152ab1aba70e8867a683d3bcfccb14e90e4f2e15230cb341"
            },
            "downloads": -1,
            "filename": "heat-1.6.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "17b1fb35b864205450e8db531d5c059c",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10",
            "size": 389303,
            "upload_time": "2025-09-03T11:33:40",
            "upload_time_iso_8601": "2025-09-03T11:33:40.401569Z",
            "url": "https://files.pythonhosted.org/packages/ea/b2/f5881a10109347be62a5d26d472ec2580a55382f902a3ee6a056fe19a85f/heat-1.6.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "7776a1fbc6584b90816a4767eed2a7e9aa282c8264583a1cab2d70cd1a298407",
                "md5": "8aafcca00d7d385228bf0d6ee7273156",
                "sha256": "cd011e67c284b7f94d0f1c6ff8bf5309535fa26a895b0db2df83290c47dae55b"
            },
            "downloads": -1,
            "filename": "heat-1.6.0.tar.gz",
            "has_sig": false,
            "md5_digest": "8aafcca00d7d385228bf0d6ee7273156",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10",
            "size": 355548,
            "upload_time": "2025-09-03T11:33:42",
            "upload_time_iso_8601": "2025-09-03T11:33:42.050255Z",
            "url": "https://files.pythonhosted.org/packages/77/76/a1fbc6584b90816a4767eed2a7e9aa282c8264583a1cab2d70cd1a298407/heat-1.6.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-09-03 11:33:42",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "helmholtz-analytics",
    "github_project": "heat",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "heat"
}
        
Elapsed time: 3.14286s