# cumm
CUda Matrix Multiply library.
[![Build Status](https://github.com/FindDefinition/cumm/workflows/build/badge.svg)](https://github.com/FindDefinition/cumm/actions?query=workflow%3Abuild)
```cumm``` is developed during learning of [CUTLASS](https://github.com/NVIDIA/cutlass), which use too much c++ template and make code unmaintainable. So I develop [pccm](https://github.com/FindDefinition/PCCM), use python as meta programming language, to replace c++ template meta programming.
Now ```pccm``` become a foundational framework of ```cumm``` and my other c++ project such as [spconv](https://github.com/traveller59/spconv).
```cumm``` also contains a python asyncio-based gemm simulator that **share same meta program** with CUDA code, enable gemm visualization and easy debug experience.
## BREAKING CHANGES
* 0.3.1: tv::DType enum value changed, this will affect all binary code of tv::Tensor user. you must recompile all code if upgrade to cumm >= 0.3.1.
## News
* Ampere feature support (by [EvernightAurora](https://github.com/EvernightAurora))
## Install
### Prebuilt
We offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for linux (manylinux).
We offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for windows 10/11.
```pip install cumm``` for CPU-only
```pip install cumm-cu102``` for CUDA 10.2
```pip install cumm-cu113``` for CUDA 11.3
```pip install cumm-cu114``` for CUDA 11.4
```pip install cumm-cu117``` for CUDA 11.7
```pip install cumm-cu120``` for CUDA 12.0
### Build from source for development (JIT, recommend for develop)
**WARNING** Use code in [tags](https://github.com/FindDefinition/cumm/releases)!!! code in main branch may contain bugs.
The c++ code will be built automatically when you change c++ code in project.
#### Linux
0. uninstall cumm installed by pip. you must ensure no "cumm" exists in ```pip list | grep cumm```
1. install build-essential, install CUDA
2. ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```git checkout tags/<tag_name>```, ```pip install -e .```
3. in python, ```import cumm``` and wait for build finish.
#### Windows
0. uninstall spconv and cumm installed by pip. you must ensure no "cumm" exists in ```pip list | grep cumm```
1. install visual studio 2019 or newer. make sure C++ development component is installed. install CUDA
2. set [powershell script execution policy](https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_execution_policies?view=powershell-7.1)
3. start a new powershell, run ```tools/msvc_setup.ps1```
4. ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```git checkout tags/<tag_name>```, ```pip install -e .```
5. in python, ```import cumm``` and wait for build finish.
### Build wheel from source
**WARNING** Use code in [tags](https://github.com/FindDefinition/cumm/releases)!!! code in main branch may contain bugs.
**WARNING**: If ```CUMM_CUDA_VERSION``` is set with a CUDA version, following steps will create a wheel named "cumm-cuxxx", not "cumm", this means you must use ```cumm-cuxxx``` in dependency of your project which depend on cumm, not ```cumm```. If ```CUMM_CUDA_VERSION``` isn't set, ```cumm``` will always built with CUDA, so the CUDA must exists in your system. The wheel name will be ```cumm``` even if it is built with cuda.
#### Linux
It's recommend to build Linux packages in [official build docker](https://github.com/FindDefinition/cumm/blob/main/.github/workflows/build.yaml). Build with CUDA support don't need a real GPU.
##### Build in Official Docker
1. select a cuda version. available: CUDA 11.1, 11.3, 11.4, 11.5, 12.0
2. (Example for CUDA 11.4) ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```docker run --rm -e PLAT=manylinux2014_x86_64 -e CUMM_CUDA_VERSION=114 -v `pwd`:/io scrin/manylinux2014-cuda:cu114-devel-1.0.0 bash -c "source /etc/bashrc && /io/tools/build-wheels.sh"```
##### Build in your environment
1. install build-essential, install CUDA
2. set env for installed cuda version. for example, ```export CUMM_CUDA_VERSION="11.4"```. If you want to build CPU-only, run ```export CUMM_CUDA_VERSION=""```. If ```CUMM_CUDA_VERSION``` isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will be ```cumm```, otherwise ```cumm-cuxxx```
3. run ```export CUMM_DISABLE_JIT="1"```
4. run ```python setup.py bdist_wheel```+```pip install dists/xxx.whl```
#### Windows 10/11
1. install visual studio 2019 or newer. make sure C++ development package is installed. install CUDA
2. set [powershell script execution policy](https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_execution_policies?view=powershell-7.1)
3. start a new powershell, run ```tools/msvc_setup.ps1```
4. set env for installed cuda version. for example, ```$Env:CUMM_CUDA_VERSION = "11.4"```. If you want to build CPU-only, run ```$Env:CUMM_CUDA_VERSION = ""```. . If ```CUMM_CUDA_VERSION``` isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will be ```cumm```, otherwise ```cumm-cuxxx```
4. run ```$Env:CUMM_DISABLE_JIT = "1"```
5. run ```python setup.py bdist_wheel```+```pip install dists/xxx.whl```
## Contributers
* [EvernightAurora](https://github.com/EvernightAurora): add ampere feature.
## Note
The work is done when the author is an employee at [Tusimple](https://www.tusimple.com/).
## LICENSE
Apache 2.0
Raw data
{
"_id": null,
"home_page": "https://github.com/FindDefinition/cumm",
"name": "cumm-cu116",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "",
"author": "Yan Yan",
"author_email": "yanyan.sub@outlook.com",
"download_url": "",
"platform": null,
"description": "\n# cumm\nCUda Matrix Multiply library.\n\n[![Build Status](https://github.com/FindDefinition/cumm/workflows/build/badge.svg)](https://github.com/FindDefinition/cumm/actions?query=workflow%3Abuild)\n\n```cumm``` is developed during learning of [CUTLASS](https://github.com/NVIDIA/cutlass), which use too much c++ template and make code unmaintainable. So I develop [pccm](https://github.com/FindDefinition/PCCM), use python as meta programming language, to replace c++ template meta programming. \nNow ```pccm``` become a foundational framework of ```cumm``` and my other c++ project such as [spconv](https://github.com/traveller59/spconv). \n```cumm``` also contains a python asyncio-based gemm simulator that **share same meta program** with CUDA code, enable gemm visualization and easy debug experience.\n\n## BREAKING CHANGES\n\n* 0.3.1: tv::DType enum value changed, this will affect all binary code of tv::Tensor user. you must recompile all code if upgrade to cumm >= 0.3.1.\n\n## News\n\n* Ampere feature support (by [EvernightAurora](https://github.com/EvernightAurora))\n\n## Install\n\n### Prebuilt\n\nWe offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for linux (manylinux).\n\nWe offer python 3.7-3.11 and cuda 10.2/11.3/11.4/11.7/12.0 prebuilt binaries for windows 10/11.\n\n```pip install cumm``` for CPU-only\n\n```pip install cumm-cu102``` for CUDA 10.2\n\n```pip install cumm-cu113``` for CUDA 11.3\n\n```pip install cumm-cu114``` for CUDA 11.4\n\n```pip install cumm-cu117``` for CUDA 11.7\n\n```pip install cumm-cu120``` for CUDA 12.0\n\n### Build from source for development (JIT, recommend for develop)\n\n**WARNING** Use code in [tags](https://github.com/FindDefinition/cumm/releases)!!! code in main branch may contain bugs.\n\nThe c++ code will be built automatically when you change c++ code in project.\n\n#### Linux\n\n0. uninstall cumm installed by pip. you must ensure no \"cumm\" exists in ```pip list | grep cumm```\n1. install build-essential, install CUDA\n2. ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```git checkout tags/<tag_name>```, ```pip install -e .```\n3. in python, ```import cumm``` and wait for build finish.\n\n#### Windows\n0. uninstall spconv and cumm installed by pip. you must ensure no \"cumm\" exists in ```pip list | grep cumm```\n1. install visual studio 2019 or newer. make sure C++ development component is installed. install CUDA\n2. set [powershell script execution policy](https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_execution_policies?view=powershell-7.1)\n3. start a new powershell, run ```tools/msvc_setup.ps1```\n4. ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```git checkout tags/<tag_name>```, ```pip install -e .```\n5. in python, ```import cumm``` and wait for build finish.\n\n### Build wheel from source \n\n**WARNING** Use code in [tags](https://github.com/FindDefinition/cumm/releases)!!! code in main branch may contain bugs.\n\n**WARNING**: If ```CUMM_CUDA_VERSION``` is set with a CUDA version, following steps will create a wheel named \"cumm-cuxxx\", not \"cumm\", this means you must use ```cumm-cuxxx``` in dependency of your project which depend on cumm, not ```cumm```. If ```CUMM_CUDA_VERSION``` isn't set, ```cumm``` will always built with CUDA, so the CUDA must exists in your system. The wheel name will be ```cumm``` even if it is built with cuda.\n\n#### Linux\n\nIt's recommend to build Linux packages in [official build docker](https://github.com/FindDefinition/cumm/blob/main/.github/workflows/build.yaml). Build with CUDA support don't need a real GPU.\n\n##### Build in Official Docker\n\n1. select a cuda version. available: CUDA 11.1, 11.3, 11.4, 11.5, 12.0\n2. (Example for CUDA 11.4) ```git clone https://github.com/FindDefinition/cumm```, ```cd ./cumm```, ```docker run --rm -e PLAT=manylinux2014_x86_64 -e CUMM_CUDA_VERSION=114 -v `pwd`:/io scrin/manylinux2014-cuda:cu114-devel-1.0.0 bash -c \"source /etc/bashrc && /io/tools/build-wheels.sh\"```\n\n##### Build in your environment\n\n1. install build-essential, install CUDA\n2. set env for installed cuda version. for example, ```export CUMM_CUDA_VERSION=\"11.4\"```. If you want to build CPU-only, run ```export CUMM_CUDA_VERSION=\"\"```. If ```CUMM_CUDA_VERSION``` isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will be ```cumm```, otherwise ```cumm-cuxxx```\n3. run ```export CUMM_DISABLE_JIT=\"1\"```\n4. run ```python setup.py bdist_wheel```+```pip install dists/xxx.whl```\n\n#### Windows 10/11\n\n1. install visual studio 2019 or newer. make sure C++ development package is installed. install CUDA\n2. set [powershell script execution policy](https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_execution_policies?view=powershell-7.1)\n3. start a new powershell, run ```tools/msvc_setup.ps1```\n4. set env for installed cuda version. for example, ```$Env:CUMM_CUDA_VERSION = \"11.4\"```. If you want to build CPU-only, run ```$Env:CUMM_CUDA_VERSION = \"\"```. . If ```CUMM_CUDA_VERSION``` isn't set, you need to ensure cuda libraries are inside OS search path, and the built wheel name will be ```cumm```, otherwise ```cumm-cuxxx```\n4. run ```$Env:CUMM_DISABLE_JIT = \"1\"```\n5. run ```python setup.py bdist_wheel```+```pip install dists/xxx.whl```\n\n## Contributers\n\n* [EvernightAurora](https://github.com/EvernightAurora): add ampere feature.\n\n## Note\nThe work is done when the author is an employee at [Tusimple](https://www.tusimple.com/).\n\n## LICENSE\n\nApache 2.0\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "CUda Matrix Multiply library",
"version": "0.5.1",
"project_urls": {
"Homepage": "https://github.com/FindDefinition/cumm"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0a89c7dfcef23ea1104a2b2215a2c550efd8b85a111022aa29ce64b0b08f3cdf",
"md5": "603a805a0da86b21e098511668f0d387",
"sha256": "22455d945f28727d2865faabb86bd3d734d85706dcb24101287245dce32714a9"
},
"downloads": -1,
"filename": "cumm_cu116-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "603a805a0da86b21e098511668f0d387",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.6",
"size": 23057625,
"upload_time": "2023-12-26T04:25:49",
"upload_time_iso_8601": "2023-12-26T04:25:49.858005Z",
"url": "https://files.pythonhosted.org/packages/0a/89/c7dfcef23ea1104a2b2215a2c550efd8b85a111022aa29ce64b0b08f3cdf/cumm_cu116-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0874c3200f4f1a8fc3589fd8f04a3b84c7d474a2339c2e8191a95b43c3765cb8",
"md5": "745ddcb823d353ec4bde988f77ffd916",
"sha256": "825212bbb63a134954c5d73aa1c1ec688ffa254f466de10b6aea1f7ca671f137"
},
"downloads": -1,
"filename": "cumm_cu116-0.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "745ddcb823d353ec4bde988f77ffd916",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.6",
"size": 23060295,
"upload_time": "2023-12-26T04:25:53",
"upload_time_iso_8601": "2023-12-26T04:25:53.327111Z",
"url": "https://files.pythonhosted.org/packages/08/74/c3200f4f1a8fc3589fd8f04a3b84c7d474a2339c2e8191a95b43c3765cb8/cumm_cu116-0.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f02c4ecce05c9bbeb1dd40363aa53b1162e737fa875187514e2fa4b1a277461d",
"md5": "9e4ae3a00c01491442a5aecbc81e0594",
"sha256": "20490a044524b33e54c4a6281175e9c4d48332bd1eea5d021294c7709b43b7b7"
},
"downloads": -1,
"filename": "cumm_cu116-0.5.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "9e4ae3a00c01491442a5aecbc81e0594",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": ">=3.6",
"size": 23049015,
"upload_time": "2023-12-26T04:25:56",
"upload_time_iso_8601": "2023-12-26T04:25:56.995510Z",
"url": "https://files.pythonhosted.org/packages/f0/2c/4ecce05c9bbeb1dd40363aa53b1162e737fa875187514e2fa4b1a277461d/cumm_cu116-0.5.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "206f3d771877b6e905bf31a905df45996c3ca866ce39249372d217801a6610d4",
"md5": "3731eee8b3912fd1f35aba9ecf7bb284",
"sha256": "87a144f89d1a37f8a00bd8c108ff06874fa9a5703a1cbca2bd3d1c2db55ac19d"
},
"downloads": -1,
"filename": "cumm_cu116-0.5.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "3731eee8b3912fd1f35aba9ecf7bb284",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.6",
"size": 23056438,
"upload_time": "2023-12-26T04:26:03",
"upload_time_iso_8601": "2023-12-26T04:26:03.225752Z",
"url": "https://files.pythonhosted.org/packages/20/6f/3d771877b6e905bf31a905df45996c3ca866ce39249372d217801a6610d4/cumm_cu116-0.5.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cd5e3419249a49f62b3b1c1c1f94644497794c6c158f9062e9b3e6db764b00c5",
"md5": "02c8b1dfaa76b5396628ff20b5dbedaa",
"sha256": "a53787c513e0a5f81a928453d48c09dfa0f6415644877520b92a8440e029cb8e"
},
"downloads": -1,
"filename": "cumm_cu116-0.5.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "02c8b1dfaa76b5396628ff20b5dbedaa",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.6",
"size": 23055959,
"upload_time": "2023-12-26T04:26:08",
"upload_time_iso_8601": "2023-12-26T04:26:08.391802Z",
"url": "https://files.pythonhosted.org/packages/cd/5e/3419249a49f62b3b1c1c1f94644497794c6c158f9062e9b3e6db764b00c5/cumm_cu116-0.5.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-12-26 04:25:49",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "FindDefinition",
"github_project": "cumm",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "cumm-cu116"
}