# AutoAWQ Kernels
AutoAWQ Kernels is a new package that is split up from the [main repository](https://github.com/casper-hansen/AutoAWQ) in order to avoid compilation times.
## Requirements
- Windows: Must use WSL2.
- NVIDIA:
- GPU: Must be compute capability 7.5 or higher.
- CUDA Toolkit: Must be 11.8 or higher.
- AMD:
- ROCm: Must be 5.6 or higher.
## Install
### Install from PyPi
The package is available on PyPi with CUDA 12.1.1 wheels:
```
pip install autoawq-kernels
```
### Install release wheels
For ROCm and other CUDA versions, you can use the wheels published at each [release](https://github.com/casper-hansen/AutoAWQ_kernels/releases/):
```
pip install https://github.com/casper-hansen/AutoAWQ_kernels/releases/download/v0.0.2/autoawq_kernels-0.0.2+rocm561-cp310-cp310-linux_x86_64.whl
```
### Build from source
You can also build from source:
```
git clone https://github.com/casper-hansen/AutoAWQ_kernels
cd AutoAWQ_kernels
pip install -e .
```
To build for ROCm, you need to first install the following packages `rocsparse-dev hipsparse-dev rocthrust-dev rocblas-dev hipblas-dev`.
Raw data
{
"_id": null,
"home_page": "https://github.com/casper-hansen/AutoAWQ_kernels",
"name": "autoawq-kernels",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8.0",
"maintainer_email": "",
"keywords": "awq,autoawq,quantization,transformers",
"author": "Casper Hansen",
"author_email": "",
"download_url": "",
"platform": "linux",
"description": "# AutoAWQ Kernels\n\nAutoAWQ Kernels is a new package that is split up from the [main repository](https://github.com/casper-hansen/AutoAWQ) in order to avoid compilation times.\n\n## Requirements\n\n- Windows: Must use WSL2.\n\n- NVIDIA:\n - GPU: Must be compute capability 7.5 or higher.\n - CUDA Toolkit: Must be 11.8 or higher.\n- AMD:\n - ROCm: Must be 5.6 or higher.\n\n## Install\n\n### Install from PyPi\n\nThe package is available on PyPi with CUDA 12.1.1 wheels:\n\n```\npip install autoawq-kernels\n```\n\n### Install release wheels\n\nFor ROCm and other CUDA versions, you can use the wheels published at each [release](https://github.com/casper-hansen/AutoAWQ_kernels/releases/):\n\n```\npip install https://github.com/casper-hansen/AutoAWQ_kernels/releases/download/v0.0.2/autoawq_kernels-0.0.2+rocm561-cp310-cp310-linux_x86_64.whl\n```\n\n### Build from source\nYou can also build from source:\n\n```\ngit clone https://github.com/casper-hansen/AutoAWQ_kernels\ncd AutoAWQ_kernels\npip install -e .\n```\n\nTo build for ROCm, you need to first install the following packages `rocsparse-dev hipsparse-dev rocthrust-dev rocblas-dev hipblas-dev`.\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "AutoAWQ Kernels implements the AWQ kernels.",
"version": "0.0.6",
"project_urls": {
"Homepage": "https://github.com/casper-hansen/AutoAWQ_kernels"
},
"split_keywords": [
"awq",
"autoawq",
"quantization",
"transformers"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "e94d5979a137c9a425c814f9def0ebc538b3fe4b5ada5d1fa562c40b8ac6aa85",
"md5": "79ba5f19e29876570c07518fd8f2924f",
"sha256": "e5d98d63e325ab3a51042b4aa87130bcd4d0fb9e7efc63dd4c307af3f44fcf05"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp310-cp310-manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "79ba5f19e29876570c07518fd8f2924f",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.8.0",
"size": 33364974,
"upload_time": "2024-02-24T22:42:37",
"upload_time_iso_8601": "2024-02-24T22:42:37.665061Z",
"url": "https://files.pythonhosted.org/packages/e9/4d/5979a137c9a425c814f9def0ebc538b3fe4b5ada5d1fa562c40b8ac6aa85/autoawq_kernels-0.0.6-cp310-cp310-manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "447ffbd583381e197acb0bc46e460fd4951f14dad40ee9115643c6279ff6dd77",
"md5": "7970e428224a732c80915a61287b5817",
"sha256": "06e66e079cb24cfd4f93a7a190b45f8a36e1b7d418f8dfd85553455530e336a6"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp310-cp310-win_amd64.whl",
"has_sig": false,
"md5_digest": "7970e428224a732c80915a61287b5817",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.8.0",
"size": 2404424,
"upload_time": "2024-02-24T22:42:40",
"upload_time_iso_8601": "2024-02-24T22:42:40.976365Z",
"url": "https://files.pythonhosted.org/packages/44/7f/fbd583381e197acb0bc46e460fd4951f14dad40ee9115643c6279ff6dd77/autoawq_kernels-0.0.6-cp310-cp310-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "fe0011d0059bf1cf48619f4bd10f5a93b484aeb18f65dab74876633e6265f972",
"md5": "f0463153e47cedda68229fa99e606de2",
"sha256": "eded9956bb3f3ad208ad2abde49c90ea5e17001175f2abb7edd5c9ac0156aeda"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp311-cp311-manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "f0463153e47cedda68229fa99e606de2",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.8.0",
"size": 33392577,
"upload_time": "2024-02-24T22:42:48",
"upload_time_iso_8601": "2024-02-24T22:42:48.829221Z",
"url": "https://files.pythonhosted.org/packages/fe/00/11d0059bf1cf48619f4bd10f5a93b484aeb18f65dab74876633e6265f972/autoawq_kernels-0.0.6-cp311-cp311-manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "05f59f3d42cbc4b183081bf5df2a52c0b1ad889014154e74e04571b600381341",
"md5": "51a99ef3efa62fd2061cb38d9c4f5fc6",
"sha256": "28d61e7d04a9c582a77c667351deadba61e7a6596b58a86226f52d69df18a511"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp311-cp311-win_amd64.whl",
"has_sig": false,
"md5_digest": "51a99ef3efa62fd2061cb38d9c4f5fc6",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.8.0",
"size": 2412545,
"upload_time": "2024-02-24T22:42:52",
"upload_time_iso_8601": "2024-02-24T22:42:52.636186Z",
"url": "https://files.pythonhosted.org/packages/05/f5/9f3d42cbc4b183081bf5df2a52c0b1ad889014154e74e04571b600381341/autoawq_kernels-0.0.6-cp311-cp311-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "f21461bcbf52aa00ecc59cab9a453d34808fd979d01017e00b0bea273ad4e654",
"md5": "1dd7fa23deef9dc465ebfbb40cb74828",
"sha256": "ea980771ec38a48405176ee1fcbc1afdd564b003bd73bf0e55194ed0977ee7f1"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp38-cp38-manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "1dd7fa23deef9dc465ebfbb40cb74828",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8.0",
"size": 33363271,
"upload_time": "2024-02-24T22:42:58",
"upload_time_iso_8601": "2024-02-24T22:42:58.710860Z",
"url": "https://files.pythonhosted.org/packages/f2/14/61bcbf52aa00ecc59cab9a453d34808fd979d01017e00b0bea273ad4e654/autoawq_kernels-0.0.6-cp38-cp38-manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "8f7f41d3ddbb25a4e925bd489b20a7e6063996b741901b454a173710a2c78866",
"md5": "616153c5f55893440a9fe6bf27e200a5",
"sha256": "d62ea2be677a86f07263cc48959f104d42fece9a7b16395737f39ffc46d564d6"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp38-cp38-win_amd64.whl",
"has_sig": false,
"md5_digest": "616153c5f55893440a9fe6bf27e200a5",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8.0",
"size": 2401668,
"upload_time": "2024-02-24T22:43:03",
"upload_time_iso_8601": "2024-02-24T22:43:03.030812Z",
"url": "https://files.pythonhosted.org/packages/8f/7f/41d3ddbb25a4e925bd489b20a7e6063996b741901b454a173710a2c78866/autoawq_kernels-0.0.6-cp38-cp38-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "deae0c5438b24fddaa00fee456b52c4097af47648e1d56bf1a98279885a3b1e0",
"md5": "c45b8e044c02a592534e5510b23c518c",
"sha256": "7968f69c180e12f3c9f8deb2ec560b3423009d7b4bb637f993e75eb074780993"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp39-cp39-manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "c45b8e044c02a592534e5510b23c518c",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.8.0",
"size": 33370262,
"upload_time": "2024-02-24T22:43:10",
"upload_time_iso_8601": "2024-02-24T22:43:10.459463Z",
"url": "https://files.pythonhosted.org/packages/de/ae/0c5438b24fddaa00fee456b52c4097af47648e1d56bf1a98279885a3b1e0/autoawq_kernels-0.0.6-cp39-cp39-manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9c8ffb505f1e600b93b367a637644a615856ee5eda04ffbe0003809db7e2ef36",
"md5": "8e568c54381de7e53ff3643b3e5b5597",
"sha256": "1f5777e67d2780bb87a38965a157264e8245f653608b2ce64eeffc95488dcffc"
},
"downloads": -1,
"filename": "autoawq_kernels-0.0.6-cp39-cp39-win_amd64.whl",
"has_sig": false,
"md5_digest": "8e568c54381de7e53ff3643b3e5b5597",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.8.0",
"size": 2402477,
"upload_time": "2024-02-24T22:43:12",
"upload_time_iso_8601": "2024-02-24T22:43:12.970721Z",
"url": "https://files.pythonhosted.org/packages/9c/8f/fb505f1e600b93b367a637644a615856ee5eda04ffbe0003809db7e2ef36/autoawq_kernels-0.0.6-cp39-cp39-win_amd64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-24 22:42:37",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "casper-hansen",
"github_project": "AutoAWQ_kernels",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "autoawq-kernels"
}
JSON
