| Name | Version | Summary | date |
| ai-edge-quantizer-nightly |
0.0.1.dev20241222 |
A quantizer for advanced developers to quantize converted AI Edge models. |
2024-12-22 00:13:03 |
| gptqmodel |
1.4.5 |
A LLM quantization package with user-friendly apis. Based on GPTQ algorithm. |
2024-12-19 13:43:03 |
| nncf |
2.14.1 |
Neural Networks Compression Framework |
2024-12-19 12:29:25 |
| llmcompressor |
0.3.1 |
A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation. |
2024-12-12 13:05:51 |
| autoawq |
0.2.7.post3 |
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. |
2024-12-06 18:53:40 |
| optimum-intel |
1.21.0 |
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework to integrate third-party libraries from Hardware Partners and interface with their specific functionality. |
2024-12-06 12:25:14 |
| vector-quantize-pytorch |
1.20.11 |
Vector Quantization - Pytorch |
2024-12-03 14:16:08 |
| fedcore |
0.0.4.6 |
Federated learning core library |
2024-11-25 08:33:54 |
| autoawq-kernels |
0.0.9 |
AutoAWQ Kernels implements the AWQ kernels. |
2024-11-16 15:42:59 |
| llmcompressor-nightly |
0.3.0.20241112 |
A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation. |
2024-11-12 16:42:51 |
| friendli-model-optimizer |
0.8.0 |
Model Optimizer CLI for Friendli Engine. |
2024-10-31 08:01:55 |
| fmo-core |
0.8 |
Model Optimizer for Friendli Engine. |
2024-10-31 07:52:01 |
| optimum |
1.23.3 |
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework to integrate third-party libraries from Hardware Partners and interface with their specific functionality. |
2024-10-29 17:43:32 |
| optimum-quanto |
0.2.6 |
A pytorch quantization backend for optimum. |
2024-10-29 17:13:31 |
| owlite |
0.0.8 |
A fake package to warn the user they are not installing the correct package. |
2024-10-02 07:36:45 |
| hquant |
0.1.0 |
High quality quantization for Pillow images. |
2024-09-19 23:02:03 |
| bitlinear-pytorch |
0.5.0 |
Implementation of the BitLinear layer from: The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits |
2024-09-11 15:26:31 |
| awq-cli |
0.2.0 |
Command-line interface for AutoAWQ |
2024-08-09 08:02:27 |
| optimum-benchmark |
0.4.0 |
Optimum-Benchmark is a unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes. |
2024-07-31 08:35:53 |
| sparsezoo |
1.8.1 |
Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes |
2024-07-19 16:25:22 |