# Intel® NPU Acceleration Library
[](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/test.yml) [](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/style.yml) [](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/documentation.yml)
[](https://badge.fury.io/py/intel-npu-acceleration-library) [](https://pepy.tech/project/intel-npu-acceleration-library)
[Documentation](https://intel.github.io/intel-npu-acceleration-library/)
The Intel® NPU Acceleration Library is a Python library designed to boost the efficiency of your applications by leveraging the power of the Intel Neural Processing Unit (NPU) to perform high-speed computations on compatible hardware.
_Note: The **Intel® NPU Acceleration Library** is currently in active development, with our team working to introduce a variety of features that are anticipated to dramatically enhance performance._
## Intel NPU
The Intel NPU is an AI accelerator integrated into Intel Core Ultra processors, characterized by a unique architecture comprising compute acceleration and data transfer capabilities. Its compute acceleration is facilitated by Neural Compute Engines, which consist of hardware acceleration blocks for AI operations like Matrix Multiplication and Convolution, alongside Streaming Hybrid Architecture Vector Engines for general computing tasks.
To optimize performance, the NPU features DMA engines for efficient data transfers between system memory and a managed cache, supported by device MMU and IOMMU for security isolation. The NPU's software utilizes compiler technology to optimize AI workloads by directing compute and data flow in a tiled fashion, maximizing compute utilization primarily from scratchpad SRAM while minimizing data transfers between SRAM and DRAM for optimal performance and power efficiency.
Some useful links
- Intel AI PC ([link](https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/ai-pc.html?wapkw=NPU))
- Intel Core Ultra Processor line ([link](https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/core-ultra-series-1-product-brief.html?wapkw=NPU))
- AI Acceleration and NPU explained ([video](https://www.youtube.com/watch?v=QSzNoX0qplE))
## Feature roadmap
In our quest to significantly improve the library's performance, we are directing our efforts toward implementing a range of key features, including:
- [x] **8-bit quantization**
- [x] **4-bit Quantization and GPTQ**
- [x] **NPU-Native mixed precision inference**
- [x] **Float16 support**
- [ ] **BFloat16 (Brain Floating Point Format)**
- [x] **`torch.compile` support**
- [x] **LLM MLP horizontal fusion implementation**
- [x] **Static shape inference**
- [x] **MHA NPU inference**
- [ ] **NPU/GPU hetero compute**
- [ ] **Paper**
Make sure to stay updated with the project's progress as these exciting enhancements are on the horizon. External contributions are very welcomed! If you want to participate in this library development, please check the [Contributing](CONTRIBUTING.md) guide, the [developer guide](https://intel.github.io/intel-npu-acceleration-library/developer.html) and the list of open [issues](https://github.com/intel/intel-npu-acceleration-library/issues)
## Setup
Check that your system has an available NPU ([how-to](https://www.intel.com/content/www/us/en/support/articles/000097597/processors.html)).
You can install the packet in your machine with
```bash
pip install intel-npu-acceleration-library
```
You can also install the package on Windows and Linux from source by typing
```bash
pip install "intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git"
```
To build the package you need a compiler in your system (Visual Studio 2019 suggested for Windows build). MacOS is not yet supported. At the moment only Ubuntu OS is supported for Linux build. If you need a library for your specific OS, please open an [issue](https://github.com/intel/intel-npu-acceleration-library/issues)
The library is intended to be used with Intel Core Ultra processors, which have an integrated `NPU` (Neural Processing Unit). For best performance please install/update the NPU drivers to the latest version. ([Windows](https://www.intel.com/content/www/us/en/download/794734/intel-npu-driver-windows.html), [Linux](https://github.com/intel/linux-npu-driver)).
## Usage
For implemented examples, please check the `examples` folder
### Run a single MatMul in the NPU
```python
from intel_npu_acceleration_library.backend import MatMul
import numpy as np
inC, outC, batch = ... # Define your own values
# Create both inputs
X1 = np.random.uniform(-1, 1, (batch, inC)).astype(np.float16)
X2 = np.random.uniform(-1, 1, (outC, inC)).astype(np.float16)
mm = MatMul(inC, outC, batch, profile=False)
result = mm.run(X1, X2)
```
### Compile a model for the NPU
If you have `pytorch`>=2.0.0 installed you can use torch compile to optimize your model for the NPU
```python
import intel_npu_acceleration_library
import torch
# Compile model for the NPU
# model a torch.nn.Module class. Model can be quantized JIT
optimized_model = torch.compile(model, backend="npu")
# Use the model as usual
```
In windows torch.compile is not supported yet. So you might want to use the explicit function `intel_npu_acceleration_library.compile`. This is true also if you use a `pytorch` version < 2.0.0
```python
import intel_npu_acceleration_library
optimized_model = intel_npu_acceleration_library.compile(model, dtype=torch.int8)
# Use the model as usual
```
### Run a Tiny-llama model on the NPU
```python
from transformers import AutoTokenizer, TextStreamer
from intel_npu_acceleration_library import NPUModelForCausalLM
import torch
model_id = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
model = NPUModelForCausalLM.from_pretrained(model_id, use_cache=True, dtype=torch.int8).eval()
tokenizer = AutoTokenizer.from_pretrained(model_id, use_default_system_prompt=True)
tokenizer.pad_token_id = tokenizer.eos_token_id
streamer = TextStreamer(tokenizer, skip_special_tokens=True)
query = input("Ask something: ")
prefix = tokenizer(query, return_tensors="pt")["input_ids"]
generation_kwargs = dict(
input_ids=prefix,
streamer=streamer,
do_sample=True,
top_k=50,
top_p=0.9,
max_new_tokens=512,
)
print("Run inference")
_ = model.generate(**generation_kwargs)
```
Raw data
{
"_id": null,
"home_page": "https://github.com/intel/intel-npu-acceleration-library",
"name": "intel-npu-acceleration-library",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "intel-npu-acceleration-library, machine learning, llm, intel core ultra",
"author": "Alessandro Palla",
"author_email": "alessandro.palla@intel.com",
"download_url": "https://files.pythonhosted.org/packages/d1/a9/8ed16d003fdec94177f334d525b5204eb9818d329f29bf5d5a2af4a582b2/intel_npu_acceleration_library-1.3.0.tar.gz",
"platform": null,
"description": "# Intel\u00ae NPU Acceleration Library\r\n\r\n[](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/test.yml) [](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/style.yml) [](https://github.com/intel/intel-npu-acceleration-library/actions/workflows/documentation.yml)\r\n\r\n[](https://badge.fury.io/py/intel-npu-acceleration-library) [](https://pepy.tech/project/intel-npu-acceleration-library)\r\n\r\n[Documentation](https://intel.github.io/intel-npu-acceleration-library/)\r\n\r\nThe Intel\u00ae NPU Acceleration Library is a Python library designed to boost the efficiency of your applications by leveraging the power of the Intel Neural Processing Unit (NPU) to perform high-speed computations on compatible hardware.\r\n\r\n_Note: The **Intel\u00ae NPU Acceleration Library** is currently in active development, with our team working to introduce a variety of features that are anticipated to dramatically enhance performance._\r\n\r\n## Intel NPU\r\n\r\nThe Intel NPU is an AI accelerator integrated into Intel Core Ultra processors, characterized by a unique architecture comprising compute acceleration and data transfer capabilities. Its compute acceleration is facilitated by Neural Compute Engines, which consist of hardware acceleration blocks for AI operations like Matrix Multiplication and Convolution, alongside Streaming Hybrid Architecture Vector Engines for general computing tasks.\r\n\r\nTo optimize performance, the NPU features DMA engines for efficient data transfers between system memory and a managed cache, supported by device MMU and IOMMU for security isolation. The NPU's software utilizes compiler technology to optimize AI workloads by directing compute and data flow in a tiled fashion, maximizing compute utilization primarily from scratchpad SRAM while minimizing data transfers between SRAM and DRAM for optimal performance and power efficiency.\r\n\r\nSome useful links\r\n\r\n- Intel AI PC ([link](https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/ai-pc.html?wapkw=NPU))\r\n- Intel Core Ultra Processor line ([link](https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/core-ultra-series-1-product-brief.html?wapkw=NPU))\r\n- AI Acceleration and NPU explained ([video](https://www.youtube.com/watch?v=QSzNoX0qplE))\r\n\r\n## Feature roadmap\r\n\r\nIn our quest to significantly improve the library's performance, we are directing our efforts toward implementing a range of key features, including:\r\n\r\n- [x] **8-bit quantization**\r\n- [x] **4-bit Quantization and GPTQ**\r\n- [x] **NPU-Native mixed precision inference**\r\n- [x] **Float16 support**\r\n- [ ] **BFloat16 (Brain Floating Point Format)**\r\n- [x] **`torch.compile` support**\r\n- [x] **LLM MLP horizontal fusion implementation**\r\n- [x] **Static shape inference**\r\n- [x] **MHA NPU inference**\r\n- [ ] **NPU/GPU hetero compute**\r\n- [ ] **Paper**\r\n\r\nMake sure to stay updated with the project's progress as these exciting enhancements are on the horizon. External contributions are very welcomed! If you want to participate in this library development, please check the [Contributing](CONTRIBUTING.md) guide, the [developer guide](https://intel.github.io/intel-npu-acceleration-library/developer.html) and the list of open [issues](https://github.com/intel/intel-npu-acceleration-library/issues)\r\n\r\n## Setup\r\n\r\nCheck that your system has an available NPU ([how-to](https://www.intel.com/content/www/us/en/support/articles/000097597/processors.html)).\r\n\r\nYou can install the packet in your machine with\r\n\r\n```bash\r\n pip install intel-npu-acceleration-library\r\n```\r\n\r\nYou can also install the package on Windows and Linux from source by typing\r\n\r\n```bash\r\npip install \"intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git\"\r\n```\r\n\r\nTo build the package you need a compiler in your system (Visual Studio 2019 suggested for Windows build). MacOS is not yet supported. At the moment only Ubuntu OS is supported for Linux build. If you need a library for your specific OS, please open an [issue](https://github.com/intel/intel-npu-acceleration-library/issues)\r\n\r\nThe library is intended to be used with Intel Core Ultra processors, which have an integrated `NPU` (Neural Processing Unit). For best performance please install/update the NPU drivers to the latest version. ([Windows](https://www.intel.com/content/www/us/en/download/794734/intel-npu-driver-windows.html), [Linux](https://github.com/intel/linux-npu-driver)).\r\n\r\n## Usage\r\n\r\nFor implemented examples, please check the `examples` folder\r\n\r\n### Run a single MatMul in the NPU\r\n\r\n```python\r\nfrom intel_npu_acceleration_library.backend import MatMul\r\nimport numpy as np\r\n\r\ninC, outC, batch = ... # Define your own values\r\n\r\n# Create both inputs\r\nX1 = np.random.uniform(-1, 1, (batch, inC)).astype(np.float16)\r\nX2 = np.random.uniform(-1, 1, (outC, inC)).astype(np.float16)\r\n\r\nmm = MatMul(inC, outC, batch, profile=False)\r\n\r\nresult = mm.run(X1, X2)\r\n\r\n```\r\n\r\n### Compile a model for the NPU\r\n\r\nIf you have `pytorch`>=2.0.0 installed you can use torch compile to optimize your model for the NPU\r\n\r\n```python\r\nimport intel_npu_acceleration_library\r\nimport torch\r\n\r\n# Compile model for the NPU\r\n# model a torch.nn.Module class. Model can be quantized JIT\r\noptimized_model = torch.compile(model, backend=\"npu\")\r\n\r\n# Use the model as usual\r\n\r\n```\r\n\r\nIn windows torch.compile is not supported yet. So you might want to use the explicit function `intel_npu_acceleration_library.compile`. This is true also if you use a `pytorch` version < 2.0.0\r\n\r\n```python\r\nimport intel_npu_acceleration_library\r\noptimized_model = intel_npu_acceleration_library.compile(model, dtype=torch.int8)\r\n\r\n# Use the model as usual\r\n\r\n```\r\n\r\n### Run a Tiny-llama model on the NPU\r\n\r\n```python\r\nfrom transformers import AutoTokenizer, TextStreamer\r\nfrom intel_npu_acceleration_library import NPUModelForCausalLM\r\nimport torch\r\n\r\nmodel_id = \"TinyLlama/TinyLlama-1.1B-Chat-v1.0\"\r\n\r\nmodel = NPUModelForCausalLM.from_pretrained(model_id, use_cache=True, dtype=torch.int8).eval()\r\ntokenizer = AutoTokenizer.from_pretrained(model_id, use_default_system_prompt=True)\r\ntokenizer.pad_token_id = tokenizer.eos_token_id\r\nstreamer = TextStreamer(tokenizer, skip_special_tokens=True)\r\n\r\n\r\nquery = input(\"Ask something: \")\r\nprefix = tokenizer(query, return_tensors=\"pt\")[\"input_ids\"]\r\n\r\n\r\ngeneration_kwargs = dict(\r\n input_ids=prefix,\r\n streamer=streamer,\r\n do_sample=True,\r\n top_k=50,\r\n top_p=0.9,\r\n max_new_tokens=512,\r\n)\r\n\r\nprint(\"Run inference\")\r\n_ = model.generate(**generation_kwargs)\r\n\r\n```\r\n",
"bugtrack_url": null,
"license": "Apache License 2.0",
"summary": "Intel\u00ae NPU Acceleration Library",
"version": "1.3.0",
"project_urls": {
"Homepage": "https://github.com/intel/intel-npu-acceleration-library"
},
"split_keywords": [
"intel-npu-acceleration-library",
" machine learning",
" llm",
" intel core ultra"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "0d1f83abf7086f5055d8dc6177c98e8f671600a3866f47fdd5baaee3ac801029",
"md5": "b2e8931ec0695d16885522b5e255ff9b",
"sha256": "02ee17980cce4c9be4e8fa5efa09a7332fb0f858caa9ba4cafb0208f4cf52d2c"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp310-cp310-win32.whl",
"has_sig": false,
"md5_digest": "b2e8931ec0695d16885522b5e255ff9b",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.8",
"size": 39722916,
"upload_time": "2024-06-26T15:18:56",
"upload_time_iso_8601": "2024-06-26T15:18:56.025285Z",
"url": "https://files.pythonhosted.org/packages/0d/1f/83abf7086f5055d8dc6177c98e8f671600a3866f47fdd5baaee3ac801029/intel_npu_acceleration_library-1.3.0-cp310-cp310-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d66e66b2750c47ade55dfa2774f1655aa822f8337a5500d39b3cf7c110c2d206",
"md5": "12ca6dc92615cbe3e27276939607cbf2",
"sha256": "12f80ce3ec6e3bd60cb50b25d5ce0dae1438ef9432f772703196368cb4b04a3a"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp310-cp310-win_amd64.whl",
"has_sig": false,
"md5_digest": "12ca6dc92615cbe3e27276939607cbf2",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.8",
"size": 39722925,
"upload_time": "2024-06-26T15:19:00",
"upload_time_iso_8601": "2024-06-26T15:19:00.413013Z",
"url": "https://files.pythonhosted.org/packages/d6/6e/66b2750c47ade55dfa2774f1655aa822f8337a5500d39b3cf7c110c2d206/intel_npu_acceleration_library-1.3.0-cp310-cp310-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "8afa5335ae0c755d6a51d4917838d98fd6a872dc4425f837edef8f929928cae0",
"md5": "d9383c25b5642d3d3fd7a9208b35e3c3",
"sha256": "ba9a269217875e04a4185fefe43650f12af14265aef299eb38d5a770e283bfe8"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp311-cp311-win32.whl",
"has_sig": false,
"md5_digest": "d9383c25b5642d3d3fd7a9208b35e3c3",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.8",
"size": 39722917,
"upload_time": "2024-06-26T15:19:04",
"upload_time_iso_8601": "2024-06-26T15:19:04.824659Z",
"url": "https://files.pythonhosted.org/packages/8a/fa/5335ae0c755d6a51d4917838d98fd6a872dc4425f837edef8f929928cae0/intel_npu_acceleration_library-1.3.0-cp311-cp311-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "22ff5e3e6fe67f95b8142236dc58aefc7aa90ce5bfbff3e3cc72d231c143d2d8",
"md5": "86c71e02bec93b53d05cb46c75458126",
"sha256": "59dabeebcd76399479d7320d3006e2172641fba8ea3ea1f06cf2fe78ed7de868"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp311-cp311-win_amd64.whl",
"has_sig": false,
"md5_digest": "86c71e02bec93b53d05cb46c75458126",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": ">=3.8",
"size": 39722926,
"upload_time": "2024-06-26T15:19:08",
"upload_time_iso_8601": "2024-06-26T15:19:08.517030Z",
"url": "https://files.pythonhosted.org/packages/22/ff/5e3e6fe67f95b8142236dc58aefc7aa90ce5bfbff3e3cc72d231c143d2d8/intel_npu_acceleration_library-1.3.0-cp311-cp311-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "17c21aa69fe0f8b059e019bdea32cbf7ec7f8c73abb9a5e3ec78090907edbbe5",
"md5": "0690350728ec804069d17a998536e3db",
"sha256": "239df3615cf5a0e8c10840dc614d08d9815a1e61a5d9ec43dc3c76955fffb128"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp312-cp312-win32.whl",
"has_sig": false,
"md5_digest": "0690350728ec804069d17a998536e3db",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.8",
"size": 39722916,
"upload_time": "2024-06-26T15:19:13",
"upload_time_iso_8601": "2024-06-26T15:19:13.150403Z",
"url": "https://files.pythonhosted.org/packages/17/c2/1aa69fe0f8b059e019bdea32cbf7ec7f8c73abb9a5e3ec78090907edbbe5/intel_npu_acceleration_library-1.3.0-cp312-cp312-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e84800c7038023453fdeef8ed9f3c2bd958f5fe742c655ce9ebaebf97d2ab26a",
"md5": "18a45cf0f44ab9a0ffdc1a2d79824e5f",
"sha256": "c745fe51174d6ddd21212f3a09478b76a473740a8b7680f461fe1b75f3a2a998"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp312-cp312-win_amd64.whl",
"has_sig": false,
"md5_digest": "18a45cf0f44ab9a0ffdc1a2d79824e5f",
"packagetype": "bdist_wheel",
"python_version": "cp312",
"requires_python": ">=3.8",
"size": 39722926,
"upload_time": "2024-06-26T15:19:17",
"upload_time_iso_8601": "2024-06-26T15:19:17.418361Z",
"url": "https://files.pythonhosted.org/packages/e8/48/00c7038023453fdeef8ed9f3c2bd958f5fe742c655ce9ebaebf97d2ab26a/intel_npu_acceleration_library-1.3.0-cp312-cp312-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "58cef64c9ce3e33466a3538a0227b8d6033180297277e9a75306599ddb49ec69",
"md5": "a34fb567036379e0d518582095e6b76d",
"sha256": "c96d48cb3b1f6ee07d21b7d2bac75646f84c8e35ac938cec03eb9630286ae61a"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp38-cp38-win32.whl",
"has_sig": false,
"md5_digest": "a34fb567036379e0d518582095e6b76d",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 39722923,
"upload_time": "2024-06-26T15:19:22",
"upload_time_iso_8601": "2024-06-26T15:19:22.069115Z",
"url": "https://files.pythonhosted.org/packages/58/ce/f64c9ce3e33466a3538a0227b8d6033180297277e9a75306599ddb49ec69/intel_npu_acceleration_library-1.3.0-cp38-cp38-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "83d1b234623ad146f3486f13fd78e5172c28ca53a9bb74d23ca22e18d394c213",
"md5": "a413d55c9ab22c2f7af5889cf6803c72",
"sha256": "ea36ca858194ce0def7086d1bdb7538c23d52987cc79d8996297d8a876bcef08"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp38-cp38-win_amd64.whl",
"has_sig": false,
"md5_digest": "a413d55c9ab22c2f7af5889cf6803c72",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 39722920,
"upload_time": "2024-06-26T15:19:25",
"upload_time_iso_8601": "2024-06-26T15:19:25.335100Z",
"url": "https://files.pythonhosted.org/packages/83/d1/b234623ad146f3486f13fd78e5172c28ca53a9bb74d23ca22e18d394c213/intel_npu_acceleration_library-1.3.0-cp38-cp38-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "7c4b94ebb693781f5057094313de659730cf2b4c22d5e220783af80148f3f267",
"md5": "8b883cbc73ea06e4adf59c6b4e7732c6",
"sha256": "e3df4fe77cf1041cf6a725500a30b1611361577556caf072deb21382fa37410e"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp39-cp39-win32.whl",
"has_sig": false,
"md5_digest": "8b883cbc73ea06e4adf59c6b4e7732c6",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.8",
"size": 39722924,
"upload_time": "2024-06-26T15:19:28",
"upload_time_iso_8601": "2024-06-26T15:19:28.664907Z",
"url": "https://files.pythonhosted.org/packages/7c/4b/94ebb693781f5057094313de659730cf2b4c22d5e220783af80148f3f267/intel_npu_acceleration_library-1.3.0-cp39-cp39-win32.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "b5f4f0e34a0446ea233e8dde47682e71f2336561a165375c0f3d74a0aa0c804c",
"md5": "77da8fa7cf07469d3454a54f0451e153",
"sha256": "d9ef23d06b9f984bc2eb4048267033b3878f45625f99fc51d4aa16ed8436af34"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0-cp39-cp39-win_amd64.whl",
"has_sig": false,
"md5_digest": "77da8fa7cf07469d3454a54f0451e153",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": ">=3.8",
"size": 39722920,
"upload_time": "2024-06-26T15:19:32",
"upload_time_iso_8601": "2024-06-26T15:19:32.750613Z",
"url": "https://files.pythonhosted.org/packages/b5/f4/f0e34a0446ea233e8dde47682e71f2336561a165375c0f3d74a0aa0c804c/intel_npu_acceleration_library-1.3.0-cp39-cp39-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d1a98ed16d003fdec94177f334d525b5204eb9818d329f29bf5d5a2af4a582b2",
"md5": "08234e242682bf62fec238d872825eaf",
"sha256": "a6bbe15385aa4a63814d1f8489efa1f3296869d6c6d9246cc995f1421e393e80"
},
"downloads": -1,
"filename": "intel_npu_acceleration_library-1.3.0.tar.gz",
"has_sig": false,
"md5_digest": "08234e242682bf62fec238d872825eaf",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 65135,
"upload_time": "2024-06-26T15:19:36",
"upload_time_iso_8601": "2024-06-26T15:19:36.028603Z",
"url": "https://files.pythonhosted.org/packages/d1/a9/8ed16d003fdec94177f334d525b5204eb9818d329f29bf5d5a2af4a582b2/intel_npu_acceleration_library-1.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-06-26 15:19:36",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "intel",
"github_project": "intel-npu-acceleration-library",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [
{
"name": "numpy",
"specs": []
},
{
"name": "torch",
"specs": []
},
{
"name": "transformers",
"specs": [
[
">=",
"4.39.3"
]
]
},
{
"name": "neural-compressor",
"specs": []
}
],
"lcname": "intel-npu-acceleration-library"
}
JSON
