mybitnet

Name	mybitnet JSON
Version	0.6.0 JSON
	download
home_page	https://note.com/hatti8/n/nc6890e79a19a
Summary	A PyTorch implementation of BitNet, a network utilizing bit quantization for linear layers.
upload_time	2024-03-31 03:31:10
maintainer	None
docs_url	None
author	Hajime Yagihara
requires_python	<4.0,>=3.6
license	Apache-2.0
keywords	pytorch bit quantization neural networks llm pretrain
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # BitNet-b158  

noteで実装を進めているBitLinear, BitLinearb158のコードとなります。  
[BitNet&BitNet b158の実装](https://note.com/hatti8/n/nc6890e79a19a)  
- `pip install mybitnet`でインストール可能です。
- `example/01_bit_llama_pretraining.ipynb`ファイルには、bitlinearを用いた事前学習の例があります。

            

Raw data

            {
    "_id": null,
    "home_page": "https://note.com/hatti8/n/nc6890e79a19a",
    "name": "mybitnet",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.6",
    "maintainer_email": null,
    "keywords": "pytorch, bit quantization, neural networks, llm, pretrain",
    "author": "Hajime Yagihara",
    "author_email": "eitiwai@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/44/de/4e2fc26b6d4d4861a1f453a90045e4feba552842c5fb0b31ad59244eaab4/mybitnet-0.6.0.tar.gz",
    "platform": null,
    "description": "# BitNet-b158  \n\nnote\u3067\u5b9f\u88c5\u3092\u9032\u3081\u3066\u3044\u308bBitLinear, BitLinearb158\u306e\u30b3\u30fc\u30c9\u3068\u306a\u308a\u307e\u3059\u3002  \n[BitNet&BitNet b158\u306e\u5b9f\u88c5](https://note.com/hatti8/n/nc6890e79a19a)  \n- `pip install mybitnet`\u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u53ef\u80fd\u3067\u3059\u3002\n- `example/01_bit_llama_pretraining.ipynb`\u30d5\u30a1\u30a4\u30eb\u306b\u306f\u3001bitlinear\u3092\u7528\u3044\u305f\u4e8b\u524d\u5b66\u7fd2\u306e\u4f8b\u304c\u3042\u308a\u307e\u3059\u3002\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "A PyTorch implementation of BitNet, a network utilizing bit quantization for linear layers.",
    "version": "0.6.0",
    "project_urls": {
        "Homepage": "https://note.com/hatti8/n/nc6890e79a19a"
    },
    "split_keywords": [
        "pytorch",
        " bit quantization",
        " neural networks",
        " llm",
        " pretrain"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c505db9d728ae2f420c91d7fcc5c4cfc14405d68b79f65160d5d447061e5b3bb",
                "md5": "5fb21e96233bf667eeb5426870ce9fd9",
                "sha256": "37b549d83e78e4a576710c139053c9d0037d2e19dfe620a7b3a99e3210e19a13"
            },
            "downloads": -1,
            "filename": "mybitnet-0.6.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "5fb21e96233bf667eeb5426870ce9fd9",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.6",
            "size": 11132,
            "upload_time": "2024-03-31T03:31:09",
            "upload_time_iso_8601": "2024-03-31T03:31:09.305386Z",
            "url": "https://files.pythonhosted.org/packages/c5/05/db9d728ae2f420c91d7fcc5c4cfc14405d68b79f65160d5d447061e5b3bb/mybitnet-0.6.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "44de4e2fc26b6d4d4861a1f453a90045e4feba552842c5fb0b31ad59244eaab4",
                "md5": "8d77712a4b93460c0e1cea65a9e975f3",
                "sha256": "0d7626fde91842a4e8015398b7e47f786c06c5b4f4ae18e87fc136ec371a3a99"
            },
            "downloads": -1,
            "filename": "mybitnet-0.6.0.tar.gz",
            "has_sig": false,
            "md5_digest": "8d77712a4b93460c0e1cea65a9e975f3",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.6",
            "size": 9688,
            "upload_time": "2024-03-31T03:31:10",
            "upload_time_iso_8601": "2024-03-31T03:31:10.994967Z",
            "url": "https://files.pythonhosted.org/packages/44/de/4e2fc26b6d4d4861a1f453a90045e4feba552842c5fb0b31ad59244eaab4/mybitnet-0.6.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-03-31 03:31:10",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "mybitnet"
}