Atiny


NameAtiny JSON
Version 0.0.2 PyPI version JSON
download
home_pageNone
SummaryAtiny is a gradient based PyTorch optimizer. Atiny uses half of Adam's memory to achieve results that are not inferior to Adam.
upload_time2025-07-31 03:49:50
maintainerNone
docs_urlNone
authorNone
requires_python>=3.8
licenseNone
keywords tiny atiny pytorch optimizer ai neural nn memory
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls. 
            # Atiny Optimizer
Atiny is a gradient based PyTorch optimizer. Atiny uses half of Adam's memory to achieve results that are not inferior to Adam.

![image](./rendering.png)
![image](./renderingZoom.png)

## 思路说明
不使用二阶动量,而是使用一阶动量与当前梯度计算每个参数的更新补偿.
内置了一个学习率衰减器,自动为每组参数个性化的学习率衰减.(需要参数:ldr)
使用ArcSinh函数影响向量模长实现权重衰减

## Demo程序
demo程序在test.py文件中,直接运行即可得到此页面中Atiny与Adam的对比图.(依赖visdom)
demo中构建了一个神经网络用简陋的方式对一个包含动态随机参数的公式生成的周期性曲线进行预测.

## Install
```bash
pip install Atiny
```

## Use
```python
from Atiny import Atiny
...
optimizer=Atiny(moduel.parameters(),lr=lr,ldr=ldr,weight_decay=weight_decay)
```

## HomePage
<https://github.com/PsycheHalo/Atiny/>

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "Atiny",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "tiny, Atiny, PyTorch, optimizer, AI, neural, NN, memory",
    "author": null,
    "author_email": "Psyche Halo <Psyche@WinsGod.com>",
    "download_url": "https://files.pythonhosted.org/packages/ad/dc/34d9a001aadef25ef62a4b3cf99240f4e2f901df843b56cd6a569fa709ae/atiny-0.0.2.tar.gz",
    "platform": null,
    "description": "# Atiny Optimizer\nAtiny is a gradient based PyTorch optimizer. Atiny uses half of Adam's memory to achieve results that are not inferior to Adam.\n\n![image](./rendering.png)\n![image](./renderingZoom.png)\n\n## \u601d\u8def\u8bf4\u660e\n\u4e0d\u4f7f\u7528\u4e8c\u9636\u52a8\u91cf,\u800c\u662f\u4f7f\u7528\u4e00\u9636\u52a8\u91cf\u4e0e\u5f53\u524d\u68af\u5ea6\u8ba1\u7b97\u6bcf\u4e2a\u53c2\u6570\u7684\u66f4\u65b0\u8865\u507f.\n\u5185\u7f6e\u4e86\u4e00\u4e2a\u5b66\u4e60\u7387\u8870\u51cf\u5668,\u81ea\u52a8\u4e3a\u6bcf\u7ec4\u53c2\u6570\u4e2a\u6027\u5316\u7684\u5b66\u4e60\u7387\u8870\u51cf.(\u9700\u8981\u53c2\u6570:ldr)\n\u4f7f\u7528ArcSinh\u51fd\u6570\u5f71\u54cd\u5411\u91cf\u6a21\u957f\u5b9e\u73b0\u6743\u91cd\u8870\u51cf\n\n## Demo\u7a0b\u5e8f\ndemo\u7a0b\u5e8f\u5728test.py\u6587\u4ef6\u4e2d,\u76f4\u63a5\u8fd0\u884c\u5373\u53ef\u5f97\u5230\u6b64\u9875\u9762\u4e2dAtiny\u4e0eAdam\u7684\u5bf9\u6bd4\u56fe.(\u4f9d\u8d56visdom)\ndemo\u4e2d\u6784\u5efa\u4e86\u4e00\u4e2a\u795e\u7ecf\u7f51\u7edc\u7528\u7b80\u964b\u7684\u65b9\u5f0f\u5bf9\u4e00\u4e2a\u5305\u542b\u52a8\u6001\u968f\u673a\u53c2\u6570\u7684\u516c\u5f0f\u751f\u6210\u7684\u5468\u671f\u6027\u66f2\u7ebf\u8fdb\u884c\u9884\u6d4b.\n\n## Install\n```bash\npip install Atiny\n```\n\n## Use\n```python\nfrom Atiny import Atiny\n...\noptimizer=Atiny(moduel.parameters(),lr=lr,ldr=ldr,weight_decay=weight_decay)\n```\n\n## HomePage\n<https://github.com/PsycheHalo/Atiny/>\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "Atiny is a gradient based PyTorch optimizer. Atiny uses half of Adam's memory to achieve results that are not inferior to Adam. ",
    "version": "0.0.2",
    "project_urls": {
        "Homepage": "https://github.com/PsycheHalo/Atiny",
        "Issues": "https://github.com/PsycheHalo/Atiny/issues"
    },
    "split_keywords": [
        "tiny",
        " atiny",
        " pytorch",
        " optimizer",
        " ai",
        " neural",
        " nn",
        " memory"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "bfedd964c3669df63b466e7c9b3f0dad3ba8c13c9b672f46f6d3c9b5484c23cc",
                "md5": "bb8506705a1e0748f0e8433d977b83f1",
                "sha256": "083355c41588bade82a66fd66dd6aa423afa14ebfb39de75a1995e3605f0d8a7"
            },
            "downloads": -1,
            "filename": "atiny-0.0.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "bb8506705a1e0748f0e8433d977b83f1",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 10804,
            "upload_time": "2025-07-31T03:49:49",
            "upload_time_iso_8601": "2025-07-31T03:49:49.501722Z",
            "url": "https://files.pythonhosted.org/packages/bf/ed/d964c3669df63b466e7c9b3f0dad3ba8c13c9b672f46f6d3c9b5484c23cc/atiny-0.0.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "addc34d9a001aadef25ef62a4b3cf99240f4e2f901df843b56cd6a569fa709ae",
                "md5": "4a9e1a15a4d6a7e6bbeced74fee2226c",
                "sha256": "086c871e7e22aff5a3a4e4d1b83f7d5d520d16e09588553f5aac8348033e4939"
            },
            "downloads": -1,
            "filename": "atiny-0.0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "4a9e1a15a4d6a7e6bbeced74fee2226c",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 10405,
            "upload_time": "2025-07-31T03:49:50",
            "upload_time_iso_8601": "2025-07-31T03:49:50.615042Z",
            "url": "https://files.pythonhosted.org/packages/ad/dc/34d9a001aadef25ef62a4b3cf99240f4e2f901df843b56cd6a569fa709ae/atiny-0.0.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-07-31 03:49:50",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "PsycheHalo",
    "github_project": "Atiny",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "atiny"
}
None
Elapsed time: 0.52647s