| Name | msserviceprofiler JSON |
| Version |
1.1.4
JSON |
| download |
| home_page | None |
| Summary | None |
| upload_time | 2025-07-16 09:42:17 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | <4.0,>=3.8 |
| license | None |
| keywords |
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# msserviceprofiler 工具介绍
## 概述
msserviceprofiler 是一款基于昇腾平台，支持MindIE Service框架和vLLM框架的服务化调优工具。
其性能采集与数据解析能力已嵌入昇腾CANN工具包，支持MindStudio Insight、Chrome Tracing、Grafana多个平台数据可视化。
目前，扩展能力**服务化性能数据比对工具**和**vLLM服务化性能采集工具**已在本仓库开源。
## 硬件环境
| 类型 | 配置参考 | 服务化性能数据比对工具 | vLLM服务化性能采集工具 |
|:-------:|:-------:|:-------:|:-------:|
| 服务器 | Atlas 800I A2 推理产品 | √ | √ |
| 推理卡 | Atlas 300I Duo 推理卡+Atlas 800 推理服务器（型号：3000） | √ | |
## 特性清单
### [服务化性能数据比对工具](docs/服务化性能数据比对工具.md)
支持对使用msserviceprofiler工具采集的性能数据进行差异比对，通过比对快速识别可能存在的问题点。
### ️[vLLM服务化性能采集工具](docs/vLLM服务化性能采集工具.md)
基于Ascend-vLLM，提供性能数据采集能力，结合msserviceprofiler的数据解析与可视化能力，可以vLLM服务化推理调试调优。
### ️[服务化自动寻优工具](docs/服务化自动寻优工具.md)
基于msserviceprofiler工具采集的性能数据，提供服务化参数自动寻优能力，可以对服务化的参数以及测试工具的参数进行寻优。
### ️[服务化专家建议工具](docs/服务化专家建议工具.md)
基于benchmark 输出结果以及 service 的 config.json 配置，提供分析提高 TFTT / Throughput 等的优化点能力。
### ️[服务化拆解工具](docs/服务化拆解工具.md)
基于msserviceprofiler工具采集的性能数据，提供性能数据拆解能力，可以对batch内各阶段耗时进行分析。
## 安装指南
目前工具支持pip装包后调用和源码下载，脚本调用两种方式。
#### pip 安装 msserviceprofiler
```shell
pip install -U msserviceprofiler
```
#### 或通过源码方式使用 msserviceprofiler
```shell
git clone https://gitee.com/ascend/msit.git
export PYTHONPATH=$PWD/msit/msserviceprofiler/:$PYTHONPATH
```
## 支持与帮助
🐛 [Issue提交](https://gitee.com/ascend/msit/issues)
💬 [昇腾论坛](https://www.hiascend.com/forum/forum-0106101385921175006-1.html)
Raw data
{
"_id": null,
"home_page": null,
"name": "msserviceprofiler",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.8",
"maintainer_email": null,
"keywords": null,
"author": null,
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/27/1c/72097489a2697d6b775fea8ad1dfa49160f534c365a24cea8bc6a7f5ce0d/msserviceprofiler-1.1.4.tar.gz",
"platform": null,
"description": "# msserviceprofiler \u5de5\u5177\u4ecb\u7ecd\n\n## \u6982\u8ff0\n\nmsserviceprofiler \u662f\u4e00\u6b3e\u57fa\u4e8e\u6607\u817e\u5e73\u53f0\uff0c\u652f\u6301MindIE Service\u6846\u67b6\u548cvLLM\u6846\u67b6\u7684\u670d\u52a1\u5316\u8c03\u4f18\u5de5\u5177\u3002\n\n\u5176\u6027\u80fd\u91c7\u96c6\u4e0e\u6570\u636e\u89e3\u6790\u80fd\u529b\u5df2\u5d4c\u5165\u6607\u817eCANN\u5de5\u5177\u5305\uff0c\u652f\u6301MindStudio Insight\u3001Chrome Tracing\u3001Grafana\u591a\u4e2a\u5e73\u53f0\u6570\u636e\u53ef\u89c6\u5316\u3002\n\n\u76ee\u524d\uff0c\u6269\u5c55\u80fd\u529b**\u670d\u52a1\u5316\u6027\u80fd\u6570\u636e\u6bd4\u5bf9\u5de5\u5177**\u548c**vLLM\u670d\u52a1\u5316\u6027\u80fd\u91c7\u96c6\u5de5\u5177**\u5df2\u5728\u672c\u4ed3\u5e93\u5f00\u6e90\u3002\n\n## \u786c\u4ef6\u73af\u5883\n| \u7c7b\u578b | \u914d\u7f6e\u53c2\u8003 | \u670d\u52a1\u5316\u6027\u80fd\u6570\u636e\u6bd4\u5bf9\u5de5\u5177 | vLLM\u670d\u52a1\u5316\u6027\u80fd\u91c7\u96c6\u5de5\u5177 |\n|:-------:|:-------:|:-------:|:-------:|\n| \u670d\u52a1\u5668 | Atlas 800I A2 \u63a8\u7406\u4ea7\u54c1 | \u221a | \u221a |\n| \u63a8\u7406\u5361 | Atlas 300I Duo \u63a8\u7406\u5361+Atlas 800 \u63a8\u7406\u670d\u52a1\u5668\uff08\u578b\u53f7\uff1a3000\uff09 | \u221a | |\n\n## \u7279\u6027\u6e05\u5355\n\n### [\u670d\u52a1\u5316\u6027\u80fd\u6570\u636e\u6bd4\u5bf9\u5de5\u5177](docs/\u670d\u52a1\u5316\u6027\u80fd\u6570\u636e\u6bd4\u5bf9\u5de5\u5177.md)\n\n\u652f\u6301\u5bf9\u4f7f\u7528msserviceprofiler\u5de5\u5177\u91c7\u96c6\u7684\u6027\u80fd\u6570\u636e\u8fdb\u884c\u5dee\u5f02\u6bd4\u5bf9\uff0c\u901a\u8fc7\u6bd4\u5bf9\u5feb\u901f\u8bc6\u522b\u53ef\u80fd\u5b58\u5728\u7684\u95ee\u9898\u70b9\u3002\n\n### \ufe0f[vLLM\u670d\u52a1\u5316\u6027\u80fd\u91c7\u96c6\u5de5\u5177](docs/vLLM\u670d\u52a1\u5316\u6027\u80fd\u91c7\u96c6\u5de5\u5177.md)\n\n\u57fa\u4e8eAscend-vLLM\uff0c\u63d0\u4f9b\u6027\u80fd\u6570\u636e\u91c7\u96c6\u80fd\u529b\uff0c\u7ed3\u5408msserviceprofiler\u7684\u6570\u636e\u89e3\u6790\u4e0e\u53ef\u89c6\u5316\u80fd\u529b\uff0c\u53ef\u4ee5vLLM\u670d\u52a1\u5316\u63a8\u7406\u8c03\u8bd5\u8c03\u4f18\u3002\n\n### \ufe0f[\u670d\u52a1\u5316\u81ea\u52a8\u5bfb\u4f18\u5de5\u5177](docs/\u670d\u52a1\u5316\u81ea\u52a8\u5bfb\u4f18\u5de5\u5177.md)\n\n\u57fa\u4e8emsserviceprofiler\u5de5\u5177\u91c7\u96c6\u7684\u6027\u80fd\u6570\u636e\uff0c\u63d0\u4f9b\u670d\u52a1\u5316\u53c2\u6570\u81ea\u52a8\u5bfb\u4f18\u80fd\u529b\uff0c\u53ef\u4ee5\u5bf9\u670d\u52a1\u5316\u7684\u53c2\u6570\u4ee5\u53ca\u6d4b\u8bd5\u5de5\u5177\u7684\u53c2\u6570\u8fdb\u884c\u5bfb\u4f18\u3002\n\n### \ufe0f[\u670d\u52a1\u5316\u4e13\u5bb6\u5efa\u8bae\u5de5\u5177](docs/\u670d\u52a1\u5316\u4e13\u5bb6\u5efa\u8bae\u5de5\u5177.md)\n\n\u57fa\u4e8ebenchmark \u8f93\u51fa\u7ed3\u679c\u4ee5\u53ca service \u7684 config.json \u914d\u7f6e\uff0c\u63d0\u4f9b\u5206\u6790\u63d0\u9ad8 TFTT / Throughput \u7b49\u7684\u4f18\u5316\u70b9\u80fd\u529b\u3002\n\n### \ufe0f[\u670d\u52a1\u5316\u62c6\u89e3\u5de5\u5177](docs/\u670d\u52a1\u5316\u62c6\u89e3\u5de5\u5177.md)\n\n\u57fa\u4e8emsserviceprofiler\u5de5\u5177\u91c7\u96c6\u7684\u6027\u80fd\u6570\u636e\uff0c\u63d0\u4f9b\u6027\u80fd\u6570\u636e\u62c6\u89e3\u80fd\u529b\uff0c\u53ef\u4ee5\u5bf9batch\u5185\u5404\u9636\u6bb5\u8017\u65f6\u8fdb\u884c\u5206\u6790\u3002\n\n\n## \u5b89\u88c5\u6307\u5357\n\n\u76ee\u524d\u5de5\u5177\u652f\u6301pip\u88c5\u5305\u540e\u8c03\u7528\u548c\u6e90\u7801\u4e0b\u8f7d\uff0c\u811a\u672c\u8c03\u7528\u4e24\u79cd\u65b9\u5f0f\u3002\n#### pip \u5b89\u88c5 msserviceprofiler\n```shell\npip install -U msserviceprofiler\n```\n#### \u6216\u901a\u8fc7\u6e90\u7801\u65b9\u5f0f\u4f7f\u7528 msserviceprofiler\n\n```shell\ngit clone https://gitee.com/ascend/msit.git\nexport PYTHONPATH=$PWD/msit/msserviceprofiler/:$PYTHONPATH\n```\n\n## \u652f\u6301\u4e0e\u5e2e\u52a9\n\n\ud83d\udc1b [Issue\u63d0\u4ea4](https://gitee.com/ascend/msit/issues)\n\n\ud83d\udcac [\u6607\u817e\u8bba\u575b](https://www.hiascend.com/forum/forum-0106101385921175006-1.html)\n\n",
"bugtrack_url": null,
"license": null,
"summary": null,
"version": "1.1.4",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "f0cf0597ba9c0a024cc3382d93b7057881444f8b48fa80f7d7a9d4aad89402a9",
"md5": "c781d95556ce9a436c12252076aefe0a",
"sha256": "a83a83313d521856fdebf0dc72d384552a9507a45649212d7467f70ad6dfd1cf"
},
"downloads": -1,
"filename": "msserviceprofiler-1.1.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "c781d95556ce9a436c12252076aefe0a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.8",
"size": 180228,
"upload_time": "2025-07-16T09:42:14",
"upload_time_iso_8601": "2025-07-16T09:42:14.850820Z",
"url": "https://files.pythonhosted.org/packages/f0/cf/0597ba9c0a024cc3382d93b7057881444f8b48fa80f7d7a9d4aad89402a9/msserviceprofiler-1.1.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "271c72097489a2697d6b775fea8ad1dfa49160f534c365a24cea8bc6a7f5ce0d",
"md5": "11c0366c66189c648c9d224da8d8b8af",
"sha256": "312a78a0156a52942975bec9515484df1ca93da77d48dc027b03cdc0a55f14d7"
},
"downloads": -1,
"filename": "msserviceprofiler-1.1.4.tar.gz",
"has_sig": false,
"md5_digest": "11c0366c66189c648c9d224da8d8b8af",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.8",
"size": 110597,
"upload_time": "2025-07-16T09:42:17",
"upload_time_iso_8601": "2025-07-16T09:42:17.905894Z",
"url": "https://files.pythonhosted.org/packages/27/1c/72097489a2697d6b775fea8ad1dfa49160f534c365a24cea8bc6a7f5ce0d/msserviceprofiler-1.1.4.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-07-16 09:42:17",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "msserviceprofiler"
}
