# 框架环境变量
| 环境变量 | 说明 | 默认值 |
|-----------------------------|----------|-------------|
| TI_MODEL_DIR | 模型路径 | /data/model |
| TI_PREPROCESS_NUMS | 预处理进程数 | 0 |
| TI_INFERENCE_NUMS | 推理进程数 | 1 |
| TI_POSTPROCESS_NUMS | 后处理进程数 | 0 |
| TI_INFERENCE_MAX_BATCH_SIZE | 推理Batch数 | 1 |
## 说明
- 当TI_PREPROCESS_NUMS==0且TI_POSTPROCESS_NUMS==0时;
model_service.py 文件中preprocess，postpress，predict 函数在一个进程中执行
- 否则，model_service.py 文件中preprocess, postpress, predict 函数分别处于不同进程中执行，
load 函数与predict 函数处于同一进程;
Raw data
{
"_id": null,
"home_page": "https://git.woa.com/ti-cloud/ti-cloud-ems-infer/ti-cloud-infer-framework.git",
"name": "ti-cloud-infer-framework",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "machine learning,deep learning,model serving",
"author": "hayescao",
"author_email": "Hayescao <hayescao@tencent.com>",
"download_url": "",
"platform": null,
"description": "# \u6846\u67b6\u73af\u5883\u53d8\u91cf\n\n| \u73af\u5883\u53d8\u91cf | \u8bf4\u660e | \u9ed8\u8ba4\u503c |\n|-----------------------------|----------|-------------|\n| TI_MODEL_DIR | \u6a21\u578b\u8def\u5f84 | /data/model |\n| TI_PREPROCESS_NUMS | \u9884\u5904\u7406\u8fdb\u7a0b\u6570 | 0 |\n| TI_INFERENCE_NUMS | \u63a8\u7406\u8fdb\u7a0b\u6570 | 1 |\n| TI_POSTPROCESS_NUMS | \u540e\u5904\u7406\u8fdb\u7a0b\u6570 | 0 |\n| TI_INFERENCE_MAX_BATCH_SIZE | \u63a8\u7406Batch\u6570 | 1 |\n\n## \u8bf4\u660e\n\n- \u5f53TI_PREPROCESS_NUMS==0\u4e14TI_POSTPROCESS_NUMS==0\u65f6; \n \n model_service.py \u6587\u4ef6\u4e2dpreprocess\uff0cpostpress\uff0cpredict \u51fd\u6570\u5728\u4e00\u4e2a\u8fdb\u7a0b\u4e2d\u6267\u884c\n\n- \u5426\u5219\uff0cmodel_service.py \u6587\u4ef6\u4e2dpreprocess, postpress, predict \u51fd\u6570\u5206\u522b\u5904\u4e8e\u4e0d\u540c\u8fdb\u7a0b\u4e2d\u6267\u884c\uff0c\n\n load \u51fd\u6570\u4e0epredict \u51fd\u6570\u5904\u4e8e\u540c\u4e00\u8fdb\u7a0b; \n",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "Model Serving made Efficient in the Cloud",
"version": "0.1.6",
"split_keywords": [
"machine learning",
"deep learning",
"model serving"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "d89eef84fb7025e2309c238728194faeb8c2215d13d00a6a12f1913406496ed2",
"md5": "e7af498c970ccc89198a055e9792709b",
"sha256": "9bf087b192d60a441cb6c09e322521dab293d9fb597f8a9ee27440bd164cb0f2"
},
"downloads": -1,
"filename": "ti_cloud_infer_framework-0.1.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "e7af498c970ccc89198a055e9792709b",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 8161,
"upload_time": "2023-04-08T08:24:27",
"upload_time_iso_8601": "2023-04-08T08:24:27.861456Z",
"url": "https://files.pythonhosted.org/packages/d8/9e/ef84fb7025e2309c238728194faeb8c2215d13d00a6a12f1913406496ed2/ti_cloud_infer_framework-0.1.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-04-08 08:24:27",
"github": false,
"gitlab": false,
"bitbucket": false,
"lcname": "ti-cloud-infer-framework"
}
JSON