phcli


Namephcli JSON
Version 2.4.13 PyPI version JSON
download
home_page
Summarypharbers dag scheduler config
upload_time2021-04-08 12:39:55
maintainerClockQ,AlexQian,hbzhao
docs_urlNone
authorAlfred Yang
requires_python>=2.7
license
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # phDagCommand
Pharbers Python 工具集合

## 打包和发布方式
```androiddatabinding
# pipy 打包发布方式
1. 修改 phcli/define_value.py 中 CLI_CLIENT_VERSION 的版本号 
2. 修改 file/ph_max_auto/phDagJob-*.tmp 中的 install_phcli 版本号
   并将 file/ph_max_auto/phDagJob-*.tmp 上传到 s3://ph-platform/*/template/python/phcli/maxauto/ 下
3. 修改 phcli/ph_max_auto/define_value.py 中新的模板文件版本

4. 打包
$ rm -rf build/ dist/
$ python setup.py sdist bdist_egg bdist_wheel

5. 上传
发布 pypi 
$ python -m twine upload dist/*
将生成的 dist/phcli-XXX-py3.8.egg 添加到 s3://ph-platform/*/jobs/python/phcli/common/ 下
```

## 清洗打包流程
```
# zip 打包方式(scala 调用方式)
$ python setup.py sdist --formats=zip
```

## 安装方式
```androiddatabinding
$ pip install phcli
```

## 使用方法
```androiddatabinding
> phcli -h
```

# 更新文档
## 2.2.1    2021/1/29
1. 紧急修复 bug,在 .ipynb 中无法读取 ~/.profile 中的环境变量

## 2.2.0    2021/1/25
1. 新增 recall 召回功能,可撤回 publish 的 dag。``phcli maxauto recall --name dag_name``

## 2.1.0    2021/1/22
1. Jupyter Spark Session 更语义化的 App Name
2. 对 Jupyter R 的支持
3. 修复了 phcli maxauto dag 后,无法取参的问题

## 2.0.4
1. 修复 jupyter dag 时 timeout 参数的 bug
2. 修复 preset.write_asset 的 bug

## 2.0.3
1. phcli maxauto create 新增 option [--timeout],指定 job 运行的超时时间(min),默认为 60 min。

## 2.0.0
1. 之前的 phcli maxauto --cmd XXX --option 改为 phcli maxauto XXX --option
2. phcli maxauto 新增两个 option,[--ide] 可选 c9(默认),jupyter。[--runtime] 可选 python3(默认),r。
3. phcli maxauto create 新增 option [--command] 可选 submit(默认),script。
4. create/combine/dag 执行过程中出现目录已存在会提示是否覆盖。
5. phcli maxauto combine 新增参数 [--owner],[--tag],[--jobs]。
6. phcli maxauto submit 改为 phcli maxauto online_run

## 1.2.3
1. dag airflow list 完成
2. phcli 1.2.3 spark submit 中文乱码 bug 解决
3. phcli 1.2.2 修复 submit jar 问题



            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "phcli",
    "maintainer": "ClockQ,AlexQian,hbzhao",
    "docs_url": null,
    "requires_python": ">=2.7",
    "maintainer_email": "zyqi@pharbers.com,pqian@pharbers.com,15847059648@163.com",
    "keywords": "",
    "author": "Alfred Yang",
    "author_email": "alfredyang@pharbers.com",
    "download_url": "https://files.pythonhosted.org/packages/2f/78/07b76a6a5a3bb728758052216b79a8668143f66866354ea18df629d8dc4c/phcli-2.4.13.tar.gz",
    "platform": "",
    "description": "# phDagCommand\nPharbers Python \u5de5\u5177\u96c6\u5408\n\n## \u6253\u5305\u548c\u53d1\u5e03\u65b9\u5f0f\n```androiddatabinding\n# pipy \u6253\u5305\u53d1\u5e03\u65b9\u5f0f\n1. \u4fee\u6539 phcli/define_value.py \u4e2d CLI_CLIENT_VERSION \u7684\u7248\u672c\u53f7 \n2. \u4fee\u6539 file/ph_max_auto/phDagJob-*.tmp \u4e2d\u7684 install_phcli \u7248\u672c\u53f7\n   \u5e76\u5c06 file/ph_max_auto/phDagJob-*.tmp \u4e0a\u4f20\u5230 s3://ph-platform/*/template/python/phcli/maxauto/ \u4e0b\n3. \u4fee\u6539 phcli/ph_max_auto/define_value.py \u4e2d\u65b0\u7684\u6a21\u677f\u6587\u4ef6\u7248\u672c\n\n4. \u6253\u5305\n$ rm -rf build/ dist/\n$ python setup.py sdist bdist_egg bdist_wheel\n\n5. \u4e0a\u4f20\n\u53d1\u5e03 pypi \n$ python -m twine upload dist/*\n\u5c06\u751f\u6210\u7684 dist/phcli-XXX-py3.8.egg \u6dfb\u52a0\u5230 s3://ph-platform/*/jobs/python/phcli/common/ \u4e0b\n```\n\n## \u6e05\u6d17\u6253\u5305\u6d41\u7a0b\n```\n# zip \u6253\u5305\u65b9\u5f0f(scala \u8c03\u7528\u65b9\u5f0f)\n$ python setup.py sdist --formats=zip\n```\n\n## \u5b89\u88c5\u65b9\u5f0f\n```androiddatabinding\n$ pip install phcli\n```\n\n## \u4f7f\u7528\u65b9\u6cd5\n```androiddatabinding\n> phcli -h\n```\n\n# \u66f4\u65b0\u6587\u6863\n## 2.2.1    2021/1/29\n1. \u7d27\u6025\u4fee\u590d bug\uff0c\u5728 .ipynb \u4e2d\u65e0\u6cd5\u8bfb\u53d6 ~/.profile \u4e2d\u7684\u73af\u5883\u53d8\u91cf\n\n## 2.2.0    2021/1/25\n1. \u65b0\u589e recall \u53ec\u56de\u529f\u80fd\uff0c\u53ef\u64a4\u56de publish \u7684 dag\u3002``phcli maxauto recall --name dag_name``\n\n## 2.1.0    2021/1/22\n1. Jupyter Spark Session \u66f4\u8bed\u4e49\u5316\u7684 App Name\n2. \u5bf9 Jupyter R \u7684\u652f\u6301\n3. \u4fee\u590d\u4e86 phcli maxauto dag \u540e\uff0c\u65e0\u6cd5\u53d6\u53c2\u7684\u95ee\u9898\n\n## 2.0.4\n1. \u4fee\u590d jupyter dag \u65f6 timeout \u53c2\u6570\u7684 bug\n2. \u4fee\u590d preset.write_asset \u7684 bug\n\n## 2.0.3\n1. phcli maxauto create \u65b0\u589e option [--timeout]\uff0c\u6307\u5b9a job \u8fd0\u884c\u7684\u8d85\u65f6\u65f6\u95f4\uff08min\uff09\uff0c\u9ed8\u8ba4\u4e3a 60 min\u3002\n\n## 2.0.0\n1. \u4e4b\u524d\u7684 phcli maxauto --cmd XXX --option \u6539\u4e3a phcli maxauto XXX --option\n2. phcli maxauto \u65b0\u589e\u4e24\u4e2a option\uff0c[--ide] \u53ef\u9009 c9(\u9ed8\u8ba4)\uff0cjupyter\u3002[--runtime] \u53ef\u9009 python3(\u9ed8\u8ba4)\uff0cr\u3002\n3. phcli maxauto create \u65b0\u589e option [--command] \u53ef\u9009 submit(\u9ed8\u8ba4)\uff0cscript\u3002\n4. create/combine/dag \u6267\u884c\u8fc7\u7a0b\u4e2d\u51fa\u73b0\u76ee\u5f55\u5df2\u5b58\u5728\u4f1a\u63d0\u793a\u662f\u5426\u8986\u76d6\u3002\n5. phcli maxauto combine \u65b0\u589e\u53c2\u6570 [--owner]\uff0c[--tag]\uff0c[--jobs]\u3002\n6. phcli maxauto submit \u6539\u4e3a phcli maxauto online_run\n\n## 1.2.3\n1. dag airflow list \u5b8c\u6210\n2. phcli 1.2.3 spark submit \u4e2d\u6587\u4e71\u7801 bug \u89e3\u51b3\n3. phcli 1.2.2 \u4fee\u590d submit jar \u95ee\u9898\n\n\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "pharbers dag scheduler config",
    "version": "2.4.13",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "9efc40c0248b0d4b0202c049fad44496",
                "sha256": "51e9ba018e0b4d44902bd18682e087b7cb2af77b5b65abecf8f0c8b51483cb31"
            },
            "downloads": -1,
            "filename": "phcli-2.4.13-py3.8.egg",
            "has_sig": false,
            "md5_digest": "9efc40c0248b0d4b0202c049fad44496",
            "packagetype": "bdist_egg",
            "python_version": "3.8",
            "requires_python": ">=2.7",
            "size": 321796,
            "upload_time": "2021-04-08T12:39:54",
            "upload_time_iso_8601": "2021-04-08T12:39:54.673004Z",
            "url": "https://files.pythonhosted.org/packages/fc/4c/5d7a6d94f3de873a6fb9561ecb0fa77802c1ce6ddc9700f20f96cf6006aa/phcli-2.4.13-py3.8.egg",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "85fac71c509b493f3ff962039ec6d1c3",
                "sha256": "e246c791f6e65b41f4660f567e6df94b6c181c4d6d923fc0a2cfcf6f8beb74cd"
            },
            "downloads": -1,
            "filename": "phcli-2.4.13-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "85fac71c509b493f3ff962039ec6d1c3",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=2.7",
            "size": 136998,
            "upload_time": "2021-04-08T12:39:52",
            "upload_time_iso_8601": "2021-04-08T12:39:52.129489Z",
            "url": "https://files.pythonhosted.org/packages/87/75/9405261538e03df178c6f4a53f3157e0a81c51945b7222cd0fe2fc878baa/phcli-2.4.13-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "e7180ede5f8452ac964a09229ec36611",
                "sha256": "be36ad96925b69ac3e3ba07a36f44ee0902e1f6ffdfb390e0d1cd4db6a4f78fb"
            },
            "downloads": -1,
            "filename": "phcli-2.4.13.tar.gz",
            "has_sig": false,
            "md5_digest": "e7180ede5f8452ac964a09229ec36611",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=2.7",
            "size": 72671,
            "upload_time": "2021-04-08T12:39:55",
            "upload_time_iso_8601": "2021-04-08T12:39:55.877788Z",
            "url": "https://files.pythonhosted.org/packages/2f/78/07b76a6a5a3bb728758052216b79a8668143f66866354ea18df629d8dc4c/phcli-2.4.13.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2021-04-08 12:39:55",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "lcname": "phcli"
}
        
Elapsed time: 0.40419s