Name | pipen-runinfo JSON |
Version |
0.8.3
JSON |
| download |
home_page | None |
Summary | Generate running information for jobs in pipen pipelines |
upload_time | 2025-02-17 18:32:39 |
maintainer | None |
docs_url | None |
author | pwwang |
requires_python | <4.0,>=3.9 |
license | MIT |
keywords |
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# pipen-runinfo
Generate running information for jobs in [pipen][1] pipelines.
Including session info (packages and versions), time, and device info.
## Install
```bash
pip install -U pipen-runinfo
```
## Enable/Disable the plugin
The plugin is registered via entrypoints. It's by default enabled. To disable it: plugins=[..., "no:runinfo"], or uninstall this plugin.
## Plugin options
- `runinfo_lang`: The name of the language to run the job script for session info.
Default is `None`, which means it will be inferred from the `proc.lang`
This should be a process-level option, unless you only have one single
process in your pipeline.
- `runinfo_path`: Whether to include paths for the modules in the session information.
Default is `True`.
This option could be either specified in the process-level or the pipeline-level.
Only works for `python`.
- `runinfo_submod`: Whether to include submodules in the session information.
Default is `False`.
This option could be either specified in the process-level or the pipeline-level.
Only works for `python`.
## Supported languages for session info
`python`, `R`, `bash`, and `fish`.
## Usage
The plugin will generate 3 files in the job directory of the pipeline.
### `job.runinfo.session`
The session information of the job, including the interpreter, packages and their versions.
#### Python
Generates a TSV file with the following columns:
- `Name`: The name of the module, or python itself
- `__version__`: The version fetched by `module.__version__` or `module.version`
- `importlib.metadata`: The version fetched by `importlib.metadata.version(package)`
- `Path`: The path of the module (only if `runinfo_path` is `True`)
#### R
Generates a text file `sessionInfo()` output.
#### Bash
Generates a TSV file with the following columns:
- `SHELL`: The value of `$SHELL`
- `BASH_VERSION`: The value of `$BASH_VERSION`
- `BASH_ARGV0`: The value of `$BASH_ARGV0`
- `BASH_SOURCE`: The value of `$BASH_SOURCE`
- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`
- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`
#### Fish
Generates a TSV file with the following columns:
- `SHELL`: The value of `$SHELL`
- `FISH_VERSION`: The value of `$FISH_VERSION`
- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`
- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`
### `job.runinfo.time`
The time spent on the job, and more, generated by `time -v` command.
### `job.runinfo.device`
The device (cpu and memory) information of the job, generated by `lscpu`/`lsmem` command.
[1]: https://github.com/pwwang/pipen
Raw data
{
"_id": null,
"home_page": null,
"name": "pipen-runinfo",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.9",
"maintainer_email": null,
"keywords": null,
"author": "pwwang",
"author_email": "pwwang@pwwang.com",
"download_url": "https://files.pythonhosted.org/packages/67/e1/09fc2b50106dad279b8964f1be594ad8225ab7a2c95d5ba4ba55364ed081/pipen_runinfo-0.8.3.tar.gz",
"platform": null,
"description": "# pipen-runinfo\n\nGenerate running information for jobs in [pipen][1] pipelines.\n\nIncluding session info (packages and versions), time, and device info.\n\n## Install\n\n```bash\npip install -U pipen-runinfo\n```\n\n## Enable/Disable the plugin\n\nThe plugin is registered via entrypoints. It's by default enabled. To disable it: plugins=[..., \"no:runinfo\"], or uninstall this plugin.\n\n## Plugin options\n\n- `runinfo_lang`: The name of the language to run the job script for session info.\n Default is `None`, which means it will be inferred from the `proc.lang`\n This should be a process-level option, unless you only have one single\n process in your pipeline.\n- `runinfo_path`: Whether to include paths for the modules in the session information.\n Default is `True`.\n This option could be either specified in the process-level or the pipeline-level.\n Only works for `python`.\n- `runinfo_submod`: Whether to include submodules in the session information.\n Default is `False`.\n This option could be either specified in the process-level or the pipeline-level.\n Only works for `python`.\n\n## Supported languages for session info\n\n`python`, `R`, `bash`, and `fish`.\n\n## Usage\n\nThe plugin will generate 3 files in the job directory of the pipeline.\n\n### `job.runinfo.session`\n\nThe session information of the job, including the interpreter, packages and their versions.\n\n#### Python\n\nGenerates a TSV file with the following columns:\n\n- `Name`: The name of the module, or python itself\n- `__version__`: The version fetched by `module.__version__` or `module.version`\n- `importlib.metadata`: The version fetched by `importlib.metadata.version(package)`\n- `Path`: The path of the module (only if `runinfo_path` is `True`)\n\n#### R\n\nGenerates a text file `sessionInfo()` output.\n\n#### Bash\n\nGenerates a TSV file with the following columns:\n\n- `SHELL`: The value of `$SHELL`\n- `BASH_VERSION`: The value of `$BASH_VERSION`\n- `BASH_ARGV0`: The value of `$BASH_ARGV0`\n- `BASH_SOURCE`: The value of `$BASH_SOURCE`\n- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`\n- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`\n\n#### Fish\n\nGenerates a TSV file with the following columns:\n\n- `SHELL`: The value of `$SHELL`\n- `FISH_VERSION`: The value of `$FISH_VERSION`\n- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`\n- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`\n\n### `job.runinfo.time`\n\nThe time spent on the job, and more, generated by `time -v` command.\n\n### `job.runinfo.device`\n\nThe device (cpu and memory) information of the job, generated by `lscpu`/`lsmem` command.\n\n\n[1]: https://github.com/pwwang/pipen\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Generate running information for jobs in pipen pipelines",
"version": "0.8.3",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "33a09d1009226ba3bc036aafa8f1a4a210c7c9392879f265679559daeb97081e",
"md5": "4c3f9c59a21babb65de36483a4536795",
"sha256": "27c2612ec966344e818e97bdff50345180bb0d7570db54c3c8925f03fea397a4"
},
"downloads": -1,
"filename": "pipen_runinfo-0.8.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "4c3f9c59a21babb65de36483a4536795",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.9",
"size": 6150,
"upload_time": "2025-02-17T18:32:37",
"upload_time_iso_8601": "2025-02-17T18:32:37.582769Z",
"url": "https://files.pythonhosted.org/packages/33/a0/9d1009226ba3bc036aafa8f1a4a210c7c9392879f265679559daeb97081e/pipen_runinfo-0.8.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "67e109fc2b50106dad279b8964f1be594ad8225ab7a2c95d5ba4ba55364ed081",
"md5": "e848f170c7e627fecee013bf8b92de48",
"sha256": "90d6f247e9dde9dc288b7589ab552c0b47a85574755dda0b8617fcb3583c544c"
},
"downloads": -1,
"filename": "pipen_runinfo-0.8.3.tar.gz",
"has_sig": false,
"md5_digest": "e848f170c7e627fecee013bf8b92de48",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.9",
"size": 5633,
"upload_time": "2025-02-17T18:32:39",
"upload_time_iso_8601": "2025-02-17T18:32:39.158982Z",
"url": "https://files.pythonhosted.org/packages/67/e1/09fc2b50106dad279b8964f1be594ad8225ab7a2c95d5ba4ba55364ed081/pipen_runinfo-0.8.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-02-17 18:32:39",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "pipen-runinfo"
}