pipen-runinfo


Namepipen-runinfo JSON
Version 0.8.1 PyPI version JSON
download
home_pageNone
SummaryGenerate running information for jobs in pipen pipelines
upload_time2024-08-14 19:28:07
maintainerNone
docs_urlNone
authorpwwang
requires_python<4.0,>=3.9
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # pipen-runinfo

Generate running information for jobs in [pipen][1] pipelines.

Including session info (packages and versions), time, and device info.

## Install

```bash
pip install -U pipen-runinfo
```

## Enable/Disable the plugin

The plugin is registered via entrypoints. It's by default enabled. To disable it: plugins=[..., "no:runinfo"], or uninstall this plugin.

## Plugin options

- `runinfo_lang`: The name of the language to run the job script for session info.
    Default is `None`, which means it will be inferred from the `proc.lang`
    This should be a process-level option, unless you only have one single
    process in your pipeline.
- `runinfo_path`: Whether to include paths for the modules in the session information.
    Default is `True`.
    This option could be either specified in the process-level or the pipeline-level.
    Only works for `python`.
- `runinfo_submod`: Whether to include submodules in the session information.
    Default is `False`.
    This option could be either specified in the process-level or the pipeline-level.
    Only works for `python`.

## Supported languages for session info

`python`, `R`, `bash`, and `fish`.

## Usage

The plugin will generate 3 files in the job directory of the pipeline.

### `job.runinfo.session`

The session information of the job, including the interpreter, packages and their versions.

#### Python

Generates a TSV file with the following columns:

- `Name`: The name of the module, or python itself
- `__version__`: The version fetched by `module.__version__` or `module.version`
- `importlib.metadata`: The version fetched by `importlib.metadata.version(package)`
- `Path`: The path of the module (only if `runinfo_path` is `True`)

#### R

Generates a text file `sessionInfo()` output.

#### Bash

Generates a TSV file with the following columns:

- `SHELL`: The value of `$SHELL`
- `BASH_VERSION`: The value of `$BASH_VERSION`
- `BASH_ARGV0`: The value of `$BASH_ARGV0`
- `BASH_SOURCE`: The value of `$BASH_SOURCE`
- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`
- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`

#### Fish

Generates a TSV file with the following columns:

- `SHELL`: The value of `$SHELL`
- `FISH_VERSION`: The value of `$FISH_VERSION`
- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`
- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`

### `job.runinfo.time`

The time spent on the job, and more, generated by `time -v` command.

### `job.runinfo.device`

The device (cpu and memory) information of the job, generated by `lscpu`/`lsmem` command.


[1]: https://github.com/pwwang/pipen

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "pipen-runinfo",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "pwwang",
    "author_email": "pwwang@pwwang.com",
    "download_url": "https://files.pythonhosted.org/packages/bc/2c/8d9645f629538bff6cd9bdea5107a7bb15c09f53837cff3ad962b05199f6/pipen_runinfo-0.8.1.tar.gz",
    "platform": null,
    "description": "# pipen-runinfo\n\nGenerate running information for jobs in [pipen][1] pipelines.\n\nIncluding session info (packages and versions), time, and device info.\n\n## Install\n\n```bash\npip install -U pipen-runinfo\n```\n\n## Enable/Disable the plugin\n\nThe plugin is registered via entrypoints. It's by default enabled. To disable it: plugins=[..., \"no:runinfo\"], or uninstall this plugin.\n\n## Plugin options\n\n- `runinfo_lang`: The name of the language to run the job script for session info.\n    Default is `None`, which means it will be inferred from the `proc.lang`\n    This should be a process-level option, unless you only have one single\n    process in your pipeline.\n- `runinfo_path`: Whether to include paths for the modules in the session information.\n    Default is `True`.\n    This option could be either specified in the process-level or the pipeline-level.\n    Only works for `python`.\n- `runinfo_submod`: Whether to include submodules in the session information.\n    Default is `False`.\n    This option could be either specified in the process-level or the pipeline-level.\n    Only works for `python`.\n\n## Supported languages for session info\n\n`python`, `R`, `bash`, and `fish`.\n\n## Usage\n\nThe plugin will generate 3 files in the job directory of the pipeline.\n\n### `job.runinfo.session`\n\nThe session information of the job, including the interpreter, packages and their versions.\n\n#### Python\n\nGenerates a TSV file with the following columns:\n\n- `Name`: The name of the module, or python itself\n- `__version__`: The version fetched by `module.__version__` or `module.version`\n- `importlib.metadata`: The version fetched by `importlib.metadata.version(package)`\n- `Path`: The path of the module (only if `runinfo_path` is `True`)\n\n#### R\n\nGenerates a text file `sessionInfo()` output.\n\n#### Bash\n\nGenerates a TSV file with the following columns:\n\n- `SHELL`: The value of `$SHELL`\n- `BASH_VERSION`: The value of `$BASH_VERSION`\n- `BASH_ARGV0`: The value of `$BASH_ARGV0`\n- `BASH_SOURCE`: The value of `$BASH_SOURCE`\n- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`\n- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`\n\n#### Fish\n\nGenerates a TSV file with the following columns:\n\n- `SHELL`: The value of `$SHELL`\n- `FISH_VERSION`: The value of `$FISH_VERSION`\n- `proc-exe`: The real path of the executable from `/proc/<pid>/exe`\n- `proc-exe-version`: The version of the executable from `/proc/<pid>/exe --version`\n\n### `job.runinfo.time`\n\nThe time spent on the job, and more, generated by `time -v` command.\n\n### `job.runinfo.device`\n\nThe device (cpu and memory) information of the job, generated by `lscpu`/`lsmem` command.\n\n\n[1]: https://github.com/pwwang/pipen\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Generate running information for jobs in pipen pipelines",
    "version": "0.8.1",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e4af49f0d62826cda82a0da06cc2f8bf03f4effe16d1a3cc4145cfffac5b19b0",
                "md5": "24c0c97f6b0b3f9a24b95f5dfbd7260d",
                "sha256": "56bbd2f0e27ada4e0b32e7e07aabf9f3539095dd5c3f75ff2c656a44f7e64896"
            },
            "downloads": -1,
            "filename": "pipen_runinfo-0.8.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "24c0c97f6b0b3f9a24b95f5dfbd7260d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 5674,
            "upload_time": "2024-08-14T19:28:06",
            "upload_time_iso_8601": "2024-08-14T19:28:06.551730Z",
            "url": "https://files.pythonhosted.org/packages/e4/af/49f0d62826cda82a0da06cc2f8bf03f4effe16d1a3cc4145cfffac5b19b0/pipen_runinfo-0.8.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "bc2c8d9645f629538bff6cd9bdea5107a7bb15c09f53837cff3ad962b05199f6",
                "md5": "5051c51f5cc43c4398755bdcd021228f",
                "sha256": "480c8f5868b9a8f953ee61855693f33642dafb6520ba6c545f680b3298ba4d2d"
            },
            "downloads": -1,
            "filename": "pipen_runinfo-0.8.1.tar.gz",
            "has_sig": false,
            "md5_digest": "5051c51f5cc43c4398755bdcd021228f",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 5298,
            "upload_time": "2024-08-14T19:28:07",
            "upload_time_iso_8601": "2024-08-14T19:28:07.765759Z",
            "url": "https://files.pythonhosted.org/packages/bc/2c/8d9645f629538bff6cd9bdea5107a7bb15c09f53837cff3ad962b05199f6/pipen_runinfo-0.8.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-08-14 19:28:07",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "pipen-runinfo"
}
        
Elapsed time: 0.40567s