slurmgen


Nameslurmgen JSON
Version 3.7.0 PyPI version JSON
download
home_pageNone
SummarySlurmGen - Simple Slurm Manager
upload_time2024-05-29 23:48:29
maintainerNone
docs_urlNone
authorNone
requires_python>=3.6
licenseBSD-2-Clause
keywords python slurm hpc cluster
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # SlurmGen - Simple Slurm Manager

> * **Repository: [github.com/otvam/slurmgen](https://github.com/otvam/slurmgen)**
> * **Package: [pypi.org/project/slurmgen](https://pypi.org/project/slurmgen)**

## Summary

**SlurmGen** is a very **simple** **Slurm** manager:
* The job description is stored in JSON files.
* The JSON files are transformed into Slurm scripts.
* The Slurm script can be run locally or on a Slurm Cluster.

**SlurmGen** is only supporting a small **subset** of **Slurm**:
* Create and delete folders.
* Set environment variables.
* Set the job name and log.
* Set the ressources (memory, time, CPU, etc.).
* Define the set of commands to be executed.

SlurmGen is not a binding and/or a wrapper for Slurm.
SlurmGen is only generating Slurm scripts from JSON files.
SlurmGen is written in Python without any external dependencies.

## Example

An example is located in the `example` folder of the repository:
* `job_def.json` contains the job definition
* `job_tmpl.json` contains the template data
* `run_slurm.py` contains is dummy script executed by the jon
* `slurm_output` contains the generated Slurm script and log file
* `data_output` contains data generated by the Slurm job

```bash
# Create a Slurm script with a command line template.
sgen job_def.json --tmpl_str "title" "test" --tmpl_str "var" "Welcome to everyone"

# Create a Slurm script with a JSON file template.
sgen job_def.json --tmpl_file job_tmpl.json

# Create a Slurm script and run the job locally.
sgen job_def.json --local --tmpl_file job_tmpl.json

# Create a Slurm script and run the job on the cluster.
sgen job_def.json --cluster --tmpl_file job_tmpl.json
```

## Project Links

* Repository: https://github.com/otvam/slurmgen
* Releases: https://github.com/otvam/slurmgen/releases
* Tags: https://github.com/otvam/slurmgen/tags
* Issues: https://github.com/otvam/slurmgen/issues
* PyPi: https://pypi.org/project/slurmgen

## Author

* **Thomas Guillod**
* Email: guillod@otvam.ch
* Website: https://otvam.ch

## Copyright

> (c) 2023 - Thomas Guillod
> 
>  BSD 2-Clause "Simplified" License

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "slurmgen",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.6",
    "maintainer_email": "Thomas Guillod <guillod@otvam.ch>",
    "keywords": "Python, Slurm, HPC, Cluster",
    "author": null,
    "author_email": "Thomas Guillod <guillod@otvam.ch>",
    "download_url": "https://files.pythonhosted.org/packages/65/94/e83196ba1d1622ffd9969e4d29793aa47765fa7ece5c635e0d1e9e0b3c60/slurmgen-3.7.0.tar.gz",
    "platform": null,
    "description": "# SlurmGen - Simple Slurm Manager\n\n> * **Repository: [github.com/otvam/slurmgen](https://github.com/otvam/slurmgen)**\n> * **Package: [pypi.org/project/slurmgen](https://pypi.org/project/slurmgen)**\n\n## Summary\n\n**SlurmGen** is a very **simple** **Slurm** manager:\n* The job description is stored in JSON files.\n* The JSON files are transformed into Slurm scripts.\n* The Slurm script can be run locally or on a Slurm Cluster.\n\n**SlurmGen** is only supporting a small **subset** of **Slurm**:\n* Create and delete folders.\n* Set environment variables.\n* Set the job name and log.\n* Set the ressources (memory, time, CPU, etc.).\n* Define the set of commands to be executed.\n\nSlurmGen is not a binding and/or a wrapper for Slurm.\nSlurmGen is only generating Slurm scripts from JSON files.\nSlurmGen is written in Python without any external dependencies.\n\n## Example\n\nAn example is located in the `example` folder of the repository:\n* `job_def.json` contains the job definition\n* `job_tmpl.json` contains the template data\n* `run_slurm.py` contains is dummy script executed by the jon\n* `slurm_output` contains the generated Slurm script and log file\n* `data_output` contains data generated by the Slurm job\n\n```bash\n# Create a Slurm script with a command line template.\nsgen job_def.json --tmpl_str \"title\" \"test\" --tmpl_str \"var\" \"Welcome to everyone\"\n\n# Create a Slurm script with a JSON file template.\nsgen job_def.json --tmpl_file job_tmpl.json\n\n# Create a Slurm script and run the job locally.\nsgen job_def.json --local --tmpl_file job_tmpl.json\n\n# Create a Slurm script and run the job on the cluster.\nsgen job_def.json --cluster --tmpl_file job_tmpl.json\n```\n\n## Project Links\n\n* Repository: https://github.com/otvam/slurmgen\n* Releases: https://github.com/otvam/slurmgen/releases\n* Tags: https://github.com/otvam/slurmgen/tags\n* Issues: https://github.com/otvam/slurmgen/issues\n* PyPi: https://pypi.org/project/slurmgen\n\n## Author\n\n* **Thomas Guillod**\n* Email: guillod@otvam.ch\n* Website: https://otvam.ch\n\n## Copyright\n\n> (c) 2023 - Thomas Guillod\n> \n>  BSD 2-Clause \"Simplified\" License\n",
    "bugtrack_url": null,
    "license": "BSD-2-Clause",
    "summary": "SlurmGen - Simple Slurm Manager",
    "version": "3.7.0",
    "project_urls": {
        "Homepage": "https://github.com/otvam/slurmgen",
        "Issues": "https://github.com/otvam/slurmgen/issues",
        "Releases": "https://github.com/otvam/slurmgen/releases",
        "Repository": "https://github.com/otvam/slurmgen",
        "Tags": "https://github.com/otvam/slurmgen/tags"
    },
    "split_keywords": [
        "python",
        " slurm",
        " hpc",
        " cluster"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "87e423861b74850136333e71ca981197dd2d257b27375a2ca0439333bf32244f",
                "md5": "f26d023854deeaa1d4d1a5195a9fbb17",
                "sha256": "54b7dda895cf829ee5b27f76adf3d8365ed893dc13a171cd5593a98ee356213c"
            },
            "downloads": -1,
            "filename": "slurmgen-3.7.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "f26d023854deeaa1d4d1a5195a9fbb17",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.6",
            "size": 8829,
            "upload_time": "2024-05-29T23:48:28",
            "upload_time_iso_8601": "2024-05-29T23:48:28.100215Z",
            "url": "https://files.pythonhosted.org/packages/87/e4/23861b74850136333e71ca981197dd2d257b27375a2ca0439333bf32244f/slurmgen-3.7.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6594e83196ba1d1622ffd9969e4d29793aa47765fa7ece5c635e0d1e9e0b3c60",
                "md5": "7bb51614a92a910968ac383cdcdcf2d0",
                "sha256": "ff07f31f9f7f1c517f8b601648f6ab7f1bfeccdcaa487b63db6c9cac7d565421"
            },
            "downloads": -1,
            "filename": "slurmgen-3.7.0.tar.gz",
            "has_sig": false,
            "md5_digest": "7bb51614a92a910968ac383cdcdcf2d0",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6",
            "size": 10680,
            "upload_time": "2024-05-29T23:48:29",
            "upload_time_iso_8601": "2024-05-29T23:48:29.435917Z",
            "url": "https://files.pythonhosted.org/packages/65/94/e83196ba1d1622ffd9969e4d29793aa47765fa7ece5c635e0d1e9e0b3c60/slurmgen-3.7.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-05-29 23:48:29",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "otvam",
    "github_project": "slurmgen",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "slurmgen"
}
        
Elapsed time: 0.24125s