custodian


Namecustodian JSON
Version 2024.3.12 PyPI version JSON
download
home_page
SummaryA simple JIT job management framework in Python.
upload_time2024-03-12 19:08:52
maintainerJanosh Riebesell, Shyue Ping Ong
docs_urlhttps://pythonhosted.org/custodian/
authorMatthew Horton, Samuel M. Blau, Stephen Dacek, William Davidson Richards, Xiaohui Qu
requires_python>=3.9
licenseThe MIT License (MIT) Copyright (c) 2011-2012 MIT & LBNL Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
keywords jit job just-in-time management vasp
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ![Custodian logo](docs/assets/custodian_logo.png)
[![GitHub license](https://img.shields.io/github/license/materialsproject/custodian)](https://github.com/materialsproject/custodian/blob/main/LICENSE)
[![Linting](https://github.com/materialsproject/custodian/workflows/Linting/badge.svg)](https://github.com/materialsproject/custodian/workflows/Linting/badge.svg)
[![Testing](https://github.com/materialsproject/custodian/actions/workflows/pytest.yml/badge.svg)](https://github.com/materialsproject/custodian/actions/workflows/pytest.yml)
[![Downloads](https://pepy.tech/badge/custodian)](https://pepy.tech/project/custodian)
[![codecov](https://codecov.io/gh/materialsproject/custodian/branch/master/graph/badge.svg?token=OwDQVJnghu)](https://codecov.io/gh/materialsproject/custodian)

Custodian is a simple, robust and flexible just-in-time (JIT) job management
framework written in Python. Using custodian, you can create wrappers that
perform error checking, job management and error recovery. It has a simple
plugin framework that allows you to develop specific job management workflows
for different applications.

Error recovery is an important aspect of many *high-throughput* projects that
generate data on a large scale. When you are running on the order of hundreds
of thousands of jobs, even an error-rate of 1% would mean thousands of errored
jobs that would be impossible to deal with on a case-by-case basis.

The specific use case for custodian is for long running jobs, with potentially
random errors. For example, there may be a script that takes several days to
run on a server, with a 1% chance of some IO error causing the job to fail.
Using custodian, one can develop a mechanism to gracefully recover from the
error, and restart the job with modified parameters if necessary.

The current version of Custodian also comes with several sub-packages for error
handling for Vienna Ab Initio Simulation Package (VASP), NwChem, QChem, FEFF, Lobster and CP2K
calculations.

# Getting custodian

## Stable version

The version at the Python Package Index (PyPI) is always the latest stable release that will be hopefully, be
relatively bug-free. Install as follows:

```sh
pip install custodian
```

Some plugins (e.g., VASP management) require additional setup (please see [pymatgen docs]).

## Developmental version

The bleeding edge developmental version is at the custodian's [Github repo](https://github.com/materialsproject/custodian). The developmental
version is likely to be more buggy, but may contain new features. The Github version include test files as well for
complete unit testing. After cloning the source, you can type

```sh
python setup.py install
```

or to install the package in developmental mode::

```sh
python setup.py develop
```

# Requirements

Custodian supports Python 3.8+. There are no other required dependencies. However, if you wish to use many of the
built-in error handlers and Jobs for VASP, NWChem, QChem, etc., you will likely need pymatgen to be installed as well.

# Usage

Please refer to the official [custodian docs] for details on how to use
custodian.

# How to cite custodian

If you use custodian in your research, especially the VASP component, please
consider citing the following work:

```
Shyue Ping Ong, William Davidson Richards, Anubhav Jain, Geoffroy Hautier,
Michael Kocher, Shreyas Cholia, Dan Gunter, Vincent Chevrier, Kristin A.
Persson, Gerbrand Ceder. *Python Materials Genomics (pymatgen) : A Robust,
Open-Source Python Library for Materials Analysis.* Computational
Materials Science, 2013, 68, 314-319. doi:10.1016/j.commatsci.2012.10.028
```

# License

Custodian is released under the MIT License. The terms of the license are as
follows:

```txt
The MIT License (MIT)
Copyright (c) 2011-2012 MIT & LBNL

Permission is hereby granted, free of charge, to any person obtaining a
copy of this software and associated documentation files (the "Software"),
to deal in the Software without restriction, including without limitation
the rights to use, copy, modify, merge, publish, distribute, sublicense,
and/or sell copies of the Software, and to permit persons to whom the
Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
DEALINGS IN THE SOFTWARE.
```

[pymatgen docs]: http://pymatgen.org/
[custodian docs]: https://materialsproject.github.io/custodian/

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "custodian",
    "maintainer": "Janosh Riebesell, Shyue Ping Ong",
    "docs_url": "https://pythonhosted.org/custodian/",
    "requires_python": ">=3.9",
    "maintainer_email": "",
    "keywords": "jit,job,just-in-time,management,vasp",
    "author": "Matthew Horton, Samuel M. Blau, Stephen Dacek, William Davidson Richards, Xiaohui Qu",
    "author_email": "Janosh Riebesell <janosh.riebesell@gmail.com>, Shyue Ping Ong <ongsp@ucsd.edu>",
    "download_url": "https://files.pythonhosted.org/packages/2e/09/8da4479a22760b051ee1b09c53cd2a9a5b77250e02c02b394f59197b9b60/custodian-2024.3.12.tar.gz",
    "platform": null,
    "description": "![Custodian logo](docs/assets/custodian_logo.png)\n[![GitHub license](https://img.shields.io/github/license/materialsproject/custodian)](https://github.com/materialsproject/custodian/blob/main/LICENSE)\n[![Linting](https://github.com/materialsproject/custodian/workflows/Linting/badge.svg)](https://github.com/materialsproject/custodian/workflows/Linting/badge.svg)\n[![Testing](https://github.com/materialsproject/custodian/actions/workflows/pytest.yml/badge.svg)](https://github.com/materialsproject/custodian/actions/workflows/pytest.yml)\n[![Downloads](https://pepy.tech/badge/custodian)](https://pepy.tech/project/custodian)\n[![codecov](https://codecov.io/gh/materialsproject/custodian/branch/master/graph/badge.svg?token=OwDQVJnghu)](https://codecov.io/gh/materialsproject/custodian)\n\nCustodian is a simple, robust and flexible just-in-time (JIT) job management\nframework written in Python. Using custodian, you can create wrappers that\nperform error checking, job management and error recovery. It has a simple\nplugin framework that allows you to develop specific job management workflows\nfor different applications.\n\nError recovery is an important aspect of many *high-throughput* projects that\ngenerate data on a large scale. When you are running on the order of hundreds\nof thousands of jobs, even an error-rate of 1% would mean thousands of errored\njobs that would be impossible to deal with on a case-by-case basis.\n\nThe specific use case for custodian is for long running jobs, with potentially\nrandom errors. For example, there may be a script that takes several days to\nrun on a server, with a 1% chance of some IO error causing the job to fail.\nUsing custodian, one can develop a mechanism to gracefully recover from the\nerror, and restart the job with modified parameters if necessary.\n\nThe current version of Custodian also comes with several sub-packages for error\nhandling for Vienna Ab Initio Simulation Package (VASP), NwChem, QChem, FEFF, Lobster and CP2K\ncalculations.\n\n# Getting custodian\n\n## Stable version\n\nThe version at the Python Package Index (PyPI) is always the latest stable release that will be hopefully, be\nrelatively bug-free. Install as follows:\n\n```sh\npip install custodian\n```\n\nSome plugins (e.g., VASP management) require additional setup (please see [pymatgen docs]).\n\n## Developmental version\n\nThe bleeding edge developmental version is at the custodian's [Github repo](https://github.com/materialsproject/custodian). The developmental\nversion is likely to be more buggy, but may contain new features. The Github version include test files as well for\ncomplete unit testing. After cloning the source, you can type\n\n```sh\npython setup.py install\n```\n\nor to install the package in developmental mode::\n\n```sh\npython setup.py develop\n```\n\n# Requirements\n\nCustodian supports Python 3.8+. There are no other required dependencies. However, if you wish to use many of the\nbuilt-in error handlers and Jobs for VASP, NWChem, QChem, etc., you will likely need pymatgen to be installed as well.\n\n# Usage\n\nPlease refer to the official [custodian docs] for details on how to use\ncustodian.\n\n# How to cite custodian\n\nIf you use custodian in your research, especially the VASP component, please\nconsider citing the following work:\n\n```\nShyue Ping Ong, William Davidson Richards, Anubhav Jain, Geoffroy Hautier,\nMichael Kocher, Shreyas Cholia, Dan Gunter, Vincent Chevrier, Kristin A.\nPersson, Gerbrand Ceder. *Python Materials Genomics (pymatgen) : A Robust,\nOpen-Source Python Library for Materials Analysis.* Computational\nMaterials Science, 2013, 68, 314-319. doi:10.1016/j.commatsci.2012.10.028\n```\n\n# License\n\nCustodian is released under the MIT License. The terms of the license are as\nfollows:\n\n```txt\nThe MIT License (MIT)\nCopyright (c) 2011-2012 MIT & LBNL\n\nPermission is hereby granted, free of charge, to any person obtaining a\ncopy of this software and associated documentation files (the \"Software\"),\nto deal in the Software without restriction, including without limitation\nthe rights to use, copy, modify, merge, publish, distribute, sublicense,\nand/or sell copies of the Software, and to permit persons to whom the\nSoftware is furnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in\nall copies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\nIMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\nFITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\nAUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\nLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING\nFROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER\nDEALINGS IN THE SOFTWARE.\n```\n\n[pymatgen docs]: http://pymatgen.org/\n[custodian docs]: https://materialsproject.github.io/custodian/\n",
    "bugtrack_url": null,
    "license": "The MIT License (MIT) Copyright (c) 2011-2012 MIT & LBNL  Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the \"Software\"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:  The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.  THE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. ",
    "summary": "A simple JIT job management framework in Python.",
    "version": "2024.3.12",
    "project_urls": {
        "Docs": "https://materialsproject.github.io/custodian",
        "Package": "https://pypi.org/project/custodian",
        "Repo": "https://github.com/materialsproject/custodian"
    },
    "split_keywords": [
        "jit",
        "job",
        "just-in-time",
        "management",
        "vasp"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "2e098da4479a22760b051ee1b09c53cd2a9a5b77250e02c02b394f59197b9b60",
                "md5": "928f9da8a3a99339958f05e3bcc1494a",
                "sha256": "e57ff300d21ff63a08b63be6b8e1b1d5175178a2f77ac8666ffdf63c2d83808e"
            },
            "downloads": -1,
            "filename": "custodian-2024.3.12.tar.gz",
            "has_sig": false,
            "md5_digest": "928f9da8a3a99339958f05e3bcc1494a",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.9",
            "size": 92070,
            "upload_time": "2024-03-12T19:08:52",
            "upload_time_iso_8601": "2024-03-12T19:08:52.538178Z",
            "url": "https://files.pythonhosted.org/packages/2e/09/8da4479a22760b051ee1b09c53cd2a9a5b77250e02c02b394f59197b9b60/custodian-2024.3.12.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-03-12 19:08:52",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "materialsproject",
    "github_project": "custodian",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "custodian"
}
        
Elapsed time: 0.21461s