submitit_oar


Namesubmitit_oar JSON
Version 1.1.1 PyPI version JSON
download
home_pageNone
SummaryOAR plugin for Submitit
upload_time2024-03-04 16:21:53
maintainerNone
docs_urlNone
authorNone
requires_python>=3.8
licenseNone
keywords submitit oar
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # What is submitit_oar?
submitit_oar is an [Oar](https://oar.imag.fr/) plugin for [Submitit](https://github.com/facebookincubator/submitit), which is a Python 3.8+ lightweight toolbox for submitting Python functions for computation within a [Slurm](https://slurm.schedmd.com/quickstart.html) cluster. It basically wraps submission and provide access to results, logs and more.

# How to install submitit_oar?
Quick install, in a virtualenv/conda environment where `pip` is installed (check `which pip`):
- latest release:
```
pip install submitit_oar==1.1.0
```
- from source:
```
pip install git+https://github.com/ychiat35/submitit_oar@main#egg=submitit_oar
```

# How to use the submitit_oar plugin?
From inside an environment with `submitit` and `submitit_oar` installed, you can run this addition example:

```python
import submitit

def add(a, b):
    return a + b

# logs are dumped in the folder
executor = submitit.AutoExecutor(folder="log_test", cluster="oar")

job_addition = executor.submit(add, 5, 7)  # will compute add(5, 7)
output = job_addition.result()  # waits for completion and returns output
# if ever the job failed, result() will raise an error with the corresponding trace
print('job_addition output: ', output)
assert output == 12
```

You can try running this above example with a breakpoint at https://github.com/facebookincubator/submitit/blob/main/submitit/core/plugins.py#L33, to be sure that Submitit correctly finds the submitit_oar plugin.

# Releasing submitit_oar

Create a tag matching the version to release in gitlab, it should create a pipeline which will push the package to PyPi.
If you want to do this manually, populate the `FLIT_PASSWORD` environment variable with the API token, and run `make release`

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "submitit_oar",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "submitit,oar",
    "author": null,
    "author_email": "Yao Chi <yao.chi@inria.fr>",
    "download_url": "https://files.pythonhosted.org/packages/92/35/ccfcd732aa2153f3aa207a0a7e3386a3bb631d0547192413e4f301bddf7f/submitit_oar-1.1.1.tar.gz",
    "platform": null,
    "description": "# What is submitit_oar?\nsubmitit_oar is an [Oar](https://oar.imag.fr/) plugin for [Submitit](https://github.com/facebookincubator/submitit), which is a Python 3.8+ lightweight toolbox for submitting Python functions for computation within a [Slurm](https://slurm.schedmd.com/quickstart.html) cluster. It basically wraps submission and provide access to results, logs and more.\n\n# How to install submitit_oar?\nQuick install, in a virtualenv/conda environment where `pip` is installed (check `which pip`):\n- latest release:\n```\npip install submitit_oar==1.1.0\n```\n- from source:\n```\npip install git+https://github.com/ychiat35/submitit_oar@main#egg=submitit_oar\n```\n\n# How to use the submitit_oar plugin?\nFrom inside an environment with `submitit` and `submitit_oar` installed, you can run this addition example:\n\n```python\nimport submitit\n\ndef add(a, b):\n    return a + b\n\n# logs are dumped in the folder\nexecutor = submitit.AutoExecutor(folder=\"log_test\", cluster=\"oar\")\n\njob_addition = executor.submit(add, 5, 7)  # will compute add(5, 7)\noutput = job_addition.result()  # waits for completion and returns output\n# if ever the job failed, result() will raise an error with the corresponding trace\nprint('job_addition output: ', output)\nassert output == 12\n```\n\nYou can try running this above example with a breakpoint at https://github.com/facebookincubator/submitit/blob/main/submitit/core/plugins.py#L33, to be sure that Submitit correctly finds the submitit_oar plugin.\n\n# Releasing submitit_oar\n\nCreate a tag matching the version to release in gitlab, it should create a pipeline which will push the package to PyPi.\nIf you want to do this manually, populate the `FLIT_PASSWORD` environment variable with the API token, and run `make release`\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "OAR plugin for Submitit",
    "version": "1.1.1",
    "project_urls": {
        "Source": "https://github.com/ychiat35/submitit_oar.git",
        "Tracker": "https://github.com/ychiat35/submitit_oar.git/issues"
    },
    "split_keywords": [
        "submitit",
        "oar"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "8a849a324fae651261978c983a50bbf47eac945d3b127f1ae1edcc6d9c4ad40e",
                "md5": "77a9e91b3520dbcd4d10b2e82cc89bec",
                "sha256": "a11d89c423ce6d7acf3c04bea46c1e6a739900db7cc56c8464024b2f34234ff4"
            },
            "downloads": -1,
            "filename": "submitit_oar-1.1.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "77a9e91b3520dbcd4d10b2e82cc89bec",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 18108,
            "upload_time": "2024-03-04T16:21:51",
            "upload_time_iso_8601": "2024-03-04T16:21:51.159859Z",
            "url": "https://files.pythonhosted.org/packages/8a/84/9a324fae651261978c983a50bbf47eac945d3b127f1ae1edcc6d9c4ad40e/submitit_oar-1.1.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "9235ccfcd732aa2153f3aa207a0a7e3386a3bb631d0547192413e4f301bddf7f",
                "md5": "7b31074e9a43fca31afcc585a34eb25f",
                "sha256": "480194e583b94329e5c184a3e7e0e5c19343562b58b23c0bf991f0679ca5847e"
            },
            "downloads": -1,
            "filename": "submitit_oar-1.1.1.tar.gz",
            "has_sig": false,
            "md5_digest": "7b31074e9a43fca31afcc585a34eb25f",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 21114,
            "upload_time": "2024-03-04T16:21:53",
            "upload_time_iso_8601": "2024-03-04T16:21:53.156658Z",
            "url": "https://files.pythonhosted.org/packages/92/35/ccfcd732aa2153f3aa207a0a7e3386a3bb631d0547192413e4f301bddf7f/submitit_oar-1.1.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-03-04 16:21:53",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "ychiat35",
    "github_project": "submitit_oar",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "circle": true,
    "lcname": "submitit_oar"
}
        
Elapsed time: 0.18879s