beobench


Namebeobench JSON
Version 0.5.2 PyPI version JSON
download
home_page
SummaryBeobench is a toolkit providing easy and unified access to building control environments for reinforcement learning (RL).
upload_time2022-07-01 18:16:18
maintainer
docs_urlNone
authorBeobench authors
requires_python>=3.6
licenseMIT license
keywords beobench
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            A toolkit providing easy and unified access to building control environments for reinforcement learning (RL). Compared to other domains, `RL environments for building control <https://github.com/rdnfn/rl-building-control#environments>`_ tend to be more difficult to install and handle. Most environments require the user to either manually install a building simulator (e.g. `EnergyPlus <https://github.com/NREL/EnergyPlus>`_) or to manually manage Docker containers. This can be tedious.

Beobench was created to make building control environments easier to use and experiments more reproducible. Beobench uses Docker to manage all environment dependencies in the background so that the user doesn't have to. A standardised API allows the user to easily configure experiments and evaluate new RL agents on building control environments.

For more information go to the `documentation <https://beobench.readthedocs.io/>`_ and the `GitHub code repository <https://github.com/rdnfn/beobench>`_.

=======
History
=======

0.5.2 (2022-07-01)
------------------

* Improvements:

  * Add more informative error when there are issues with access to Docker from Beobench.

* Fixes:

  * Revert default build command to ``docker build`` from ``docker buildx build``. Only arm64 machines use ``buildx`` now. This aims to enable usage of older docker versions such as v19.03 on non-arm64 machines. Arm64 machines require buildx and thus also newer docker versions.
  * Fix wrong env name in logging output. Removes unused default env name var and fix logging output to use new env name location.



0.5.1 (2022-06-28)
------------------

* Features:

  * Add pretty logging based on loguru package. Now all Beobench output is clearly marked as such.

* Improvements:

  * Enable adding wrapper without setting config.
  * Add ``demo.yaml`` simple example config.

* Fixes:

  * Update Sinergym integration to latest Sinergym version.

0.5.0 (2022-05-26)
------------------

* Features:

  * Mean and cummulative metrics can now be logged by WandbLogger wrapper.
  * Support for automatically running multiple samples/trials of same experiment via ``num_samples`` config parameter.
  * Configs named `.beobench.yml` will be automatically parsed when Beobench is run in directory containing such a config. This allows users to set e.g. wandb API keys without referring to the config in every Beobench command call.
  * Configs from experiments now specify the Beobench version used. When trying to rerun an experiment this version will be checked, and an error thrown if there is a mismatch between installed and requested version.
  * Add improved high-level API for getting started. This uses the CLI arguments ``--method``, ``--gym`` and ``--env``. Example usage: ``beobench run --method ppo --gym sinergym --env Eplus-5Zone-hot-continuous-v1`` (#55).

* Improvements:

  * Add ``CITATION.cff`` file to make citing software easier.
  * By default, docker builds of experiment images are now skipped if an image with tag corresponding to installed Beobench version already exists.
  * Remove outdated guides and add yaml configuration description from docs (#38, #76, #78).
  * Add support for logging multidimensional actions to wandb.
  * Add support for logging summary metrics on every env reset to wandb.
  * Energym config now uses ``name`` argument like other integrations (#34).

* Fixes:

  * Updated BOPTEST integration to work with current version of Beobench.

0.4.4 (2022-05-09)
------------------

* Features:

  * Add general support for wrappers. (#28)

* Improvements:

  * Make dev beobench build part of image build process for improved
    speed.
  * Add number of environment steps (``env_step``) to wandb logging.
  * Update logo to new version (#48)
  * Update docs and main readme to include more useful quickstart guide, which includes a custom agent (#47)

* Fixes:

  * Enable automatic episode data logging in RLlib integration for long training periods.
  * Update broken links in main readme env list (#40)

0.4.3 (2022-04-12)
------------------

* Feature: enable easy access to standard configs via util method
* Feature: add non-normalised observations to info in energym integration (#62)
* Feature: enable logging full episode data from RLlib and adding this data
  to wandb (#62)
* Feature: ship integrations with package improving image build times (#44)
* Feature: add wandb logging support for random agent script (#59)
* Feature: add rule-based agent script based on energym controller (#60)
* Fix: add importlib-resources backport package to requirements
* Fix: allow users to disable reset() method in energym envs (#43)
* Aux: add automatic deployment of PyPI package via GitHub actions (#50)
* Aux: add tests and automatic checks on PRs (#25)

0.4.2 (2022-04-04)
------------------

* Feature: defining all relevant options/kwargs of CLI an API is now supported
  yaml files (#54)
* Feature: allow multiple configs to be given to both CLI
  (giving multiple ``-c`` options) and Python API (as a list) (#51)
* Fix: adapted Energym env reset() method to avoid triggering
  long warm-up times with additional simulation runs (#43)
* Fix: enable container build even if prior build failed midway
  and left artifacts

0.4.1 (2022-03-30)
------------------

* Feature: enable package extras to be given in development mode
* Feature: add support for arm64/aarch64-based development by forcing
  experiment containers to run as amd64 containers on those systems (#32)
* Fix: add gym to extended package requirements


0.4.0 (2022-03-28)
------------------

* Make dependencies that are only used inside experiment/gym
  containers optional
  (for all dependencies install via ``pip install beobench[extended]``)
* Add two part experiment image build process so that there is shared beobench
  installation dockerfile
* Add support for yaml config files (!)
* Overhaul of documentation, including new envs page and new theme
* Enable RLlib free experiment containers when not required
* Add beobench_contrib as submodule
* Simplify Pypi readme file
* Remove GPU requirement for devcontainer

0.3.0 (2022-02-14)
------------------

* Add complete redesign of CLI: main command changed from
  ``python -m beobench.experiment.scheduler`` to ``beobench run``.
* Add support for energym environments
* Add support for MLflow experiment tracking
* Add support for custom agents


0.2.1 (2022-02-03)
------------------

* Add integration with sinergym
* Move gym integrations to separate beobench_contrib repo
* Make usage of GPUs in containers optional

0.2.0 (2022-01-18)
------------------

* Enable adding custom environments to beobench with
  *docker build context*-based syntax
* Save experiment results on host machine
* Major improvements to documentation
* Remove unnecessary wandb arguments in main CLI

0.1.0 (2022-01-10)
------------------

* First release on PyPI.

            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "beobench",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.6",
    "maintainer_email": "",
    "keywords": "beobench",
    "author": "Beobench authors",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/f2/ec/34d05145c94a970d83b46649c5bcb6aa30205ba6adba304413240418c1fb/beobench-0.5.2.tar.gz",
    "platform": null,
    "description": "A toolkit providing easy and unified access to building control environments for reinforcement learning (RL). Compared to other domains, `RL environments for building control <https://github.com/rdnfn/rl-building-control#environments>`_ tend to be more difficult to install and handle. Most environments require the user to either manually install a building simulator (e.g. `EnergyPlus <https://github.com/NREL/EnergyPlus>`_) or to manually manage Docker containers. This can be tedious.\n\nBeobench was created to make building control environments easier to use and experiments more reproducible. Beobench uses Docker to manage all environment dependencies in the background so that the user doesn't have to. A standardised API allows the user to easily configure experiments and evaluate new RL agents on building control environments.\n\nFor more information go to the `documentation <https://beobench.readthedocs.io/>`_ and the `GitHub code repository <https://github.com/rdnfn/beobench>`_.\n\n=======\nHistory\n=======\n\n0.5.2 (2022-07-01)\n------------------\n\n* Improvements:\n\n  * Add more informative error when there are issues with access to Docker from Beobench.\n\n* Fixes:\n\n  * Revert default build command to ``docker build`` from ``docker buildx build``. Only arm64 machines use ``buildx`` now. This aims to enable usage of older docker versions such as v19.03 on non-arm64 machines. Arm64 machines require buildx and thus also newer docker versions.\n  * Fix wrong env name in logging output. Removes unused default env name var and fix logging output to use new env name location.\n\n\n\n0.5.1 (2022-06-28)\n------------------\n\n* Features:\n\n  * Add pretty logging based on loguru package. Now all Beobench output is clearly marked as such.\n\n* Improvements:\n\n  * Enable adding wrapper without setting config.\n  * Add ``demo.yaml`` simple example config.\n\n* Fixes:\n\n  * Update Sinergym integration to latest Sinergym version.\n\n0.5.0 (2022-05-26)\n------------------\n\n* Features:\n\n  * Mean and cummulative metrics can now be logged by WandbLogger wrapper.\n  * Support for automatically running multiple samples/trials of same experiment via ``num_samples`` config parameter.\n  * Configs named `.beobench.yml` will be automatically parsed when Beobench is run in directory containing such a config. This allows users to set e.g. wandb API keys without referring to the config in every Beobench command call.\n  * Configs from experiments now specify the Beobench version used. When trying to rerun an experiment this version will be checked, and an error thrown if there is a mismatch between installed and requested version.\n  * Add improved high-level API for getting started. This uses the CLI arguments ``--method``, ``--gym`` and ``--env``. Example usage: ``beobench run --method ppo --gym sinergym --env Eplus-5Zone-hot-continuous-v1`` (#55).\n\n* Improvements:\n\n  * Add ``CITATION.cff`` file to make citing software easier.\n  * By default, docker builds of experiment images are now skipped if an image with tag corresponding to installed Beobench version already exists.\n  * Remove outdated guides and add yaml configuration description from docs (#38, #76, #78).\n  * Add support for logging multidimensional actions to wandb.\n  * Add support for logging summary metrics on every env reset to wandb.\n  * Energym config now uses ``name`` argument like other integrations (#34).\n\n* Fixes:\n\n  * Updated BOPTEST integration to work with current version of Beobench.\n\n0.4.4 (2022-05-09)\n------------------\n\n* Features:\n\n  * Add general support for wrappers. (#28)\n\n* Improvements:\n\n  * Make dev beobench build part of image build process for improved\n    speed.\n  * Add number of environment steps (``env_step``) to wandb logging.\n  * Update logo to new version (#48)\n  * Update docs and main readme to include more useful quickstart guide, which includes a custom agent (#47)\n\n* Fixes:\n\n  * Enable automatic episode data logging in RLlib integration for long training periods.\n  * Update broken links in main readme env list (#40)\n\n0.4.3 (2022-04-12)\n------------------\n\n* Feature: enable easy access to standard configs via util method\n* Feature: add non-normalised observations to info in energym integration (#62)\n* Feature: enable logging full episode data from RLlib and adding this data\n  to wandb (#62)\n* Feature: ship integrations with package improving image build times (#44)\n* Feature: add wandb logging support for random agent script (#59)\n* Feature: add rule-based agent script based on energym controller (#60)\n* Fix: add importlib-resources backport package to requirements\n* Fix: allow users to disable reset() method in energym envs (#43)\n* Aux: add automatic deployment of PyPI package via GitHub actions (#50)\n* Aux: add tests and automatic checks on PRs (#25)\n\n0.4.2 (2022-04-04)\n------------------\n\n* Feature: defining all relevant options/kwargs of CLI an API is now supported\n  yaml files (#54)\n* Feature: allow multiple configs to be given to both CLI\n  (giving multiple ``-c`` options) and Python API (as a list) (#51)\n* Fix: adapted Energym env reset() method to avoid triggering\n  long warm-up times with additional simulation runs (#43)\n* Fix: enable container build even if prior build failed midway\n  and left artifacts\n\n0.4.1 (2022-03-30)\n------------------\n\n* Feature: enable package extras to be given in development mode\n* Feature: add support for arm64/aarch64-based development by forcing\n  experiment containers to run as amd64 containers on those systems (#32)\n* Fix: add gym to extended package requirements\n\n\n0.4.0 (2022-03-28)\n------------------\n\n* Make dependencies that are only used inside experiment/gym\n  containers optional\n  (for all dependencies install via ``pip install beobench[extended]``)\n* Add two part experiment image build process so that there is shared beobench\n  installation dockerfile\n* Add support for yaml config files (!)\n* Overhaul of documentation, including new envs page and new theme\n* Enable RLlib free experiment containers when not required\n* Add beobench_contrib as submodule\n* Simplify Pypi readme file\n* Remove GPU requirement for devcontainer\n\n0.3.0 (2022-02-14)\n------------------\n\n* Add complete redesign of CLI: main command changed from\n  ``python -m beobench.experiment.scheduler`` to ``beobench run``.\n* Add support for energym environments\n* Add support for MLflow experiment tracking\n* Add support for custom agents\n\n\n0.2.1 (2022-02-03)\n------------------\n\n* Add integration with sinergym\n* Move gym integrations to separate beobench_contrib repo\n* Make usage of GPUs in containers optional\n\n0.2.0 (2022-01-18)\n------------------\n\n* Enable adding custom environments to beobench with\n  *docker build context*-based syntax\n* Save experiment results on host machine\n* Major improvements to documentation\n* Remove unnecessary wandb arguments in main CLI\n\n0.1.0 (2022-01-10)\n------------------\n\n* First release on PyPI.\n",
    "bugtrack_url": null,
    "license": "MIT license",
    "summary": "Beobench is a toolkit providing easy and unified access to building control environments for reinforcement learning (RL).",
    "version": "0.5.2",
    "split_keywords": [
        "beobench"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "ca78a95777f8b4a8f1e93c5ea276a72b",
                "sha256": "b9475552d9911462821394bd57e42b78092ad6e1acbf23baf2ab0fc406f32016"
            },
            "downloads": -1,
            "filename": "beobench-0.5.2-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "ca78a95777f8b4a8f1e93c5ea276a72b",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": ">=3.6",
            "size": 63286,
            "upload_time": "2022-07-01T18:16:17",
            "upload_time_iso_8601": "2022-07-01T18:16:17.409329Z",
            "url": "https://files.pythonhosted.org/packages/1d/02/4bbb6d3d51892010e0cdfacdd4f390cd8d19862e51c0ea79426ecffadb2a/beobench-0.5.2-py2.py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "03fb205c9e715ec99813ba70356341ed",
                "sha256": "63cda18bce981e93294980c02d48707cbe3d29149e54ca9d74e73d268240ee07"
            },
            "downloads": -1,
            "filename": "beobench-0.5.2.tar.gz",
            "has_sig": false,
            "md5_digest": "03fb205c9e715ec99813ba70356341ed",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6",
            "size": 51663,
            "upload_time": "2022-07-01T18:16:18",
            "upload_time_iso_8601": "2022-07-01T18:16:18.770621Z",
            "url": "https://files.pythonhosted.org/packages/f2/ec/34d05145c94a970d83b46649c5bcb6aa30205ba6adba304413240418c1fb/beobench-0.5.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2022-07-01 18:16:18",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "lcname": "beobench"
}
        
Elapsed time: 0.47555s