NREL-nsrdb


NameNREL-nsrdb JSON
Version 4.1.1 PyPI version JSON
download
home_pageNone
SummaryNational Solar Radiation Database (NSRDB) Software
upload_time2024-10-28 11:47:52
maintainerNone
docs_urlNone
authorNone
requires_python>=3.9
licenseBSD-3-Clause
keywords nsrdb nrel
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ##########################################################
Welcome to the National Solar Radiation Data Base (NSRDB)!
##########################################################
|Docs| |Tests| |Linter| |PyPi| |PythonV| |Codecov| |Zenodo|

.. |Docs| image:: https://github.com/NREL/nsrdb/workflows/Documentation/badge.svg
    :target: https://nrel.github.io/nsrdb/

.. |Tests| image:: https://github.com/NREL/nsrdb/workflows/Pytests/badge.svg
    :target: https://github.com/NREL/nsrdb/actions?query=workflow%3A%22Pytests%22

.. |Linter| image:: https://github.com/NREL/nsrdb/workflows/Lint%20Code%20Base/badge.svg
    :target: https://github.com/NREL/nsrdb/actions?query=workflow%3A%22Lint+Code+Base%22

.. |PyPi| image:: https://img.shields.io/pypi/pyversions/NREL-nsrdb.svg
    :target: https://pypi.org/project/NREL-nsrdb/

.. |PythonV| image:: https://badge.fury.io/py/NREL-nsrdb.svg
    :target: https://badge.fury.io/py/NREL-nsrdb

.. |Codecov| image:: https://codecov.io/gh/nrel/nsrdb/branch/main/graph/badge.svg
    :target: https://codecov.io/gh/nrel/nsrdb

.. |Zenodo| image:: https://zenodo.org/badge/340209614.svg
    :target: https://zenodo.org/badge/latestdoi/340209614

.. inclusion-intro

The National Solar Radiation Database (NSRDB) software includes all the methods
for the irradiance data processing pipeline. To get started, check out the
NSRDB command line interface `(CLI) <https://nrel.github.io/nsrdb/_cli/nsrdb.html#nsrdb>`_.
Refer to the `NREL website
<https://nsrdb.nrel.gov/>`_ and the original `journal article
<https://www.sciencedirect.com/science/article/pii/S136403211830087X>`_ for
more information on the NSRDB.  For details on NSRDB variable units, datatypes,
and attributes, see the `NSRDB variable meta data
<https://github.com/NREL/nsrdb/blob/master/config/nsrdb_vars.csv>`_.

The PXS All-Sky Irradiance Model
================================
The PXS All-Sky `Irradiance Model
<https://github.com/NREL/nsrdb/tree/master/nsrdb/all_sky>`_ is the main physics
package that calculates surface irradiance variables.

The NSRDB Data Model
====================
The NSRDB `Data Model
<https://github.com/NREL/nsrdb/tree/master/nsrdb/data_model>`_ is the data
aggregation framework that sources, processes, and prepares data for input to
All-Sky.

The MLClouds Model
==================
The `MLClouds Model <https://github.com/NREL/mlclouds.git>`_ is used to predict
missing cloud properties (a.k.a. Gap Fill). The NSRDB interface with MLClouds
can be found `here <https://github.com/NREL/nsrdb/tree/master/nsrdb/gap_fill>`_.

Installation
============

Option 1: Install from PIP (recommended for analysts):
------------------------------------------------------

1. Create a new environment: ``conda create --name nsrdb python=3.9``

2. Activate environment: ``conda activate nsrdb``

3. Install nsrdb: ``pip install NREL-nsrdb``

Option 2: Clone repo (recommended for developers)
-------------------------------------------------

1. from home dir, ``git clone git@github.com:NREL/nsrdb.git``

2. Create ``nsrdb`` environment and install package
    1) Create a conda env: ``conda create -n nsrdb``
    2) Run the command: ``conda activate nsrdb``
    3) ``cd`` into the repo cloned in 1.
    4) Prior to running ``pip`` below, make sure the branch is correct (install
       from main!)
    5) Install ``nsrdb`` and its dependencies by running:
       ``pip install .`` (or ``pip install -e .`` if running a dev branch
       or working on the source code)
    6) *Optional*: Set up the pre-commit hooks with ``pip install pre-commit`` and ``pre-commit install``


NSRDB Versions
==============

.. list-table:: NSRDB Versions History
    :widths: auto
    :header-rows: 1

    * - Version
      - Effective Date
      - Data Years*
      - Notes
    * - 4.1.0
      - 7/9/24
      - None
      - Complete CLI refactor.
    * - 4.0.0
      - 5/1/23
      - 2022
      - Integrated new FARMS-DNI model.
    * - 3.2.3
      - 4/13/23
      - None
      - Fixed MERRA interpolation issue #51 and deprecated python 3.7/3.8.
        Added changes to accommodate pandas v2.0.0.
    * - 3.2.2
      - 2/25/2022
      - 1998-2021
      - Implemented a model for snowy albedo as a function of temperature from
        MERRA2 based on the paper "A comparison of simulated and observed
        fluctuations in summertime Arctic surface albedo" by Becky Ross and
        John E. Walsh
    * - 3.2.1
      - 1/12/2021
      - 2021
      - Implemented an algorithm to re-map the parallax and shading corrected
        cloud coordinates to the nominal GOES coordinate system. This fixes the
        issue of PC cloud coordinates conflicting with clearsky coordinates.
        This also fixes the strange pattern that was found in the long term
        means generated from PC data.
    * - 3.2.0
      - 3/17/2021
      - 2020
      - Enabled cloud solar shading coordinate adjustment by default, enabled
        MLClouds machine learning gap fill method for missing cloud properties
        (cloud fill flag #7)
    * - 3.1.2
      - 6/8/2020
      - 2020
      - Added feature to adjust cloud coordinates based on solar position and
        shading geometry.
    * - 3.1.1
      - 12/5/2019
      - 2018+, TMY/TDY/TGY-2018
      - Complete refactor of TMY processing code.
    * - 3.1.0
      - 9/23/2019
      - 2018+
      - Complete refactor of NSRDB processing code for NSRDB 2018
    * - 3.0.6
      - 4/23/2019
      - 1998-2017
      - Missing data for all cloud properties gap filled using heuristics method
    * - 3.0.5
      - 4/8/2019
      - 1998-2017
      - Cloud pressure attributes and scale/offset fixed for 2016 and 2017
    * - 3.0.4
      - 3/29/2019
      - 1998-2017
      - Aerosol optical depth patched with physical range from 0 to 3.2
    * - 3.0.3
      - 2/25/2019
      - 1998-2017
      - Wind data recomputed to fix corrupted data in western extent
    * - 3.0.2
      - 2/25/2019
      - 1998-2017
      - Air temperature data recomputed from MERRA2 with elevation correction
    * - 3.0.1
      - 2018
      - 2017+
      - Moved from timeshift of radiation to timeshift of cloud properties.
    * - 3.0.0
      - 2018
      - 1998-2017
      - Initial release of PSM v3

        - Hourly AOD (1998-2016) from Modern-Era Retrospective analysis for
          Research and Applications Version 2 (MERRA2).
        - Snow-free Surface Albedo from MODIS (2001-2015), (MCD43GF CMG
          Gap-Filled Snow-Free Products from University of Massachusetts,
          Boston).
        - Snow cover from Integrated Multi-Sensor Snow and Ice Mapping System
          (IMS) daily snow cover product (National Snow and Ice Data Center).
        - GOES-East time-shift applied to cloud properties instead of solar
          radiation.
        - Modern-Era Retrospective analysis for Research and Applications,
          Version 2 (MERRA-2) is used for ancillary data (pressure, humidity,
          wind speed etc.)

    * - 2.0.0
      - 2016
      - 1998-2015
      - Initial release of PSM v2 (use of FARMS, downscaling of ancillary data
        introduced to account for elevation, NSRDB website distribution
        developed)

        - Clear sky: REST2, Cloudy sky: NREL FARMS model and DISC model
        - Climate Forecast System Reanalysis (CFSR) is used for ancillary data
        - Monthly 0.5º aerosol optical depth (AOD) for 1998-2014 using
          satellite and ground-based measurements. Monthly results interpolated
          to daily 4-km AOD data. Daily data calibrated using ground
          measurements to develop accurate AOD product.

    * - 1.0.0
      - 2015
      - 2005-2012
      - Initial release of PSM v1 (no FARMS)

        - Satellite Algorithm for Shortwave Radiation Budget (SASRAB) model
        - MMAC model for clear sky condition
        - The DNI for cloud scenes is then computed using the DISC model


Recommended Citation
====================

Update with current version and DOI:

Grant Buster, Brandon Benton, Mike Bannister, Yu Xie, Aron Habte, Galen
Maclaurin, Manajit Sengupta. National Solar Radiation Database (NSRDB).
https://github.com/NREL/nsrdb (version v4.0.0), 2023. DOI:
10.5281/zenodo.10471523

Acknowledgments
===============

This work (SWR-23-77) was authored by the National Renewable Energy Laboratory,
operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of
Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the DOE
Grid Deployment Office (GDO), the DOE Advanced Scientific Computing Research
(ASCR) program, the DOE Solar Energy Technologies Office (SETO), the DOE Wind
Energy Technologies Office (WETO), the United States Agency for International
Development (USAID), and the Laboratory Directed Research and Development
(LDRD) program at the National Renewable Energy Laboratory. The research was
performed using computational resources sponsored by the Department of Energy's
Office of Energy Efficiency and Renewable Energy and located at the National
Renewable Energy Laboratory. The views expressed in the article do not
necessarily represent the views of the DOE or the U.S. Government. The U.S.
Government retains and the publisher, by accepting the article for publication,
acknowledges that the U.S. Government retains a nonexclusive, paid-up,
irrevocable, worldwide license to publish or reproduce the published form of
this work, or allow others to do so, for U.S. Government purposes.

\*Note: The “Data Years” column shows which years of NSRDB data were updated at
the time of version release. However, each NSRDB file should be checked for the
version attribute, which should be a more accurate record of the actual data
version.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "NREL-nsrdb",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.9",
    "maintainer_email": null,
    "keywords": "nsrdb, NREL",
    "author": null,
    "author_email": "Brandon Benton <brandon.benton@nrel.gov>",
    "download_url": null,
    "platform": null,
    "description": "##########################################################\nWelcome to the National Solar Radiation Data Base (NSRDB)!\n##########################################################\n|Docs| |Tests| |Linter| |PyPi| |PythonV| |Codecov| |Zenodo|\n\n.. |Docs| image:: https://github.com/NREL/nsrdb/workflows/Documentation/badge.svg\n    :target: https://nrel.github.io/nsrdb/\n\n.. |Tests| image:: https://github.com/NREL/nsrdb/workflows/Pytests/badge.svg\n    :target: https://github.com/NREL/nsrdb/actions?query=workflow%3A%22Pytests%22\n\n.. |Linter| image:: https://github.com/NREL/nsrdb/workflows/Lint%20Code%20Base/badge.svg\n    :target: https://github.com/NREL/nsrdb/actions?query=workflow%3A%22Lint+Code+Base%22\n\n.. |PyPi| image:: https://img.shields.io/pypi/pyversions/NREL-nsrdb.svg\n    :target: https://pypi.org/project/NREL-nsrdb/\n\n.. |PythonV| image:: https://badge.fury.io/py/NREL-nsrdb.svg\n    :target: https://badge.fury.io/py/NREL-nsrdb\n\n.. |Codecov| image:: https://codecov.io/gh/nrel/nsrdb/branch/main/graph/badge.svg\n    :target: https://codecov.io/gh/nrel/nsrdb\n\n.. |Zenodo| image:: https://zenodo.org/badge/340209614.svg\n    :target: https://zenodo.org/badge/latestdoi/340209614\n\n.. inclusion-intro\n\nThe National Solar Radiation Database (NSRDB) software includes all the methods\nfor the irradiance data processing pipeline. To get started, check out the\nNSRDB command line interface `(CLI) <https://nrel.github.io/nsrdb/_cli/nsrdb.html#nsrdb>`_.\nRefer to the `NREL website\n<https://nsrdb.nrel.gov/>`_ and the original `journal article\n<https://www.sciencedirect.com/science/article/pii/S136403211830087X>`_ for\nmore information on the NSRDB.  For details on NSRDB variable units, datatypes,\nand attributes, see the `NSRDB variable meta data\n<https://github.com/NREL/nsrdb/blob/master/config/nsrdb_vars.csv>`_.\n\nThe PXS All-Sky Irradiance Model\n================================\nThe PXS All-Sky `Irradiance Model\n<https://github.com/NREL/nsrdb/tree/master/nsrdb/all_sky>`_ is the main physics\npackage that calculates surface irradiance variables.\n\nThe NSRDB Data Model\n====================\nThe NSRDB `Data Model\n<https://github.com/NREL/nsrdb/tree/master/nsrdb/data_model>`_ is the data\naggregation framework that sources, processes, and prepares data for input to\nAll-Sky.\n\nThe MLClouds Model\n==================\nThe `MLClouds Model <https://github.com/NREL/mlclouds.git>`_ is used to predict\nmissing cloud properties (a.k.a. Gap Fill). The NSRDB interface with MLClouds\ncan be found `here <https://github.com/NREL/nsrdb/tree/master/nsrdb/gap_fill>`_.\n\nInstallation\n============\n\nOption 1: Install from PIP (recommended for analysts):\n------------------------------------------------------\n\n1. Create a new environment: ``conda create --name nsrdb python=3.9``\n\n2. Activate environment: ``conda activate nsrdb``\n\n3. Install nsrdb: ``pip install NREL-nsrdb``\n\nOption 2: Clone repo (recommended for developers)\n-------------------------------------------------\n\n1. from home dir, ``git clone git@github.com:NREL/nsrdb.git``\n\n2. Create ``nsrdb`` environment and install package\n    1) Create a conda env: ``conda create -n nsrdb``\n    2) Run the command: ``conda activate nsrdb``\n    3) ``cd`` into the repo cloned in 1.\n    4) Prior to running ``pip`` below, make sure the branch is correct (install\n       from main!)\n    5) Install ``nsrdb`` and its dependencies by running:\n       ``pip install .`` (or ``pip install -e .`` if running a dev branch\n       or working on the source code)\n    6) *Optional*: Set up the pre-commit hooks with ``pip install pre-commit`` and ``pre-commit install``\n\n\nNSRDB Versions\n==============\n\n.. list-table:: NSRDB Versions History\n    :widths: auto\n    :header-rows: 1\n\n    * - Version\n      - Effective Date\n      - Data Years*\n      - Notes\n    * - 4.1.0\n      - 7/9/24\n      - None\n      - Complete CLI refactor.\n    * - 4.0.0\n      - 5/1/23\n      - 2022\n      - Integrated new FARMS-DNI model.\n    * - 3.2.3\n      - 4/13/23\n      - None\n      - Fixed MERRA interpolation issue #51 and deprecated python 3.7/3.8.\n        Added changes to accommodate pandas v2.0.0.\n    * - 3.2.2\n      - 2/25/2022\n      - 1998-2021\n      - Implemented a model for snowy albedo as a function of temperature from\n        MERRA2 based on the paper \"A comparison of simulated and observed\n        fluctuations in summertime Arctic surface albedo\" by Becky Ross and\n        John E. Walsh\n    * - 3.2.1\n      - 1/12/2021\n      - 2021\n      - Implemented an algorithm to re-map the parallax and shading corrected\n        cloud coordinates to the nominal GOES coordinate system. This fixes the\n        issue of PC cloud coordinates conflicting with clearsky coordinates.\n        This also fixes the strange pattern that was found in the long term\n        means generated from PC data.\n    * - 3.2.0\n      - 3/17/2021\n      - 2020\n      - Enabled cloud solar shading coordinate adjustment by default, enabled\n        MLClouds machine learning gap fill method for missing cloud properties\n        (cloud fill flag #7)\n    * - 3.1.2\n      - 6/8/2020\n      - 2020\n      - Added feature to adjust cloud coordinates based on solar position and\n        shading geometry.\n    * - 3.1.1\n      - 12/5/2019\n      - 2018+, TMY/TDY/TGY-2018\n      - Complete refactor of TMY processing code.\n    * - 3.1.0\n      - 9/23/2019\n      - 2018+\n      - Complete refactor of NSRDB processing code for NSRDB 2018\n    * - 3.0.6\n      - 4/23/2019\n      - 1998-2017\n      - Missing data for all cloud properties gap filled using heuristics method\n    * - 3.0.5\n      - 4/8/2019\n      - 1998-2017\n      - Cloud pressure attributes and scale/offset fixed for 2016 and 2017\n    * - 3.0.4\n      - 3/29/2019\n      - 1998-2017\n      - Aerosol optical depth patched with physical range from 0 to 3.2\n    * - 3.0.3\n      - 2/25/2019\n      - 1998-2017\n      - Wind data recomputed to fix corrupted data in western extent\n    * - 3.0.2\n      - 2/25/2019\n      - 1998-2017\n      - Air temperature data recomputed from MERRA2 with elevation correction\n    * - 3.0.1\n      - 2018\n      - 2017+\n      - Moved from timeshift of radiation to timeshift of cloud properties.\n    * - 3.0.0\n      - 2018\n      - 1998-2017\n      - Initial release of PSM v3\n\n        - Hourly AOD (1998-2016) from Modern-Era Retrospective analysis for\n          Research and Applications Version 2 (MERRA2).\n        - Snow-free Surface Albedo from MODIS (2001-2015), (MCD43GF CMG\n          Gap-Filled Snow-Free Products from University of Massachusetts,\n          Boston).\n        - Snow cover from Integrated Multi-Sensor Snow and Ice Mapping System\n          (IMS) daily snow cover product (National Snow and Ice Data Center).\n        - GOES-East time-shift applied to cloud properties instead of solar\n          radiation.\n        - Modern-Era Retrospective analysis for Research and Applications,\n          Version 2 (MERRA-2) is used for ancillary data (pressure, humidity,\n          wind speed etc.)\n\n    * - 2.0.0\n      - 2016\n      - 1998-2015\n      - Initial release of PSM v2 (use of FARMS, downscaling of ancillary data\n        introduced to account for elevation, NSRDB website distribution\n        developed)\n\n        - Clear sky: REST2, Cloudy sky: NREL FARMS model and DISC model\n        - Climate Forecast System Reanalysis (CFSR) is used for ancillary data\n        - Monthly 0.5\u00ba aerosol optical depth (AOD) for 1998-2014 using\n          satellite and ground-based measurements. Monthly results interpolated\n          to daily 4-km AOD data. Daily data calibrated using ground\n          measurements to develop accurate AOD product.\n\n    * - 1.0.0\n      - 2015\n      - 2005-2012\n      - Initial release of PSM v1 (no FARMS)\n\n        - Satellite Algorithm for Shortwave Radiation Budget (SASRAB) model\n        - MMAC model for clear sky condition\n        - The DNI for cloud scenes is then computed using the DISC model\n\n\nRecommended Citation\n====================\n\nUpdate with current version and DOI:\n\nGrant Buster, Brandon Benton, Mike Bannister, Yu Xie, Aron Habte, Galen\nMaclaurin, Manajit Sengupta. National Solar Radiation Database (NSRDB).\nhttps://github.com/NREL/nsrdb (version v4.0.0), 2023. DOI:\n10.5281/zenodo.10471523\n\nAcknowledgments\n===============\n\nThis work (SWR-23-77) was authored by the National Renewable Energy Laboratory,\noperated by Alliance for Sustainable Energy, LLC, for the U.S. Department of\nEnergy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the DOE\nGrid Deployment Office (GDO), the DOE Advanced Scientific Computing Research\n(ASCR) program, the DOE Solar Energy Technologies Office (SETO), the DOE Wind\nEnergy Technologies Office (WETO), the United States Agency for International\nDevelopment (USAID), and the Laboratory Directed Research and Development\n(LDRD) program at the National Renewable Energy Laboratory. The research was\nperformed using computational resources sponsored by the Department of Energy's\nOffice of Energy Efficiency and Renewable Energy and located at the National\nRenewable Energy Laboratory. The views expressed in the article do not\nnecessarily represent the views of the DOE or the U.S. Government. The U.S.\nGovernment retains and the publisher, by accepting the article for publication,\nacknowledges that the U.S. Government retains a nonexclusive, paid-up,\nirrevocable, worldwide license to publish or reproduce the published form of\nthis work, or allow others to do so, for U.S. Government purposes.\n\n\\*Note: The \u201cData Years\u201d column shows which years of NSRDB data were updated at\nthe time of version release. However, each NSRDB file should be checked for the\nversion attribute, which should be a more accurate record of the actual data\nversion.\n",
    "bugtrack_url": null,
    "license": "BSD-3-Clause",
    "summary": "National Solar Radiation Database (NSRDB) Software",
    "version": "4.1.1",
    "project_urls": {
        "documentation": "https://nrel.github.io/nsrdb/",
        "homepage": "https://github.com/NREL/nsrdb",
        "repository": "https://github.com/NREL/nsrdb"
    },
    "split_keywords": [
        "nsrdb",
        " nrel"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "efbdb8e8ae489f81dc36f02dd5de9ca000ac2a0cff7826239a97b264cd15ff59",
                "md5": "d015fd303138422c1cffda8ec63fdcb4",
                "sha256": "5a8bfb4282e8394c1bc325e3de7d35b399bd23cc930f822d1d6e471b8269de52"
            },
            "downloads": -1,
            "filename": "NREL_nsrdb-4.1.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "d015fd303138422c1cffda8ec63fdcb4",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.9",
            "size": 10018718,
            "upload_time": "2024-10-28T11:47:52",
            "upload_time_iso_8601": "2024-10-28T11:47:52.233494Z",
            "url": "https://files.pythonhosted.org/packages/ef/bd/b8e8ae489f81dc36f02dd5de9ca000ac2a0cff7826239a97b264cd15ff59/NREL_nsrdb-4.1.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-10-28 11:47:52",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "NREL",
    "github_project": "nsrdb",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "nrel-nsrdb"
}
        
Elapsed time: 0.71801s