intake-esgf


Nameintake-esgf JSON
Version 2024.4.23 PyPI version JSON
download
home_pageNone
SummaryAn intake-esm inspired catalog for ESGF
upload_time2024-04-23 13:47:02
maintainerNone
docs_urlNone
authorNathan Collier
requires_pythonNone
licenseBSD-3-Clause
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            [<img width=250px src=./doc/_static/logo.png>](https://climatemodeling.science.energy.gov/presentations/esgf2-building-next-generation-earth-system-grid-federation)

# intake-esgf

## Badges

[![Continuous Integration][ci-badge]][ci-link]
[![Documentation Status][rtd-badge]][rtd-link]
[![Code Coverage Status][codecov-badge]][codecov-link]
[![PyPI][pypi-badge]][pypi-link]
[![Conda][conda-badge]][conda-link]

## Overview

`intake-esgf` is an [intake-esm](https://github.com/intake/intake-esm) *inspired* package under development in ESGF2. The main difference is that in place of querying a static index which is completely loaded at runtime, `intake-esgf` catalogs initialize empty and are populated by searching, querying ESGF index nodes.

## Installation

You may install `intake-esgf` using [pip](https://pypi.org/project/pip/):

```bash
python -m pip install intake-esgf
```

or [conda-forge](https://conda-forge.org/):

```bash
conda install -c conda-forge intake-esgf
```
## Features

For a full listing of features with code examples, please consult the [documentation](https://intake-esgf.readthedocs.io/en/latest/?badge=latest). In brief, `intake-esgf` aims to hide some of the complexity of obtaining ESGF data and get the user the data as fast as we can.

* Indices are queried in parallel and report when they fail to return a response. The results are aggregated and presented to the user as a [pandas](https://pandas.pydata.org/) DataFrame.
* The locations of the data are hidden from the user. Internally we track which locations provide the user the fastest transfers and automatically favor them for you.
* Files are downloaded in parallel into a local cache which mirrors the remote storage directory structure. They are returned to the user as a dictionary of [xarray](https://xarray.dev/) Datasets. Your search script then becomes the way you download data as well as how you load it into memory for your analysis.
* Prior to downloading data, we first check that it is not already available locally. This could be because you had previously downloaded it, but also because you are working on a server that has direct access.
* Cell measure information is harvested from your search results and automatically included in the returned datasets.


[ci-badge]: https://github.com/esgf2-us/intake-esgf/actions/workflows/ci.yml/badge.svg?branch=main
[ci-link]: https://github.com/esgf2-us/intake-esgf/actions/workflows/ci.yml
[rtd-badge]: https://readthedocs.org/projects/intake-esgf/badge/?version=latest
[rtd-link]: https://intake-esgf.readthedocs.io/en/latest/?badge=latest
[codecov-badge]: https://img.shields.io/codecov/c/github/esgf2-us/intake-esgf.svg?logo=codecov
[codecov-link]: https://codecov.io/gh/esgf2-us/intake-esgf
[pypi-badge]: https://img.shields.io/pypi/v/intake-esgf?logo=pypi
[pypi-link]: https://pypi.org/project/intake-esgf
[conda-badge]: https://img.shields.io/conda/vn/conda-forge/intake-esgf?logo=anaconda
[conda-link]: https://anaconda.org/conda-forge/intake-esgf

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "intake-esgf",
    "maintainer": null,
    "docs_url": null,
    "requires_python": null,
    "maintainer_email": null,
    "keywords": null,
    "author": "Nathan Collier",
    "author_email": "nathaniel.collier@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/70/60/8a3c62e27b9e772143b9aabb18c21ca5a7024af9349c74e24e5a4d0f512f/intake_esgf-2024.4.23.tar.gz",
    "platform": null,
    "description": "[<img width=250px src=./doc/_static/logo.png>](https://climatemodeling.science.energy.gov/presentations/esgf2-building-next-generation-earth-system-grid-federation)\n\n# intake-esgf\n\n## Badges\n\n[![Continuous Integration][ci-badge]][ci-link]\n[![Documentation Status][rtd-badge]][rtd-link]\n[![Code Coverage Status][codecov-badge]][codecov-link]\n[![PyPI][pypi-badge]][pypi-link]\n[![Conda][conda-badge]][conda-link]\n\n## Overview\n\n`intake-esgf` is an [intake-esm](https://github.com/intake/intake-esm) *inspired* package under development in ESGF2. The main difference is that in place of querying a static index which is completely loaded at runtime, `intake-esgf` catalogs initialize empty and are populated by searching, querying ESGF index nodes.\n\n## Installation\n\nYou may install `intake-esgf` using [pip](https://pypi.org/project/pip/):\n\n```bash\npython -m pip install intake-esgf\n```\n\nor [conda-forge](https://conda-forge.org/):\n\n```bash\nconda install -c conda-forge intake-esgf\n```\n## Features\n\nFor a full listing of features with code examples, please consult the [documentation](https://intake-esgf.readthedocs.io/en/latest/?badge=latest). In brief, `intake-esgf` aims to hide some of the complexity of obtaining ESGF data and get the user the data as fast as we can.\n\n* Indices are queried in parallel and report when they fail to return a response. The results are aggregated and presented to the user as a [pandas](https://pandas.pydata.org/) DataFrame.\n* The locations of the data are hidden from the user. Internally we track which locations provide the user the fastest transfers and automatically favor them for you.\n* Files are downloaded in parallel into a local cache which mirrors the remote storage directory structure. They are returned to the user as a dictionary of [xarray](https://xarray.dev/) Datasets. Your search script then becomes the way you download data as well as how you load it into memory for your analysis.\n* Prior to downloading data, we first check that it is not already available locally. This could be because you had previously downloaded it, but also because you are working on a server that has direct access.\n* Cell measure information is harvested from your search results and automatically included in the returned datasets.\n\n\n[ci-badge]: https://github.com/esgf2-us/intake-esgf/actions/workflows/ci.yml/badge.svg?branch=main\n[ci-link]: https://github.com/esgf2-us/intake-esgf/actions/workflows/ci.yml\n[rtd-badge]: https://readthedocs.org/projects/intake-esgf/badge/?version=latest\n[rtd-link]: https://intake-esgf.readthedocs.io/en/latest/?badge=latest\n[codecov-badge]: https://img.shields.io/codecov/c/github/esgf2-us/intake-esgf.svg?logo=codecov\n[codecov-link]: https://codecov.io/gh/esgf2-us/intake-esgf\n[pypi-badge]: https://img.shields.io/pypi/v/intake-esgf?logo=pypi\n[pypi-link]: https://pypi.org/project/intake-esgf\n[conda-badge]: https://img.shields.io/conda/vn/conda-forge/intake-esgf?logo=anaconda\n[conda-link]: https://anaconda.org/conda-forge/intake-esgf\n",
    "bugtrack_url": null,
    "license": "BSD-3-Clause",
    "summary": "An intake-esm inspired catalog for ESGF",
    "version": "2024.4.23",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "bad85999dcfec8a1990ec8ec8631ae4a41b1b43de6d0c59b152e09178aaa5500",
                "md5": "3b1258623e7cbffe03d5950d06f78571",
                "sha256": "a90d92f54f8874a1a64f9404faffbf2a44de2f410214543699436c51694f042d"
            },
            "downloads": -1,
            "filename": "intake_esgf-2024.4.23-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "3b1258623e7cbffe03d5950d06f78571",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 32591,
            "upload_time": "2024-04-23T13:47:00",
            "upload_time_iso_8601": "2024-04-23T13:47:00.343505Z",
            "url": "https://files.pythonhosted.org/packages/ba/d8/5999dcfec8a1990ec8ec8631ae4a41b1b43de6d0c59b152e09178aaa5500/intake_esgf-2024.4.23-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "70608a3c62e27b9e772143b9aabb18c21ca5a7024af9349c74e24e5a4d0f512f",
                "md5": "9c941907b9f7c90f0780e46e988c4263",
                "sha256": "2a22907a6b721e99cface780d048caf5d009740f49aa3d96f3ef666edd4b1598"
            },
            "downloads": -1,
            "filename": "intake_esgf-2024.4.23.tar.gz",
            "has_sig": false,
            "md5_digest": "9c941907b9f7c90f0780e46e988c4263",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 433065,
            "upload_time": "2024-04-23T13:47:02",
            "upload_time_iso_8601": "2024-04-23T13:47:02.180455Z",
            "url": "https://files.pythonhosted.org/packages/70/60/8a3c62e27b9e772143b9aabb18c21ca5a7024af9349c74e24e5a4d0f512f/intake_esgf-2024.4.23.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-04-23 13:47:02",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "intake-esgf"
}
        
Elapsed time: 0.21282s