Name | nnja-ai JSON |
Version |
1.0.0
JSON |
| download |
home_page | None |
Summary | Find and load data from the Brightband AI-ready mirror of the NOAA NASA Joint Archive (NNJA) of Observations for Earth System Reanalysis |
upload_time | 2025-08-05 22:40:58 |
maintainer | None |
docs_url | None |
author | None |
requires_python | >=3.10 |
license | MIT License
Copyright (c) 2025 Brightband
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
|
keywords |
nnja
artificial intelligence
earth system reanalysis
data catalog
dataset
earth observation
|
VCS |
 |
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
[](https://github.com/brightbandtech/nnja-ai/actions/workflows/ci.yaml)
[](https://nnja-ai.readthedocs.io/en/stable/)
[](https://pypi.org/p/nnja-ai)
[](https://doi.org/10.5281/zenodo.14633508)
---
# nnja-ai: multi-modal, AI-ready weather observations
This is the companion Python SDK to the [Brightband](https://www.brightband.com/) AI-ready reprocessing of the [NOAA NASA Joint Archive](https://psl.noaa.gov/data/nnja_obs/) (NNJA).
It is meant to serve as a helpful interface between a user and the underlying NNJA datasets (which currently consist of parquet files on [GCS](https://console.cloud.google.com/storage/browser/nnja-ai)).
The V1 release of the NNJA-AI dataset and SDK represents a major increment in availability of NNJA data, with ~50 TiB of observations made available in parquet form along with a data catalog and code examples in this SDK.
## Background
The NNJA archive project is a curated archive of Earth system data from 1979 to present.
This data represents a rich trove of observational data for use in AI weather modelling, however the archival format in which the data is originally available (BUFR) is cumbersome to work with.
In [partnership with NOAA](https://techpartnerships.noaa.gov/tpo_partnership/making-observation-data-ai-ready/), Brightband is processing that data to make it more accessible to the community.
## Data
NNJA datasets are organized by sensor/source (e.g. all-sky radiances from the GOES ABI).
The list of all NNJA datasets can be found on the [NNJA project page](https://psl.noaa.gov/data/nnja_obs/#data-sources), while the subset that is currently found in the NNJA-AI archive can be found [here](datasets.md) or by exploring the data catalog (this will be be expanding rapidly).
## Getting Started
To install this package directly from the GitHub repository, you can use the following `pip` command:
```sh
pip install git+https://github.com/brightbandtech/nnja-ai.git
```
You can find an example notebook [here](example_notebooks/basic_dataset_example.ipynb) showing the basics of opening the data catalog, finding a dataset, subsetting, and finally loading the data to pandas.
Though to get started, you can open the data catalog like so:
```python
from nnja_ai import DataCatalog
catalog = DataCatalog()
print("datasets in catalog:", catalog.list_datasets())
```
```
datasets in catalog:
['amsua-1bamua-NC021023',
'atms-atms-NC021203',
'mhs-1bmhs-NC021027',
'cris-crisf4-NC021206',
...]
```
## How to Cite
If you use this library or the Brightband reprocessed NNJA data, please cite it using the following DOI:
[](https://doi.org/10.5281/zenodo.14633508)
Additionally, please follow the citation guidance on the [NNJA project page](https://psl.noaa.gov/data/nnja_obs/#cite
).
The NNJA-AI data is distributed with the same license as the original NNJA data, [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/deed.en).
Raw data
{
"_id": null,
"home_page": null,
"name": "nnja-ai",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "NNJA, artificial intelligence, earth system reanalysis, data catalog, dataset, earth observation",
"author": null,
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/07/b6/cd4275ff9519a0337cf58c4e721f199351aaff6fd6b78ec1a5b7815071ca/nnja_ai-1.0.0.tar.gz",
"platform": null,
"description": "[](https://github.com/brightbandtech/nnja-ai/actions/workflows/ci.yaml)\n[](https://nnja-ai.readthedocs.io/en/stable/)\n[](https://pypi.org/p/nnja-ai)\n[](https://doi.org/10.5281/zenodo.14633508)\n\n---\n\n# nnja-ai: multi-modal, AI-ready weather observations\n\nThis is the companion Python SDK to the [Brightband](https://www.brightband.com/) AI-ready reprocessing of the [NOAA NASA Joint Archive](https://psl.noaa.gov/data/nnja_obs/) (NNJA).\nIt is meant to serve as a helpful interface between a user and the underlying NNJA datasets (which currently consist of parquet files on [GCS](https://console.cloud.google.com/storage/browser/nnja-ai)).\n\nThe V1 release of the NNJA-AI dataset and SDK represents a major increment in availability of NNJA data, with ~50 TiB of observations made available in parquet form along with a data catalog and code examples in this SDK.\n\n## Background\nThe NNJA archive project is a curated archive of Earth system data from 1979 to present.\nThis data represents a rich trove of observational data for use in AI weather modelling, however the archival format in which the data is originally available (BUFR) is cumbersome to work with.\nIn [partnership with NOAA](https://techpartnerships.noaa.gov/tpo_partnership/making-observation-data-ai-ready/), Brightband is processing that data to make it more accessible to the community.\n\n## Data\nNNJA datasets are organized by sensor/source (e.g. all-sky radiances from the GOES ABI).\nThe list of all NNJA datasets can be found on the [NNJA project page](https://psl.noaa.gov/data/nnja_obs/#data-sources), while the subset that is currently found in the NNJA-AI archive can be found [here](datasets.md) or by exploring the data catalog (this will be be expanding rapidly).\n\n## Getting Started\n\nTo install this package directly from the GitHub repository, you can use the following `pip` command:\n\n```sh\npip install git+https://github.com/brightbandtech/nnja-ai.git\n```\nYou can find an example notebook [here](example_notebooks/basic_dataset_example.ipynb) showing the basics of opening the data catalog, finding a dataset, subsetting, and finally loading the data to pandas.\nThough to get started, you can open the data catalog like so:\n\n```python\nfrom nnja_ai import DataCatalog\ncatalog = DataCatalog()\nprint(\"datasets in catalog:\", catalog.list_datasets())\n```\n\n```\ndatasets in catalog:\n\n['amsua-1bamua-NC021023',\n 'atms-atms-NC021203',\n 'mhs-1bmhs-NC021027',\n 'cris-crisf4-NC021206',\n ...]\n```\n\n## How to Cite\nIf you use this library or the Brightband reprocessed NNJA data, please cite it using the following DOI:\n\n[](https://doi.org/10.5281/zenodo.14633508)\n\nAdditionally, please follow the citation guidance on the [NNJA project page](https://psl.noaa.gov/data/nnja_obs/#cite\n).\n\nThe NNJA-AI data is distributed with the same license as the original NNJA data, [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/deed.en).\n",
"bugtrack_url": null,
"license": "MIT License\n \n Copyright (c) 2025 Brightband\n \n Permission is hereby granted, free of charge, to any person obtaining a copy\n of this software and associated documentation files (the \"Software\"), to deal\n in the Software without restriction, including without limitation the rights\n to use, copy, modify, merge, publish, distribute, sublicense, and/or sell\n copies of the Software, and to permit persons to whom the Software is\n furnished to do so, subject to the following conditions:\n \n The above copyright notice and this permission notice shall be included in all\n copies or substantial portions of the Software.\n \n THE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\n IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\n FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\n AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\n LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\n OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE\n SOFTWARE.\n ",
"summary": "Find and load data from the Brightband AI-ready mirror of the NOAA NASA Joint Archive (NNJA) of Observations for Earth System Reanalysis",
"version": "1.0.0",
"project_urls": {
"Documentation": "https://nnja-ai.readthedocs.io/",
"Repository": "https://github.com/brightbandtech/nnja-ai"
},
"split_keywords": [
"nnja",
" artificial intelligence",
" earth system reanalysis",
" data catalog",
" dataset",
" earth observation"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "e0022770f013fe79b3244037ac8757d218c03c25ee1b89a0e2cd217974b7eb9d",
"md5": "59f3d27ef722f09f5aeb56eac140e26a",
"sha256": "71d8858b919f60fa0e3810c6ab8e1431669e23f9c709d2d5907e53c1b2bbb59a"
},
"downloads": -1,
"filename": "nnja_ai-1.0.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "59f3d27ef722f09f5aeb56eac140e26a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 17818,
"upload_time": "2025-08-05T22:40:57",
"upload_time_iso_8601": "2025-08-05T22:40:57.124540Z",
"url": "https://files.pythonhosted.org/packages/e0/02/2770f013fe79b3244037ac8757d218c03c25ee1b89a0e2cd217974b7eb9d/nnja_ai-1.0.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "07b6cd4275ff9519a0337cf58c4e721f199351aaff6fd6b78ec1a5b7815071ca",
"md5": "7d10dbf6f22502aab5a70316e1c02cfb",
"sha256": "e64006c0a9046c04cffebef3e8d154fa0c31f574d72c50bb7c3c1d7ac691dcc5"
},
"downloads": -1,
"filename": "nnja_ai-1.0.0.tar.gz",
"has_sig": false,
"md5_digest": "7d10dbf6f22502aab5a70316e1c02cfb",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 18552,
"upload_time": "2025-08-05T22:40:58",
"upload_time_iso_8601": "2025-08-05T22:40:58.435930Z",
"url": "https://files.pythonhosted.org/packages/07/b6/cd4275ff9519a0337cf58c4e721f199351aaff6fd6b78ec1a5b7815071ca/nnja_ai-1.0.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-08-05 22:40:58",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "brightbandtech",
"github_project": "nnja-ai",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "nnja-ai"
}