<div align="center">
<img src="https://raw.githubusercontent.com/fotioudim/NWC-SAFer/main/docs/nwc-safer-logo.png" alt="logo" width="60%" height="auto" />
<h1>NWC-SAFer</h1>
<p>
An awesome CLI tool simplifying NetCDF data extraction of NWC-SAF products and transformation to different file formats!
</p>
<!-- Badges -->
[](https://github.com/fotioudim/nwc-safer/commits/main)
[](https://github.com/fotioudim/nwc-safer/issues/)
[](https://github.com/fotioudim/nwc-safer/network/members)
[](https://github.com/fotioudim/nwc-safer/stargazers)
[](https://opensource.org/licenses/MIT)
<h4>
<a href="https://github.com/fotioudim/nwc-safer/issues/">Report Bug</a>
<span> · </span>
<a href="https://github.com/fotioudim/nwc-safer/issues/">Request Feature</a>
</h4>
</div>
<br />
<!-- Table of Contents -->
# Table of Contents
- [ Table of Contents](#notebook_with_decorative_cover-table-of-contents)
- [ About the Project](#star2-about-the-project)
- [ Tech Stack](#books-tech-stack)
- [ Getting Started](#toolbox-getting-started)
- [ Prerequisites](#wrench-prerequisites)
- [ Installation](#gear-installation)
- [PyPi (recommended)](#pypi-recommended)
- [Source](#source)
- [ Run Locally](#running-run-locally)
- [ Usage](#bookmark_tabs-usage)
- [Watch directory and convert incoming files](#watch-directory-and-convert-incoming-files)
- [Manual file conversion](#manual-file-conversion)
- [Check compatible products](#check-compatible-products)
- [Launch Github repository](#launch-github-repository)
- [ Roadmap](#compass-roadmap)
- [ License](#warning-license)
- [ Contact](#handshake-contact)
<!-- About the Project -->
## About the Project
This is a modern and simplified Command Line Interface tool created to extract info and metadata from NetCDF files and convert them into different file formats such as Csv, Excel, plain text, etc.
Its aim is to simplify data extraction from NWC SAF [products](https://www.nwcsaf.org/web/guest/nwc/geo-geostationary-near-real-time-v2021) and their transformation to different file formats, more readable and easier to access and edit. ΝWC-SAF is an initiative of [EUMETSAT](https://www.eumetsat.int/) to provide operational services ensuring the optimum use of meteorological satellite data in Nowcasting and Very Short Range Forecasting.
<!-- TechStack -->
### Tech Stack
The tech stack of this project consists of the following main technologies/frameworks/tools:
- [](https://www.python.org/)
- [](https://typer.tiangolo.com/)
- [](https://python-poetry.org/)
- [](https://github.com/gorakhargosh/watchdog)
- _Python Queues and thread handling is applied to enhance user experience_
- _NetCDF4, Pandas, xarray libraries are used for file manipulation_
<!-- Getting Started -->
## Getting Started
<!-- Prerequisites -->
### Prerequisites
You just need to have installed Python language preferrably > 3.10 version and a Python package/dependency management tool like Pip, Poetry, Conda etc.
The tool is compatible with all popular OS.
_Better used along with CLIs that support emojis and Unicode characters for a better user experience._
<!-- Installation -->
### Installation
#### PyPi (recommended)
- Install it from PyPi using pip or any other python package manager
```bash
pip install --user nwc-safer
```
- Enable auto-completion by executing the following command
```bash
nwc-safer --install-completion
```
#### Source
- Clone the Git repo
```bash
git clone https://github.com/fotioudim/nwc-safer.git
```
- Install using poetry in the corresponding directory
```bash
poetry install
```
<!-- Run Locally -->
### Run Locally
Just run it using `nwc-safer`. Get help for the available commands
```bash
nwc-safer --help
```
<!-- Usage -->
## Usage
Run `nwc-safer` or `nwc-safer -- help` in your CLI to get a better description of the available commands and options.
### Watch directory and convert incoming files
Constantly watch a directory for incoming NetCDF files, in order to extract the desired data and export them in the form of Csv/Excel/Text files.
```bash
nwc-safer watch [OPTIONS] [INPUT_PATH] [OUTPUT_PATH]
```
Arguments:
- `input_path`: The path (relative/absolute) for the directory desired to be watched [default: .]
- `output_path`: The path (relative/absolute) for the output directory [default: .\output\]
Options:
- `--lat` `-la`: The latitude coordinate range in ascending order, given in the form of two int values (min & max)
- `--lon` `-lo`: The longitude coordinate range in ascending order, given in the form of two int values (min & max)
- `--format` `-f`: The output file format [default: csv]
- `--recursive` `-r`: Watch for incoming files recursively in all the subdirectories of the specified directory
- `--existing` `-e`: Convert pre-existing files in the specified directory
### Manual file conversion
Process a single or multiple NetCDF file(s), by extracting the desired data
and exporting them in a new file format (eg. Csv, Excel).
```bash
nwc-safer convert [OPTIONS] [FILE_PATHS]...
```
Arguments:
- `file_paths`: The path(s) (relative/absolute) for the file(s) desired to be converted [default: None] [required]
Options:
- `--lat` `-la`: The latitude coordinate range in ascending order, given in the form of two int values (min & max)
- `--lon` `-lo`: The longitude coordinate range in ascending order, given in the form of two int values (min & max)
- `--output` `-o`: The path (relative/absolute) for the output directory [default: .\output\]
- `--format` `-f`: The output file format [default: csv]
### Check compatible products
Check which NWC-SAF products are currently supported by the tool
```bash
nwc-safer compatibility
```
### Launch Github repository
Launch NWC-SAF NetCDF Data Exporter Github repository in the web browser
```bash
nwc-safer repo
```
<!-- Roadmap -->
## Roadmap
* [x] Add continuous watching & conversion operation
* [x] Single conversion operation
* [x] OS agnostic functionality
* [x] Multiple conversion operation
* [x] Subset dataset based on coordinates range
* [x] Support 3 output file formats (.csv, .xlsx, txt)
* [ ] Generalize solution for a bigger set of [NWC SAF products](https://www.nwcsaf.org/web/guest/nwc/geo-geostationary-near-real-time-v2021)
<!-- License -->
## License
Distributed under the MIT License. See `LICENSE.md` for more information.
<!-- Contact -->
## Contact
You can reach me at:
- Personal website: https://www.dfotiou.gr
- StackOverflow profile: https://stackoverflow.com/users/11680294/fotiou-d
- Linkedin profile: https://www.linkedin.com/in/dimitris-fotiou-4141a8197/
- Email: [fotioudimitris93@gmail.com](mailto:fotioudimitris93@gmail.com)
Raw data
{
"_id": null,
"home_page": "https://github.com/fotioudim/NWC-SAFer",
"name": "nwc-safer",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.10,<4.0",
"maintainer_email": "",
"keywords": "nwc-saf,netcdf,typer,python,poetry,watchdog",
"author": "dfotiou",
"author_email": "fotioudimitris93@vodafone.com",
"download_url": "https://files.pythonhosted.org/packages/fa/a2/7aa359f584888d90bfaa768fc6f3a0a3e82641c1f96eb060d7390403d9af/nwc_safer-0.8.0.tar.gz",
"platform": null,
"description": "<div align=\"center\">\n\n <img src=\"https://raw.githubusercontent.com/fotioudim/NWC-SAFer/main/docs/nwc-safer-logo.png\" alt=\"logo\" width=\"60%\" height=\"auto\" />\n <h1>NWC-SAFer</h1>\n \n <p>\n An awesome CLI tool simplifying NetCDF data extraction of NWC-SAF products and transformation to different file formats! \n </p>\n \n \n<!-- Badges -->\n[](https://github.com/fotioudim/nwc-safer/commits/main)\n[](https://github.com/fotioudim/nwc-safer/issues/)\n[](https://github.com/fotioudim/nwc-safer/network/members)\n[](https://github.com/fotioudim/nwc-safer/stargazers)\n[](https://opensource.org/licenses/MIT)\n\n \n<h4>\n <a href=\"https://github.com/fotioudim/nwc-safer/issues/\">Report Bug</a>\n <span> \u00b7 </span>\n <a href=\"https://github.com/fotioudim/nwc-safer/issues/\">Request Feature</a>\n </h4>\n</div>\n\n<br />\n\n<!-- Table of Contents -->\n# Table of Contents\n\n- [ Table of Contents](#notebook_with_decorative_cover-table-of-contents)\n - [ About the Project](#star2-about-the-project)\n - [ Tech Stack](#books-tech-stack)\n - [ Getting Started](#toolbox-getting-started)\n - [ Prerequisites](#wrench-prerequisites)\n - [ Installation](#gear-installation)\n - [PyPi (recommended)](#pypi-recommended)\n - [Source](#source)\n - [ Run Locally](#running-run-locally)\n - [ Usage](#bookmark_tabs-usage)\n - [Watch directory and convert incoming files](#watch-directory-and-convert-incoming-files)\n - [Manual file conversion](#manual-file-conversion)\n - [Check compatible products](#check-compatible-products)\n - [Launch Github repository](#launch-github-repository)\n - [ Roadmap](#compass-roadmap)\n - [ License](#warning-license)\n - [ Contact](#handshake-contact)\n \n\n<!-- About the Project -->\n## About the Project\n\nThis is a modern and simplified Command Line Interface tool created to extract info and metadata from NetCDF files and convert them into different file formats such as Csv, Excel, plain text, etc.\n\nIts aim is to simplify data extraction from NWC SAF [products](https://www.nwcsaf.org/web/guest/nwc/geo-geostationary-near-real-time-v2021) and their transformation to different file formats, more readable and easier to access and edit. \u039dWC-SAF is an initiative of [EUMETSAT](https://www.eumetsat.int/) to provide operational services ensuring the optimum use of meteorological satellite data in Nowcasting and Very Short Range Forecasting.\n\n\n<!-- TechStack -->\n### Tech Stack\n\nThe tech stack of this project consists of the following main technologies/frameworks/tools:\n- [](https://www.python.org/)\n- [](https://typer.tiangolo.com/)\n- [](https://python-poetry.org/)\n- [](https://github.com/gorakhargosh/watchdog)\n\n\n- _Python Queues and thread handling is applied to enhance user experience_\n- _NetCDF4, Pandas, xarray libraries are used for file manipulation_\n\n<!-- Getting Started -->\n## \t Getting Started\n\n<!-- Prerequisites -->\n### Prerequisites\n\nYou just need to have installed Python language preferrably > 3.10 version and a Python package/dependency management tool like Pip, Poetry, Conda etc.\n\nThe tool is compatible with all popular OS.\n\n_Better used along with CLIs that support emojis and Unicode characters for a better user experience._\n\n<!-- Installation -->\n### Installation\n\n#### PyPi (recommended)\n- Install it from PyPi using pip or any other python package manager\n ```bash\n pip install --user nwc-safer\n ```\n- Enable auto-completion by executing the following command\n ```bash\n nwc-safer --install-completion\n ```\n\n#### Source\n- Clone the Git repo\n ```bash\n git clone https://github.com/fotioudim/nwc-safer.git\n ```\n- Install using poetry in the corresponding directory\n ```bash\n poetry install\n ```\n\n<!-- Run Locally -->\n### Run Locally\n\nJust run it using `nwc-safer`. Get help for the available commands \n\n```bash\n nwc-safer --help\n```\n\n<!-- Usage -->\n## Usage\n\nRun `nwc-safer` or `nwc-safer -- help` in your CLI to get a better description of the available commands and options.\n\n### Watch directory and convert incoming files\nConstantly watch a directory for incoming NetCDF files, in order to extract the desired data and export them in the form of Csv/Excel/Text files.\n```bash\n nwc-safer watch [OPTIONS] [INPUT_PATH] [OUTPUT_PATH]\n```\nArguments:\n- `input_path`: The path (relative/absolute) for the directory desired to be watched [default: .]\n- `output_path`: The path (relative/absolute) for the output directory [default: .\\output\\]\n\nOptions:\n- `--lat` `-la`: The latitude coordinate range in ascending order, given in the form of two int values (min & max)\n- `--lon` `-lo`: The longitude coordinate range in ascending order, given in the form of two int values (min & max)\n- `--format` `-f`: The output file format [default: csv]\n- `--recursive` `-r`: Watch for incoming files recursively in all the subdirectories of the specified directory\n- `--existing` `-e`: Convert pre-existing files in the specified directory\n \n### Manual file conversion\nProcess a single or multiple NetCDF file(s), by extracting the desired data\nand exporting them in a new file format (eg. Csv, Excel).\n```bash\n nwc-safer convert [OPTIONS] [FILE_PATHS]...\n```\n\nArguments:\n- `file_paths`: The path(s) (relative/absolute) for the file(s) desired to be converted [default: None] [required]\n\nOptions:\n- `--lat` `-la`: The latitude coordinate range in ascending order, given in the form of two int values (min & max)\n- `--lon` `-lo`: The longitude coordinate range in ascending order, given in the form of two int values (min & max)\n- `--output` `-o`: The path (relative/absolute) for the output directory [default: .\\output\\]\n- `--format` `-f`: The output file format [default: csv]\n \n### Check compatible products\nCheck which NWC-SAF products are currently supported by the tool\n```bash\n nwc-safer compatibility\n```\n\n### Launch Github repository\nLaunch NWC-SAF NetCDF Data Exporter Github repository in the web browser\n```bash\n nwc-safer repo\n```\n\n<!-- Roadmap -->\n## Roadmap\n\n* [x] Add continuous watching & conversion operation\n* [x] Single conversion operation\n* [x] OS agnostic functionality\n* [x] Multiple conversion operation\n* [x] Subset dataset based on coordinates range\n* [x] Support 3 output file formats (.csv, .xlsx, txt)\n* [ ] Generalize solution for a bigger set of [NWC SAF products](https://www.nwcsaf.org/web/guest/nwc/geo-geostationary-near-real-time-v2021) \n\n<!-- License -->\n## License\n\nDistributed under the MIT License. See `LICENSE.md` for more information.\n\n\n<!-- Contact -->\n## Contact\n\nYou can reach me at:\n- Personal website: https://www.dfotiou.gr\n- StackOverflow profile: https://stackoverflow.com/users/11680294/fotiou-d\n- Linkedin profile: https://www.linkedin.com/in/dimitris-fotiou-4141a8197/\n- Email: [fotioudimitris93@gmail.com](mailto:fotioudimitris93@gmail.com)\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "NWC-SAFer CLI tool simplifying NetCDF data extraction and conversion of NWC-SAF products.",
"version": "0.8.0",
"split_keywords": [
"nwc-saf",
"netcdf",
"typer",
"python",
"poetry",
"watchdog"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "8df3ef31da2ab826c0668b1ce804fe440070ad121d2c6aa238f3bf3f54abc554",
"md5": "4fbe7f19caf0fe1d169f07a77388ff0b",
"sha256": "873433103eb4c389f4580b308fee9bc792ee0679b4420d79af04814a28bc1f6a"
},
"downloads": -1,
"filename": "nwc_safer-0.8.0-cp310-cp310-win_amd64.whl",
"has_sig": false,
"md5_digest": "4fbe7f19caf0fe1d169f07a77388ff0b",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": ">=3.10,<4.0",
"size": 11830,
"upload_time": "2023-03-27T15:51:05",
"upload_time_iso_8601": "2023-03-27T15:51:05.181301Z",
"url": "https://files.pythonhosted.org/packages/8d/f3/ef31da2ab826c0668b1ce804fe440070ad121d2c6aa238f3bf3f54abc554/nwc_safer-0.8.0-cp310-cp310-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "faa27aa359f584888d90bfaa768fc6f3a0a3e82641c1f96eb060d7390403d9af",
"md5": "78b5c483922ebb144639f7612d9c56d2",
"sha256": "38cd684ecd5b68306116fdc1330b564c8ddb61e13c5394a0297dfbbe61181195"
},
"downloads": -1,
"filename": "nwc_safer-0.8.0.tar.gz",
"has_sig": false,
"md5_digest": "78b5c483922ebb144639f7612d9c56d2",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10,<4.0",
"size": 13756,
"upload_time": "2023-03-27T15:51:07",
"upload_time_iso_8601": "2023-03-27T15:51:07.018365Z",
"url": "https://files.pythonhosted.org/packages/fa/a2/7aa359f584888d90bfaa768fc6f3a0a3e82641c1f96eb060d7390403d9af/nwc_safer-0.8.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-03-27 15:51:07",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "fotioudim",
"github_project": "NWC-SAFer",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "nwc-safer"
}
JSON
