# climafeis
CLI Python application for scraping daily climate data from [Canal CLIMA](https://clima.feis.unesp.br) [UNESP Ilha Solteira](https://www.feis.unesp.br/) using [requests](https://requests.readthedocs.io/en/latest/) and [BeautifulSoup 4](https://www.crummy.com/software/BeautifulSoup/).
### Installation
1. Make sure Python 3.8 or higher and pip are installed
1. Run `pip install climafeis`
### Development
1. Check Python's version `python -V`
1. Install Python 3.8 or higher and pip, if they aren't already installed:
- Windows `winget install Python.Python.3.X` (replace X with the desired minor version)
- Ubuntu based distros `apt install python3 python3-pip`
- Arch based distros `pacman -S python python-pip`
- Fedora `dnf install python3 python3-pip`
1. [Install poetry](https://python-poetry.org/docs/#installation)
1. Clone this repo `git clone https://github.com/joaofauvel/climafeis.git && cd climafeis`
1. Install requirements `poetry install`
### Output headers
| Header | Description |
| ---------- | ----------------------------------------------------- |
| Date | Observation date (dd-mm-yyyy) |
| Tmean | Mean temperature (ºC) |
| Tmax | Max temperature (ºC) |
| Tmin | Min temperature (ºC) |
| RHmean | Mean relative humidity (%) |
| RHmax | Max relative humidity (%) |
| RHmin | Min relative humidity (%) |
| Pmean | Mean pressure (kPa) |
| Rn | Net radiation (MJ/m^2*day) |
| Rl | Liquid radiation (MJ/m^2*day) |
| G | Soil heat flux (MJ/m^2*day) |
| PAR | (μmoles/m^2) |
| ETcat | Evapotranspiration Class A Tank (mm/day) |
| ET0pm | Reference evapotranspiration Penman–Monteith (mm/day) |
| ET0cat | Reference evapotranspiration Class A Tank (mm/day) |
| U2max | Max windspeed at 2 meters (m/s) |
| U2mean | Mean windspeed at 2 meters (m/s) |
| U2dir | Wind direction at 2 meters (º) |
| Rain | Rainfall (mm) |
| Insolation | Solar insolation (h/day) |
[Reference](https://www.fao.org/3/x0490e/x0490e06.htm)
### Usage
Daily data from ILHA_SOLTEIRA station from 30/05/2020 (dd/MM/YYYY) to 03/05/2020
`climafeis ILHA_SOLTEIRA 30/05/2020 03/06/2020`
Daily data from MARINOPOLIS station from 30/05/2020 to today
`climafeis MARINOPOLIS 30/05/2020`
Daily data from ILHA_SOLTEIRA station from 30/05/2020 to today, supplying username and password
`climafeis ILHA_SOLTEIRA 30/05/2020 -U user -P password`
---
usage: climafeis [-h] [-U USER] [-P PW] [-o OUT] [-l LOG] [-v] station start [end]
Scrape daily climate date from Canal CLIMA (https://clima.feis.unesp.br)
positional arguments:
station station name: ILHA_SOLTEIRA, MARINOPOLIS, JUNQUEIROPOLIS, PARANAPUA, IRAPURU,
POPULINA, SANTA_ADELIA_PIONEIROS, SANTA_ADELIA, BONANCA, ITAPURA, DRACENA
start start date dd/MM/YYYY (30/05/2020)
end end date dd/MM/YYYY (03/05/2020). Default: today
options:
-h, --help show this help message and exit
-U USER, --user USER override Canal CLIMA user set in the environment variable $USER_CLIMAFEIS
-P PW, --pw PW override Canal CLIMA password set in the environment variable $PASSWD_CLIMAFEIS
-o OUT, --output OUT output file. Default: <station>.csv
-l LOG, --log LOG output log file. Default: stdout
-v, --verbose
Raw data
{
"_id": null,
"home_page": "https://github.com/joaofauvel/climafeis",
"name": "climafeis",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "scraping,climate,eto,evapotranspiration,dataset",
"author": "Jo\u00e3o Fauvel",
"author_email": "jmmfauvel@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/c8/28/ee8bf07e252ca5348ccf919e08d747e19ff1ba3f257d3a8f260b22e5c871/climafeis-1.0.10.tar.gz",
"platform": null,
"description": "# climafeis\nCLI Python application for scraping daily climate data from [Canal CLIMA](https://clima.feis.unesp.br) [UNESP Ilha Solteira](https://www.feis.unesp.br/) using [requests](https://requests.readthedocs.io/en/latest/) and [BeautifulSoup 4](https://www.crummy.com/software/BeautifulSoup/). \n\n### Installation\n1. Make sure Python 3.8 or higher and pip are installed\n1. Run `pip install climafeis`\n\n### Development\n1. Check Python's version `python -V`\n1. Install Python 3.8 or higher and pip, if they aren't already installed:\n\n - Windows `winget install Python.Python.3.X` (replace X with the desired minor version)\n - Ubuntu based distros `apt install python3 python3-pip`\n - Arch based distros `pacman -S python python-pip`\n - Fedora `dnf install python3 python3-pip`\n\n1. [Install poetry](https://python-poetry.org/docs/#installation) \n1. Clone this repo `git clone https://github.com/joaofauvel/climafeis.git && cd climafeis`\n1. Install requirements `poetry install`\n\n### Output headers\n| Header | Description |\n| ---------- | ----------------------------------------------------- |\n| Date | Observation date (dd-mm-yyyy) |\n| Tmean | Mean temperature (\u00baC) |\n| Tmax | Max temperature (\u00baC) |\n| Tmin | Min temperature (\u00baC) |\n| RHmean | Mean relative humidity (%) |\n| RHmax | Max relative humidity (%) |\n| RHmin | Min relative humidity (%) |\n| Pmean | Mean pressure (kPa) |\n| Rn | Net radiation (MJ/m^2*day) |\n| Rl | Liquid radiation (MJ/m^2*day) |\n| G | Soil heat flux (MJ/m^2*day) |\n| PAR | (\u03bcmoles/m^2) |\n| ETcat | Evapotranspiration Class A Tank (mm/day) |\n| ET0pm | Reference evapotranspiration Penman\u2013Monteith (mm/day) |\n| ET0cat | Reference evapotranspiration Class A Tank (mm/day) |\n| U2max | Max windspeed at 2 meters (m/s) |\n| U2mean | Mean windspeed at 2 meters (m/s) |\n| U2dir | Wind direction at 2 meters (\u00ba) |\n| Rain | Rainfall (mm) |\n| Insolation | Solar insolation (h/day) | \n\n[Reference](https://www.fao.org/3/x0490e/x0490e06.htm)\n\n### Usage\nDaily data from ILHA_SOLTEIRA station from 30/05/2020 (dd/MM/YYYY) to 03/05/2020 \n`climafeis ILHA_SOLTEIRA 30/05/2020 03/06/2020`\n\nDaily data from MARINOPOLIS station from 30/05/2020 to today \n`climafeis MARINOPOLIS 30/05/2020`\n\nDaily data from ILHA_SOLTEIRA station from 30/05/2020 to today, supplying username and password \n`climafeis ILHA_SOLTEIRA 30/05/2020 -U user -P password` \n\n---\n\n usage: climafeis [-h] [-U USER] [-P PW] [-o OUT] [-l LOG] [-v] station start [end]\n\n Scrape daily climate date from Canal CLIMA (https://clima.feis.unesp.br)\n\n positional arguments:\n station station name: ILHA_SOLTEIRA, MARINOPOLIS, JUNQUEIROPOLIS, PARANAPUA, IRAPURU, \n POPULINA, SANTA_ADELIA_PIONEIROS, SANTA_ADELIA, BONANCA, ITAPURA, DRACENA\n start start date dd/MM/YYYY (30/05/2020)\n end end date dd/MM/YYYY (03/05/2020). Default: today\n\n options:\n -h, --help show this help message and exit\n -U USER, --user USER override Canal CLIMA user set in the environment variable $USER_CLIMAFEIS\n -P PW, --pw PW override Canal CLIMA password set in the environment variable $PASSWD_CLIMAFEIS\n -o OUT, --output OUT output file. Default: <station>.csv\n -l LOG, --log LOG output log file. Default: stdout\n -v, --verbose\n",
"bugtrack_url": null,
"license": "GPL-3.0-or-later",
"summary": "Scrape daily climate data from Canal CLIMA",
"version": "1.0.10",
"project_urls": {
"Homepage": "https://github.com/joaofauvel/climafeis",
"Repository": "https://github.com/joaofauvel/climafeis"
},
"split_keywords": [
"scraping",
"climate",
"eto",
"evapotranspiration",
"dataset"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "55d636d5bd10d3e92204cd3243683bf6827259c8b103f331608fe8f240ed20cf",
"md5": "2a3444519bba8c9a596fc59660ffafb3",
"sha256": "a975f6abad75392352494b77c61cf7167f0bd2ecd30b255df6aa3614fc90d8c4"
},
"downloads": -1,
"filename": "climafeis-1.0.10-py3-none-any.whl",
"has_sig": false,
"md5_digest": "2a3444519bba8c9a596fc59660ffafb3",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 17601,
"upload_time": "2023-12-01T18:39:09",
"upload_time_iso_8601": "2023-12-01T18:39:09.607893Z",
"url": "https://files.pythonhosted.org/packages/55/d6/36d5bd10d3e92204cd3243683bf6827259c8b103f331608fe8f240ed20cf/climafeis-1.0.10-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "c828ee8bf07e252ca5348ccf919e08d747e19ff1ba3f257d3a8f260b22e5c871",
"md5": "c0cb4ef2d5166c13e7fab2d9e36a30b2",
"sha256": "e1d745d119ccf487e8c63ff4e155c60457b332089c7c0ec0049047f06a72d391"
},
"downloads": -1,
"filename": "climafeis-1.0.10.tar.gz",
"has_sig": false,
"md5_digest": "c0cb4ef2d5166c13e7fab2d9e36a30b2",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 17104,
"upload_time": "2023-12-01T18:39:10",
"upload_time_iso_8601": "2023-12-01T18:39:10.793628Z",
"url": "https://files.pythonhosted.org/packages/c8/28/ee8bf07e252ca5348ccf919e08d747e19ff1ba3f257d3a8f260b22e5c871/climafeis-1.0.10.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-12-01 18:39:10",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "joaofauvel",
"github_project": "climafeis",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "climafeis"
}
JSON
