ml4floods


Nameml4floods JSON
Version 1.0.1 PyPI version JSON
download
home_pagehttps://github.com/spaceml-org/ml4floods
SummaryMachine learning models for end-to-end flood extent segmentation.
upload_time2023-12-19 08:45:15
maintainer
docs_urlNone
authorSpaceML-org
requires_python
license
keywords floods pytorch machine-learning earth
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
<p align="center">
    <img src="https://raw.githubusercontent.com/spaceml-org/ml4floods/main/jupyterbook/ml4floods_banner.png" alt="awesome ml4floods" width="50%">
</p>

[![Article DOI:10.1038/s41598-023-47595-7](https://img.shields.io/badge/Article%20DOI-10.1038%2Fs41598.023.47595.7-blue)](https://doi.org/10.1038/s41598-023-47595-7)  ![PyPI](https://img.shields.io/pypi/v/ml4floods) ![PyPI - Python Version](https://img.shields.io/pypi/pyversions/ml4floods) ![PyPI - License](https://img.shields.io/pypi/l/ml4floods) [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.8153514.svg)](https://doi.org/10.5281/zenodo.8153514)

ML4Floods is an end-to-end ML pipeline for flood extent estimation: from data preprocessing, model training, model deployment to visualization.

<p align="center">
    <img src="https://raw.githubusercontent.com/spaceml-org/ml4floods/main/jupyterbook/content/ml4ops/ts_albania.gif" alt="awesome flood extent estimation" width="100%">
</p>

## Install

Install from [pip](https://pypi.org/project/ml4floods/):

```bash
pip install ml4floods
```

Install the latest version from GitHub:

```bash
pip install git+https://github.com/spaceml-org/ml4floods#egg=ml4floods
```

## Docs
[spaceml-org.github.io/ml4floods](https://spaceml-org.github.io/ml4floods)

These tutorials may help you explore the datasets and models:
* [Run the clouds-aware flood segmentation model in Sentinel-2 and Landsat and vectorise the flood maps](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_postprocess_inference.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_postprocess_inference.ipynb)
* [Run the model on time series of Sentinel-2 images](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_inference_on_image_time_series.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_inference_on_image_time_series.ipynb)
* [Ingest data from Copernicus EMS](https://spaceml-org.github.io/ml4floods/content/prep/full_data_ingest.html)  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/prep/full_data_ingest.ipynb)
* [ML-models step by step](https://spaceml-org.github.io/ml4floods/content/ml_overview.html)
    * [Training](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_Train_models.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_Train_models.ipynb)
    * [Inference on new data](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_Run_Inference_on_new_data.html) (a Sentinel-2 image) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_Run_Inference_on_new_data.ipynb)
    * [Perf metrics](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_performance_metrics_workflow.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_performance_metrics_workflow.ipynb)

## The *WorldFloods* database

The [*WorldFloods* database](https://www.nature.com/articles/s41598-023-47595-7) contains 509 pairs of Sentinel-2 images and flood segmentation masks. 
It requires approximately 300GB of hard-disk storage. 

The *WorldFloods* database and all pre-trained models are released under a [Creative Commons non-commercial licence](https://creativecommons.org/licenses/by-nc/4.0/legalcode.txt) 
<img src="https://mirrors.creativecommons.org/presskit/buttons/88x31/png/by-nc.png" alt="licence" width="60"/>

To download the *WorldFloods* database or the pretrained flood segmentation models see [the instructions to download the database](https://spaceml-org.github.io/ml4floods/content/worldfloods_dataset.html).

## Cite

If you find this work useful please cite:

```
@article{portales-julia_global_2023,
	title = {Global flood extent segmentation in optical satellite images},
	volume = {13},
	issn = {2045-2322},
	doi = {10.1038/s41598-023-47595-7},
	number = {1},
	urldate = {2023-11-30},
	journal = {Scientific Reports},
	author = {Portalés-Julià, Enrique and Mateo-García, Gonzalo and Purcell, Cormac and Gómez-Chova, Luis},
	month = nov,
	year = {2023},
	pages = {20316},
}
@article{mateo-garcia_towards_2021,
	title = {Towards global flood mapping onboard low cost satellites with machine learning},
	volume = {11},
	issn = {2045-2322},
	doi = {10.1038/s41598-021-86650-z},
	number = {1},
	urldate = {2021-04-01},
	journal = {Scientific Reports},
	author = {Mateo-Garcia, Gonzalo and Veitch-Michaelis, Joshua and Smith, Lewis and Oprea, Silviu Vlad and Schumann, Guy and Gal, Yarin and Baydin, Atılım Güneş and Backes, Dietmar},
	month = mar,
	year = {2021},
	pages = {7249},
}
```

## About

ML4Floods has been funded by the United Kingdom Space Agency (UKSA) and led by [Trillium Technologies](http://trillium.tech/). It has also been partially supported by the Spanish Ministry of Science and Innovation project PID2019-109026RB-I00 (MINECO-ERDF MCIN/AEI/10.13039/501100011033).

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/spaceml-org/ml4floods",
    "name": "ml4floods",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "floods pytorch machine-learning earth",
    "author": "SpaceML-org",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/7c/57/9ccc4296d18773c1d246619853df50b8c5dfae74e52bc4f0599c5fe0e11a/ml4floods-1.0.1.tar.gz",
    "platform": null,
    "description": "\n<p align=\"center\">\n    <img src=\"https://raw.githubusercontent.com/spaceml-org/ml4floods/main/jupyterbook/ml4floods_banner.png\" alt=\"awesome ml4floods\" width=\"50%\">\n</p>\n\n[![Article DOI:10.1038/s41598-023-47595-7](https://img.shields.io/badge/Article%20DOI-10.1038%2Fs41598.023.47595.7-blue)](https://doi.org/10.1038/s41598-023-47595-7)  ![PyPI](https://img.shields.io/pypi/v/ml4floods) ![PyPI - Python Version](https://img.shields.io/pypi/pyversions/ml4floods) ![PyPI - License](https://img.shields.io/pypi/l/ml4floods) [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.8153514.svg)](https://doi.org/10.5281/zenodo.8153514)\n\nML4Floods is an end-to-end ML pipeline for flood extent estimation: from data preprocessing, model training, model deployment to visualization.\n\n<p align=\"center\">\n    <img src=\"https://raw.githubusercontent.com/spaceml-org/ml4floods/main/jupyterbook/content/ml4ops/ts_albania.gif\" alt=\"awesome flood extent estimation\" width=\"100%\">\n</p>\n\n## Install\n\nInstall from [pip](https://pypi.org/project/ml4floods/):\n\n```bash\npip install ml4floods\n```\n\nInstall the latest version from GitHub:\n\n```bash\npip install git+https://github.com/spaceml-org/ml4floods#egg=ml4floods\n```\n\n## Docs\n[spaceml-org.github.io/ml4floods](https://spaceml-org.github.io/ml4floods)\n\nThese tutorials may help you explore the datasets and models:\n* [Run the clouds-aware flood segmentation model in Sentinel-2 and Landsat and vectorise the flood maps](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_postprocess_inference.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_postprocess_inference.ipynb)\n* [Run the model on time series of Sentinel-2 images](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_inference_on_image_time_series.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_inference_on_image_time_series.ipynb)\n* [Ingest data from Copernicus EMS](https://spaceml-org.github.io/ml4floods/content/prep/full_data_ingest.html)  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/prep/full_data_ingest.ipynb)\n* [ML-models step by step](https://spaceml-org.github.io/ml4floods/content/ml_overview.html)\n    * [Training](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_Train_models.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_Train_models.ipynb)\n    * [Inference on new data](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_Run_Inference_on_new_data.html) (a Sentinel-2 image) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_Run_Inference_on_new_data.ipynb)\n    * [Perf metrics](https://spaceml-org.github.io/ml4floods/content/ml4ops/HOWTO_performance_metrics_workflow.html) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/spaceml-org/ml4floods/blob/main/jupyterbook/content/ml4ops/HOWTO_performance_metrics_workflow.ipynb)\n\n## The *WorldFloods* database\n\nThe [*WorldFloods* database](https://www.nature.com/articles/s41598-023-47595-7) contains 509 pairs of Sentinel-2 images and flood segmentation masks. \nIt requires approximately 300GB of hard-disk storage. \n\nThe *WorldFloods* database and all pre-trained models are released under a [Creative Commons non-commercial licence](https://creativecommons.org/licenses/by-nc/4.0/legalcode.txt) \n<img src=\"https://mirrors.creativecommons.org/presskit/buttons/88x31/png/by-nc.png\" alt=\"licence\" width=\"60\"/>\n\nTo download the *WorldFloods* database or the pretrained flood segmentation models see [the instructions to download the database](https://spaceml-org.github.io/ml4floods/content/worldfloods_dataset.html).\n\n## Cite\n\nIf you find this work useful please cite:\n\n```\n@article{portales-julia_global_2023,\n\ttitle = {Global flood extent segmentation in optical satellite images},\n\tvolume = {13},\n\tissn = {2045-2322},\n\tdoi = {10.1038/s41598-023-47595-7},\n\tnumber = {1},\n\turldate = {2023-11-30},\n\tjournal = {Scientific Reports},\n\tauthor = {Portal\u00e9s-Juli\u00e0, Enrique and Mateo-Garc\u00eda, Gonzalo and Purcell, Cormac and G\u00f3mez-Chova, Luis},\n\tmonth = nov,\n\tyear = {2023},\n\tpages = {20316},\n}\n@article{mateo-garcia_towards_2021,\n\ttitle = {Towards global flood mapping onboard low cost satellites with machine learning},\n\tvolume = {11},\n\tissn = {2045-2322},\n\tdoi = {10.1038/s41598-021-86650-z},\n\tnumber = {1},\n\turldate = {2021-04-01},\n\tjournal = {Scientific Reports},\n\tauthor = {Mateo-Garcia, Gonzalo and Veitch-Michaelis, Joshua and Smith, Lewis and Oprea, Silviu Vlad and Schumann, Guy and Gal, Yarin and Baydin, At\u0131l\u0131m G\u00fcne\u015f and Backes, Dietmar},\n\tmonth = mar,\n\tyear = {2021},\n\tpages = {7249},\n}\n```\n\n## About\n\nML4Floods has been funded by the United Kingdom Space Agency (UKSA) and led by [Trillium Technologies](http://trillium.tech/). It has also been partially supported by the Spanish Ministry of Science and Innovation project PID2019-109026RB-I00 (MINECO-ERDF MCIN/AEI/10.13039/501100011033).\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "Machine learning models for end-to-end flood extent segmentation.",
    "version": "1.0.1",
    "project_urls": {
        "Homepage": "https://github.com/spaceml-org/ml4floods"
    },
    "split_keywords": [
        "floods",
        "pytorch",
        "machine-learning",
        "earth"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "dca288bad8ce07172235f411318a97c3d8569e817daefe3e990a3771d2f73a9a",
                "md5": "967a579e1f07d9b5e688a14c4682362e",
                "sha256": "9844efe204433152a0b0f8acea4d49e4fae1fc479009836950558cde7a3d3077"
            },
            "downloads": -1,
            "filename": "ml4floods-1.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "967a579e1f07d9b5e688a14c4682362e",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 138667,
            "upload_time": "2023-12-19T08:45:13",
            "upload_time_iso_8601": "2023-12-19T08:45:13.291618Z",
            "url": "https://files.pythonhosted.org/packages/dc/a2/88bad8ce07172235f411318a97c3d8569e817daefe3e990a3771d2f73a9a/ml4floods-1.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7c579ccc4296d18773c1d246619853df50b8c5dfae74e52bc4f0599c5fe0e11a",
                "md5": "8fdd582d07abbd15bd809a6594de38f8",
                "sha256": "ffc9ff9351c8ef0d72a8a2d9ac554aba67e930768806f7adf7384f3ddacac13e"
            },
            "downloads": -1,
            "filename": "ml4floods-1.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "8fdd582d07abbd15bd809a6594de38f8",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 120340,
            "upload_time": "2023-12-19T08:45:15",
            "upload_time_iso_8601": "2023-12-19T08:45:15.480417Z",
            "url": "https://files.pythonhosted.org/packages/7c/57/9ccc4296d18773c1d246619853df50b8c5dfae74e52bc4f0599c5fe0e11a/ml4floods-1.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-12-19 08:45:15",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "spaceml-org",
    "github_project": "ml4floods",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [],
    "lcname": "ml4floods"
}
        
Elapsed time: 3.44315s