skip to main content
10.1145/3356471.3365235acmconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
research-article

Urban Flood Mapping with Residual Patch Similarity Learning

Published: 05 November 2019 Publication History

Abstract

Urban flood mapping is essential for disaster rescue and relief missions, reconstruction efforts, and financial loss evaluation. Much progress has been made to map the extent of flooding with multi-source remote sensing imagery and pattern recognition algorithms. However, urban flood mapping at high spatial resolution remains a major challenge due to three main reasons: (1) the very high resolution (VHR) optical remote sensing imagery often has heterogeneous background involving various ground objects (e.g., vehicles, buildings, roads, and trees), making traditional classification algorithms fail to capture the underlying spatial correlation between neighboring pixels within the flood hazard area; (2) traditional flood mapping methods with handcrafted features as input cannot fully leverage massive available data, which requires robust and scalable algorithms; and (3) due to inconsistent weather conditions at different time of data acquisition, pixels of the same objects in VHR optical imagery could have very different pixel values, leading to the poor generalization capability of classical flood mapping methods. To address this challenge, this paper proposed a residual patch similarity convolutional neural network (ResPSNet) to map urban flood hazard zones using bi-temporal high resolution (3m) pre- and post-flooding multispectral surface reflectance satellite imagery. Besides, remote sensing specific data augmentation was also developed to remove the impact of varying illuminations due to different data acquisition conditions, which in turn further improves the performance of the proposed model. Experiments using the high resolution imagery before and after the 2017 Hurricane Harvey flood in Houston, Texas, showed that the developed ResPSNet model, along with associated remote sensing specific data augmentation method, can robustly produce flood maps over urban areas with high precision (0.9002), recall (0.9302), F1 score (0.9128), and overall accuracy (0.9497). The research sheds light on multitemporal image fusion for high precision image change detection, which in turn can be used for monitoring natural hazards.

References

[1]
Fabio Cian, Mattia Marconcini, and Pietro Ceccato. 2018. Normalized Difference Flood Index for rapid flood mapping: Taking advantage of EO big data. Remote Sensing of Environment 209 (may 2018), 712--730. https://doi.org/10.1016/j.rse.2018.03.006
[2]
DigitalGlobe. [n.d.]. Open Data Program. https://www.digitalglobe.com/ecosystem/open-data
[3]
Jigar Doshi, Saikat Basu, and Guan Pang. 2018. From Satellite Imagery to Disaster Insights. In 32nd Conference on Neural Information Processing Systems Workshop.
[4]
FEMA. [n.d.]. Federal Emergency Management Agency Flood Mapping Products. https://www.fema.gov/flood-mapping-products
[5]
Quanlong Feng, Jiantao Liu, and Jianhua Gong. 2015. Urban Flood Mapping Based on Unmanned Aerial Vehicle Remote Sensing and Random Forest Classifier A Case of Yuyao, China. Water 7, 12 (mar 2015), 1437--1455. https://doi.org/10.3390/w7041437
[6]
Bo-Cai Gao. 1996. NDWIâĂŤA normalized difference water index for remote sensing of vegetation liquid water from space. Remote sensing of environment 58, 3 (1996), 257--266.
[7]
Asmamaw Gebrehiwot, Leila Hashemi-Beni, Gary Thompson, Parisa Kordjamshidi, and Thomas Langan. 2019. Deep Convolutional Neural Network for Flood Extent Mapping Using Unmanned Aerial Vehicles Data. Sensors 19, 7 (mar 2019), 1486. https://doi.org/10.3390/s19071486
[8]
Laura Giustarini, Renaud Hostache, Dmitri Kavetski, Marco Chini, Giovanni Corato, Stefan Schlaffer, and Patrick Matgen. 2016. Probabilistic flood mapping using synthetic aperture radar data. IEEE Transactions on Geoscience and Remote Sensing 54, 12 (2016), 6958--6969.
[9]
Stephane Hallegatte, Colin Green, Robert J Nicholls, and Jan Corfee-Morlot. 2013. Future flood losses in major coastal cities. Nature climate change 3, 9 (2013), 802.
[10]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE international conference on computer vision. 1026--1034.
[11]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[12]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. http://arxiv.org/abs/1412.6980 cite arxiv:1412.6980Comment: Published as a conference paper at the 3rd International Conference for Learning Representations, San Diego, 2015.
[13]
Linyi Li, Yun Chen, Xin Yu, Rui Liu, and Chang Huang. 2015. Sub-pixel flood inundation mapping from multispectral remotely sensed images based on discrete particle swarm optimization. ISPRS Journal of Photogrammetry and Remote Sensing 101 (mar 2015), 10--21. https://doi.org/10.1016/j.isprsjprs.2014.11.006
[14]
Yu Li, Sandro Martinis, and Marc Wieland. 2019. Urban flood mapping with an active self-learning convolutional neural network based on TerraSAR-X intensity and interferometric coherence. ISPRS Journal of Photogrammetry and Remote Sensing 152 (jun 2019), 178--191. https://doi.org/10.1016/j.isprsjprs.2019.04.014
[15]
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. 2017. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 136--144.
[16]
Radosław Malinowski, Geoff Groom, Wolfgang Schwanghart, and Goswin Heckrath. 2015. Detection and delineation of localized flooding from WorldView-2 multispectral data. Remote sensing 7, 11 (2015), 14853--14875.
[17]
Giuseppe Masi, Davide Cozzolino, Luisa Verdoliva, and Giuseppe Scarpa. 2016. Pansharpening by convolutional neural networks. 8, 7 (2016), 594.
[18]
National Oceanic and Atmospheric Administration. [n.d.]. Data and Imagery from NOAA National Geodetic Survey. https://www.ngs.noaa.gov/
[19]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.
[20]
Planet Team. 2018. Planet Application Program Interface: In Space for Life on Earth. San Francisco, CA. https://api.planet.com
[21]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention âĂŞ MICCAI 2015, Nassir Navab, Joachim Hornegger, William M Wells, and Alejandro F Frangi (Eds.). Springer International Publishing, Cham, 234--241.
[22]
Tim G. J. Rudner, Marc Ruçwurm, Jakub Fil, Ramona Pelich, Benjamin Bischke, Veronika Kopackova, and Piotr Bilinski. 2019. Multi3Net: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery. https://arxiv.org/abs/1812.01756
[23]
Xinyi Shen, Emmanouil N Anagnostou, George H Allen, G Robert Brakenridge, and Albert J Kettner. 2019. Near-real-time non-obstructed flood inundation mapping using synthetic aperture radar. Remote Sensing of Environment 221 (feb 2019), 302--315. https://doi.org/10.1016/j.rse.2018.11.008
[24]
United Nations. 2018. The Sustainable Development Goals Report. https://www.un.org/sustainabledevelopment/cities
[25]
Peng Wang, Gong Zhang, and Henry Leung. 2018. Improving super-resolution flood inundation mapping for multispectral remote sensing image by supplying more spectral information. IEEE Geoscience and Remote Sensing Letters (2018).
[26]
Miao Xie, Zhe Jiang, and Arpan Man Sainju. 2018. Geographical hidden markov tree for flood extent mapping. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2545--2554.
[27]
Jure Zbontar and Yann LeCun. 2016. Stereo matching by training a convolutional neural network to compare image patches. Journal of Machine Learning Research 17, 1--32 (2016), 2.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GeoAI '19: Proceedings of the 3rd ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery
November 2019
96 pages
ISBN:9781450369572
DOI:10.1145/3356471
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Flood mapping
  2. deep learning
  3. flood extent estimation
  4. patch similarity
  5. residual learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SIGSPATIAL '19
Sponsor:

Acceptance Rates

GeoAI '19 Paper Acceptance Rate 17 of 25 submissions, 68%;
Overall Acceptance Rate 17 of 25 submissions, 68%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)3
Reflects downloads up to 14 Sep 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media