Document Type
Article
Abstract
This article aims to implement a prototype screening system to identify flooding-related photos from social media. These photos, associated with their geographic locations, can provide free, timely, and reliable visual information about flood events to the decision-makers. This screening system, designed for application to social media images, includes several key modules: tweet/image downloading, flooding photo detection, and aWebGIS application for human verification. In this study, a training dataset of 4800 flooding photos was built based on an iterative method using a convolutional neural network (CNN) developed and trained to detect flooding photos. The system was designed in a way that the CNN can be re-trained by a larger training dataset when more analyst-verified flooding photos are being added to the training set in an iterative manner. The total accuracy of flooding photo detection was 93% in a balanced test set, and the precision ranges from 46–63% in the highly imbalanced real-time tweets. The system is plug-in enabled, permitting flexible changes to the classification module. Therefore, the system architecture and key components may be utilized in other types of disaster events, such as wildfires, earthquakes for the damage/impact assessment.
Digital Object Identifier (DOI)
Publication Info
Published in ISPRS International Journal of Geo-Information, Volume 9, Issue 2, 2020, pages 104-.
Rights
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
APA Citation
Ning, H., Li, Z., Hodgson, M. E., & Wang, C. (Susan). (2020). Prototyping a social media flooding photo screening system based on deep learning. ISPRS International Journal of Geo-Information, 9(2), 104. https://doi.org/10.3390/ijgi9020104