Mask R-CNN and OBIA Fusion Improves the Segmentation of Scattered Vegetation in Very High-Resolution Optical Sensors
MetadataShow full item record
AuthorGuirado, Emilio; Blanco Sacristán, Javier; Rodríguez-Caballero, Emilio; Tabik, Siham; Alcaraz Segura, Domingo; Martínez-Valderrama, Jaime; Cabello, Javier
Deep learningFusionMask R-CNNObject-Based Image Analysis (OBIA)Optical sensorScattered vegetationVery high-resolution
Guirado, E.; Blanco-Sacristán, J.; Rodríguez-Caballero, E.; Tabik, S.; Alcaraz-Segura, D.; Martínez-Valderrama, J.; Cabello, J. Mask R-CNN and OBIA Fusion Improves the Segmentation of Scattered Vegetation in Very High-Resolution Optical Sensors. Sensors 2021, 21, 320. [https://doi.org/10.3390/s21010320]
SponsorshipEuropean Research Council (ERC) 647038; European LIFE Project ADAPTAMED LIFE14 CCA/ES/000612; Junta de Andalucia P18-RT-1927 P18-RT-5130; DETECTOR A-RNM-256-UGR18; European Union Funds for Regional Development; HIPATIA-UAL fellowship; Spanish Government RYC-201518136; A-TIC-458-UGR18
Vegetation generally appears scattered in drylands. Its structure, composition and spatial patterns are key controls of biotic interactions, water, and nutrient cycles. Applying segmentation methods to very high-resolution images for monitoring changes in vegetation cover can provide relevant information for dryland conservation ecology. For this reason, improving segmentation methods and understanding the effect of spatial resolution on segmentation results is key to improve dryland vegetation monitoring. We explored and analyzed the accuracy of Object-Based Image Analysis (OBIA) and Mask Region-based Convolutional Neural Networks (Mask R-CNN) and the fusion of both methods in the segmentation of scattered vegetation in a dryland ecosystem. As a case study, we mapped Ziziphus lotus, the dominant shrub of a habitat of conservation priority in one of the driest areas of Europe. Our results show for the first time that the fusion of the results from OBIA and Mask R-CNN increases the accuracy of the segmentation of scattered shrubs up to 25% compared to both methods separately. Hence, by fusing OBIA and Mask R-CNNs on very high-resolution images, the improved segmentation accuracy of vegetation mapping would lead to more precise and sensitive monitoring of changes in biodiversity and ecosystem services in drylands.