TY - JOUR
T1 - Cross-domain landslide mapping from large-scale remote sensing images using prototype-guided domain-aware progressive representation learning
AU - Zhang, Xiaokang
AU - Yu, Weikang
AU - Pun, Man-On
AU - Shi, Wenzhong
N1 - Funding Information:
The authors would like to thank the editors and anonymous reviewers for their instructive comments. This work was supported by the National Natural Science Foundation of China under Grant No. 41801323, the National Key R&D Program of China under Grant No. 2018YFB1800800, and the Basic Research Project of Hetao Shenzhen-HK S&T Cooperation Zone, China under Grant No. HZQB-KCZYZ-2021067.
Funding Information:
The authors would like to thank the editors and anonymous reviewers for their instructive comments. This work was supported by the National Natural Science Foundation of China under Grant No. 41801323 , the National Key RD Program of China under Grant No. 2018YFB1800800 , and the Basic Research Project of Hetao Shenzhen-HK ST Cooperation Zone, China under Grant No. HZQB-KCZYZ-2021067 .
Publisher Copyright:
© 2023 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)
PY - 2023/3
Y1 - 2023/3
N2 - Landslide mapping via pixel-wise classification of remote sensing imagery is essential for hazard prevention and risk assessment. Deep-learning-based change detection greatly aids landslide mapping by identifying the down-slope movement of soil, rock and other materials from bitemporal images, benefiting from the feature representation capabilities of convolutional neural networks. However, these networks rely on large amounts of pixel-level annotated data to achieve their promising performance and they normally exhibit weak generalization capability on heterogeneous image data from unseen domains. To address these issues, we propose a prototype-guided domain-aware progressive representation learning (PG-DPRL) method for cross-domain landslide mapping from large-scale remote sensing images based on the multitarget domain adaptation (MTDA) technique. PG-DPRL attempts to learn a shared landslide mapping network that performs well in multiple target domains with no additional effort for sample annotation. Specifically, PG-DPRL adopts a near-to-far adaptation strategy to gradually align the representation distributions of all target domains with the source domain, considering discrepancies between them. On this basis, cross-domain prototype learning is exploited to generate reliable domain-specific pseudo-labels and aggregate representations across domains to learn a shared decision boundary. In each DPRL step, the prototype-guided adversarial learning (PGAL) algorithm is performed to achieve category-wise representation alignment and improve the discriminative capability of representations by introducing the Wasserstein distance metric and cross-domain prototype consistency (CPC) loss. Experiments on a global very-high-resolution landslide mapping (GVLM) dataset consisting of 17 heterogeneous domains from different landslide sites demonstrate the effectiveness and robustness of PG-DPRL. It considerably improves the transferability of landslide mapping networks and outperforms several state-of-the-art approaches in terms of total and average accuracy metrics among all target domains.
AB - Landslide mapping via pixel-wise classification of remote sensing imagery is essential for hazard prevention and risk assessment. Deep-learning-based change detection greatly aids landslide mapping by identifying the down-slope movement of soil, rock and other materials from bitemporal images, benefiting from the feature representation capabilities of convolutional neural networks. However, these networks rely on large amounts of pixel-level annotated data to achieve their promising performance and they normally exhibit weak generalization capability on heterogeneous image data from unseen domains. To address these issues, we propose a prototype-guided domain-aware progressive representation learning (PG-DPRL) method for cross-domain landslide mapping from large-scale remote sensing images based on the multitarget domain adaptation (MTDA) technique. PG-DPRL attempts to learn a shared landslide mapping network that performs well in multiple target domains with no additional effort for sample annotation. Specifically, PG-DPRL adopts a near-to-far adaptation strategy to gradually align the representation distributions of all target domains with the source domain, considering discrepancies between them. On this basis, cross-domain prototype learning is exploited to generate reliable domain-specific pseudo-labels and aggregate representations across domains to learn a shared decision boundary. In each DPRL step, the prototype-guided adversarial learning (PGAL) algorithm is performed to achieve category-wise representation alignment and improve the discriminative capability of representations by introducing the Wasserstein distance metric and cross-domain prototype consistency (CPC) loss. Experiments on a global very-high-resolution landslide mapping (GVLM) dataset consisting of 17 heterogeneous domains from different landslide sites demonstrate the effectiveness and robustness of PG-DPRL. It considerably improves the transferability of landslide mapping networks and outperforms several state-of-the-art approaches in terms of total and average accuracy metrics among all target domains.
KW - Landslide mapping
KW - Change detection
KW - Multitarget domain adaption
KW - Progressive learning
KW - Deep learning
UR - http://www.scopus.com/inward/record.url?scp=85147195531&partnerID=8YFLogxK
U2 - 10.1016/j.isprsjprs.2023.01.018
DO - 10.1016/j.isprsjprs.2023.01.018
M3 - Journal article
SN - 0924-2716
VL - 197
SP - 1
EP - 17
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
IS - 0924-2716
ER -