A Deep Transfer Learning Framework Using Teacher-Student Structure for Land Cover Classification of Remote-Sensing Imagery

DOI码：10.1109/lgrs.2023.3312591

发表刊物：IEEE GEOSCIENCE AND REMOTE SENSING LETTERS

关键字：Remote sensing

摘要：Deep-learning techniques are widely used for land cover classification in remote-sensing, primarily because they can effectively extract complex features from imagery data, which is essential for accurate land cover classification. However, the heterogeneity of data can pose a challenge to the generalizability of deep models. To address this issue, we propose a novel transfer learning framework for land cover classification using teacher-student structure. The proposed framework utilizes the knowledge acquired by the teacher model from large datasets to facilitate fine-tuning of the student model on small datasets, which prevents problems such as overfitting resulting from training large models on small datasets and inferior performance arising from the limited learning capacity of small models. To achieve this goal, we design a loss function based on central moment discrepancy (CMD) and high-temperature softmax. In addition, we conducted experiments on three distinct pairs of datasets and found that our proposed framework outperforms both training the student model from scratch on the target domain and simply fine-tuning the teacher and student models from the source domain to the target domain. Specifically, we observed an average increase in mean intersection over union (mIoU) of 9.9%, 2.1%, and 4.3%. These results demonstrate the effectiveness and generalizability of our proposed framework for remote-sensing land cover classification.

合写作者：Xianwei Li,Puyun Liao,Tong Wang,Haobo Yang,Chanjuan He,Wenlin Zhou,Yufeng Sun

论文类型：期刊论文

通讯作者：Guanzhou Chen

文献类型：J

卷号：21

页面范围：1-1

ISSN号：1545-598X

是否译文：否

发表时间：2023-09-06

收录刊物：SCI