Dual-path Interactive U-Net for Unsupervised Hyperspectral Image Super-Resolution

作     者：Deng, Wenchen Liu, Jianjun Yang, Jinlong Wu, Zebin Xiao, Liang 

作者机构：Jiangnan University Jiangsu Provincial Engineering Laboratory for Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Wuxi214122 China Nanjing University of Science and Technology School of Computer Science and Engineering Nanjing210094 China 

出 版 物：《IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing》 (IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens.)

年 卷 期：2025年第18卷

页      面：11751-11766页

学科分类：0808[工学-电气工程] 08[工学] 0803[工学-光学工程] 

基　　金：National Natural Science Foundation of China 

主　　题：Image coding 

摘      要：Combining low-spatial-resolution hyperspectral image (LrHSI) with high-spatial-resolution multispectral image (HrMSI) serves as an effective strategy for enhancing the spatial fidelity of LrHSI. Nevertheless, most existing methods still face challenges in effectively leveraging the complementary information between the two distinct modalities and maintaining internal consistency, leading to suboptimal fusion results. Previous studies have demonstrated that U-shaped networks can capture spatial structural features within images. Inspired by this, we propose a dual-path interactive U-Net architecture to preserve spatial and spectral integrity. Specifically, we use a standard U-Net and a reversed U-Net as the backbone to extract image information and generate abundance maps of the input images. By enabling interaction between the encoders and decoders of both U-Nets, our architecture integrates information across different scales and modes, leading to enhanced fusion results. To further improve the feature extraction capability, we construct a multi-mode decomposition and reconstruction module, which adaptively fuses the features of LrHSI and HrMSI. This module extracts and combines correlations between the images through Canonical Polyadic decomposition and attention mechanism, capturing global features across different modes. Additionally, we design a weight-sharing U-Net that leverages the similarities and differences between two abundance maps, ensuring internal consistency while reducing computational cost. Thorough evaluations conducted using four publicly available datasets, along with one real-world dataset, and under various noise conditions confirm the validity of our proposed model. © 2008-2012 IEEE.