基于深度展开和双流网络的高光谱图像融合
作者:
作者单位:

上海理工大学光电信息与计算机工程学院,上海 200093

作者简介:

通讯作者:

基金项目:

国家自然科学基金(61703278)。


Hyperspectral Image Fusion via Deep Unfolding and Dual-stream Networks
Author:
Affiliation:

School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    针对基于深度学习的高光谱图像融合算法通常堆积多个卷积以学习映射关系、没有充分利用问题的特性以及缺乏可解释性等问题,提出一种结合深度展开与双流网络的深度网络。首先使用卷积稀疏编码建立融合模型,该模型将低分辨率高光谱图像(Low-resolution hyperspectral images, LR-HSI)和高分辨率多光谱图像(high-resolution multispectral images, HR-MSI)映射到低维子空间中。在融合模型设计中,考虑了LR-HSI和HR-MSI的共有信息以及LR-HSI的独有信息,并将HR-MSI作为辅助信息加入模型中。其次将该融合模型展开为可学习的可解释深度网络。最后,使用双流网络获取更精确的高分辨率高光谱图像(High-resolution hyperspectral images, HR-HSI)。实验表明,该网络在高光谱图像融合中可以获得出色的效果。

    Abstract:

    Hyperspectral image fusion algorithms based on deep learning typically stack multiple convolutional layers to learn mapping relationships, which suffer from the problems of not fully utilizing the characteristics of the task and lack of interpretability. To address these problems, this paper proposes a deep network combining deep unfolding and dual-stream networks. Firstly, an image fusion model is established using convolutional sparse coding, which maps low-resolution hyperspectral images (LR-HSI) and high-resolution multispectral images (HR-MSI) into a low-dimensional subspace. In the design of the fusion model, we consider the common information of LR-HSI and HR-MSI as well as the unique information of LR-HSI, and add HR-MSI to the model as auxiliary information. Next, the fusion model is unfolded into a learnable interpretable deep network. Finally, the dual-stream network is used to get more accurate high-resolution hyperspectral images (HR-HSI). Experiments prove that the network obtains excellent results in the hyperspectral image fusion task.

    参考文献
    相似文献
    引证文献
引用本文

刘丛,姚佳浩.基于深度展开和双流网络的高光谱图像融合[J].数据采集与处理,2023,38(6):1406-1421

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2022-08-27
  • 最后修改日期:2023-03-27
  • 录用日期:
  • 在线发布日期: 2023-12-08