用于遥感图像变化描述的多尺度特征补偿与变化增强方法
DOI:
作者:
作者单位:

昆明理工大学 信息工程与自动化学院,昆明 650500

作者简介:

通讯作者:

基金项目:


Multi-scale Feature Compensation and Change Enhancement for Remote Sensing Image Change Captioning
Author:
Affiliation:

Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming Yunnan 650500, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    遥感图像变化描述(RSICC)旨在利用多时相图像生成反映地表变化的自然语言文本,在国土监测、灾害评估等领域具有重要价值。然而,在实际应用中,双时相图像常受光照波动、季节演替等非语义因素干扰,导致模型易产生“语义幻觉”,现有方法的普遍采用的简单差分机制难以抑制干扰因素,且对微弱变化信号的感知力不足,致使生成的描述文本不够精准。针对上述挑战,本文提出一种基于多尺度特征补偿与变化增强的遥感图像变化描述框架。首先,通过构建特征补偿网络(FCN),在特征层面强制非变化区域实现双向交互对齐,显式抑制阴影、光照等伪变化干扰;其次,设计变化感知引导模块(DAGM)及多尺度融合策略,在空间与通道维度同步强化判别性特征,提升模型对复杂地物微小演变的响应灵敏度。在 LEVIR-CC 和 Dubai-CC 基准数据集上的实验结果表明,本文方法在多项核心评价指标上均优于主流先进算法。

    Abstract:

    Remote Sensing Image Change Captioning (RSICC) aims to generate natural language descriptions that reflect land-surface alterations using multi-temporal images, holding substantial value in domains such as land-resource monitoring and disaster assessment. However, in practical deployment, bi-temporal images are frequently vulnerable to complex non-semantic interference, such as seasonal successions and sudden illumination fluctuations, which easily induces "semantic hallucinations" in deep networks. Moreover, the ubiquitous simple differencing mechanisms adopted by existing methods struggle to effectively suppress these confounding factors and lack sufficient sensitivity to highly localized change signals, thereby yielding imprecise descriptive captions with poor contextual alignment. To tackle these multi-faceted challenges, this paper proposes a robust remote sensing image change captioning framework grounded on multi-scale feature compensation and change enhancement. To effectively alleviate the severe interference stemming from pseudo-change factors like lighting variations and environmental dynamics, a novel Feature Compensation Network (FCN) is designed. Leveraging a bidirectional guided compensation mechanism via cross-temporal attention, the FCN adaptively modulates bi-temporal features to enforce strict semantic and stylistic consistency across non-change background regions, thereby achieving the explicit suppression of illumination and shadow pseudo-changes. Concurrently, to overcome the perceptual deficiency regarding subtle change signals, a Discriminative Change-Aware Guided Module (DAGM) and a multi-scale fusion strategy are introduced. By synchronously reinforcing highly discriminative representations across both spatial and channel dimensions, this module substantially elevates the framework's operational sensitivity to the minor and intricate evolution of complex ground objects. Comprehensive quantitative comparison experiments conducted on the challenging LEVIR-CC and Dubai-CC benchmark datasets demonstrate that the proposed method consistently and significantly outperforms mainstream state-of-the-art algorithms across multiple core evaluation metrics, such as BLEU-4 and CIDEr, validating its distinct superiority in generating accurate and grammatically coherent text descriptions. Furthermore, qualitative analysis and comprehensive visualization results provide intuitive, empirical evidence supporting the robust cross-temporal interpretability of the model. Meanwhile, rigorous ablation studies systematically verify the theoretical necessity and practical effectiveness of each key proposed component. Ultimately, both experimental and theoretical investigations indicate that the proposed Feature Compensation Network (FCN) successfully achieves bidirectional interactive alignment and explicit interference suppression within non-change regions. Meanwhile, the seamlessly integrated Change-Aware Guided Module (DAGM) and multi-scale feature fusion strategy can effectively mine, preserve, and reinforce fine-grained details within genuine change regions, offering a highly promising and generalizable solution for high-precision earth observation and semantic change interpretation tasks.

    参考文献
    相似文献
    引证文献
引用本文

李 浩,谢明鸿.用于遥感图像变化描述的多尺度特征补偿与变化增强方法[J].数据采集与处理,,():

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-07-14