基于Transformer与多层注意力机制的膀胱医学图像分割算法研究
作者:
作者单位:

上海理工大学光电信息与计算机工程学院,上海 200093

作者简介:

通讯作者:

基金项目:

国家自然科学基金 11502145国家自然科学基金(11502145)。


Research on Bladder Medical Image Segmentation Algorithm Based on Transformer and Multi-level Attention Mechanism
Author:
Affiliation:

School of Optical-Electrical & Computer Engineering, University of Shanghai for Science & Technology, Shanghai 200093, China

Fund Project:

National Natural Science Foundation of China 11502145National Natural Science Foundation of China (No.11502145).

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    深度学习技术目前已经广泛应用于医学图像分割领域,然而,膀胱图像的精准分割依然面临挑战。本文针对膀胱磁共振成像(Magnetic resonance imaging, MRI)图像分割问题,提出了一种基于特征融合以及注意力机制的改进算法,记作MIV-Net。该算法通过引入多尺度核心特征融合器(Multi-scale core feature fusionizer,MCF)来增强模型图像特征提取能力,并引入视觉特征解析与转换(Vision Transformer,VIT)网络来优化全局信息处理能力。此外,在解码过程中通过多层次注意力融合(Multi-level attention fusion,MAF)模块来增强对上下文信息的利用。实验结果表明,MIV-Net模型在膀胱壁和膀胱肿瘤的分割中展现出优异的性能,其IoU、Precision和Dice系数等关键评价指标均显著超越当前主流方法,在两个分割任务上分别达到83.16%、91.66%和90.81%以及82.49%、90.50%和90.40%。该模型不仅在技术上具有创新性,更在实际应用中有望显著提升膀胱癌诊断的准确性。

    Abstract:

    Deep learning technology has been widely applied to the field of medical image segmentation; however, accurate segmentation of bladder images remains challenging. To address the segmentation of bladder magnetic resonance imaging (MRI) iamges, this study proposes MIV-Net, an improved algorithm based on feature fusion and attention mechanisms. The network introduces a multi-scale core feature fusionizer (MCF) to aggregate feature information at different scales and enhance the representation of local structures and boundary details. A vision Transformer (VIT) network is incorporated to capture long-range dependencies, thereby improving the modeling of global contextual information. In the decoding stage, a multilevel attention fusion (MAF) module is employed to integrate multi-level semantic and spatial information, allowing the network to make better use of contextual cues and recover fine segmentation details. Experiments are conducted on two tasks: Bladder wall segmentation and bladder tumor segmentation. For bladder wall segmentation, MIV-Net achieves IoU, Precision, and Dice coefficient values of 83.16%, 91.66%, and 90.81%, respectively. For bladder tumor segmentation, the corresponding values are 82.49%, 90.50%, and 90.40%. These results demonstrate that MIV-Net outperforms current mainstream methods across the key evaluation metrics and provides accurate segmentation of both bladder walls and tumors. By jointly exploiting multi-scale local features, global dependencies, and multi-level contextual information, the proposed model offers a promising technical approach for automated bladder MRI image analysis and may support more accurate computer-aided diagnosis of bladder cancer.Highlights:1. Propose MIV-Net by integrating the multi-scale core feature fusionizer (MCF), vision Transformer (VIT) network, and multi-level attention fusion (MAF) module for bladder MRI image segmentation.2. Enhance multi-scale feature extraction, global information modeling, and contextual information fusion through the coordinated use of MCF, VIT, and MAF.3. Achieve Dice scores of 90.81% and 90.40% for bladder wall and bladder tumor segmentations, respectively, outperforming current mainstream methods.

    参考文献
    相似文献
    引证文献
引用本文

高博艺,丁学明,丁雪峰,胡鸿翔.基于Transformer与多层注意力机制的膀胱医学图像分割算法研究[J].数据采集与处理,2026,(5):1480-1493

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2024-10-20
  • 最后修改日期:2025-03-10
  • 录用日期:
  • 在线发布日期: 2026-10-14