Early Mycosis Fungoides Recognition Based on Multimodal Image Fusion
CSTR:
Author:
Affiliation:

1.Image Processing Center, School of Astronautics, Beihang University, Beijing 100191, China;2.Department of Dermatology, Peking Union Medical College Hospital, Beijing 100730, China;3.Peking Union Medical College,Chinese Academy of Medical Science,Beijing 100730, China

Clc Number:

TP183;R751

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Early mycosis fungoides (MFs) may present as erythematous scaly skin lesions, which are difficult to distinguish from benign inflammatory skin diseases such as psoriasis and chronic eczema. This paper presents a new method based on multimodal image fusion for early mycosis fungoides recognition. The method adopts the ResNet18 network to extract features of single-modality images based on dermoscopic images and clinical images, designs the cross-modal attention module to achieve feature fusion of two modal images, and uses the self-attention module to extract the key information and reduce redundant information in the fusion features, thereby improving the accuracy of intelligent identification of early mycosis fungoides. Experimental results show that the proposed intelligent diagnosis model outperforms the comparison algorithms. At the same time, the proposed intelligent model is applied to the actual clinical diagnosis of dermatologists. Through the changes in the average diagnostic accuracy of the experimental group and the control group, it is confirmed that the proposed intelligent diagnostic model can effectively improve the clinical diagnosis level.

    Reference
    Related
    Cited by
Get Citation

XIE Fengying, ZHAO Danpei, WANG Ke, LIU Zhaorui, WANG Yukun, ZHANG Yilan, LIU Jie. Early Mycosis Fungoides Recognition Based on Multimodal Image Fusion[J].,2023,38(4):792-801.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:July 30,2022
  • Revised:September 10,2022
  • Adopted:
  • Online: July 25,2023
  • Published:
Article QR Code