Liver Cancer Diagnosis Method Based on Multi-modal Ultrasound Contrast Learning
CSTR:
Author:
Affiliation:

1.Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education, College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;2.Department of Ultrasound, Affiliated Drum Tower Hospital, Medical School of Nanjing University, Nanjing 210008, China

Clc Number:

TP18;R445

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    In recent years, liver cancer has become a disease that seriously threatens human health, and multi-modal ultrasound imaging is one of the important diagnostic tools for it. Similar to how clinicians use multi-modal ultrasound to diagnose liver cancer, using multi-modal fusion methods to integrate the image features of each ultrasound modality is expected to improve the accuracy of liver cancer diagnosis. However, the existing multi-modal fusion methods often isolate the feature information of each modality during the fusion process, failing to fully consider the intra-modal sample similarity and inter-modal semantic consistency, while ignoring modality uncertainty. Therefore, this paper proposes a liver cancer diagnosis method based on multi-modal ultrasound contrast learning, aiming to make full use of the feature information of each ultrasound modality to improve the diagnostic accuracy. Specifically, this method employs supervised contrastive learning to deeply explore modality features, capturing both the similarity information among samples within the modality and the semantic consistency information across different modalities. In addition, this method introduces a measure of modality uncertainty based on Subjective Logic, enabling dynamic fusion of modality information and exhibiting good robustness. Evaluation of multimodal ultrasound imaging shows that the proposed method achieves an 85.21% diagnostic accuracy, demonstrating performance improvement compared to other mainstream multimodal fusion methods.

    Reference
    Related
    Cited by
Get Citation

YANG Yinkai, WAN Peng, SHI Hang, XUE Haiyan, SHAO Wei. Liver Cancer Diagnosis Method Based on Multi-modal Ultrasound Contrast Learning[J].,2024,39(4):874-885.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:May 20,2024
  • Revised:July 09,2024
  • Adopted:
  • Online: July 25,2024
  • Published:
Article QR Code