Integrated Processing Method for Target Speech Extraction Based on Diffusion Model
CSTR:
Author:
Affiliation:

1Taiyuan Satellite Launch Center, Taiyuan 030027, China;2College of Computer, Xi’an Jiaotong University, Xi’an 710072, China;3College of Computer , National University of Defense Technology, Changsha 410073, China

Clc Number:

TN912.3

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    This paper introduces a two-stage deep learning approach to enhance the performance of single-channel target speech extraction. Conventional discriminative models often over-optimize objective metrics, leading to unnatural artifacts, distortions, and compromised subjective auditory quality in the extracted speech. To address this limitation, we innovatively incorporate a diffusion model as a second-stage refinement module. This module, built upon a stochastic differential equation (SDE) framework, regenerates and refines the initial output from the discriminative model. This process not only reduces extraction errors but also significantly improves the naturalness and harmonic clarity of the target speech. Experimental results on the WSJ0-2mix-extr dataset show that our method achieves an 11.18% improvement (from 3.22 to 3.58) on the non-intrusive speech quality assessment (NISQA) metric, which simulates subjective auditory perception. This indicates a substantial enhancement in perceived speech quality and naturalness. Furthermore, subjective listening tests using the comparative mean opinion score (CMOS) confirm the effectiveness of our approach in boosting speech clarity and intelligibility.

    Reference
    Related
    Cited by
Get Citation

WANG Gang, MU Zhaoxi, JIA Chunbo, ZHOU Lixin, GU Baoguo. Integrated Processing Method for Target Speech Extraction Based on Diffusion Model[J]. Journal of Data Acquisition and Processing,2026,41(5):1378-1394.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:March 11,2025
  • Revised:October 17,2025
  • Adopted:
  • Online: October 14,2026
  • Published:
Article QR Code