Frame-Level Few-Shot Sound Event Detection Framework Based on Multi-Task Learning and Dynamic Convolution
DOI:
CSTR:
Author:
Affiliation:

1.iFlytek Research, iFLYTEK Co., Ltd., Hefei 230088, China; 2.School of Information Science and Technology, University of Science and Technology of China, Hefei 230026, China; 3.School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Sound Event Detection (SED) plays a critical role in intelligent perception systems, with broad applications in industrial monitoring, ecological surveillance, and public safety. To address the limitations of low-resource SED scenarios, such as insufficient labeled data and limited temporal resolution, this paper proposes a frame-level few-shot sound event detection method based on multi-task learning and dynamic convolution. The proposed method integrates a foreground/background sound classification (FBSC) task alongside the primary SED objective, and combines a NetMamba encoder with a Frequency Dynamic Convolution (FDC) module to enhance long-range temporal modeling and frequency-adaptive feature extraction. Additionally, a linear time-domain perturbation strategy, TimeFilterAug, is designed to simulate noise interference in complex acoustic environments, further improving the model's generalization capability. The proposed method achieved an F1-score of 56.7% in the DCASE 2024 Challenge, ranking second. Experimental results confirm its effectiveness in detecting transient events and maintaining robustness under noisy conditions, demonstrating strong potential for practical deployment.

    Reference
    Related
    Cited by
Get Citation

FANG Xin, ZHAO Pengyuan, ZHANG Yutao, YAN Genwei, YAN Zulong, ZOU Liang. Frame-Level Few-Shot Sound Event Detection Framework Based on Multi-Task Learning and Dynamic Convolution[J]. Journal of Data Acquisition and Processing,,().

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: July 14,2026
  • Published:
Article QR Code