Audio Adversarial Examples Generation Method Based on Self-attention Mechanism
CSTR:
Author:
Affiliation:

National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei 230027, China

Clc Number:

TN912.3

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    With the widespread of personal speech and development of automatic speaker recognition algorithms, personal privacy protection is in a high-risk situation. Audio adversarial examples can protect personal voiceprint features through disabling automatic speaker recognition algorithms while the subjective hearing of the human ear remains unchanged. We improve the typical adversarial attacks algorithm FoolHD with multi-head self-attention mechanism, and we call it FoolHD-MHSA. First, convolutional neural networks are introduced as the encoder to extract adversarial perturbation spectrograms. Second, we use self-attention mechanism to extract correlation features of different parts of perturbation spectrogram from a global perspective , focus the network on the important information and suppress the useless information. Finally, the processed perturbation spectrogram is steganographed into the input spectrogram with a decoder to get adversarial example spectrogram. Experimental results show that FoolHD-MHSA can generate adversarial examples with higher attack success rate and average PESQ score than FoolHD.

    Reference
    Related
    Cited by
Get Citation

LI Zhuhai, Guo Wu. Audio Adversarial Examples Generation Method Based on Self-attention Mechanism[J].,2024,39(2):416-423.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:December 08,2022
  • Revised:February 26,2023
  • Adopted:
  • Online: March 25,2024
  • Published:
Article QR Code