Application of Mechanomyogram’s Pattern Recognition in Real-Time Sign Language Translation Embedded System
CSTR:
Author:
Affiliation:

Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, China

Clc Number:

TN911.7

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Mechanomyogram (MMG)-based pattern recognition refers to the process of collecting MMG bands and applying machine learning algorithms to perform motion recognition. To realize the real-time classification of sign language motions, six-channel MMG signals of three muscles on forearm are collected by dual-axis acceleration sensors which are controlled by lightweight embedded device with STM32 chip. The back propagation neural network (BPNN) algorithm is used to establish recognition classification models, where the parameters are extracted and put into the embedded system to transfer BPNN algorithm. The embedded device can accomplish real-time recognition of 30 kinds of sign language motions, with the self-test accuracy up to 99.6% and the accuracy of real-time recognition up to 97.5%. Moreover, the classification time for each motion is less than 0.52 ms, satisfying the real-time recognition condition. The results can be applied to the fields of rehabilitation engineering, sign language translator, and prosthetic control, etc.

    Reference
    Related
    Cited by
Get Citation

WANG Xinping, XIA Chunming, ZHANG Hanyang. Application of Mechanomyogram’s Pattern Recognition in Real-Time Sign Language Translation Embedded System[J].,2021,36(2):304-313.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:August 05,2020
  • Revised:January 17,2021
  • Adopted:
  • Online: March 25,2021
  • Published:
Article QR Code