TY - JOUR
T1 - Feature-Fused Deep Learning Approach for Hand Gesture Recognition in Intelligent Myoelectric Hand
AU - Yan, Lingyun
AU - Bi, Luzheng
AU - Zhang, Zhihong
AU - Wei, Yuyang
AU - Xiu, Haohua
N1 - Publisher Copyright:
© 2001-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Accurate and efficient hand gesture recognition is a cornerstone for advancing the functionality of myoelectric prostheses, enabling intuitive and responsive human-machine interaction. In this study, we present a novel hybrid deep learning architecture that synergistically integrates convolutional neural networks (CNNs) with Transformer models to achieve unprecedented accuracy in electromyogram (EMG)-based hand gesture classification. By leveraging advanced feature engineering, we extract and combine time-domain (TD), frequency-domain (FD), and time-frequency (TF) features to provide a comprehensive representation of muscle activity patterns. This approach addresses critical challenges in existing methods, such as poor generalization and limited robustness to subject variability. The proposed system achieves a state-of-the-art (SOTA) recognition accuracy of 98.5% and an F1-score of 0.98 across 12 distinct hand gestures, surpassing existing methodologies. Additionally, we validate the practicality of our system by implementing it in a real-time control platform for a myoelectric hand, demonstrating its capability to perform precise, real-world motor tasks. Our findings represent a significant step forward in neural systems and rehabilitation engineering, offering a transformative solution for enhancing the usability and functionality of intelligent myoelectric prostheses.
AB - Accurate and efficient hand gesture recognition is a cornerstone for advancing the functionality of myoelectric prostheses, enabling intuitive and responsive human-machine interaction. In this study, we present a novel hybrid deep learning architecture that synergistically integrates convolutional neural networks (CNNs) with Transformer models to achieve unprecedented accuracy in electromyogram (EMG)-based hand gesture classification. By leveraging advanced feature engineering, we extract and combine time-domain (TD), frequency-domain (FD), and time-frequency (TF) features to provide a comprehensive representation of muscle activity patterns. This approach addresses critical challenges in existing methods, such as poor generalization and limited robustness to subject variability. The proposed system achieves a state-of-the-art (SOTA) recognition accuracy of 98.5% and an F1-score of 0.98 across 12 distinct hand gestures, surpassing existing methodologies. Additionally, we validate the practicality of our system by implementing it in a real-time control platform for a myoelectric hand, demonstrating its capability to perform precise, real-world motor tasks. Our findings represent a significant step forward in neural systems and rehabilitation engineering, offering a transformative solution for enhancing the usability and functionality of intelligent myoelectric prostheses.
KW - Convolutional neural network (CNN)-Transformer
KW - electromyogram (EMG)
KW - hand gesture
KW - machine learning
KW - prosthetic
UR - http://www.scopus.com/pages/publications/105005861137
U2 - 10.1109/JSEN.2025.3570236
DO - 10.1109/JSEN.2025.3570236
M3 - Article
AN - SCOPUS:105005861137
SN - 1530-437X
VL - 25
SP - 23831
EP - 23841
JO - IEEE Sensors Journal
JF - IEEE Sensors Journal
IS - 13
ER -