Adversarially regularized transformer with channel-wise noise for robust hand gesture recognition using surface electromyography

Vigotsky AD, Halperin I, Lehman GJ, Trajano GS, Vieira TM. Interpreting signal amplitudes in surface electromyography studies in sport and rehabilitation sciences. Front Physiol. 2018;8:985.

Article  Google Scholar 

Zheng M, Crouch MS, Eggleston MS. Surface electromyography as a natural human-machine interface: a review. IEEE Sens J. 2022;22(10):9198–214.

Article  Google Scholar 

Palermo F, Cognolato M, Gijsberts A, Müller H, Caputo B, Atzori M. Repeatability of grasp recognition for robotic hand prosthesis control based on semg data. In: 2017 International Conference on Rehabilitation Robotics (ICORR). IEEE. 2017;1154–1159.

Gechev A, Kane N, Koltzenburg M, Rao D, Van Der Star R. Potential risks of iatrogenic complications of nerve conduction studies (NCS) and electromyography (EMG). Clin Neurophysiol Pract. 2016;1:62–6.

Article  Google Scholar 

Gijsberts A, Atzori M, Castellini C, Müller H, Caputo B. Movement error rate for evaluation of machine learning methods for sEMG-based hand movement classification. IEEE Trans Neural Syst Rehabil Eng. 2014;22(4):735–44.

Article  Google Scholar 

Shi W-T, Lyu Z-J, Tang S-T, Chia T-L, Yang C-Y. A bionic hand controlled by hand gesture recognition based on surface EMG signals: a preliminary study. Biocybern Biomed Eng. 2018;38(1):126–35.

Article  Google Scholar 

Yu M, Li G, Jiang D, Jiang G, Tao B, Chen D. Hand medical monitoring system based on machine learning and optimal emg feature set. Personal and Ubiquitous Computing. 2023;1–17.

Li C, Li G, Jiang G, Chen D, Liu H. Surface EMG data aggregation processing for intelligent prosthetic action recognition. Neural Comput Appl. 2020;32:16795–806.

Article  Google Scholar 

Xiong D, Zhang D, Zhao X, Zhao Y. Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J Automat Sinica. 2021;8(3):512–33.

Article  Google Scholar 

Sherwood AM, McKay WB, Dimitrijević MR. Motor control after spinal cord injury: assessment using surface EMG. Muscle Nerve Off J Am Associat Electrodiagn stic Med. 1996;19(8):966–79.

Google Scholar 

Zhu C, Cheng Y, Gan Z, Sun S, Goldstein T, Liu J. Freelb: Enhanced adversarial training for natural language understanding. arXiv preprint arXiv:1909.11764 2019.

Jiang H, He P, Chen W, Liu X, Gao J, Zhao T. Smart: Robust and efficient fine-tuning for pre-trained natural language models through principled regularized optimization. arXiv preprint arXiv:1911.03437 2019.

Aghajanyan A, Shrivastava A, Gupta A, Goyal N, Zettlemoyer L, Gupta S. Better fine-tuning by reducing representational collapse. arXiv preprint arXiv:2008.03156 2020.

Briouza S, Gritli H, Khraief N, Belghith S, Singh D. Classification of semg biomedical signals for upper-limb and hand rehabilitation using a hybrid cnn-svm architecture. In: 2022 International Conference on Data Analytics for Business and Industry (ICDABI). IEEE. 2022;467–471.

Karnam NK, Dubey SR, Turlapaty AC, Gokaraju B. Emghandnet: a hybrid CNN and Bi-LSTM architecture for hand activity classification using surface EMG signals. Biocybern Biomed Eng. 2022;42(1):325–40.

Article  Google Scholar 

Vaswani A. Attention is all you need. Advances in Neural Information Processing Systems 2017.

Dosovitskiy A. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 2020.

Goodfellow IJ, Shlens J, Szegedy C. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572 2014.

Dodge S, Karam L. A study and comparison of human and deep learning recognition performance under visual distortions. In: 2017 26th International Conference on Computer Communication and Networks (ICCCN). IEEE. 2017;1–7

Miyato T, Maeda S-i, Koyama M, Nakae K, Ishii S. Distributional smoothing with virtual adversarial training. arXiv preprint arXiv:1507.00677 2015.

Miyato T, Dai AM, Goodfellow I. Adversarial training methods for semi-supervised text classification. arXiv preprint arXiv:1605.07725. 2016.

Miyato T, Maeda S-I, Koyama M, Ishii S. Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell. 2018;41(8):1979–93.

Article  Google Scholar 

Atzori M, Gijsberts A, Kuzborskij I, Elsig S, Hager A-GM, Deriaz O, et al. Characterization of a benchmark database for myoelectric movement classification. IEEE Trans Neural Syst Rehabil Eng. 2014;23(1):73–83.

Article  Google Scholar 

Atzori M, Gijsberts A, Castellini C, Caputo B, Hager A-GM, Elsig S, et al. Electromyography data for non-invasive naturally-controlled robotic hand prostheses. Sci Data. 2014;1(1):1–13.

Article  Google Scholar 

Pizzolato S, Tagliapietra L, Cognolato M, Reggiani M, Müller H, Atzori M. Comparison of six electromyography acquisition setups on hand movement classification tasks. PLoS ONE. 2017;12(10):0186132.

Article  Google Scholar 

Criswell E. Cram’s Introduction to Surface Electromyography. G - Reference,Information and Interdisciplinary Subjects Series. Jones & Bartlett Learning,. https://books.google.co.kr/books?id=RgfX5jXrmzMC 2011.

Hendrycks D, Gimpel K. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 2016.

Devlin J. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 2018.

Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. Adv Neural Inf Process Syst. 2020;33:1877–901.

Google Scholar 

Lin J. Divergence measures based on the Shannon entropy. IEEE Trans Inf Theory. 1991;37(1):145–51.

Article  MathSciNet  MATH  Google Scholar 

Olsson AE, Björkman A, Antfolk C. Automatic discovery of resource-restricted convolutional neural network topologies for myoelectric pattern recognition. Comput Biol Med. 2020;120:103723.

Article  Google Scholar 

Nazemi A, Maleki A. Artificial neural network classifier in comparison with lda and ls-svm classifiers to recognize 52 hand postures and movements. In: 2014 4th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE. 2014;18–22.

Wei W, Dai Q, Wong Y, Hu Y, Kankanhalli M, Geng W. Surface-electromyography-based gesture recognition by multi-view deep learning. IEEE Trans Biomed Eng. 2019;66(10):2964–73.

Article  Google Scholar 

Karnam NK, Turlapaty AC, Dubey SR, Gokaraju B. Classification of sEMG signals of hand gestures based on energy features. Biomed Signal Process Control. 2021;70:102948.

Article  Google Scholar 

Zhang Y, Chen Y, Yu H, Yang X, Lu W. Learning effective spatial–temporal features for sEMG armband-based gesture recognition. IEEE Internet Things J. 2020;7(8):6979–92. https://doi.org/10.1109/JIOT.2020.2979328.

Article  Google Scholar 

Yang Z, Jiang D, Sun Y, Tao B, Tong X, Jiang G, et al. Dynamic gesture recognition using surface EMG signals based on multi-stream residual network. Front Bioeng Biotechnol. 2021;9:779353.

Article  Google Scholar 

Chen X, Li Y, Hu R, Zhang X, Chen X. Hand gesture recognition based on surface electromyography using convolutional neural network with transfer learning method. IEEE J Biomed Health Inform. 2020;25(4):1292–304.

Article  Google Scholar 

Comments (0)

No login
gif