Dexterous hand gestures recognition based on low-density sEMG signals for upper-limb forearm amputees
Mayor, John Jairo Villarejo; Costa, Regina Mamede; Frizera-Neto, Anselmo; Bastos, Teodiano Freire
Abstract
Introduction: Intuitive prosthesis control is one of the most important challenges in order to reduce the user effort in learning how to use an artificial hand. This work presents the development of a novel method for pattern recognition of sEMG signals able to discriminate, in a very accurate way, dexterous hand and fingers movements using a reduced number of electrodes, which implies more confidence and usability for amputees. Methods: The system was evaluated for ten forearm amputees and the results were compared with the performance of able-bodied subjects. Multiple sEMG features based on fractal analysis (detrended fluctuation analysis and Higuchi’s fractal dimension) combined with traditional magnitude-based features were analyzed. Genetic algorithms and sequential forward selection were used to select the best set of features. Support vector machine (SVM), K-nearest neighbors (KNN) and linear discriminant analysis (LDA) were analyzed to classify individual finger flexion, hand gestures and different grasps using four electrodes, performing contractions in a natural way to accomplish these tasks. Statistical significance was computed for all the methods using different set of features, for both groups of subjects (able-bodied and amputees). Results: The results showed average accuracy up to 99.2% for able-bodied subjects and 98.94% for amputees using SVM, followed very closely by KNN. However, KNN also produces a good performance, as it has a lower computational complexity, which implies an advantage for real-time applications. Conclusion: The results show that the method proposed is promising for accurately controlling dexterous prosthetic hands, providing more functionality and better acceptance for amputees.
Keywords
References
Al-Timemy AH, Bugmann G, Escudero J, Outram N. Classification of finger movements for the dexterous hand prosthesis control with surface electromyography. IEEE Journal of Biomedical and Health Informatics. 2013; 17(3):608-18. PMid:24592463. http://dx.doi.org/10.1109/JBHI.2013.2249590.
Arjunan SP, Kumar DK, Bueno L, Villarejo JJ, Bastos TF. Upper limb prosthesis devices. In: Bastos TF, Kumar DK, Arjunan SP. Devices for mobility and manipulation for people with reduced abilities. Boca Raton: CRC Press; 2015. p. 121-7.
Arjunan SP, Kumar DK. Decoding subtle forearm flexions using fractal features of surface electromyogram from single and multiple sensors. Journal of Neuroengineering and Rehabilitation. 2010; 7(1):53. PMid:20964863. http://dx.doi.org/10.1186/1743-0003-7-53.
Arjunan SP, Kumar DK. Fractal theory based Non-linear analysis of sEMG. In: 3rd International Conference on Intelligent Sensors, Sensor Networks and Information; 2007 Dec 3-6; Melbourne, Australia. Melbourne: IEEE; 2007. p. 545-8.
Castro MCF, Arjunan SP, Kumar DK. Selection of suitable hand gestures for reliable myoelectric human computer interface. Biomedical Engineering Online. 2015; 14(1):30. PMid:25889735. http://dx.doi.org/10.1186/s12938-015-0025-5.
Chowdhury RH, Reaz MBI, Ali MABM, Bakar AAA, Chellappan K, Chang TG. Surface electromyography signal processing and classification techniques. Sensors (Basel). 2013; 13(9):12431-66. PMid:24048337. http://dx.doi.org/10.3390/s130912431.
Chu JU, Lee YJ. Conjugate-prior-penalized learning of gaussian mixture models for multifunction myoelectric hand control. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2009; 17(3):287-97. PMid:19228565. http://dx.doi.org/10.1109/TNSRE.2009.2015177.
Cipriani C, Antfolk C, Controzzi M, Lundborg G, Rosen B, Carrozza MC, Sebelius F. Online myoelectric control of a dexterous hand prosthesis by transradial amputees. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2011; 19(3):260-70. PMid:21292599. http://dx.doi.org/10.1109/TNSRE.2011.2108667.
E-Hand.com. Anatomy of the hand [internet]. American Society for Surgery of the Hand; 2017 [cited 2017 Jan 28]. Available from: http://www.eatonhand.com/hom/hom033.htm
Englehart K, Hudgins B, Parker PA. A wavelet-based continuous classification scheme for multifunction myoelectric control. IEEE Transactions on Biomedical Engineering. 2001; 48(3):302-11.
Englehart K, Hudgins B. A robust, real-time control scheme for multifunction myoelectric control. IEEE Transactions on Biomedical Engineering. 2003; 50(7):848-54.
Esteller R, Vachtsevanos G, Echauz J, Litt BA. Comparison of waveform fractal dimension algorithms. IEEE Transactions on Circuits and Systems. 2001; 48(2):177-83. http://dx.doi.org/10.1109/81.904882.
Guo S, Pang M, Gao B, Hirata H, Ishihara H. Comparison of sEMG-Based Feature Extraction and Motion Classification Methods for Upper-Limb Movement. Sensors (Basel). 2015; 15(4):9022-38. PMid:25894941. http://dx.doi.org/10.3390/s150409022.
Hargrove LJ, Li G, Englehart KB, Hudgins BS. Principal components analysis preprocessing for improved classification accuracies in pattern-recognition-based myoelectric control. IEEE Transactions on Biomedical Engineering. 2009; 56(5):1407-14.
Hermens HJ, Freriks B, Disselhorst-Klug C, Rau G. Development of recommendations for SEMG sensors and sensor placement procedures. Journal of Electromyography and Kinesiology. 2000; 10(5):361-74. PMid:11018445. http://dx.doi.org/10.1016/S1050-6411(00)00027-4.
Huang C, Wang C. A GA-based feature selection, parameters optimization for support vector machines. Expert Systems with Applications. 2006; 31(2):231-40. http://dx.doi.org/10.1016/j.eswa.2005.09.024.
Japkowicz N, Shah M. Evaluation learning algorithms a classification perspective. New York: Cambridge University Press; 2011.
Khezri M, Jahed M. Real-time intelligent pattern recognition algorithm for surface EMG signals. Biomedical Engineering Online. 2007; 6(1):45. PMid:18053184. http://dx.doi.org/10.1186/1475-925X-6-45.
Khushaba RN, Kodagoda S, Takruri M, Dissanayake G. Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals. Expert Systems with Applications. 2012; 39(12):10731-8. http://dx.doi.org/10.1016/j.eswa.2012.02.192.
Kumar DK, Arjunan SP, Singh VP. Towards identification of finger flexions using single channel surface electromyography - able bodied and amputee subjects. Journal of Neuroengineering and Rehabilitation. 2013; 10(1):50. PMid:23758881. http://dx.doi.org/10.1186/1743-0003-10-50.
Li G, Li Y, Yu L, Geng Y. Conditioning and sampling issues of EMG signals in motion recognition of multifunctional myoelectric prostheses. Annals of Biomedical Engineering. 2011; 39(6):1779-87. PMid:21293972. http://dx.doi.org/10.1007/s10439-011-0265-x.
Merletti R, Parker PJ. Electromyography: physiology, engineering and non-ivasive applications. New York: John Wiley; 2004.
Naik GR, Kumar DK, Arjunan S. Use of sEMG in identification of low level muscle activities: features based on ICA and Fractal dimension. In: EMBC 2009: Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine; 2009 Sept 3-6; Minneapolis, USA. Minneapolis: IEEE; 2009. p. 364-7.
Naik GR, Kumar DK, Arjunan SP. Pattern classification of myo-electrical signal during different Maximum Voluntary Contractions: a study using BSS techniques. Measurement Science Review. 2010; 10(1):1-6. http://dx.doi.org/10.2478/v10048-010-0001-y.
Oskoei MA, Hu H. Support vector machine-based classification scheme for myoelectric control applied to upper limb. IEEE Transactions on Biomedical Engineering. 2008; 55(8):1956-65.
Peerdeman B, Boere D, Witteveen H, Huis R, Hermens H, Stramigioli S, et al. Myoelectric forearm prostheses: State of the art from a user-centered perspective. Journal of Rehabilitation Research and Development. 2011; 48(6):719-37. PMid:21938658. http://dx.doi.org/10.1682/JRRD.2010.08.0161.
Peleg D, Braiman E, Yom-Tov E, Inbar GF. Classification of finger activation for use in a robotic prosthesis arm. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2002; 10(4):290-3. PMid:12611366. http://dx.doi.org/10.1109/TNSRE.2002.806831.
Phinyomark A, Limsakul C, Phukpattaranont P. A novel feature extraction for robust EMG pattern recognition. Journal of Computers. 2009; 1(1):71-80.
Phinyomark A, Phukpattaranont P, Limsakul C. Feature reduction and selection for EMG signal classification. Expert Systems with Applications. 2012a; 39(8):7420-31. http://dx.doi.org/10.1016/j.eswa.2012.01.102.
Phinyomark A, Phukpattaranont P, Limsakul C. Fractal analysis features for weak and single-channel upper-limb EMG signals. Expert Systems with Applications. 2012b; 39(12):11156-63. http://dx.doi.org/10.1016/j.eswa.2012.03.039.
Phinyomark A, Quaine F, Charbonnier S, Serviere C, Tarpin-Bernard F, Laurillau Y. EMG feature evaluation for improving myoelectric pattern recognition robustness. Expert Systems with Applications. 2013; 40(12):4832-40. http://dx.doi.org/10.1016/j.eswa.2013.02.023.
Sensinger JW, Lock BA, Kuiken TA. Adaptive pattern recognition of myoelectric signals: exploration of conceptual framework and practical algorithms. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2009; 17(3):270-8. PMid:19497834. http://dx.doi.org/10.1109/TNSRE.2009.2023282.
Tenore FVG, Ramos A, Fahmy A, Acharya S, Etienne-Cummings R, Thakor NV. Decoding of individuated finger movements using surface electromyography. IEEE Transactions on Biomedical Engineering. 2009; 56(5):1427-34.
Theodoridis S, Koutroumbas K. Pattern recognition. 4th ed. Cambridge: Academic Press; 2008.
Tommasi T, Orabona F, Castellini C, Caputo B. Improving control of dexterous hand prostheses using adaptive learning. IEEE Transactions on Robotics. 2013; 29(1):207-19. http://dx.doi.org/10.1109/TRO.2012.2226386.
Tsenov G, Zeghbib AH, Palis F, Shoylev N, Mladenov V. Neural networks for online classification of hand and finger movements using surface EMG signals. In: NEUREL 2006: 8th Seminar on Neural Network Applications in Electrical Engineering; 2006 Sept 25-27; Belgrade, Serbia & Montenegro. Serbia: IEEE; 2006. p. 167-71.
Wang N, Chen Y, Zhang X. The recognition of multi-finger prehensile postures using LDA. Biomed Signal Proces. 2013; 8(6):706-12. http://dx.doi.org/10.1016/j.bspc.2013.06.006.
Zecca M, Micera S, Carrozza MC, Dario P. Control of multifunctional prosthetic hands by processing the electromyographic signal. Critical Reviews in Biomedical Engineering. 2002; 30(4-6):459-85. PMid:12739757. http://dx.doi.org/10.1615/CritRevBiomedEng.v30.i456.80. [ Links ]
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email