Research on Biomedical Engineering
http://www.rbejournal.periodikos.com.br/article/doi/10.1590/2446-4740.0601
Research on Biomedical Engineering
Review Article

A concept-environment for computer-based augmentative and alternative communication founded on a systematic review

Loja, Luiz Fernando Batista; Gomide, Renato de Sousa; Mendes, Fabiana Freitas; Teixeira, Ricardo Antonio Gonçalves; Lemos, Rodrigo Pinto; Flôres, Edna Lúcia

Downloads: 0
Views: 886

Abstract

Introduction: Locked-In Syndrome is admittedly the worst case of motor and speech impairment, it seriously damages the ability of oral and gestural communication of patients. In recent years, alternative and augmentative communication technology has provided resources to restore these patients' ability to communicate. Methods: In order to relate and classify the main methods with that purpose, this work conducted a systematic review on several journal databases. Results: We found 203 related papers and 55 of them were selected to compose the study. After that, we classified them into three major groups and we identified the main difficulties when using each approach. Conclusion: In order to overcome these difficulties, we propose a new system concept to develop an adaptive, robust and low cost communication environment. The proposed system is composed of five modules: data entry, communication, aid to the caregiver and external interaction.

Keywords

Computer, Augmentative and alternative communication, Systematic review, Locked-in syndrome, Assistive technology.

References

Al-Abdullatif A, Al-Negheimish H, Al-Mofeez L, Al-Khalifa N, Al-Andas L, Al-Wabil A. Mind-controlled augmentative and alternative communication for people with severe motor disabilities. In: Proceedings of the 9th International Conference on Innovations in Information Technology (IIT); 2013. 2013. p. 107-12.

Alja’am JM, Alsuwaidi H, Alkuwari N, Aldosari H. Tutorials-based system to assist qatari children with special needs. In: AICCSA 08: Proceedings of the 6th IEEE/ACS International Conference on Computer Systems and Applications; 2008. p. 945-6.

Alwell M, Cobb B. Social and communicative interventions and transition outcomes for youth with disabilities: A systematic review. Career Development for Exceptional Individuals. 2009; 32(2):94-107. http://dx.doi.org/10.1177/0885728809336657.

Ann OC, Theng LB. A study on the effectiveness of biometrics based alternative communication tool. In: Proceedings of the 8th International Conference on Information, Communications and Signal Processing; 2011. 2011a. p. 1-4.

Ann OC, Theng LB. Biometrics based assistive communication tool for children with special needs. In: Proceedings of the 7th International Conference on Information Technology in Asia; 2011. 2011b. p. 1-6.

Arboleda C, García E, Posada A, Torres R. P300-based brain computer interface experimental setup. In: EMBC 2009: Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine. 2009. p. 598-601.

Arif AS, Stuerzlinger W. Evaluation of a new error prevention technique for mobile touchscreen text entry. In: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration [internet]. New York: ACM; 2013. p. 397-400. [cited 2014 May 12]. Available from: http://doi.acm.org/10.1145/2541016.2541063

Arnott JL, Alm N. Towards the improvement of Augmentative and Alternative Communication through the modelling of conversation. Computer Speech & Language. 2013; 27(6):1194-211. http://dx.doi.org/10.1016/j.csl.2012.10.008.

Bahill AT, Stark L. Overlapping saccades and glissades are produced by fatigue in the saccadic eye movement system. Experimental Neurology. 1975; 48(1):95-106. http://dx.doi.org/10.1016/0014-4886(75)90225-3. PMid:1132472.

Belani H. Towards a usability requirements taxonomy for mobile AAC services. In: UsARE 2012: Proceedings of the 1st International Workshop on Usability and Accessibility Focused Requirements Engineering; 2012. 2012. p. 36-9.

Bermúdez GR, Roca-Gonzalez J, Martínez-González F, Peña-Morán L, Roca-González JL, Roca-Dorda J. Performance analysis of different feature-classifier binomials in Motor-Imagering BCIs: Preliminary results. In: Proceedings of the 3rd International Symposium on Applied Sciences in Biomedical and Communication Technologies, ISABEL 2010; 2010. 2010.

Besio WG, Kay SM, Liu X. An optimal spatial filtering electrode for brain computer interface. In: EMBC 2009: Proceedings of the 31st Annual International Conference on IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine. 2009. p. 3138-41.

Bhattacharya S, Laha S. Bengali text input interface design for mobile devices. Universal Access in the Information Society. 2012; 12(4):441-51. http://dx.doi.org/10.1007/s10209-012-0280-1.

Bhattacharya S, Samanta D, Basu A. Performance models for automatic evaluation of virtual scanning keyboards. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2008a; 16(5):510-9. http://dx.doi.org/10.1109/TNSRE.2008.2003377.

Bhattacharya S, Samanta D, Basu A. User errors on scanning keyboards: Empirical study, model and design principles. Interacting with Computers. 2008b; 20(3):406-18. http://dx.doi.org/10.1016/j.intcom.2008.03.002.

Biolchini JCA, Mian PG, Natali ACC, Conte TU, Travassos GH. Scientific research ontology to support systematic review in software engineering. Advanced Engineering Informatics. 2007; 21(2):133-51. http://dx.doi.org/10.1016/j.aei.2006.11.006.

Biswas P, Samanta D. Friend: a communication aid for persons with disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2008; 16(2):205-9. http://dx.doi.org/10.1109/TNSRE.2008.917305. PMid:18403290.

Blain S, Mihailidis A, Chau T. Assessing the potential of electrodermal activity as an alternative access pathway. Medical Engineering & Physics. 2008; 30(4):498-505. http://dx.doi.org/10.1016/j.medengphy.2007.05.015. PMid:17656143.

Brasil. Decreto Nº 5.296, de 2 de dezembro de 2004. Regulamenta as Leis nos 10.048, de 8 de novembro de 2000, que dá prioridade de atendimento às pessoas que especifica, e 10.098, de 19 de dezembro de 2000, que estabelece normas gerais e critérios básicos para a promoção da acessibilidade das pessoas portadoras de deficiência ou com mobilidade reduzida, e dá outras providências. Diário Oficial da República Federativa do Brasil [internet], Brasília, dec. 2004 [cited 2013 Dec 9]. Available from: http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2004/decreto/d5296.htm

Cabrera AF, Nascimento OFD, Farina D, Dremstrup K. Brain-computer interfacing: how to control computers with thoughts. In: ISABEL 2008: Proceedings of the 1st International Symposium on Applied Sciences in Biomedical and Communication Technologies. 2008.

Caltenco HA, Breidegard B, Jönsson B, Andreasen Struijk LNS. Understanding computer users with tetraplegia: Survey of assistive technology users. International Journal of Human-Computer Interaction. 2012; 28(4):258-68. http://dx.doi.org/10.1080/10447318.2011.586305.

Car Z, Vukovic M, Vucak I, Pibernik J, Dolic J. A platform model for symbol based communication services. In: Proceedings of the 11th International Conference on Telecommunications. 2011. p. 141-8.

Cardwell MS. Locked-in syndrome. Texas Medicine. 2013; 109(2):e1. PMid:23378122.

Chin S, Lee C, Lee J. Facial expression image mapping for brain-computer interface using El type classification. In: Proceedings of the 3rd International Conference on Information Sciences and Interaction Sciences; 2010. 2010. p. 465-9.

Chun RYS. Comunicação suplementar e/ou alternativa: abrangência e peculiaridades dos termos e conceitos em uso no Brasil. Pró-Fono Revista de Atualização Científica. 2009; 1:69-74.

Cipresso P, Meriggi P, Carelli L, Solca F, Meazzi D, Poletti B, Lule D, Ludolph AC, Riva G, Silani V. The combined use of brain computer interface and eye-tracking technology for cognitive assessment in amyotrophic lateral sclerosis. In: Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops; 2011. 2011. p. 320-4.

Deepa VB, Thangaraj P, Chitra S. Investigating principal component analysis for classification of EEG data. In: ICNIT 2010: Proceedings of the Networking and Information Technology. 2010. p. 461-4.

Doval FMG, Carballo JMP, Vez Jeremías JM. TICTAC: Information and communication technologies for augmentative communication boards. In: Proceedings of the 2010 IEEE Education Engineering Conference. 2010. p. 1783-7.

Eggers J, Feillet D, Kehl S, Wagner MO, Yannou B. Optimization of the keyboard arrangement problem using an ant colony algorithm. European Journal of Operational Research. 2003; 148(3):672-86. http://dx.doi.org/10.1016/S0377-2217(02)00489-7.

Finke EH, Light J, Kitko L. A systematic review of the effectiveness of nurse communication with patients with complex communication needs with a focus on the use of augmentative and alternative communication. Journal of Clinical Nursing. 2008; 17(16):2102-15. http://dx.doi.org/10.1111/j.1365-2702.2008.02373.x. PMid:18705734.

Friginal E, Pearson P, Di Ferrante L, Pickering L, Bruce C. Linguistic characteristics of AAC discourse in the workplace. Discourse Studies. 2013; 15(3):279-98. http://dx.doi.org/10.1177/1461445613480586.

Fu YF, Ho CS. A fast text-based communication system for handicapped aphasiacs. In: Proceedings of the 5th International Conference on Intelligent Information Hiding and Multimedia Signal Processing. 2009; 2009. p. 583-94.

García JCD, Galvão TA Fo. Pesquisa nacional de tecnologia assistiva. São Paulo: ITS BRASIL/MCTI-SECIS; 2012.

Ghosh S, Sarcar S, Samantha D. Designing an efficient virtual keyboard for text composition in bengali. New York: ACM; 2011. p. 84-7.

Hanson EK, Beukelman DR, Heidemann JK, Shutts-Johnson E. The impact of alphabet supplementation and word prediction on sentence intelligiblity of electronically distorted speech. Speech Communication. 2010; 52(2):99-105. http://dx.doi.org/10.1016/j.specom.2009.08.004.

Hill K. Advances in augmentative and alternative communication as quality-of-life technology. Physical Medicine and Rehabilitation Clinics of North America. 2010; 21(1):43-58. http://dx.doi.org/10.1016/j.pmr.2009.07.007. PMid:19951777.

Hsieh MC, Hung WS, Lin SW, Luo CH. Designing an assistive dialog agent for a case of spinal cord injury. In: Proceedings of the 9th International Conference on Hybrid Intelligent Systems. 2009. p. 67-72.

Johnson JM, Inglebret E, Jones C, Ray J. Perspectives of speech language pathologists regarding success versus abandonment of AAC. Augmentative and Alternative Communication. 2006; 22(2):85-99. PMID: 17114167.

Joubert K, Bornman J, Alant E. Speech intelligibility and marital communication in amyotrophic lateral sclerosis: an exploratory study. Communication Disorders Quarterly. 2011; 33(1):34-41. http://dx.doi.org/10.1177/1525740110367824.

Keegan J, Burke E, Condron J. An electrooculogram-based Binary Saccade Sequence Classification (BSSC) technique for augmentative communication and control. In: EMBC 2009: Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine. 2009. p. 2604-7.

Kim JH, Aulck L, Bartha MC, Harper CA, Johnson PW. Differences in typing forces, muscle activity, comfort, and typing performance among virtual, notebook, and desktop keyboards. Applied Ergonomics. 2014; 45(6):1406-13. http://dx.doi.org/10.1016/j.apergo.2014.04.001. PMid:24856862.

Kitchenham B, Brereton P. A systematic review of systematic review process research in software engineering. Information and Software Technology. 2013; 55(12):2049-75. http://dx.doi.org/10.1016/j.infsof.2013.07.010.

Kraskowsky LH, Finlayson M. Factors affecting older adults’ use of adaptive equipment: review of the literature. The American Journal of Occupational Therapy. 2001; 55(3):303-10. http://dx.doi.org/10.5014/ajot.55.3.303. PMid:11723971.

Kübler A, Mushahwar VK, Hochberg LR, Donoghue JP. BCI Meeting 2005-- workshop on clinical issues and applications. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2006. 14(2): 131-4. PMID: 16792277.

Kwon S, Lee D, Chung MK. Effect of key size and activation area on the performance of a regional error correction method in a touch-screen QWERTY keyboard. International Journal of Industrial Ergonomics. 2009; 39(5):888-93. http://dx.doi.org/10.1016/j.ergon.2009.02.013.

Lakhani KR, Hippel EV. How open source software works: “free” user-to-user assistance. Research Policy. 2003; 32(6):923-43. http://dx.doi.org/10.1016/S0048-7333(02)00095-1.

Levine SH, Trepagnier CG. Customised text entry devices for motor-impaired users. Applied Ergonomics. 1990; 21(1):55-62. http://dx.doi.org/10.1016/0003-6870(90)90074-8.

Mak JN, Wolpaw JR. Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects. IEEE Reviews in Biomedical Engineering. 2009; 2:187-99. http://dx.doi.org/10.1109/RBME.2009.2035356. PMid:20442804.

Mason C, Chinn KM. Augmentative-alternative communication. 3rd ed. Oxford: Elsevier Science; 2010. International Encyclopedia of Education.

McCoy KF, Arnott JL, Ferres L, Fried-Oken M, Roark B. Speech and language processing as assistive technologies. Computer Speech & Language. 2013; 27(6):1143-6. http://dx.doi.org/10.1016/j.csl.2013.04.005.

Ming D, Zhu Y, Qi H, Wan B, Hu Y, Luk KDK. Study on EEG-based mouse system by using brain-computer interface. In: VECIMS 2009: Proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurements Systems; 2009. 2009. p. 236-9.

Molina AJ, Rivera O, Gómez IM, Sánchez G. Evaluation of unambiguous virtual keyboards with character prediction. Amsterdam: IOS Press; 2009. p. 144-9. (Assistive Technology from Adapted Equipment to Inclusive Environments, v. 25). http://dx.doi.org/10.3233/978-1-60750-042-1-144.

Naves E, Rocha L, Pino P. Alternative communication system for people with severe motor disabilities using myoelectric signal control. In: BRC 2012: Proceedings of the ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living; 2012. 2012.

Okasaka S, Hoshino Y. Development of estimation method about activity states for NIRS-based BCI system. In: Proceedings of the Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS). 2012. p. 1144-9.

Orhan U, Hild KE, Erdogmus D, Roark B, Oken B, Fried-Oken M. RSVP keyboard: an EEG based typing interface. In: Proceedings of the ICASSP, IEEE International Conference on Acoustics, Speech and Signal. 2012. p. 645-8.

Ortner R, Allison BZ, Korisek G, Gaggl H, Pfurtscheller G. An SSVEP BCI to control a hand orthosis for persons with tetraplegia. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2011; 19(1):1-5. http://dx.doi.org/10.1109/TNSRE.2010.2076364. PMid:20875978.

Park S-W, Yim YL, Yi SH, Kim HY, Jung SM. Augmentative and alternative communication training using eye blink switch for locked-in syndrome patient. Annals of Rehabilitation Medicine. 2012; 36(2):268-72. http://dx.doi.org/10.5535/arm.2012.36.2.268. PMid:22639753.

Pinheiro CG Jr, Naves ELM, Pino P, Losson E, Andrade AO, Bourhis G. Alternative communication systems for people with severe motor disabilities: a survey. Biomedical Engineering Online. 2011; 10(1):31. http://dx.doi.org/10.1186/1475-925X-10-31. PMid:21507236.

Poláček O, M’ikovec Z, Slav’ik P. Predictive scanning keyboard operated by hissing. In: Proceedings of the 2nd IASTED International Conference Assistive Technologies; 2012. p. 862-9.

Prabhu V, Prasad G. Designing a virtual keyboard with multi-modal access for people with disabilities. In: Proceedings of the 2011 World Congress on Information and Communication Technologies. 2011. p. 1133-8.

San Agustin J, Skovsgaard H, Mollenbach E, Barret M, Tall M, Hansen DW, Hansen, JP. Evaluation of a low-cost open-source gaze tracker. In: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications. 2010. p. 77-80.

Schalk G, Brunner P, Gerhardt LA, Bischof H, Wolpaw JR. Brain-computer interfaces (BCIs): detection instead of classification. Journal of Neuroscience Methods. 2008; 167(1):51-62. http://dx.doi.org/10.1016/j.jneumeth.2007.08.010. PMid:17920134.

Silva F, Pereira F. Communication between people with motion and speech disabilities. In: Proceedings of the 6th Iberian Conference on Information Systems and Technologies. 2011. p. 1-4.

Simpson R. Making better decisions. IEEE Engineering in Medicine and Biology Magazine. 2008; 27(2):23-8. http://dx.doi.org/10.1109/EMB.2007.907394. PMid:18463018.

Sörensen K. Multi-objective optimization of mobile phone keymaps for typing messages using a word list. European Journal of Operational Research. 2007; 179(3):838-46. http://dx.doi.org/10.1016/j.ejor.2005.03.069.

Sorger B, Dahmen B, Reithler J, Gosseries O, Maudoux A, Laureys S, Goebel R. Another kind of ‘BOLD Response’: answering multiple-choice questions via online decoded single-trial brain signals. Progress in Brain Research. 2009; 177:275-92. http://dx.doi.org/10.1016/S0079-6123(09)17719-1. PMid:19818908.

Sorna C, Steele R, Inoue A. Word prediction in assistive technologies for aphasia rehabilitation using systemic functional grammar. In: Proceedings of the Annual Conference of the North American Fuzzy Information Processing Society. 2009.

Sun GSG, Hu JHJ, Wu GWG. A novel frequency band selection method for common spatial pattern in motor imagery based brain computer interface. In: Proceedings of the 2010 International Joint Conference on Neural Networks; 18-23 July 2010; Barcelona. Barcelona: IEEE; 2010. p. 1-6. http://dx.doi.org/10.1109/IJCNN.2010.5596474.

Thomas KP, Guan C, Tong LC, Prasad VA. An adaptive filter bank for motor imagery based Brain Computer Interface. IEEE Engineering in Medicine and Biology Society Annual Conference; 2008: 1104-7. http://dx.doi.org/10.1109/IEMBS.2008.4649353. PMID: 19162856.

Thompson DE, Blain-Moraes S, Huggins JE. Performance assessment in brain-computer interface-based augmentative and alternative communication. Biomedical Engineering Online. 2013; 12:43. http://dx.doi.org/10.1186/1475-925X-12-43. PMid:23680020.

Tsai MJ. Adults’ preferences between Picture Communication Symbols (PCSs) and Gus Communication Symbols (GCSs) used in AAC. Research in Developmental Disabilities. 2013; 34(10):3536-44. http://dx.doi.org/10.1016/j.ridd.2013.07.013. PMid:23962601.

Usakli AB, Gurkan S, Aloise F, Vecchiato G, Babiloni F. A hybrid platform based on EOG and EEG signals to restore communication for patients afflicted with progressive motor neuron diseases. In: Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society: Engineering the Future of Biomedicine. 2009. p. 543-6.

Wilkinson KM, Hennig S. The state of research and practice in augmentative and alternative communication for children with developmental/intellectual disabilities. Mental Retardation and Developmental Disabilities Research Reviews. 2007; 13(1):58-69. http://dx.doi.org/10.1002/mrdd.20133. PMid:17326111.

Yin P-Y, Su E-P. Cyber Swarm optimization for general keyboard arrangement problem. International Journal of Industrial Ergonomics. 2011; 41(1):43-52. http://dx.doi.org/10.1016/j.ergon.2010.11.007.
5889fbf55d01231a018b4887 rbejournal Articles
Links & Downloads

Res. Biomed. Eng.

Share this page
Page Sections