Development of Brain-Computer Interface System for Rehabilitation Device by Combining Motor Imagery and Visual Illusion Stimulation
Keywords:
brain-computer interface, motor imagery, illusion motionAbstract
This article presents an enhancement of Motor Imagery--MI -based Brain-Computer Interface--BCI for rehabilitation by combining a visual motion illusion stimulation method. Since, the motor imagery takes a long time for training, the method of stimulation by external stimuli through the sensory system is an alternative way to increase the efficiency. The research is divided into two parts, mainly: (1) To observe and test the pattern of visual motion illusion for brain-computer interface (2) The proposed system of the BCI by combining motor imagery and visual illusion stimulation. This research uses the windmill pattern to modulate signal at occipital area of the brain. We were testing the windmill pattern with a different number of propellers. It was found that the windmill pattern with 96 propellers can stimulate the brain with the best result. Therefore, we used the obtained pattern to combine with motor imagery. This proposed system can create two commands to control the rehabilitation device for lifting the left or right arm with the designed algorithm, which implemented for the interface program using LabVIEW software. A total of 8 volunteers participated in the experiment, using a brain-computer interface system with motor imagery and combining the methods to compare the efficiency. The results show that the proposed method can increase the accuracy by approximately 4% to 6%. The speed of command creation is increased due to visual stimulation. Therefore, the combined effects may be caused by stimulating the brain with visual motion illusion only. In the future, we will develop algorithms, verify performance, and establish guidelines for use appropriate to control an arm rehabilitation device in reality.
References
Ahn, M., Cho, H., Ahn, S., & Jun, S. C. (2018). User's Self-Prediction of Performance in Motor Imagery Brain-Computer Interface. Frontiers in Human Neuroscience, 12, 59. https://doi.org/10.3389/fnhum.2018.00059
Ahn, S., Ahn, M., Cho, H., & Chan Jun, S. (2014). Achieving a hybrid brain-computer interface with tactile selective attention and motor imagery. Journal of neural engineering, 11(6), 1-14. https://doi.org/10.1088/1741-2560/11/6/066004
Allison, B. Z., Brunner, C., Kaiser, V., Müller-Putz, G. R., Neuper, C., & Pfurtscheller, G. (2010). Toward a hybrid brain-computer interface based on imagined movement and visual attention. Journal of Neural Engineering, 7, 1-9. doi: 10.1088/1741-2560/7/2/026007.
Annett, J. (1995). Motor imagery: Perception or action? Neurophychologia, 33(11), 1395-1417. https://doi.org/10.1016/0028-3932(95)00072-B.
Bashir, M., & Abdulhalim, K. (2014). A brief review of brain signal monitoring Technologies of BCI applications: Challenges and prospects. Journal of Bioengineering & Biomedical Science, 4(1), 1-10. doi: 10.4172/2155-9538.10000141.
Bureau of Non-Communicable Diseases, The Ministry of Public Health. (2018). Number and rate of non-communicable diseases. Retrieved from http://www.thaincd.com/2016/mission3. (in Thai)
Cecotti, H., Volosyak, I., & Graser, A. (2009). Evaluation of a SSVEP based Brain-Computer Interface on the command and application levels. 4th International Conference of Neural Engineering NER, (pp. 474-477). Antalya: NER. doi: 10.1109/NER.2009.5109336.
Cervera, M. A., Soekadar, S. R., Ushiba, J., Millán, J., del, R., Lui, M., Birbaumer, N., & Garipelli, G. (2018). Brain-computer interface for post-stroke motor rehabilitation: A meta-analysis. Annals of Clinical and Translational Neurology, 5(5), 651-663. doi: 10.1002/acn3.544.
Daly, J. J., & Huggins, J. E. (2015). Brain-Computer Interface: Current and Emerging Rehabilitation Applications. Archives of Physical Medicine and Rehabilitation, 96(3), S1-S7. https://doi.org/10.1016/j.apmr.2015.01.007.
Department of Empowerment of Persons with Disabilities. (2019). Situation for the disabled. Retrieved from http://dep.go.th/Content/View/5805/1. (in Thai)
Horki, P., Solis-Escalante, T., Neuper, C., & Muller-Putz, G. (2011). Combined motor imagery and SSVEP based BCI control of 2 DoF artificial upper limb. Medical & Biological Engineering & Computing, 49, 567-577. doi: 10.1007/s11517-011-07750-2.
Iturrate, I., Antelis, J. M., Kübler, A., & Minguez, J. (2009). A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation. IEEE Transactions on Robotics, 25(3), 614-627. doi:10.1109/TRO.2009.2020347
Leow, R. S., Ibrahim, F., & Moghavvemi, M. (2007). Development of a steady state visual evoked potential (SSVEP)-based brain computer interface (BCI) system. 2007 International Conference in Intelligent and Advanced Systems (pp. 321-324). Kuala Lumpur: IEEE. doi: 10.1109/ICIAS.2007.4658399
Lupu, R. G., Irimia, D. C., Ungureanu, F., Poboroniuc, M. S., & Moldoveanu, A. (2018). BCI and FES based theraphy for stroke rehabilitation using VR facilities. Wireless Communications and Mobile Computing, 2018, 1-8. doi: 10.1155/2018/4798359.
Mebarkia, K., & Reffad, A. (2019). Multi optimized SVM classifiers for motor imagery left and right hand movement identification. Journal of Bioengineering & Biomedical Sciences, 42(4), 949-958. doi: 10.1007/s13246-019-00793-y.
Nicolas-Alonso, L. F., & Gomez-Gil, J. (2012). Brain Computer Interface. A Review Sensor, 12(2), 1211-1279. doi: 10.3390/s120201211.
Pfurtscheller, G., Solis-Escalante, T., Ortner, R., Linortner, P. & Muller-Putz, G. R. (2010). Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based & Brain Switch: A Feasibility Study Towards a Hybrid BCI. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 18(4), 409-414. doi: 10.1109/TNSRE.2010.2040837.
Pires, G., Castelo-Branco, M., & Nunes, U. (2008). Visual P300-based BCI to steer a wheelchair: A Bayesian approach. Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference, 2008, 658–661. https://doi.org/10.1109/IEMBS.2008.4649238
Punsawad, Y., & Wongsawat, Y. (2017). Multi-command SSVEP-based BCI system with training sessions for SSVEP during an eye fatigue state. IEEJ Transactions on Electronics, Information and Systems, 12(S1), S89-S94. https://doi.org/10.1002/tee.22441.
Punsawad, Y., Siribunyaphat, N., & Wongsawat, Y. (2018). Self-Flickering Visual Stimulus based on Visual illusion for SSVEP-based BCI System. 2018 11th Biomedical Engineering International Conference (BMEiCON). 21-25 Nov. 2018 (pp.1-4). Chiang Mai. IEEE. doi: 10.1109/BMEiCON.2018.8610000.
Rhodes, D. L., & Robertson, L. C. (2002). Visual field asymmetries and allocation of attention in visual scenes. Brain and Cognition, 50(1), 95-115. https://doi.org/10.1016/S0278-2626(02)00014-3.
Rovati, L., Salvatori, G., Bulf, L., & Fonda, S. (2007). Optical and electrical recording of neural activity evoked by graded contrast visual stimulus. Biomedical Engineering Online. 28(6), 2-28. https://doi.org/10.1186/1475-925X-6-28.
Sokoliuk, R., & VanRullen, R. (2013). The flickering wheel illusion: When α rhythms make a static wheel flicker. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 33(33), 13498–13504. https://doi.org/10.1523/JNEUROSCI.5647-12.2013
Song, M., & Kim, J. (2017). Motor imagery enhancement paradigm using moving rubber hand illusion system. 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 1146-1149). Seogwipo: IEEE. doi: 10.1109/EMBC.2017.8037032.
Ma, T., Li, H., Deng, L., Yang, H., Lv, X., Li, P., Li, F., Zhang, R., Liu, T., Yao, D., & Xu, P. (2017). The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential. Journal of neural engineering, 14(2), 1-20. doi: 10.1088/1741-2552/aa5d5f.
Tsukasa, K., & Jun’ichi, K. (2017). Regularity of approaching visual stimuli influences spatial expectations for subsequent somatosensory stimuli. Experimental Brain Research, 235(6), 1657-1663. doi: 10.1007/s00221-016-4863-6.
Van Dokkum, L. E. H., Ward, T., & Laffont, I. (2015). Brain computer interfaces for neurorehabilitation – its current status as a rehabilitation strategy post-stroke. Annals of Physical and Rehabilitation Medicine, 58(1), 3-8. https://doi.org/10.1016/j.rehab.2014.09.016.
Verma, P. A., Heilinger, A., Reitner, P., Grünwald, J., Guger, C., & Franklin, D. (2019). Performance Investigation of Brain-Computer Interface that Combine EEG and fNIRS for Motor Imagery Tasks. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) (pp. 259-263). Bari, Italy: IEEE. doi: 10.1109/SMC.20198914083.
Vialatte, F. B., Maurice, M., Dauwels, J., & Cichocki, A. (2009). Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives. Journal Progress in Neurobiology, 90(4), 418-438. https://doi.org/10.1016/j.pneurobio.2009.11.005.
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002). Brain-Computer Interfaces for communication and control. Clinical Neurophysiology: Official Journal of the International Federation of Clinical Neurophysiology, 113(6), 767–791. https://doi.org/10.1016/s1388-2457(02)00057-3
Wu, Z., Lai, Y., Xia, Y., Wu, D., & Yao, D. (2008). Stimulator selection in SSVEP-based BCI. Medical Engineering & Physic, 30(8), 1079-1088. http://doi.org/10.1016/j.medengphy.2008.01.004.
Xiaokang, S., Lin, Y., Xinjun, S., Dingguo, Z., & Xiangyang, Z. (2017). Enhanced Motor Imagery-Based BCI Performance via Tactile Stimulation on Unilateral Hand. Frontiers in Human Neuroscience, 11, 585. https://doi.org/10.3389/fnhum.2017.00585.
Xie, J., Xu, G., Wang, J., Zhang, F. & Zhang, Y. (2012). Steady-State Motion Visual Evoked Potentials by Oscillating Newton’s Rings: Implications for Brain-Computer Interfaces. PLoS ONE, 7(6), 1-8. doi: 10.1371/journal.pone.0039707.
Yin, E., Zeyl, T., Saab, R., Chau, T., Hu, D. & Zhou, Z. (2014). A Hybrid Brain-Computer Interface Based on the Fusion of P300 and SSVEP Scores. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 23(4), 1-9. doi: 10.1109/TNSRE.2015.2403270.
Zainuddin, B. S., Hussain, Z., & Isa, I. S. (2014), Alpha and beta EEG brainwave signal classification technique: A conceptual study. IEEE 10 th International Colloquium on Signal Processing and its Application (pp. 233-237). Kuala Lumpur, Malaysia: IEEE. doi: 10.1109/CSPA.2014.6805755.
Zhu, D., Bieger, J., & Garcia Molina, G., (2010). A survey of stimulation methods used in SSVEP-based BCIs. Computational Intelligence and Neuroscience, 2010, 1-12. doi: 10.1155/2010/702357.
