Eye Gaze Correlates of Motor Impairment in VR Observation of Motor Actions

Summary

Introduction: This article is part of the Focus Theme of Methods of Information in Medicine on “Methodologies, Models and Algorithms for Patients Rehabilitation”. Objective: Identify eye gaze correlates of motor impairment in a virtual reality motor observation task in a study with healthy participants and stroke patients. Methods: Participants consisted of a group of healthy subjects (N = 20) and a group of stroke survivors (N = 10). Both groups were required to observe a simple reach-and-grab and place-and-release task in a virtual environment. Additionally, healthy subjects were required to observe the task in a normal condition and a constrained movement condition. Eye movements were recorded during the observation task for later analysis. Results: For healthy participants, results showed differences in gaze metrics when comparing the normal and arm-constrained conditions. Differences in gaze metrics were also found when comparing dominant and non-dominant arm for saccades and smooth pursuit events. For stroke patients, results showed longer smooth pursuit segments in action observation when observing the paretic arm, thus providing evidence that the affected circuitry may be activated for eye gaze control during observation of the simulated motor action. Conclusions: This study suggests that neural motor circuits are involved, at multiple levels, in observation of motor actions displayed in a virtual reality environment. Thus, eye tracking combined with action observation tasks in a virtual reality display can be used to monitor motor deficits derived from stroke, and consequently can also be used for re -habilitation of stroke patients.

Keywords

Action observation - eye movements - stroke - virtual reality

• References

• 1 Mukherjee D, Patil CG. Epidemiology and the global burden of stroke. World Neurosurgery 2011; 76 (Suppl. 06) S85-S90.
• 2 Hermann DM, Chopp M. Promoting brain remodelling and plasticity for stroke recovery: therapeutic promise and potential pitfalls of clinical translation. The Lancet Neurology 2012; 11 (Suppl. 04) 369-380.
• 3 Seitz RJ, Donnan GA. Role of neuroimaging in promoting long-term recovery from ischemic stroke. Journal of Magnetic Resonance Imaging 2010; 32 (Suppl. 04) 756-772.
• 4 Rizzolatti G, Sinigaglia C. The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nature Reviews Neuroscience 2010; 11 (Suppl. 04) 264-274.
• 5 Rizzolatti G, Craighero L. The mirror-neuron system. Annu Rev Neurosci 2004; 27: 169-192.
• 6 Buccino G, Binkofski F, Riggio L. The mirror neuron system and action recognition. Brain and language 2004; 89 (Suppl. 02) 370-376.
• 7 Oztop E, Arbib MA. Schema design and implementation of the grasp-related mirror neuron system. Biological cybernetics 2002; 87 (Suppl. 02) 116-140.
• 8 Bonaiuto J, Rosta E, Arbib MA. Extending the mirror neuron system model. I. Biological cybernetics 2007; 96 (Suppl. 01) 9-38.
• 9 Oztop E, Kawato M, Arbib MA. Mirror neurons: functions, mechanisms and models. Neuroscience letters 2013; 540: 43-55.
• 10 Grezes J, Decety J. Functional anatomy of execution, mental simulation, observation, and verb generation of actions: a meta-analysis. Human Brain Mapping 2001; 12 (Suppl. 01) 1-19.
• 11 Holmes PS, Cumming J, Edwards MG. Movement imagery, observation, and skill. In: Guillot A, Collet C. editors. The neurophysiological foundations of mental and motor imagery. Oxford University Press; 2010. pp 245-269.
• 12 Thill S, Caligiore D, Borghi AM, Ziemke T, Baldassarre G. Theories and computational models of affordance and mirror systems: an integrative review. Neuroscience & Biobehavioral Reviews 2013; 37 (Suppl. 03) 491-521.
• 13 Brouwer AM, Franz VH, Gegenfurtner KR. Differences in fixations between grasping and viewing objects. Journal of Vision 2009; 9 (Suppl. 01) 18.
• 14 Liversedge SP, Findlay JM. Saccadic eye movements and cognition. Trends in Cognitive Sciences 2000; 4 (Suppl. 01) 6-14.
• 15 Causer J, McCormick SA, Holmes PS. Congruency of gaze metrics in action, imagery and action observation. Frontiers in human neuroscience 2013; 7: 604.
• 16 Ertelt D, Small S, Solodkin A, Dettmers C, McNamara A, Binkofski F. et al. Action observation has a positive impact on rehabilitation of motor deficits after stroke. Neuroimage. 2007 36: T164 –T173.
• 17 Mulder T. Motor imagery and action observation: cognitive tools for rehabilitation. Journal of neural transmission 2007; 114 (Suppl. 10) 1265-1278.
• 18 Alves J, Vourvopoulos A, Bernardino A, Bermudez i Badia S. Eye gaze patterns after stroke: correlates of a VR action execution and observation task. REHAB 2014. Proceedings of the 2nd Patient Rehabilitation Research Techniques Workshop; 2014 May 20; Oldenburg, Germany: ICST; 2014
• 19 Amantis R, Corradi F, Molteni AM, Massara B, Orlandi M, Federici S. et al. Eye-tracking assistive technology: Is this effective for the developmental age? Evaluation of eye-tracking systems for children and adolescents with cerebral palsy. In: Gelderblom GJ, Soede M, Adriaens L, Miesenberger K. editors. Everyday Technology for Independence and Care: AAATE 2011. Amsterdam: IOS Press; 2011. pp 489-496.
• 20 Loconsole C, Bartalucci R, Frisoli A, Bergamasco M. A new gaze-tracking guidance mode for upper limb robot-aided neurorehabilitation. WHC 2011. Proceedings of the World Haptics Conference, 2011 IEEE; 2011 June 21–24; Istanbul, Turkey: IEEE; 2011. pp 185-190.
• 21 Vourvopoulos A, Faria AL, Cameirao MS, Bermudez i Badia S. RehabNet: A distributed architecture for motor and cognitive neuro-rehabilitation. HealthCom 2013. Proceedings of the 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services; 2013 October 9–12; Lisbon, Portugal: IEEE; 2013. pp 454-459.