Subscribe to RSS
![](/products/assets/desktop/img/oa-logo.png)
DOI: 10.1055/s-0041-1727676
Augmented Reality during Parotid Surgery: Real-Life Evaluation of Voice Control and User-Experience
Content Introduction Augmented Reality (AR) can improve surgical planing and performance in parotid surgery. For easier application during surgery we implemented a complete voice control manual for our AR system used for parotid surgery. The aim of the study was to evaluate the feasibility of the voice control in a Real-Life Situation as well as the User-Experience.
Methods We used the HoloLens 1® (Microsoft Corporation) with an own specially developed speech recognition software (DFC-SYSTEMS GmbH, Munich) for parotid surgery with our AR system. The evaluation took place during real surgical procedures. Voice commands were used to display MRI images and 3D structures of the patient during surgery with the HoloLens. Commands had different variations (male/female, with/without accent, slow/fast, clear/unclear). Additionally the surgeons completed a Likert-Survey and a validated Subjective Mental Effort Questionnaire to evaluate the personal benefit and usability of voice control against gesture control as standard control method of the HoloLens provided by Microsoft.
Results The mean background noise during surgery was 58.1 dB with a speech recognition rate of 80 % . The speaker's gender or accent had no significant influence on the recognition rate (p = 0.7407). In terms of stress load and work efficiency results from questionnaires revealed that users prefer voice control to the gesture control as originally provided by Microsoft (p < 0,001).
Conclusion Voice control in AR for surgical application proved to be sufficient even at high levels of backround noise in terms of cognitive and physical stress reduction. Even in high levels of background noise commands are recognized and carried out by the HoloLens.
Poster-PDF A-1653.pdf
Publication History
Article published online:
13 May 2021
© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany