CC BY-NC-ND 4.0 · Laryngorhinootologie 2021; 100(S 02): S30-S31
DOI: 10.1055/s-0041-1727676
Abstracts
Surgical assistance procedures

Augmented Reality during Parotid Surgery: Real-Life Evaluation of Voice Control and User-Experience

A Dias
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
D Männle
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
T Balkenhol
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
Jürgen Hesser
2   Institute of Experimental Radiation Oncology, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, Mannheim
,
N Rotter
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
L Huber
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
O Hoffmann
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
A Schell
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
B Kramer
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
A Lammert
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
,
C Scherl
1   Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim
› Institutsangaben
› Weitere Informationen
Auch verfügbar auf
 
 

    Content Introduction Augmented Reality (AR) can improve surgical planing and performance in parotid surgery. For easier application during surgery we implemented a complete voice control manual for our AR system used for parotid surgery. The aim of the study was to evaluate the feasibility of the voice control in a Real-Life Situation as well as the User-Experience.

    Methods We used the HoloLens 1® (Microsoft Corporation) with an own specially developed speech recognition software (DFC-SYSTEMS GmbH, Munich) for parotid surgery with our AR system. The evaluation took place during real surgical procedures. Voice commands were used to display MRI images and 3D structures of the patient during surgery with the HoloLens. Commands had different variations (male/female, with/without accent, slow/fast, clear/unclear). Additionally the surgeons completed a Likert-Survey and a validated Subjective Mental Effort Questionnaire to evaluate the personal benefit and usability of voice control against gesture control as standard control method of the HoloLens provided by Microsoft.

    Results The mean background noise during surgery was 58.1 dB with a speech recognition rate of 80 % . The speaker's gender or accent had no significant influence on the recognition rate (p = 0.7407). In terms of stress load and work efficiency results from questionnaires revealed that users prefer voice control to the gesture control as originally provided by Microsoft (p  <  0,001).

    Conclusion Voice control in AR for surgical application proved to be sufficient even at high levels of backround noise in terms of cognitive and physical stress reduction. Even in high levels of background noise commands are recognized and carried out by the HoloLens.

    Poster-PDF A-1653.pdf


    #

    Conflict of interest

    Der Erstautor gibt keinen Interessenskonflikt an.

    Address for correspondence

    Dias Andre
    Department of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Theodor-Kutzer-Ufer 1-3, 68167
    Mannheim

    Publikationsverlauf

    Artikel online veröffentlicht:
    13. Mai 2021

    © 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).

    Georg Thieme Verlag KG
    Rüdigerstraße 14, 70469 Stuttgart, Germany