From Augmented to Virtual Reality in Plastic Surgery: Blazing the Trail to a New Frontier

Janessa Sullivan; Rachel Skladman; Kaamya Varagur; Elijah Tenenbaum; Jacob L. Sacks; Cameron Martin; Terry Gordon; John Murphy; William R. Moritz; Justin M. Sacks

doi:10.1055/a-2199-3870

Journal of Reconstructive Microsurgery, Table of Contents

J Reconstr Microsurg 2024; 40(05): 398-406
DOI: 10.1055/a-2199-3870

Original Article

From Augmented to Virtual Reality in Plastic Surgery: Blazing the Trail to a New Frontier

Janessa Sullivan

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Rachel Skladman

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Kaamya Varagur

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Elijah Tenenbaum

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Jacob L. Sacks

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Cameron Martin

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Terry Gordon

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

John Murphy

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

William R. Moritz

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

,

Justin M. Sacks

¹Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri

› Author Affiliations

Abstract

Background Augmented reality (AR) and virtual reality (VR)—termed mixed reality—have shown promise in the care of operative patients. Currently, AR and VR have well-known applications for craniofacial surgery, specifically in preoperative planning. However, the application of AR/VR technology to other reconstructive challenges has not been widely adopted. Thus, the purpose of this investigation is to outline the current applications of AR and VR in the operative setting.

Methods The literature pertaining to the use of AR/VR technology in the operative setting was examined. Emphasis was placed on the use of mixed reality technology in surgical subspecialities, including plastic surgery, oral and maxillofacial surgery, colorectal surgery, neurosurgery, otolaryngology, neurosurgery, and orthopaedic surgery.

Results Presently, mixed reality is widely used in the care of patients requiring complex reconstruction of the craniomaxillofacial skeleton for pre- and intraoperative planning. For upper extremity amputees, there is evidence that VR may be efficacious in the treatment of phantom limb pain. Furthermore, VR has untapped potential as a cost-effective tool for microsurgical education and for training residents on techniques in surgical and nonsurgical aesthetic treatment. There is utility for mixed reality in breast reconstruction for preoperative planning, mapping perforators, and decreasing operative time. VR has well- documented applications in the planning of deep inferior epigastric perforator flaps by creating three-dimensional immersive simulations based on a patient's preoperative computed tomography angiogram.

Conclusion The benefits of AR and VR are numerous for both patients and surgeons. VR has been shown to increase surgical precision and decrease operative time. Furthermore, it is effective for patient-specific rehearsal which uses the patient's exact anatomical data to rehearse the procedure before performing it on the actual patient. Taken together, AR/VR technology can improve patient outcomes, decrease operative times, and lower the burden of care on both patients and health care institutions.

Keywords

plastic surgery - augmented reality - virtual reality

Full Text

References

References
1 Kanevsky J, Safran T, Zammit D, Lin SJ, Gilardino M. Making augmented and virtual reality work for the plastic surgeon. Ann Plast Surg 2019; 82 (04) 363-368
2 Zhou Z, Li J, Wang H, Luan Z, Li Y, Peng X. Upper limb rehabilitation system based on virtual reality for breast cancer patients: development and usability study. PLOS ONE 2021; 16 (12) e0261220
3 Tokgöz P, Stampa S, Wähnert D, Vordemvenne T, Dockweiler C. Virtual reality in the rehabilitation of patients with injuries and diseases of upper extremities. Healthcare (Basel) 2022; 10 (06) 1124
4 Dunn J, Yeo E, Moghaddampour P, Chau B, Humbert S. Virtual and augmented reality in the treatment of phantom limb pain: a literature review. NeuroRehabilitation 2017; 40 (04) 595-601
5 Bielsa VF. Virtual reality simulation in plastic surgery training. Literature review. J Plast Reconstr Aesthet Surg 2021; 74 (09) 2372-2378
6 Gupta N, Verhey EM, Torres-Guzman RA. et al. Outcomes of lymphovenous anastomosis for upper extremity lymphedema: a systematic review. Plast Reconstr Surg Glob Open 2021; 9 (08) e3770
7 Tan YPA, Liverneaux P, Wong JKF. Current limitations of surgical robotics in reconstructive plastic microsurgery. Front Surg 2018; 5: 22
8 Lindenblatt N, Grünherz L, Wang A. et al. Early experience using a new robotic microsurgical system for lymphatic surgery. Plast Reconstr Surg Glob Open 2022; 10 (01) e4013
9 Ukimura O, Gill IS. Image-fusion, augmented reality, and predictive surgical navigation. Urol Clin North Am 2009; 36 (02) 115-123 , vii
10 Rosen JM, Hong J, Klaudt-Moreau J, Podsednik A, Hentz VR. Frontiers of brachial plexus injury: future revolutions in the field. In: Bahm J. ed. Brachial Plexus Injury—New Techniques and Ideas. IntechOpen; 2022
11 Larysz D, Nieroba E. Subjective assessment of head and facial appearance in children with craniosynostoses after surgical treatment. Healthcare (Basel) 2018; 6 (04) 127
12 Alshomer F, Alazzam A, Alturki A, Almeshal O, Alhusainan H. Smartphone-assisted augmented reality in craniofacial surgery. Plast Reconstr Surg Glob Open 2021; 9 (08) e3743
13 Kim Y, Kim H, Kim YO. Virtual reality and augmented reality in plastic surgery: a review. Arch Plast Surg 2017; 44 (03) 179-187
14 Olsson P, Nysjö F, Rodríguez-Lorenzo A, Thor A, Hirsch JM, Carlbom IB. Haptics-assisted virtual planning of bone, soft tissue, and vessels in fibula osteocutaneous free flaps. Plast Reconstr Surg Glob Open 2015; 3 (08) e479
15 Ayoub A, Pulijala Y. The application of virtual reality and augmented reality in oral & maxillofacial surgery. BMC Oral Health 2019; 19 (01) 238
16 Cho KH, Papay FA, Yanof J. et al. Mixed reality and 3D printed models for planning and execution of face transplantation. Ann Surg 2021; 274 (06) e1238-e1246
17 Cai EZ, Gao Y, Ngiam KY, Lim TC. Mixed reality intraoperative navigation in craniomaxillofacial surgery. Plast Reconstr Surg 2021; 148 (04) 686e-688e
18 Smith DM, Aston SJ, Cutting CB, Oliker A. Applications of virtual reality in aesthetic surgery. Plast Reconstr Surg 2005; 116 (03) 898-904 , discussion 905–906
19 Mespreuve M, Waked K, Collard B, De Ranter J, Vanneste F, Hendrickx B. The usefulness of magnetic resonance angiography to analyze the variable arterial facial anatomy in an effort to reduce filler-associated blindness: anatomical study and visualization through an augmented reality application. Aesthet Surg J Open Forum 2021; 3 (03) ojab018
20 Sayadi LR, Naides A, Eng M. et al. The new frontier: a review of augmented reality and virtual reality in plastic surgery. Aesthet Surg J 2019; 39 (09) 1007-1016
21 Wang Y, Cao D, Chen SL, Li YM, Zheng YW, Ohkohchi N. Current trends in three-dimensional visualization and real-time navigation as well as robot-assisted technologies in hepatobiliary surgery. World J Gastrointest Surg 2021; 13 (09) 904-922
22 Galati R, Simone M, Barile G, De Luca R, Cartanese C, Grassi G. Experimental setup employed in the operating room based on virtual and mixed reality: analysis of pros and cons in open abdomen surgery. J Healthc Eng 2020; 2020: 8851964
23 Ghaednia H, Fourman MS, Lans A. et al. Augmented and virtual reality in spine surgery, current applications and future potentials. Spine J 2021; 21 (10) 1617-1625
24 Fitoussi A, Tacher V, Pigneur F. et al. Augmented reality-assisted deep inferior epigastric artery perforator flap harvesting. J Plast Reconstr Aesthet Surg 2021; 74 (08) 1931-1971
25 Gacto-Sánchez P, Sicilia-Castro D, Gómez-Cía T. et al. Use of a three-dimensional virtual reality model for preoperative imaging in DIEP flap breast reconstruction. J Surg Res 2010; 162 (01) 140-147
26 Egozi D, Perkhulov V, Kouniavsky L, Di Via Loschope A, Benkler M, Benharush D. DIEP flap preoperative planning using virtual reality based on CT angiography. Plast Reconstr Surg Glob Open 2022; 10 (03) e4209
27 Wesselius TS, Meulstee JW, Luijten G, Xi T, Maal TJJ, Ulrich DJO. Holographic augmented reality for DIEP flap harvest. Plast Reconstr Surg 2021; 147 (01) 25e-29e
28 Moritz WR, Sacks JM, Anolik R. Immersive View Virtual Reality Technology as an Adjunct for Deep Inferior Epigastric Perforator Flap Dissection: A Case Series (forthcoming). 2022
29 Nielsen CAB, Lönn L, Konge L, Taudorf M. Simulation-based virtual-reality patient-specific rehearsal prior to endovascular procedures: a systematic review. Diagnostics (Basel) 2020; 10 (07) 500
30 Pratt P, Ives M, Lawton G. et al. Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur Radiol Exp 2018; 2 (01) 2
31 Nuri T, Mitsuno D, Iwanaga H, Otsuki Y, Ueda K. Application of augmented reality (AR) technology to locate the cutaneous perforator of anterolateral thigh perforator flap: a case report. Microsurgery 2022; 42 (01) 76-79
32 Tsukada S, Ogawa H, Nishino M, Kurosaka K, Hirasawa N. Augmented reality-assisted femoral bone resection in total knee arthroplasty. JBJS Open Access 2021; 6 (03) e21.00001
33 Ortiz-Catalan M, Guðmundsdóttir RA, Kristoffersen MB. et al. Phantom motor execution facilitated by machine learning and augmented reality as treatment for phantom limb pain: a single group, clinical trial in patients with chronic intractable phantom limb pain. Lancet 2016; 388 (10062): 2885-2894
34 Rothgangel A, Braun S, Winkens B, Beurskens A, Smeets R. Traditional and augmented reality mirror therapy for patients with chronic phantom limb pain (PACT study): results of a three-group, multicentre single-blind randomized controlled trial. Clin Rehabil 2018; 32 (12) 1591-1608
35 Blumstein G. Research: how virtual reality can help train surgeons. Harvard Business Review. Accessed November 11, 2023 at: https://hbr.org/2019/10/research-how-virtual-reality-can-help-train-surgeons . Published October 16, 2019
36 Agrawal N, Turner A, Grome L. et al. Use of simulation in plastic surgery training. Plast Reconstr Surg Glob Open 2020; 8 (07) e2896
37 Lee GK, Moshrefi S, Fuertes V, Veeravagu L, Nazerali R, Lin SJ. What is your reality? Virtual, augmented, and mixed reality in plastic surgery training, education, and practice. Plast Reconstr Surg 2021; 147 (02) 505-511
38 Chen J, Xun H, Abousy M, Long C, Sacks JM. No microscope? No problem: a systematic review of microscope-free microsurgery training models. J Reconstr Microsurg 2022; 38 (02) 106-114
39 de Montbrun SL, Macrae H. Simulation in surgical education. Clin Colon Rectal Surg 2012; 25 (03) 156-165
40 Greenfield MJ, Luck J, Billingsley ML. et al. Demonstration of the effectiveness of augmented reality telesurgery in complex hand reconstruction in Gaza. Plast Reconstr Surg Glob Open 2018; 6 (03) e1708
41 Vyas RM, Sayadi LR, Bendit D, Hamdan US. Using virtual augmented reality to remotely proctor overseas surgical outreach: building long-term international capacity and sustainability. Plast Reconstr Surg 2020; 146 (05) 622e-629e
42 Al Omran Y, Abdall-Razak A, Sohrabi C. et al. Use of augmented reality in reconstructive microsurgery: a systematic review and development of the augmented reality microsurgery score. J Reconstr Microsurg 2020; 36 (04) 261-270
43 Clerc PGB, Arneja JS, Zwimpfer CM, Behboudi A, Goldman RD. A randomized controlled trial of virtual reality in awake minor pediatric plastic surgery procedures. Plast Reconstr Surg 2021; 148 (02) 400-408
44 Hoxhallari E, Behr IJ, Bradshaw JS. et al. Virtual reality improves the patient experience during wide-awake local anesthesia no tourniquet hand surgery: a single-blind, randomized, prospective study. Plast Reconstr Surg 2019; 144 (02) 408-414