Download PDF
J Reconstr Microsurg 2024; 40(05): 398-406
DOI: 10.1055/a-2199-3870
Original Article

From Augmented to Virtual Reality in Plastic Surgery: Blazing the Trail to a New Frontier

Janessa Sullivan 
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Rachel Skladman
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Kaamya Varagur 
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Elijah Tenenbaum
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Jacob L. Sacks
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Cameron Martin
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Terry Gordon
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
John Murphy 
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
William R. Moritz
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
,
Justin M. Sacks
1   Division of Plastic and Reconstructive Surgery, Department of Surgery, Washington University in St. Louis School of Medicine, St. Louis, Missouri
› Author Affiliations
› Further Information
Also available at
    Permissions and Reprints

Abstract

Background Augmented reality (AR) and virtual reality (VR)—termed mixed reality—have shown promise in the care of operative patients. Currently, AR and VR have well-known applications for craniofacial surgery, specifically in preoperative planning. However, the application of AR/VR technology to other reconstructive challenges has not been widely adopted. Thus, the purpose of this investigation is to outline the current applications of AR and VR in the operative setting.

Methods The literature pertaining to the use of AR/VR technology in the operative setting was examined. Emphasis was placed on the use of mixed reality technology in surgical subspecialities, including plastic surgery, oral and maxillofacial surgery, colorectal surgery, neurosurgery, otolaryngology, neurosurgery, and orthopaedic surgery.

Results Presently, mixed reality is widely used in the care of patients requiring complex reconstruction of the craniomaxillofacial skeleton for pre- and intraoperative planning. For upper extremity amputees, there is evidence that VR may be efficacious in the treatment of phantom limb pain. Furthermore, VR has untapped potential as a cost-effective tool for microsurgical education and for training residents on techniques in surgical and nonsurgical aesthetic treatment. There is utility for mixed reality in breast reconstruction for preoperative planning, mapping perforators, and decreasing operative time. VR has well- documented applications in the planning of deep inferior epigastric perforator flaps by creating three-dimensional immersive simulations based on a patient's preoperative computed tomography angiogram.

Conclusion The benefits of AR and VR are numerous for both patients and surgeons. VR has been shown to increase surgical precision and decrease operative time. Furthermore, it is effective for patient-specific rehearsal which uses the patient's exact anatomical data to rehearse the procedure before performing it on the actual patient. Taken together, AR/VR technology can improve patient outcomes, decrease operative times, and lower the burden of care on both patients and health care institutions.

Keywords

plastic surgery - augmented reality - virtual reality

Disclosures

Dr. Justin Sacks is a Co-Founder of LifeSprout. All other authors have no disclosures.




Publication History

Received: 23 February 2023

Accepted: 23 October 2023

Accepted Manuscript online:
26 October 2023

Article published online:
18 December 2023

© 2023. Thieme. All rights reserved.

Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA

 

  • References

  • 1 Kanevsky J, Safran T, Zammit D, Lin SJ, Gilardino M. Making augmented and virtual reality work for the plastic surgeon. Ann Plast Surg 2019; 82 (04) 363-368
    CrossrefPubMedSearch in Google Scholar
  • 2 Zhou Z, Li J, Wang H, Luan Z, Li Y, Peng X. Upper limb rehabilitation system based on virtual reality for breast cancer patients: development and usability study. PLOS ONE 2021; 16 (12) e0261220
    CrossrefPubMedSearch in Google Scholar
  • 3 Tokgöz P, Stampa S, Wähnert D, Vordemvenne T, Dockweiler C. Virtual reality in the rehabilitation of patients with injuries and diseases of upper extremities. Healthcare (Basel) 2022; 10 (06) 1124
    CrossrefPubMedSearch in Google Scholar
  • 4 Dunn J, Yeo E, Moghaddampour P, Chau B, Humbert S. Virtual and augmented reality in the treatment of phantom limb pain: a literature review. NeuroRehabilitation 2017; 40 (04) 595-601
    CrossrefPubMedSearch in Google Scholar
  • 5 Bielsa VF. Virtual reality simulation in plastic surgery training. Literature review. J Plast Reconstr Aesthet Surg 2021; 74 (09) 2372-2378
    CrossrefPubMedSearch in Google Scholar
  • 6 Gupta N, Verhey EM, Torres-Guzman RA. et al. Outcomes of lymphovenous anastomosis for upper extremity lymphedema: a systematic review. Plast Reconstr Surg Glob Open 2021; 9 (08) e3770
    CrossrefPubMedSearch in Google Scholar
  • 7 Tan YPA, Liverneaux P, Wong JKF. Current limitations of surgical robotics in reconstructive plastic microsurgery. Front Surg 2018; 5: 22
    CrossrefPubMedSearch in Google Scholar
  • 8 Lindenblatt N, Grünherz L, Wang A. et al. Early experience using a new robotic microsurgical system for lymphatic surgery. Plast Reconstr Surg Glob Open 2022; 10 (01) e4013
    CrossrefPubMedSearch in Google Scholar
  • 9 Ukimura O, Gill IS. Image-fusion, augmented reality, and predictive surgical navigation. Urol Clin North Am 2009; 36 (02) 115-123 , vii
    CrossrefPubMedSearch in Google Scholar
  • 10 Rosen JM, Hong J, Klaudt-Moreau J, Podsednik A, Hentz VR. Frontiers of brachial plexus injury: future revolutions in the field. In: Bahm J. ed. Brachial Plexus Injury—New Techniques and Ideas. IntechOpen; 2022
    Search in Google Scholar
  • 11 Larysz D, Nieroba E. Subjective assessment of head and facial appearance in children with craniosynostoses after surgical treatment. Healthcare (Basel) 2018; 6 (04) 127
    CrossrefPubMedSearch in Google Scholar
  • 12 Alshomer F, Alazzam A, Alturki A, Almeshal O, Alhusainan H. Smartphone-assisted augmented reality in craniofacial surgery. Plast Reconstr Surg Glob Open 2021; 9 (08) e3743
    CrossrefPubMedSearch in Google Scholar
  • 13 Kim Y, Kim H, Kim YO. Virtual reality and augmented reality in plastic surgery: a review. Arch Plast Surg 2017; 44 (03) 179-187
    Thieme ConnectPubMedSearch in Google Scholar
  • 14 Olsson P, Nysjö F, Rodríguez-Lorenzo A, Thor A, Hirsch JM, Carlbom IB. Haptics-assisted virtual planning of bone, soft tissue, and vessels in fibula osteocutaneous free flaps. Plast Reconstr Surg Glob Open 2015; 3 (08) e479
    CrossrefPubMedSearch in Google Scholar
  • 15 Ayoub A, Pulijala Y. The application of virtual reality and augmented reality in oral & maxillofacial surgery. BMC Oral Health 2019; 19 (01) 238
    CrossrefPubMedSearch in Google Scholar
  • 16 Cho KH, Papay FA, Yanof J. et al. Mixed reality and 3D printed models for planning and execution of face transplantation. Ann Surg 2021; 274 (06) e1238-e1246
    CrossrefPubMedSearch in Google Scholar
  • 17 Cai EZ, Gao Y, Ngiam KY, Lim TC. Mixed reality intraoperative navigation in craniomaxillofacial surgery. Plast Reconstr Surg 2021; 148 (04) 686e-688e
    CrossrefPubMedSearch in Google Scholar
  • 18 Smith DM, Aston SJ, Cutting CB, Oliker A. Applications of virtual reality in aesthetic surgery. Plast Reconstr Surg 2005; 116 (03) 898-904 , discussion 905–906
    CrossrefPubMedSearch in Google Scholar
  • 19 Mespreuve M, Waked K, Collard B, De Ranter J, Vanneste F, Hendrickx B. The usefulness of magnetic resonance angiography to analyze the variable arterial facial anatomy in an effort to reduce filler-associated blindness: anatomical study and visualization through an augmented reality application. Aesthet Surg J Open Forum 2021; 3 (03) ojab018
    CrossrefPubMedSearch in Google Scholar
  • 20 Sayadi LR, Naides A, Eng M. et al. The new frontier: a review of augmented reality and virtual reality in plastic surgery. Aesthet Surg J 2019; 39 (09) 1007-1016
    CrossrefPubMedSearch in Google Scholar
  • 21 Wang Y, Cao D, Chen SL, Li YM, Zheng YW, Ohkohchi N. Current trends in three-dimensional visualization and real-time navigation as well as robot-assisted technologies in hepatobiliary surgery. World J Gastrointest Surg 2021; 13 (09) 904-922
    CrossrefPubMedSearch in Google Scholar
  • 22 Galati R, Simone M, Barile G, De Luca R, Cartanese C, Grassi G. Experimental setup employed in the operating room based on virtual and mixed reality: analysis of pros and cons in open abdomen surgery. J Healthc Eng 2020; 2020: 8851964
    CrossrefPubMedSearch in Google Scholar
  • 23 Ghaednia H, Fourman MS, Lans A. et al. Augmented and virtual reality in spine surgery, current applications and future potentials. Spine J 2021; 21 (10) 1617-1625
    CrossrefPubMedSearch in Google Scholar
  • 24 Fitoussi A, Tacher V, Pigneur F. et al. Augmented reality-assisted deep inferior epigastric artery perforator flap harvesting. J Plast Reconstr Aesthet Surg 2021; 74 (08) 1931-1971
    CrossrefPubMedSearch in Google Scholar
  • 25 Gacto-Sánchez P, Sicilia-Castro D, Gómez-Cía T. et al. Use of a three-dimensional virtual reality model for preoperative imaging in DIEP flap breast reconstruction. J Surg Res 2010; 162 (01) 140-147
    CrossrefPubMedSearch in Google Scholar
  • 26 Egozi D, Perkhulov V, Kouniavsky L, Di Via Loschope A, Benkler M, Benharush D. DIEP flap preoperative planning using virtual reality based on CT angiography. Plast Reconstr Surg Glob Open 2022; 10 (03) e4209
    CrossrefPubMedSearch in Google Scholar
  • 27 Wesselius TS, Meulstee JW, Luijten G, Xi T, Maal TJJ, Ulrich DJO. Holographic augmented reality for DIEP flap harvest. Plast Reconstr Surg 2021; 147 (01) 25e-29e
    CrossrefPubMedSearch in Google Scholar
  • 28 Moritz WR, Sacks JM, Anolik R. Immersive View Virtual Reality Technology as an Adjunct for Deep Inferior Epigastric Perforator Flap Dissection: A Case Series (forthcoming). 2022
    PubMedSearch in Google Scholar
  • 29 Nielsen CAB, Lönn L, Konge L, Taudorf M. Simulation-based virtual-reality patient-specific rehearsal prior to endovascular procedures: a systematic review. Diagnostics (Basel) 2020; 10 (07) 500
    CrossrefPubMedSearch in Google Scholar
  • 30 Pratt P, Ives M, Lawton G. et al. Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur Radiol Exp 2018; 2 (01) 2
    CrossrefPubMedSearch in Google Scholar
  • 31 Nuri T, Mitsuno D, Iwanaga H, Otsuki Y, Ueda K. Application of augmented reality (AR) technology to locate the cutaneous perforator of anterolateral thigh perforator flap: a case report. Microsurgery 2022; 42 (01) 76-79
    CrossrefPubMedSearch in Google Scholar
  • 32 Tsukada S, Ogawa H, Nishino M, Kurosaka K, Hirasawa N. Augmented reality-assisted femoral bone resection in total knee arthroplasty. JBJS Open Access 2021; 6 (03) e21.00001
    CrossrefPubMedSearch in Google Scholar
  • 33 Ortiz-Catalan M, Guðmundsdóttir RA, Kristoffersen MB. et al. Phantom motor execution facilitated by machine learning and augmented reality as treatment for phantom limb pain: a single group, clinical trial in patients with chronic intractable phantom limb pain. Lancet 2016; 388 (10062): 2885-2894
    CrossrefPubMedSearch in Google Scholar
  • 34 Rothgangel A, Braun S, Winkens B, Beurskens A, Smeets R. Traditional and augmented reality mirror therapy for patients with chronic phantom limb pain (PACT study): results of a three-group, multicentre single-blind randomized controlled trial. Clin Rehabil 2018; 32 (12) 1591-1608
    CrossrefPubMedSearch in Google Scholar
  • 35 Blumstein G. Research: how virtual reality can help train surgeons. Harvard Business Review. Accessed November 11, 2023 at: https://hbr.org/2019/10/research-how-virtual-reality-can-help-train-surgeons . Published October 16, 2019
    PubMed
  • 36 Agrawal N, Turner A, Grome L. et al. Use of simulation in plastic surgery training. Plast Reconstr Surg Glob Open 2020; 8 (07) e2896
    CrossrefPubMedSearch in Google Scholar
  • 37 Lee GK, Moshrefi S, Fuertes V, Veeravagu L, Nazerali R, Lin SJ. What is your reality? Virtual, augmented, and mixed reality in plastic surgery training, education, and practice. Plast Reconstr Surg 2021; 147 (02) 505-511
    CrossrefPubMedSearch in Google Scholar
  • 38 Chen J, Xun H, Abousy M, Long C, Sacks JM. No microscope? No problem: a systematic review of microscope-free microsurgery training models. J Reconstr Microsurg 2022; 38 (02) 106-114
    Thieme ConnectPubMedSearch in Google Scholar
  • 39 de Montbrun SL, Macrae H. Simulation in surgical education. Clin Colon Rectal Surg 2012; 25 (03) 156-165
    Thieme ConnectPubMedSearch in Google Scholar
  • 40 Greenfield MJ, Luck J, Billingsley ML. et al. Demonstration of the effectiveness of augmented reality telesurgery in complex hand reconstruction in Gaza. Plast Reconstr Surg Glob Open 2018; 6 (03) e1708
    CrossrefPubMedSearch in Google Scholar
  • 41 Vyas RM, Sayadi LR, Bendit D, Hamdan US. Using virtual augmented reality to remotely proctor overseas surgical outreach: building long-term international capacity and sustainability. Plast Reconstr Surg 2020; 146 (05) 622e-629e
    CrossrefPubMedSearch in Google Scholar
  • 42 Al Omran Y, Abdall-Razak A, Sohrabi C. et al. Use of augmented reality in reconstructive microsurgery: a systematic review and development of the augmented reality microsurgery score. J Reconstr Microsurg 2020; 36 (04) 261-270
    Thieme ConnectPubMedSearch in Google Scholar
  • 43 Clerc PGB, Arneja JS, Zwimpfer CM, Behboudi A, Goldman RD. A randomized controlled trial of virtual reality in awake minor pediatric plastic surgery procedures. Plast Reconstr Surg 2021; 148 (02) 400-408
    CrossrefPubMedSearch in Google Scholar
  • 44 Hoxhallari E, Behr IJ, Bradshaw JS. et al. Virtual reality improves the patient experience during wide-awake local anesthesia no tourniquet hand surgery: a single-blind, randomized, prospective study. Plast Reconstr Surg 2019; 144 (02) 408-414
    CrossrefPubMedSearch in Google Scholar