Download PDF
CC BY-NC 4.0 · Arch Plast Surg 2017; 44(03): 179-187
DOI: 10.5999/aps.2017.44.3.179
Review Article

Virtual Reality and Augmented Reality in Plastic Surgery: A Review

Youngjun Kim
Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
,
Hannah Kim
Center for Bionics, Korea Institute of Science and Technology, Seoul, Korea
,
Yong Oock Kim
Department of Plastic and Reconstructive Surgery, Yonsei University College of Medicine, Seoul, Korea
› Author AffiliationsThis research was supported by the Korea Institute of Science and Technology institutional program (2E26880, 2E26276).
› Further Information
   Permissions and Reprints

Recently, virtual reality (VR) and augmented reality (AR) have received increasing attention, with the development of VR/AR devices such as head-mounted displays, haptic devices, and AR glasses. Medicine is considered to be one of the most effective applications of VR/AR. In this article, we describe a systematic literature review conducted to investigate the state-of-the-art VR/AR technology relevant to plastic surgery. The 35 studies that were ultimately selected were categorized into 3 representative topics: VR/AR-based preoperative planning, navigation, and training. In addition, future trends of VR/AR technology associated with plastic surgery and related fields are discussed.

Keywords

Virtual reality - Augmented reality - Plastic surgery - Virtual surgery - Virtual simulation


Publication History

Received: 27 February 2017

Accepted: 21 April 2017

Article published online:
20 April 2022

© 2017. The Korean Society of Plastic and Reconstructive Surgeons. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonCommercial License, permitting unrestricted noncommercial use, distribution, and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes. (https://creativecommons.org/licenses/by-nc/4.0/)

Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA

 

  • REFERENCES

  • 1 Zimmerman TG, Lanier J, Blanchard C. et al. A hand gesture interface device. In: Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface. 1987 Apr 5-9; Toronto, CA 1987: 189-192
    Search in Google Scholar
  • 2 Chinnock C. Virtual reality in surgery and medicine. Hosp Technol Ser 1994; 13: 1-48
    PubMedSearch in Google Scholar
  • 3 Pensieri C, Pennacchini M. Overview: virtual reality in medicine. J Virtual Worlds Res 2014; 7: 1-34
    Search in Google Scholar
  • 4 Geomagic. Geomagic Haptic Devices [Internet]. Rock Hill, SC: Geomagic; 2016. cited 2017 Feb 7. Available from: http://www.geomagic.com/en/products-landing-pages/haptic
    Search in Google Scholar
  • 5 Fushima K, Kobayashi M. Mixed-reality simulation for orthognathic surgery. Maxillofac Plast Reconstr Surg 2016; 38: 13
    CrossrefPubMedSearch in Google Scholar
  • 6 Tsai MD, Liu CS, Liu HY. et al. Virtual reality facial contouring surgery simulator based on CT transversal slices. Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering. 2011 May 10-12 Wuhan, China: 2011: 1-4
    Search in Google Scholar
  • 7 Wang Q, Chen H, Wu W. et al. Real-time mandibular angle reduction surgical simulation with haptic rendering. IEEE Trans Inf Technol Biomed 2012; 16: 1105-1114
    CrossrefPubMedSearch in Google Scholar
  • 8 Olsson P, Nysjo F, Rodriguez-Lorenzo A. et al. Haptics-assisted virtual planning of bone, soft tissue, and vessels in fibula osteocutaneous free flaps. Plast Reconstr Surg Glob Open 2015; 3: e479
    CrossrefPubMedSearch in Google Scholar
  • 9 Schendel S, Montgomery K, Sorokin A. et al. A surgical simulator for planning and performing repair of cleft lips. J Craniomaxillofac Surg 2005; 33: 223-228
    CrossrefPubMedSearch in Google Scholar
  • 10 Olsson P, Nysjo F, Hirsch JM. et al. A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases. Int J Comput Assist Radiol Surg 2013; 8: 887-894
    CrossrefPubMedSearch in Google Scholar
  • 11 Zhang J, Li D, Liu Q. et al. Virtual surgical system in reduction of maxillary fracture. Proceedings of the 2015 IEEE International Conference on Digital Signal Processing (DSP). 2015 Jul 21-24 Singapore: 2015: 1102-1105
    Search in Google Scholar
  • 12 Kovler I, Joskowicz L, Weil YA. et al. Haptic computer-assisted patient-specific preoperative planning for orthopedic fractures surgery. Int J Comput Assist Radiol Surg 2015; 10: 1535-1546
    CrossrefPubMedSearch in Google Scholar
  • 13 Cecil J, Ramanathan P, Pirela-Cruz M. et al. A Virtual Reality Based Simulation Environment for Orthopedic Surgery. In: Meersman R, Panetto H, Mishra A. et al. On the Move to Meaningful Internet Systems: OTM 2014 Workshops. Confederated International Workshops: OTM Academy, OTM Industry Case Studies Program, C&TC, EI2N, INBAST, ISDE, META4eS, MSC and OnToContent 2014 Oct 27-31 Amantea, Italy Berlin, Heidelberg: Springer Berlin Heidelberg; 2014: 275-285
    Search in Google Scholar
  • 14 Cecil J, Ramanathan P, Rahneshin V. et al. Collaborative virtual environments for orthopedic surgery. Proceedings of the 2013 IEEE International Conference on Automation Science and Engineering (CASE). 2013 Aug 17-20 Madison, WI: 2013: 133-137
    Search in Google Scholar
  • 15 Shen F, Chen B, Guo Q. et al. Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery. Int J Comput Assist Radiol Surg 2013; 8: 169-179
    CrossrefPubMedSearch in Google Scholar
  • 16 Chan S, Li P, Locketz G. et al. High-fidelity haptic and visual rendering for patient-specific simulation of temporal bone surgery. Comput Assist Surg (Abingdon) 2016; 21: 85-101
    CrossrefPubMedSearch in Google Scholar
  • 17 Luciano CJ, Banerjee PP, Sorenson JM. et al. Percutaneous spinal fixation simulation with virtual reality and haptics. Neurosurgery 2013; 72 (Suppl. 01) 89-96
    CrossrefPubMedSearch in Google Scholar
  • 18 ImmersiveTouch Inc. ImmersiveTouch [Internet]. IChicago, CA: ImmersiveTouch Inc; 2017. cited 2017 Jan 12 Available from: http://www.immersivetouch.com
    Search in Google Scholar
  • 19 Badiali G, Ferrari V, Cutolo F. et al. Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Craniomaxillofac Surg 2014; 42: 1970-1976
    CrossrefPubMedSearch in Google Scholar
  • 20 Zinser MJ, Mischkowski RA, Dreiseidler T. et al. Computer-assisted orthognathic surgery: waferless maxillary positioning, versatility, and accuracy of an image-guided visualisation display. Br J Oral Maxillofac Surg 2013; 51: 827-833
    CrossrefPubMedSearch in Google Scholar
  • 21 Mischkowski RA, Zinser MJ, Kubler AC. et al. Application of an augmented reality tool for maxillary positioning in orthognathic surgery: a feasibility study. J Craniomaxillofac Surg 2006; 34: 478-483
    CrossrefPubMedSearch in Google Scholar
  • 22 Lin L, Shi Y, Tan A. et al. Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms: a feasibility study. J Craniomaxillofac Surg 2016; 44: 215-223
    CrossrefPubMedSearch in Google Scholar
  • 23 Wang J, Suenaga H, Yang L. et al. Video see-through augmented reality for oral and maxillofacial surgery. Int J Med Robot. 09.06.2016. [Epub]
    Search in Google Scholar
  • 24 Choi H, Park Y, Cho H. et al. An augmented reality based simple navigation system for pelvic tumor resection. Proceedings of the 11th Asian Conference on Computer Aided Surgery (ACCAS 2015). 2015 Jul 9-11 Singapore 2015
    Search in Google Scholar
  • 25 Choi H, Cho B, Masamune K. et al. An effective visualization technique for depth perception in augmented reality-based surgical navigation. Int J Med Robot 2016; 12: 62-72
    CrossrefPubMedSearch in Google Scholar
  • 26 Wu F, Chen X, Lin Y. et al. A virtual training system for maxillofacial surgery using advanced haptic feedback and immersive workbench. Int J Med Robot 2014; 10: 78-87
    CrossrefPubMedSearch in Google Scholar
  • 27 Lin Y, Wang X, Wu F. et al. Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. J Biomed Inform 2014; 48: 122-129
    CrossrefPubMedSearch in Google Scholar
  • 28 Seah TE, Barrow A, Baskaradas A. et al. A virtual reality system to train image guided placement of kirschner-wires for distal radius fractures. In: Bello F, Cotin S. Biomedical Simulation. 6th International Symposium, ISBMS 2014 2014 Oct 16-17 Strasbourg, FR Cham: Springer International Publishing; 2014: 20-29
    Search in Google Scholar
  • 29 Thomas GW, Johns BD, Kho JY. et al. The validity and reliability of a hybrid reality simulator for wire navigation in orthopedic surgery. IEEE Trans Hum Mach Syst 2015; 45: 119-125
    Search in Google Scholar
  • 30 Swemac. TraumaVision-medical orthopedic simulator [Internet]. Linkoping, SE: Swemac; 2017 cited 2017 Jan 12. Available from: http://www.swemac.com/simulators/traumavision
    PubMedSearch in Google Scholar
  • 31 OssoVR. OssoVR [Internet]. San Francisco, CA: OssoVR. cited 2017 Feb 6. Available from: http://ossovr.com
  • 32 Vankipuram M, Kahol K, McLaren A. et al. A virtual reality simulator for orthopedic basic skills: a design and validation study. J Biomed Inform 2010; 43: 661-668
    CrossrefPubMedSearch in Google Scholar
  • 33 Wong D, Unger B, Kraut J. et al. Comparison of cadaveric and isomorphic virtual haptic simulation in temporal bone training. J Otolaryngol Head Neck Surg 2014; 43: 31
    CrossrefPubMedSearch in Google Scholar
  • 34 Qiong W, Hui C, Wen W. et al. Impulse-based rendering methods for haptic simulation of bone-burring. IEEE Trans Haptics 2012; 5: 344-355
    CrossrefPubMedSearch in Google Scholar
  • 35 Lemole Jr GM, Banerjee PP, Luciano C. et al. Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 2007; 61: 142-148
    CrossrefPubMedSearch in Google Scholar
  • 36 Alaraj A, Luciano CJ, Bailey DP. et al. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Neurosurgery 2015; 11 (Suppl. 02) 52-58
    PubMedSearch in Google Scholar
  • 37 Sutherland C, Hashtrudi-Zaad K, Sellens R. et al. An augmented reality haptic training simulator for spinal needle procedures. IEEE Trans Biomed Eng 2013; 60: 3009-3018
    CrossrefPubMedSearch in Google Scholar
  • 38 Tsai MD, Hsieh MS. Computer based system for simulating spine surgery. Proceedings of the 22nd IEEE International Symposium on Computer-Based Medical Systems 2009 Aug 2-5 Albuquerque, NM: 2009: 1-8
    Search in Google Scholar
  • 39 CAE Healthcare Inc. NeuroVR [Internet]. Montreal, CA: Cae Healthcare; 2017. cited 2017 Jan 12 Available from: http://caehealthcare.com/eng/interventional-simulators/neurovr
    Search in Google Scholar
  • 40 Woo T, Kraeima J, Kim YO. et al. Mandible reconstruction with 3D virtual planning. J Int Soc Simul Surg 2015; 2: 90-93
    Search in Google Scholar
  • 41 Burdea G, Coiffet P. Virtual reality technology. Hoboken, NJ: J. Wiley-Interscience; 2003
    Search in Google Scholar
  • 42 Hackett M, Proctor M. Three-dimensional display technologies for anatomical education: a literature Review. J Sci Educ Technol 2016; 25: 641-654
    CrossrefSearch in Google Scholar
  • 43 Makino Y, Furuyama Y, Inoue S. et al. HaptoClone (Haptic-Optical Clone) for mutual tele-environment by real-time 3D image transfer with midair force Feedback. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems 2016 Santa Clara, CA: ACM; 2016: 1980-1990
    Search in Google Scholar