Download PDF
J Reconstr Microsurg 2024; 40(05): 371-378
DOI: 10.1055/a-2181-6921
Original Article

Video-Based Assessment of Microsurgical Trainees: An Evaluation of Gender Bias

Eliana J. Schaefer
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
2   Georgetown University School of Medicine, Washington, District of Columbia
,
Mary K. Thayer
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
,
Anthony F. Colon
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
,
Kavya K. Sanghavi
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
,
Erika D. Sears
3   Section of Plastic Surgery, University of Michigan, Ann Arbor, Michigan
4   VA Center for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, Michigan
,
Aviram M. Giladi 
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
,
Ryan D. Katz
1   The Curtis National Hand Center, MedStar Union Memorial Hospital, Baltimore, Maryland
› Author Affiliations
› Further Information
Also available at
    Permissions and Reprints

Abstract

Background Gender bias in graduate medical evaluations remains a challenging issue. This study evaluates implicit gender bias in video-based evaluations of microsurgical technique, which has not previously been described in the literature.

Methods Two videos were recorded of microsurgical anastomosis; the first was performed by a hand/microsurgery fellow and the second by an expert microsurgeon. A total of 150 surgeons with microsurgical experience were recruited to evaluate the videos; they were told these videos depicted a surgical trainee 1 month into fellowship followed by the same trainee 10 months later. The only variable was the name (“Rachel” or “David”) that each participant was randomly assigned to evaluate. Participants were asked to score each video for quality, technique, efficiency, as well as overall progression and development after the second video compared with the initial video. To focus on bias, these outcome measures were selected to be purposefully subjective and all ratings were based on a subjective 1to 10 scale (10 = excellent).

Results The analysis included 150 participants (75% male). There were no statistically significant differences in scores between the “female” and “male” trainee. The trainees received the same median initial (1-month video) and final (11th-month video) scores for all criteria except initial technique, in which the female trainee received a 7 and the male trainee received an 8. Notably, 11-month scores were consistently the same or lower than 1-month scores for both study groups (p < 0.001). There were also no differences within either study group based on participant sex. Microsurgery practitioners overall rated both groups lower than those who do not currently practice microsurgery.

Conclusion Our study did not identify a gender bias in this evaluation method. Further investigation into how we assess and grade trainees as well as the presence and impact of implicit biases on varying surgical assessment methods is warranted.

Keywords

evaluation - gender bias - medical education - surgical education


Publication History

Received: 21 March 2023

Accepted: 18 September 2023

Accepted Manuscript online:
26 September 2023

Article published online:
03 November 2023

© 2023. Thieme. All rights reserved.

Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA

 

  • References

  • 1 The Majority of U.S. Medical Students Are Women, New Data Show. Association of American Medical Colleges; . Accessed August 20, 2020 at: https://www.aamc.org/news-insights/press-releases/majority-us-medical-students-are-women-new-data-show
  • 2 Bae GH, Lee AW, Park DJ, Maniwa K, Zurakowski D, Day CS. ASSH Diversity Committee. Ethnic and gender diversity in hand surgery trainees. J Hand Surg Am 2015; 40 (04) 790-797
    CrossrefPubMedSearch in Google Scholar
  • 3 Chen W, Baron M, Bourne DA, Kim JS, Washington KM, De La Cruz C. A report on the representation of women in academic plastic surgery leadership. Plast Reconstr Surg 2020; 145 (03) 844-852
    CrossrefPubMedSearch in Google Scholar
  • 4 Bernardi K, Shah P, Lyons NB. et al. Perceptions on gender disparity in surgery and surgical leadership: a multicenter mixed methods study. Surgery 2020; 167 (04) 743-750
    CrossrefPubMedSearch in Google Scholar
  • 5 Klein R, Julian KA, Snyder ED. et al; From the Gender Equity in Medicine (GEM) workgroup. Gender bias in resident assessment in graduate medical education: review of the literature. J Gen Intern Med 2019; 34 (05) 712-719
    CrossrefPubMedSearch in Google Scholar
  • 6 Applebaum MA, Doren EL, Ghanem AM, Myers SR, Harrington M, Smith DJ. Microsurgery competency during plastic surgery residency: an objective skills assessment of an integrated residency training program. Eplasty 2018; 18: e25
    PubMedSearch in Google Scholar
  • 7 McGoldrick RB, Davis CR, Paro J, Hui K, Nguyen D, Lee GK. Motion analysis for microsurgical training: objective measures of dexterity, economy of movement, and ability. Plast Reconstr Surg 2015; 136 (02) 231e-240e
    CrossrefPubMedSearch in Google Scholar
  • 8 Rajan S, Sathyan R, Sreelesh LS. et al. Objective assessment of microsurgery competency-in search of a validated tool. Indian J Plast Surg 2019; 52 (02) 216-221
    Thieme ConnectPubMedSearch in Google Scholar
  • 9 Ramachandran S, Ghanem AM, Myers SR. Assessment of microsurgery competency-where are we now?. Microsurgery 2013; 33 (05) 406-415
    CrossrefPubMedSearch in Google Scholar
  • 10 Klein R, Ufere NN, Rao SR. et al; Gender Equity in Medicine workgroup. Association of gender with learner assessment in graduate medical education. JAMA Netw Open 2020; 3 (07) e2010888
    CrossrefPubMedSearch in Google Scholar
  • 11 Anderson JE, Zern NK, Calhoun KE, Wood DE, Smith CA. Assessment of potential gender bias in general surgery resident milestone evaluations. JAMA Surg 2022; 157 (12) 1164-1166
    CrossrefPubMedSearch in Google Scholar
  • 12 Dayal A, O'Connor DM, Qadri U, Arora VM. Comparison of male vs female resident milestone evaluations by faculty during emergency medicine residency training. JAMA Intern Med 2017; 177 (05) 651-657
    CrossrefPubMedSearch in Google Scholar
  • 13 Gerull KM, Loe M, Seiler K, McAllister J, Salles A. Assessing gender bias in qualitative evaluations of surgical residents. Am J Surg 2019; 217 (02) 306-313
    CrossrefPubMedSearch in Google Scholar
  • 14 McQueen S, McKinnon V, VanderBeek L, McCarthy C, Sonnadara R. Video-based assessment in surgical education: a scoping review. J Surg Educ 2019; 76 (06) 1645-1654
    CrossrefPubMedSearch in Google Scholar
  • 15 Salles A, Awad M, Goldin L. et al. Estimating implicit and explicit gender bias among health care professionals and surgeons. JAMA Netw Open 2019; 2 (07) e196545
    CrossrefPubMedSearch in Google Scholar
  • 16 Phillips NA, Tannan SC, Kalliainen LK. Understanding and overcoming implicit gender bias in plastic surgery. Plast Reconstr Surg 2016; 138 (05) 1111-1116
    CrossrefPubMedSearch in Google Scholar
  • 17 Brienza RS, Huot S, Holmboe ES. Influence of gender on the evaluation of internal medicine residents. J Womens Health (Larchmt) 2004; 13 (01) 77-83
    CrossrefPubMedSearch in Google Scholar
  • 18 Holmboe ES, Huot SJ, Brienza RS, Hawkins RE. The association of faculty and residents' gender on faculty evaluations of internal medicine residents in 16 residencies. Acad Med 2009; 84 (03) 381-384
    CrossrefPubMedSearch in Google Scholar
  • 19 Ringdahl EN, Delzell JE, Kruse RL. Evaluation of interns by senior residents and faculty: is there any difference?. Med Educ 2004; 38 (06) 646-651
    CrossrefPubMedSearch in Google Scholar
  • 20 Ong TQ, Kopp JP, Jones AT, Malangoni MA. Is there gender bias on the American Board of Surgery General surgery certifying examination?. J Surg Res 2019; 237: 131-135
    CrossrefPubMedSearch in Google Scholar
  • 21 Kwasny L, Shebrain S, Munene G, Sawyer R. Is there a gender bias in milestones evaluations in general surgery residency training?. Am J Surg 2021; 221 (03) 505-508
    CrossrefPubMedSearch in Google Scholar
  • 22 Flyckt RL, White EE, Goodman LR, Mohr C, Dutta S, Zanotti KM. The use of laparoscopy simulation to explore gender differences in resident surgical confidence. Obstet Gynecol Int 2017; 2017: 1945801
    CrossrefPubMedSearch in Google Scholar
  • 23 Salles A, Mueller CM, Cohen GL. A values affirmation intervention to improve female residents' surgical performance. J Grad Med Educ 2016; 8 (03) 378-383
    CrossrefPubMedSearch in Google Scholar
  • 24 Salles A, Mueller CM, Cohen GL. Exploring the relationship between stereotype perception and residents' well-being. J Am Coll Surg 2016; 222 (01) 52-58
    CrossrefPubMedSearch in Google Scholar
  • 25 Hoops H, Heston A, Dewey E, Spight D, Brasel K, Kiraly L. Resident autonomy in the operating room: does gender matter?. Am J Surg 2019; 217 (02) 301-305
    CrossrefPubMedSearch in Google Scholar
  • 26 Joh DB, van der Werf B, Watson BJ. et al. Assessment of autonomy in operative procedures among female and male New Zealand general surgery trainees. JAMA Surg 2020; 155 (11) 1019-1026
    CrossrefPubMedSearch in Google Scholar
  • 27 Meyerson SL, Odell DD, Zwischenberger JB. et al; Procedural Learning and Safety Collaborative. The effect of gender on operative autonomy in general surgery residents. Surgery 2019; 166 (05) 738-743
    CrossrefPubMedSearch in Google Scholar
  • 28 Shellito AD, de Virgilio C, Lee G. et al; Surgery Educators Workgroup. Investigating association between sex and faculty teaching evaluation in general surgery residency programs: a multi-institutional study. J Am Coll Surg 2020; 231 (03) 309-315.e1
    CrossrefPubMedSearch in Google Scholar
  • 29 Lane SM, Young KA, Hayek SA. et al. Meaningful autonomy in general surgery training: exploring for gender bias. Am J Surg 2020; 219 (02) 240-244
    CrossrefPubMedSearch in Google Scholar
  • 30 Skjold-Ødegaard B, Ersdal HL, Assmus J, Soreide K. Comparison of performance score for female and male residents in general surgery doing supervised real-life laparoscopic appendectomy: is there a Norse Shield-maiden effect?. World J Surg 2021; 45 (04) 997-1005
    CrossrefPubMedSearch in Google Scholar
  • 31 Sudario-Lumague R, Chiang YC, Lin TS. Gender comparison of medical student microsurgical skills in a laboratory model. J Reconstr Microsurg 2018; 34 (05) 359-362
    Thieme ConnectPubMedSearch in Google Scholar
  • 32 Govaerts MJ, Schuwirth LW, Van der Vleuten CP, Muijtjens AM. Workplace-based assessment: effects of rater expertise. Adv Health Sci Educ Theory Pract 2011; 16 (02) 151-165
    CrossrefPubMedSearch in Google Scholar
  • 33 Yeates P, O'Neill P, Mann K, Eva KW. Effect of exposure to good vs poor medical trainee performance on attending physician ratings of subsequent performances. JAMA 2012; 308 (21) 2226-2232
    CrossrefPubMedSearch in Google Scholar
  • 34 Abelson JS, Chartrand G, Moo TA, Moore M, Yeo H. The climb to break the glass ceiling in surgery: trends in women progressing from medical school to surgical training and academic leadership from 1994 to 2015. Am J Surg 2016; 212 (04) 566-572.e1
    CrossrefPubMedSearch in Google Scholar
  • 35 Plana NM, Khouri KS, Motosko CC. et al. The evolving presence of women in academic plastic surgery: a study of the past 40 years. Plast Reconstr Surg 2018; 141 (05) 1304-1310
    CrossrefPubMedSearch in Google Scholar