Subscribe to RSS
DOI: 10.1055/s-0040-1722311
Objective Resident Characteristics Associated with Performance on the Ophthalmic Knowledge Assessment Program Examination
Abstract
Background To determine objective resident characteristics that correlate with Ophthalmic Knowledge Assessment Program (OKAP) performance, as well as to correlate OKAP performance with Accreditation Council for Graduate Medical Education (ACGME) milestone assessments, written qualifying examination (WQE) scores, and oral board pass rates.
Methods Review of administrative records at an ACGME-accredited ophthalmology residency training program at an urban, tertiary academic medical center.
Results The study included data from a total of 50 resident physicians who completed training from 2012 to 2018. Mean (standard deviation) OKAP percentile performance was 60.90 (27.51), 60.46 (28.12), and 60.55 (27.43) for Years 1, 2, and 3 examinations, respectively. There were no statistically significant differences based on sex, marital status, having children, MD/PhD degree, other additional degree, number of publications, number of first author publications, or grades on medical school medicine and surgery rotations. OKAP percentile scores were significantly associated with United States Medical Licensing Examination (USMLE) Step 1 scores (linear regression coefficient 0.88 [0.54–1.18], p = 0.008). Finally, continuous OKAP scores were significantly correlated with WQE (r s = 0.292, p = 0.049) and oral board (r s = 0.49, p = 0.001) scores.
Conclusion Higher OKAP performance is correlated with passage of both WQE and oral board examinations during the first attempt. USMLE Step 1 score is the preresidency academic factor with the strongest association with success on the OKAP examination. Programs can utilize this information to identify those who may benefit from additional OKAP, WQE, and oral board preparation assistance.
Keywords
OKAP - Ophthalmic Knowledge Assessment Program - oral board examination - Accreditation Council for Graduate Medical Education - ACGME - ACGME milestones - ophthalmology residency - graduate medical education - United States Medical Licensing Examination - USMLE - ABO-WQE - written qualifying examinationPublication History
Received: 05 July 2020
Accepted: 18 November 2020
Article published online:
24 March 2021
© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Thieme Medical Publishers, Inc.
333 Seventh Avenue, 18th Floor, New York, NY 10001, USA
-
References
- 1 Richardson DP, Porter GA, Johnson PM. Surgeon knowledge contributes to the relationship between surgeon volume and patient outcomes in rectal cancer. Ann Surg 2013; 257 (02) 295-301
- 2 Tamblyn R, Abrahamowicz M, Brailovsky C. et al. Association between licensing examination scores and resource use and quality of care in primary care practice. JAMA 1998; 280 (11) 989-996
- 3 Tamblyn R, Abrahamowicz M, Dauphinee WD. et al. Association between licensure examination scores and practice in primary care. JAMA 2002; 288 (23) 3019-3026
- 4 Holmboe ES, Edgar L, Hamstra S. The Milestones Guidebook. 2016 . Accessed March 18, 2020 at: https://www.acgme.org/Portals/0/MilestonesGuidebook.pdf?ver=2016-05-31-113245-103
- 5 Epstein RM. Assessment in medical education. N Engl J Med 2007; 356 (04) 387-396
- 6 American Academy of Ophthalmology. OKAP Exam. 2020 . Accessed March 18, 2020 at: https://www.aao.org/okap-exam
- 7 Hamming NA, Kline LB, Keltner JC, Orcutt JC, Farber MJ. History of the American Board of Ophthalmology Oral Examination. Ophthalmology 2016; 123 (9, Suppl): S20-S24
- 8 Zafar S, Wang X, Srikumaran D. et al. Resident and program characteristics that impact performance on the Ophthalmic Knowledge Assessment Program (OKAP). BMC Med Educ 2019; 19 (01) 190
- 9 Singman EL, Boland MV, Tian J, Green LK, Srikumaran D. Writing Committee of the Ophthalmology Program Directors' Study Group (OPDSG). Supervision and autonomy of ophthalmology residents in the outpatient clinic in the United States II: a survey of senior residents. BMC Med Educ 2019; 19 (01) 202
- 10 Lee AG, Oetting TA, Blomquist PH. et al. A multicenter analysis of the Ophthalmic Knowledge Assessment Program and American Board of Ophthalmology written qualifying examination performance. Ophthalmology 2012; 119 (10) 1949-1953
- 11 Johnson GA, Bloom JN, Szczotka-Flynn L, Zauner D, Tomsak RL. A comparative study of resident performance on standardized training examinations and the American Board of Ophthalmology written examination. Ophthalmology 2010; 117 (12) 2435-2439
- 12 Chen PP, Bhandari A. Resident performance on the Ophthalmic Knowledge Assessment Program and the written qualifying examination for board certification. J Acad Ophthalmol. 2010; 3 (01) 11-14
-
13
Ophthalmology Times.
Bascom Palmer tops in annual program survey. October 4, 2019. Accessed August 11, 2020 at: https://www.ophthalmologytimes.com/view/bascom-palmer-tops-annual-program-survey
- 14 American Board of Ophthalmology. Oral Examination. 2020 . Accessed June 2, 2020 at: https://abop.org/become-certified/oral-exam/
- 15 Kay C, Jackson JL, Frank M. The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination. Acad Med 2015; 90 (01) 100-104
- 16 Sutton E, Richardson JD, Ziegler C, Bond J, Burke-Poole M, McMasters KM. Is USMLE Step 1 score a valid predictor of success in surgical residency?. Am J Surg 2014; 208 (06) 1029-1034 , discussion 1034
-
17
United States Medical Licensing Examination.
“Change to pass/fail score reporting for Step 1. Accessed April 2, 2020 at: https://www.usmle.org/inCus/
- 18 Chaudhry HJ, Katsufrakis PJ, Tallia AF. The USMLE Step 1 decision: an opportunity for medical education and training. JAMA 2020; 323 (20) 2017-2018
- 19 Grubbs Jr JR, Mian SI. Advising students interested in ophthalmology: a summary of the evidence. Ophthalmology 2016; 123 (07) 1406-1410
- 20 Brownstein MR, Shen MR, Strassle PD, Meyers MO. Variation of surgery clerkship grades in US medical schools. Am J Surg 2019; 217 (02) 329-334
- 21 Westerman ME, Boe C, Bole R. et al. Evaluation of medical school grading variability in the United States: are all honors the same?. Acad Med 2019; 94 (12) 1939-1945
- 22 Schilling DC. Using the clerkship shelf exam score as a qualification for an overall clerkship grade of honors: a valid practice or unfair to students?. Acad Med 2019; 94 (03) 328-332
- 23 American Academy of Ophthalmology. OKAP User's Guide. 2020 . Accessed August 11, 2020 at: https://www.aao.org/Assets/d2fea240-4856-4025-92bb-52162866f5c3/637278171985530000/user-guide-2020-pdf
- 24 Association of University Professors of Ophthalmology. Ophthalmology Residency Match Summary Report. 2020 . Accessed March 23, 2020 at: https://sfmatch.org/PDFFilesDisplay/Ophthalmology_Residency_Stats_2020.pdf
-
25
American Board of Ophthalmology.
Certification Statistics. Accessed August 11, 2020 at: https://abop.org/about/certification-statistics/
- 26 American Board of Ophthalmology. 1.5 Scoring Procedures. In: American Board of Ophthalmology Virtual Online Exam 2020 Candidate Procedures Manual. 2020 . Accessed June 2, 2020 at: https://www.manula.com/manuals/american-board-of-ophthal/abo-voe20-candidate-procedures-manual/1/en/topic/scoring-procedures
- 27 American Board of Ophthalmology. Written Qualifying Examination. In: Become Certified. 2020 . Accessed June 2, 2020 at: https://abop.org/become-certified/written-qualifying-exam/