Impact of 3-second rule for high confidence assignment on the performance of endoscopists for the real-time optical diagnosis of colorectal polyps

Abstract

Background Confusion between high and low confidence decisions in optical diagnosis hinders the implementation of real-time optical diagnosis in clinical practice. We evaluated the effect of a 3-second rule (decision time limited to 3 seconds for a high confidence assignment) in expert and nonexpert endoscopists.

Methods This single-center prospective study included eight board-certified gastroenterologists. A 2-month baseline phase used standard real-time optical diagnosis for colorectal polyps < 10 mm and was followed by a 6-month intervention phase using optical diagnosis with the 3-second rule. Performance, including high confidence accuracy, and Preservation and Incorporation of Valuable Endoscopic Innovations (PIVI) and Simple Optical Diagnosis Accuracy (SODA) thresholds, was measured.

Results Real-time optical diagnosis was performed on 1793 patients with 3694 polyps. There was significant improvement in high confidence accuracy between baseline and intervention phases in the nonexpert group (79.2 % vs. 86.3 %; P = 0.01) but not in the expert group (85.3 % vs. 87.5 %; P = 0.53). Using the 3-second rule improved the overall performance of PIVI and SODA in both groups.

Conclusions The 3-second rule was effective in improving real-time optical diagnosis performance, especially in nonexperts.

^‡ Co-first authors.

Publication History

Received: 19 October 2022

Accepted after revision: 05 April 2023

Article published online:
12 May 2023

• References

• 1 Rex DK, Kahi C, O’Brien M. et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2011; 73: 419-422
• 2 Houwen B, Hassan C, Coupé VMH. et al. Definition of competence standards for optical diagnosis of diminutive colorectal polyps: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement. Endoscopy 2022; 54: 88-99
• 3 Hassan C, Balsamo G, Lorenzetti R. et al. Artificial intelligence allows leaving-in-situ colorectal polyps. Clin Gastroenterol Hepatol 2022; 20: 2505-2513
• 4 Vleugels JLA, Hazewinkel Y, Dijkgraaf MGW. et al. Optical diagnosis expanded to small polyps: post-hoc analysis of diagnostic performance in a prospective multicenter study. Endoscopy 2019; 51: 244-252
• 5 Patel SG, Schoenfeld P, Kim HM. et al. Real-time characterization of diminutive colorectal polyp histology using narrow-band imaging: implications for the resect and discard strategy. Gastroenterology 2016; 150: 406-418
• 6 Kaltenbach T, Rastogi A, Rouse RV. et al. Real-time optical diagnosis for diminutive colorectal polyps using narrow-band imaging: the VALID randomised clinical trial. Gut 2015; 64: 1569-1577
• 7 McGill SK, Soetikno R, Rastogi A. et al. Endoscopists can sustain high performance for the optical diagnosis of colorectal polyps following standardized and continued training. Endoscopy 2015; 10: 200-206
• 8 Bae JH, Lee C, Kang HY. et al. Improved real-time optical diagnosis of colorectal polyps following a comprehensive training program. Clin Gastroenterol Hepatol 2019; 17: 2479-2488
• 9 Rees CJ, Rajasekhar PT, Wilson A. et al. Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: the Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) study. Gut 2017; 66: 887-895
• 10 Ladabaum U, Fioritto A, Mitani A. et al. Real-time optical biopsy of colon polyps with narrow band imaging in community practice does not yet meet key thresholds for clinical decisions. Gastroenterology 2013; 144: 81-91
• 11 IJspeert JEG, Bastiaansen BAJ, van Leerdam ME. et al. Development and validation of the WASP classification system for optical diagnosis of adenomas, hyperplastic polyps and sessile serrated adenomas/polyps. Gut 2016; 65: 963-970
• 12 Jin EH, Lee D, Bae JH. et al. Improved accuracy in optical diagnosis of colorectal polyps using convolutional neural networks with visual explanations. Gastroenterology 2020; 158: 2169-2179
• 13 Gupta S, Lieberman D, Anderson JC. et al. Recommendations for follow-up after colonoscopy and polypectomy: a consensus update by the US Multi-Society Task Force on Colorectal Cancer. Gastrointest Endosc 2020; 91: 463-485
• 14 Gupta N, Kaltenbach T, Sato T. et al. Diagnosis time determines the accuracy of optical diagnosis of diminutive polyp histology. Gastrointest Endosc 2013; 77: AB553-AB554
• 15 Subramaniam S, Hayee B, Aepli P. et al. Optical diagnosis of colorectal polyps with Blue Light Imaging using a new international classification. United European Gastroenterol J 2019; 7: 316-325
• 16 Smith SCL, Saltzman J, Shivaji UN. et al. Randomized controlled study of the prediction of diminutive/small colorectal polyp histology using didactic versus computer-based self-learning module in gastroenterology trainees. Dig Endosc 2019; 31: 535-543
• 17 Bang CS, Lee JJ, Baik GH. Computer-aided diagnosis of diminutive colorectal polyps in endoscopic images: systematic review and meta-analysis of diagnostic test accuracy. J Med Internet Res 2021; 23: e29682
• 18 Wanders LK, East JE, Uitentuis SE. et al. Diagnostic performance of narrowed spectrum endoscopy, autofluorescence imaging, and confocal laser endomicroscopy for optical diagnosis of colonic polyps: a meta-analysis. Lancet Oncol 2013; 14: 1337-1347
• 19 Hassan C, Pickhardt PJ, Rex DK. A resect and discard strategy would improve cost-effectiveness of colorectal cancer screening. Clin Gastroenterol Hepatol 2010; 8: 865-869
• 20 Vleugels JLA, Greuter MJE, Hazewinkel Y. et al. Implementation of an optical diagnosis strategy saves costs and does not impair clinical outcomes of a fecal immunochemical test-based colorectal cancer screening program. Endosc Int Open 2017; 5: e1197-e1207