Subscribe to RSS
DOI: 10.1055/a-2034-3803
Artificial intelligence for diagnosing neoplasia on digital cholangioscopy: development and multicenter validation of a convolutional neural network model
Trial Registration: ClinicalTrials.gov Registration number (trial ID): NCT05147389 Type of study: Prospective, Multi-Center Study
Abstract
Background We aimed to develop a convolutional neural network (CNN) model for detecting neoplastic lesions during real-time digital single-operator cholangioscopy (DSOC) and to clinically validate the model through comparisons with DSOC expert and nonexpert endoscopists.
Methods In this two-stage study, we first developed and validated CNN1. Then, we performed a multicenter diagnostic trial to compare four DSOC experts and nonexperts against an improved model (CNN2). Lesions were classified into neoplastic and non-neoplastic in accordance with Carlos Robles-Medranda (CRM) and Mendoza disaggregated criteria. The final diagnosis of neoplasia was based on histopathology and 12-month follow-up outcomes.
Results In stage I, CNN2 achieved a mean average precision of 0.88, an intersection over the union value of 83.24 %, and a total loss of 0.0975. For clinical validation, a total of 170 videos from newly included patients were analyzed with the CNN2. Half of cases (50 %) had neoplastic lesions. This model achieved significant accuracy values for neoplastic diagnosis, with a 90.5 % sensitivity, 68.2 % specificity, and 74.0 % and 87.8 % positive and negative predictive values, respectively. The CNN2 model outperformed nonexpert #2 (area under the receiver operating characteristic curve [AUC]-CRM 0.657 vs. AUC-CNN2 0.794, P < 0.05; AUC-Mendoza 0.582 vs. AUC-CNN2 0.794, P < 0.05), nonexpert #4 (AUC-CRM 0.683 vs. AUC-CNN2 0.791, P < 0.05), and expert #4 (AUC-CRM 0.755 vs. AUC-CNN2 0.848, P < 0.05; AUC-Mendoza 0.753 vs. AUC-CNN2 0.848, P < 0.05).
Conclusions The proposed CNN model distinguished neoplastic bile duct lesions with good accuracy and outperformed two nonexpert and one expert endoscopist.
Publication History
Received: 10 June 2022
Accepted after revision: 13 February 2023
Accepted Manuscript online:
13 February 2023
Article published online:
18 April 2023
© 2023. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Navaneethan U, Njei B, Lourdusamy V. et al. Comparative effectiveness of biliary brush cytology and intraductal biopsy for detection of malignant biliary strictures: a systematic review and meta-analysis. Gastrointest Endosc 2015; 81: 168-176
- 2 Yoon WJ, Brugge WR. Endoscopic evaluation of bile duct strictures. Gastrointest Endosc Clin N Am 2013; 23: 277-293
- 3 Robles-Medranda C, Oleas R, Sánchez-Carriel M. et al. Vascularity can distinguish neoplastic from non-neoplastic bile duct lesions during digital single-operator cholangioscopy. Gastrointest Endosc 2021; 93: 935-941
- 4 Chung HG, Chang JI, Lee KH. et al. Comparison of EUS and ERCP-guided tissue sampling in suspected biliary stricture. PLoS One 2021; 16: 1-12
- 5 Robles-Medranda C, Valero M, Soria-Alcivar M. et al. Reliability and accuracy of a novel classification system using peroral cholangioscopy for the diagnosis of bile duct lesions. Endoscopy 2018; 50: 1059-1070
- 6 Gerges C, Beyna T, Tang RSY. et al. Digital single-operator peroral cholangioscopy-guided biopsy sampling versus ERCP-guided brushing for indeterminate biliary strictures: a prospective, randomized, multicenter trial (with video). Gastrointest Endosc 2020; 91: 1105-1013
- 7 Fukuda Y, Tsuyuguchi T, Sakai Y. et al. Diagnostic utility of peroral cholangioscopy for various bile-duct lesions. Gastrointest Endosc 2005; 62: 374-382
- 8 Kahaleh M, Gaidhane M, Shahid HM. et al. Digital single-operator cholangioscopy interobserver study using a new classification: the Mendoza Classification (with video). Gastrointest Endosc 2022; 95: 319-326
- 9 de Oliveira PVAG, de Moura DTH, Ribeiro IB. et al. Efficacy of digital single-operator cholangioscopy in the visual interpretation of indeterminate biliary strictures: a systematic review and meta-analysis. Surg Endosc 2020; 34: 3321-3329
- 10 Sethi A, Tyberg A, Slivka A. et al. Digital single-operator cholangioscopy (DSOC) improves interobserver agreement (IOA) and accuracy for evaluation of indeterminate biliary strictures: the Monaco Classification. J Clin Gastroenterol 2022; 56: e94-e97
- 11 Kahaleh M, Raijman I, Gaidhane M. et al. Digital cholangioscopic interpretation: when North meets the South. Dig Dis Sci 2021; 67: 1345-1351
- 12 Sarvamangala DR, Kulkarni Raghavendra V. Convolutional neural networks in medical image understanding: a survey. Evol Intell 2022; 15: 1-22
- 13 Chan HP, Samala RK, Hadjiiski LM. et al. Deep learning in medical image analysis. Adv Exp Med Biol 2020; 1213: 3-21
- 14 le Berre C, Sandborn WJ, Aridhi S. et al. Application of artificial intelligence to gastroenterology and hepatology. Gastroenterology 2020; 158: 76-94
- 15 Pereira P, Mascarenhas M, Ribeiro T. et al. Automatic detection of tumor vessels in indeterminate biliary strictures in digital single-operator cholangioscopy. Endosc Int Open 2022; 10: E262-268
- 16 Saraiva MM, Ribeiro T, Ferreira JPS. et al. Artificial intelligence for automatic diagnosis of biliary stricture malignancy status in single-operator cholangioscopy: a pilot study. Gastrointest Endosc 2022; 95: 339-348
- 17 Kohl M. CRAN package MKmisc. Accessed 18 April 2022. https://cran.r-project.org/web/packages/MKmisc/index.html
- 18 Shah RJ, Raijman I, Brauer B. et al. Performance of a fully disposable, digital, single-operator cholangiopancreatoscope. Endoscopy 2017; 49: 651-658