Accuracy of convolutional neural network-based artificial intelligence in diagnosis of gastrointestinal lesions based on endoscopic images: A systematic review and meta-analysis

Abstract

Background and study aims Recently, a growing body of evidence has been amassed on evaluation of artificial intelligence (AI) known as deep learning in computer-aided diagnosis of gastrointestinal lesions by means of convolutional neural networks (CNN). We conducted this meta-analysis to study pooled rates of performance for CNN-based AI in diagnosis of gastrointestinal neoplasia from endoscopic images.

Methods Multiple databases were searched (from inception to November 2019) and studies that reported on the performance of AI by means of CNN in the diagnosis of gastrointestinal tumors were selected. A random effects model was used and pooled accuracy, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were calculated. Pooled rates were categorized based on the gastrointestinal location of lesion (esophagus, stomach and colorectum).

Results Nineteen studies were included in our final analysis. The pooled accuracy of CNN in esophageal neoplasia was 87.2 % (76–93.6) and NPV was 92.1 % (85.9–95.7); the accuracy in lesions of stomach was 85.8 % (79.8–90.3) and NPV was 92.1 % (85.9–95.7); and in colorectal neoplasia the accuracy was 89.9 % (82–94.7) and NPV was 94.3 % (86.4–97.7).

Conclusions Based on our meta-analysis, CNN-based AI achieved high accuracy in diagnosis of lesions in esophagus, stomach, and colorectum.

Publication History

Received: 22 April 2020

Accepted: 08 July 2020

Article published online:
22 October 2020

• References

• 1 Liu X, Faes L, Kale AU. et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digital Health 2019; 1: e271-e97
• 2 Byrne MF, Chapados N, Soudan F. et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2019; 68: 94-100
• 3 Krizhevsky A, Sutskever I, Hinton GE. Advances in neural information processing systems. Neural Information Processing Systems Foundation; 2012: 1269
• 4 Szegedy C, Vanhoucke V, Ioffe S. et al. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016
• 5 Wu L, Zhou W, Wan X. et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy 2019; 51: 522-531
• 6 Zhao YY, Xue DX, Wang YL. et al. Computer-assisted diagnosis of early esophageal squamous cell carcinoma using narrow-band imaging magnifying endoscopy. Endoscopy 2019; 51: 333-341
• 7 Stroup DF, Berlin JA, Morton SC. et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000; 283: 2008-2012
• 8 DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177-188
• 9 Higgins JP, Thompson SG, Deeks JJ. et al. Measuring inconsistency in meta-analyses. BMJ 2003; 327: 557
• 10 Mohan BP, Adler DG. Heterogeneity in systematic review and meta-analysis: how to read between the numbers. Gastrointest Endosc 2019; 89: 902-903
• 11 Ahmad OF, Brandao P, Sami SS. et al. Artificial intelligence for real-time polyp localisation in colonoscopy withdrawal videos. Gut 2019; 68: A2-A3
• 12 Cai SL, Li B, Tan WM. et al. Using a deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). Gastrointest Endosc 2019; 90: 745-53.e2
• 13 Chen PJ, Lin MC, Lai MJ. et al. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 2018; 154: 568-575
• 14 Cho BJ, Bang CS, Park SW. et al. Automated classification of gastric neoplasms in endoscopic images using a convolutional neural network. Endoscopy 2019; 23
• 15 Guo X, Zhang N, Guo J. et al. Automated polyp segmentation for colonoscopy images: A method based on convolutional neural networks and ensemble learning. Med Phys 2019; 46: 5666-5676
• 16 Hirasawa T, Aoyama K, Tanimoto T. et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 2018; 21: 653-660
• 17 Horie Y, Yoshio T, Aoyama K. et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc 2019; 89: 25-32
• 18 Horiuchi Y, Aoyama K, Tokai Y. et al. Convolutional neural network for differentiating gastric cancer from gastritis using magnified endoscopy with narrow band imaging. Digest Dis Sci 2020; 65: 1355-1363
• 19 Ikenoyama Y, Hirasawa T, Ishioka M. et al. 379 comparing artificial intelligence using deep learning through convolutional neural networks and endoscopist's diagnostic ability for detecting early gastric cancer. Gastrointest Endosc 2019; 89: AB75
• 20 Ito N, Kawahira H, Nakashima H. et al. Endoscopic diagnostic support system for cT1b colorectal cancer using deep learning. Oncology (Switzerland) 2018; 96: 44-50
• 21 Komeda Y, Handa H, Matsui R. et al. Computer-aided diagnosis based on convolutional neural network system using artificial intelligence for colorectal polyp classification. Gastrointest Endosc 2019; 89: AB631
• 22 Li L, Chen Y, Shen Z. et al. Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging images. Gastric Cancer 2020; 23: 126-132
• 23 Liu X, Wang C, Hu Y. et al. Transfer learning with convolutional neural network for early gastric cancer classification on magnifying narrow-band imaging images. 25th IEEE International Conference on Image Processing; 2018
• 24 Ozawa T, Ishihara S, Fujishiro M. et al. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Gastrointest Endosc 2018; 87: AB271
• 25 Sakai Y, Takemoto S, Hori K. et al. Automatic detection of early gastric cancer in endoscopic images using a transferring convolutional neural network. Annual International Conference of the IEEE Engineering in Medicine & Biology Society; 2018: 4138-4141
• 26 Zhang C, Ma L, Uedo N. et al. The use of convolutional neural artificial intelligence network to aid the diagnosis and classification of early esophageal neoplasia a feasibility study. Gastrointest Endosc 2017; 85: AB581-AB2
• 27 Puhan MA, Schunemann HJ, Murad MH. et al. A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ 2014; 349: g5630
• 28 Lui TK, Guo CG, Leung WK. Accuracy of artificial intelligence on histology prediction and detection of colorectal polyps: A systematic review and meta-analysis. Gastrointest Endosc 2020; 92: 11022.e6
• 29 Abu Dayyeh BK, Thosani N, Konda V. et al. ASGE Technology Committee systematic review and meta-analysis assessing the ASGE PIVI thresholds for adopting real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2015; 81: 502.e1-e16