Download PDF
CC BY-NC-ND 4.0 · Endosc Int Open 2020; 08(11): E1584-E1594
DOI: 10.1055/a-1236-3007
Original article

Accuracy of convolutional neural network-based artificial intelligence in diagnosis of gastrointestinal lesions based on endoscopic images: A systematic review and meta-analysis

Babu P. Mohan
1   Gastroenterology & Hepatology, University of Utah Health, Salt Lake City, Utah, United States
,
Shahab R. Khan
2   Gastroenterology, Rush University Medical Center, Chicago, Illinois, United States
,
Lena L. Kassab
3   Internal Medicine, Mayo Clinic, Rochester, Minnesota, United States
,
Suresh Ponnada
4   Internal Medicine, Roanoke Medical Center, Roanoke, Virginia, United States
,
Parambir S. Dulai
5   Gastroenterology and Hepatology, University of California, San Diego, California, United States
,
Gursimran S. Kochhar
6   Division of Gastroenterology and Hepatology, Allegheny Health Network, Pittsburgh, Pennsylvania, United States
› Author Affiliations
› Further Information
Also available at
   Permissions and Reprints

Abstract

Background and study aims Recently, a growing body of evidence has been amassed on evaluation of artificial intelligence (AI) known as deep learning in computer-aided diagnosis of gastrointestinal lesions by means of convolutional neural networks (CNN). We conducted this meta-analysis to study pooled rates of performance for CNN-based AI in diagnosis of gastrointestinal neoplasia from endoscopic images.

Methods Multiple databases were searched (from inception to November 2019) and studies that reported on the performance of AI by means of CNN in the diagnosis of gastrointestinal tumors were selected. A random effects model was used and pooled accuracy, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were calculated. Pooled rates were categorized based on the gastrointestinal location of lesion (esophagus, stomach and colorectum).

Results Nineteen studies were included in our final analysis. The pooled accuracy of CNN in esophageal neoplasia was 87.2 % (76–93.6) and NPV was 92.1 % (85.9–95.7); the accuracy in lesions of stomach was 85.8 % (79.8–90.3) and NPV was 92.1 % (85.9–95.7); and in colorectal neoplasia the accuracy was 89.9 % (82–94.7) and NPV was 94.3 % (86.4–97.7).

Conclusions Based on our meta-analysis, CNN-based AI achieved high accuracy in diagnosis of lesions in esophagus, stomach, and colorectum.

Supplementary material



Publication History

Received: 22 April 2020

Accepted: 08 July 2020

Article published online:
22 October 2020

© 2020. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commecial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Liu X, Faes L, Kale AU. et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digital Health 2019; 1: e271-e97
    CrossrefPubMedGoogle Scholar
  • 2 Byrne MF, Chapados N, Soudan F. et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2019; 68: 94-100
    CrossrefPubMedGoogle Scholar
  • 3 Krizhevsky A, Sutskever I, Hinton GE. Advances in neural information processing systems. Neural Information Processing Systems Foundation; 2012: 1269
    PubMedGoogle Scholar
  • 4 Szegedy C, Vanhoucke V, Ioffe S. et al. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016 DOI: 10.1109/CVPR.1997.609286
    CrossrefPubMedGoogle Scholar
  • 5 Wu L, Zhou W, Wan X. et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy 2019; 51: 522-531
    Article in Thieme ConnectPubMedGoogle Scholar
  • 6 Zhao YY, Xue DX, Wang YL. et al. Computer-assisted diagnosis of early esophageal squamous cell carcinoma using narrow-band imaging magnifying endoscopy. Endoscopy 2019; 51: 333-341
    Article in Thieme ConnectPubMedGoogle Scholar
  • 7 Stroup DF, Berlin JA, Morton SC. et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000; 283: 2008-2012
    Google Scholar
  • 8 DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7: 177-188
    CrossrefPubMedGoogle Scholar
  • 9 Higgins JP, Thompson SG, Deeks JJ. et al. Measuring inconsistency in meta-analyses. BMJ 2003; 327: 557
    Google Scholar
  • 10 Mohan BP, Adler DG. Heterogeneity in systematic review and meta-analysis: how to read between the numbers. Gastrointest Endosc 2019; 89: 902-903
    CrossrefPubMedGoogle Scholar
  • 11 Ahmad OF, Brandao P, Sami SS. et al. Artificial intelligence for real-time polyp localisation in colonoscopy withdrawal videos. Gut 2019; 68: A2-A3
    PubMedGoogle Scholar
  • 12 Cai SL, Li B, Tan WM. et al. Using a deep learning system in endoscopy for screening of early esophageal squamous cell carcinoma (with video). Gastrointest Endosc 2019; 90: 745-53.e2
    CrossrefPubMedGoogle Scholar
  • 13 Chen PJ, Lin MC, Lai MJ. et al. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 2018; 154: 568-575
    CrossrefPubMedGoogle Scholar
  • 14 Cho BJ, Bang CS, Park SW. et al. Automated classification of gastric neoplasms in endoscopic images using a convolutional neural network. Endoscopy 2019; 23
    PubMedGoogle Scholar
  • 15 Guo X, Zhang N, Guo J. et al. Automated polyp segmentation for colonoscopy images: A method based on convolutional neural networks and ensemble learning. Med Phys 2019; 46: 5666-5676
    CrossrefPubMedGoogle Scholar
  • 16 Hirasawa T, Aoyama K, Tanimoto T. et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 2018; 21: 653-660
    CrossrefPubMedGoogle Scholar
  • 17 Horie Y, Yoshio T, Aoyama K. et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc 2019; 89: 25-32
    CrossrefPubMedGoogle Scholar
  • 18 Horiuchi Y, Aoyama K, Tokai Y. et al. Convolutional neural network for differentiating gastric cancer from gastritis using magnified endoscopy with narrow band imaging. Digest Dis Sci 2020; 65: 1355-1363
    CrossrefPubMedGoogle Scholar
  • 19 Ikenoyama Y, Hirasawa T, Ishioka M. et al. 379 comparing artificial intelligence using deep learning through convolutional neural networks and endoscopist's diagnostic ability for detecting early gastric cancer. Gastrointest Endosc 2019; 89: AB75
    CrossrefPubMedGoogle Scholar
  • 20 Ito N, Kawahira H, Nakashima H. et al. Endoscopic diagnostic support system for cT1b colorectal cancer using deep learning. Oncology (Switzerland) 2018; 96: 44-50
    CrossrefPubMedGoogle Scholar
  • 21 Komeda Y, Handa H, Matsui R. et al. Computer-aided diagnosis based on convolutional neural network system using artificial intelligence for colorectal polyp classification. Gastrointest Endosc 2019; 89: AB631
    CrossrefPubMedGoogle Scholar
  • 22 Li L, Chen Y, Shen Z. et al. Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging images. Gastric Cancer 2020; 23: 126-132
    CrossrefPubMedGoogle Scholar
  • 23 Liu X, Wang C, Hu Y. et al. Transfer learning with convolutional neural network for early gastric cancer classification on magnifying narrow-band imaging images. 25th IEEE International Conference on Image Processing; 2018 DOI: 10.1109/ICIP.2018.8451067
    CrossrefPubMedGoogle Scholar
  • 24 Ozawa T, Ishihara S, Fujishiro M. et al. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Gastrointest Endosc 2018; 87: AB271
    CrossrefPubMedGoogle Scholar
  • 25 Sakai Y, Takemoto S, Hori K. et al. Automatic detection of early gastric cancer in endoscopic images using a transferring convolutional neural network. Annual International Conference of the IEEE Engineering in Medicine & Biology Society; 2018: 4138-4141
    PubMedGoogle Scholar
  • 26 Zhang C, Ma L, Uedo N. et al. The use of convolutional neural artificial intelligence network to aid the diagnosis and classification of early esophageal neoplasia a feasibility study. Gastrointest Endosc 2017; 85: AB581-AB2
    CrossrefPubMedGoogle Scholar
  • 27 Puhan MA, Schunemann HJ, Murad MH. et al. A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ 2014; 349: g5630
    CrossrefPubMedGoogle Scholar
  • 28 Lui TK, Guo CG, Leung WK. Accuracy of artificial intelligence on histology prediction and detection of colorectal polyps: A systematic review and meta-analysis. Gastrointest Endosc 2020; 92: 11022.e6
    PubMedGoogle Scholar
  • 29 Abu Dayyeh BK, Thosani N, Konda V. et al. ASGE Technology Committee systematic review and meta-analysis assessing the ASGE PIVI thresholds for adopting real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2015; 81: 502.e1-e16
    CrossrefPubMedGoogle Scholar