Automated classification of gastric neoplasms in endoscopic images using a convolutional neural network

Abstract

Background Visual inspection, lesion detection, and differentiation between malignant and benign features are key aspects of an endoscopist’s role. The use of machine learning for the recognition and differentiation of images has been increasingly adopted in clinical practice. This study aimed to establish convolutional neural network (CNN) models to automatically classify gastric neoplasms based on endoscopic images.

Methods Endoscopic white-light images of pathologically confirmed gastric lesions were collected and classified into five categories: advanced gastric cancer, early gastric cancer, high grade dysplasia, low grade dysplasia, and non-neoplasm. Three pretrained CNN models were fine-tuned using a training dataset. The classifying performance of the models was evaluated using a test dataset and a prospective validation dataset.

Results A total of 5017 images were collected from 1269 patients, among which 812 images from 212 patients were used as the test dataset. An additional 200 images from 200 patients were collected and used for prospective validation. For the five-category classification, the weighted average accuracy of the Inception-Resnet-v2 model reached 84.6 %. The mean area under the curve (AUC) of the model for differentiating gastric cancer and neoplasm was 0.877 and 0.927, respectively. In prospective validation, the Inception-Resnet-v2 model showed lower performance compared with the endoscopist with the best performance (five-category accuracy 76.4 % vs. 87.6 %; cancer 76.0 % vs. 97.5 %; neoplasm 73.5 % vs. 96.5 %; P  < 0.001). However, there was no statistical difference between the Inception-Resnet-v2 model and the endoscopist with the worst performance in the differentiation of gastric cancer (accuracy 76.0 % vs. 82.0 %) and neoplasm (AUC 0.776 vs. 0.865).

Conclusion The evaluated deep-learning models have the potential for clinical application in classifying gastric cancer or neoplasm on endoscopic white-light images.

• References

• 1 World Health Organization Fact Sheets on Cancer. Available from: http://www.who.int/mediacentre/factsheets/fs297/en Accessed: 13 August 2018
• 2 de Vries AC, van Grieken NC, Looman CW. et al. Gastric cancer risk in patients with premalignant gastric lesions: a nationwide cohort study in the Netherlands. Gastroenterology 2008; 134: 945-952
• 3 Jun JK, Choi KS, Lee HY. et al. Effectiveness of the Korean National Cancer Screening Program in reducing gastric cancer mortality. Gastroenterology 2017; 152: 1319-1328
• 4 Bang CS, Baik GH, Shin IS. et al. Endoscopic submucosal dissection for early gastric cancer with undifferentiated-type histology: a meta-analysis. World J Gastroenterol 2015; 21: 6032-6043
• 5 Bang CS, Baik GH, Kim JH. et al. Effect of training in upper endoscopic biopsy. Korean J Helicobacter Up Gastrointest Res 2015; 15: 33-38
• 6 Park JM, Huo SM, Lee HH. et al. Longer observation time increases proportion of neoplasms detected by esophagogastroduodenoscopy. Gastroenterology 2017; 153: 460-469
• 7 Muguruma N, Miyamoto H, Okahisa T. et al. Endoscopic molecular imaging: status and future perspective. Clin Endosc 2013; 46: 603
• 8 Cotton PB, Barkun A, Ginsberg G. et al. Diagnostic endoscopy: 2020 vision. Gastrointest Endosc 2006; 64: 395-398
• 9 Cohen J, Safdi MA, Deal SE. et al. Quality indicators for esophagogastroduodenoscopy. Am J Gastroenterol 2006; 101: 886-891
• 10 Hirasawa T, Aoyama K, Tanimoto T. et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 2018; 21: 653-660
• 11 Itoh T, Kawahira H, Nakashima H. et al. Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images. Endosc Int Open 2018; 6: E139-E144
• 12 Chen PJ, Lin MC, Lai MJ. et al. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 2018; 154: 568-575
• 13 Komeda Y, Handa H, Watanabe T. et al. Computer-aided diagnosis based on convolutional neural network system for colorectal polyp classification: preliminary experience. Oncology 2017; 93 (Suppl. 01) 30-34
• 14 Jisu H, Bo-Yong P, Hyunjin P. Convolutional neural network classifier for distinguishing Barrett’s esophagus and neoplasia endomicroscopy images. Conf Proc IEEE Eng Med Biol Soc 2017; 2017: 2892-2895
• 15 DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988; 44: 837-845
• 16 Anderson MA, Ben-Menachem T, Gan SI. et al. Management of antithrombotic agents for endoscopic procedures. Gastrointest Endosc 2009; 70: 1060-1070
• 17 Stolte M. The new Vienna classification of epithelial neoplasia of the gastrointestinal tract: advantages and disadvantages. Virchows Arch 2003; 442: 99-106