CC BY-NC-ND 4.0 · Endosc Int Open 2024; 12(11): E1260-E1266
DOI: 10.1055/a-2401-6611
Original article

Differences in regions of interest to identify deeply invasive colorectal cancers: Computer-aided diagnosis vs expert endoscopists

Yuki Nakajima
1   Department of Gastroenterology, Aizu Medical Center, Fukushima Medical University, Aizuwakamatsu, Japan (Ringgold ID: RIN38219)
,
Daiki Nemoto
2   Department of Coloproctology, Aizu Medical Center, Fukushima Medical University, Aizuwakamatsu, Japan (Ringgold ID: RIN38219)
,
Zhe Guo
3   Biomedical Information Engineering Lab, The University of Aizu, Aizuwakamatsu, Japan (Ringgold ID: RIN13132)
,
Peng Boyuan
3   Biomedical Information Engineering Lab, The University of Aizu, Aizuwakamatsu, Japan (Ringgold ID: RIN13132)
,
Zhang Ruiyao
3   Biomedical Information Engineering Lab, The University of Aizu, Aizuwakamatsu, Japan (Ringgold ID: RIN13132)
,
Shinichi Katsuki
4   Department of Gastroenterology, Otaru Ekisaikai Hospital, Otaru, Japan
,
Takahito Takezawa
5   Department of Medicine, Division of Gastroenterology, Jichi Medical University, Shimotsuke, Japan (Ringgold ID: RIN12838)
,
Ryo Maemoto
6   Department of Surgery, Saitama Medical Center, Jichi Medical University, Saitama, Japan (Ringgold ID: RIN26312)
,
Keisuke Kawasaki
7   Department of Gastroenterology, Iwate Medical University, Morioka, Japan (Ringgold ID: RIN12833)
,
Ken Inoue
8   Department of Molecular Gastroenterology and Hepatology, Kyoto Prefectural University of Medicine, Kyoto, Japan (Ringgold ID: RIN12898)
,
Takashi Akutagawa
9   Division of Gastroenterology, Department of Internal Medicine, Faculty of Medicine, Saga University, Saga, Japan (Ringgold ID: RIN38309)
,
Hirohito Tanaka
10   Department of Gastroenterology and Hepatology, Gunma University Graduate School of Medicine, Maebashi, Japan (Ringgold ID: RIN38357)
,
Koichiro Sato
11   Department of Clinical Laboratory and Endoscopy, Tokyo Women's Medical University Medical Center East, Tokyo, Japan (Ringgold ID: RIN163613)
,
12   Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan (Ringgold ID: RIN13131)
,
5   Department of Medicine, Division of Gastroenterology, Jichi Medical University, Shimotsuke, Japan (Ringgold ID: RIN12838)
,
Yasuyuki Miyakura
6   Department of Surgery, Saitama Medical Center, Jichi Medical University, Saitama, Japan (Ringgold ID: RIN26312)
,
Takayuki Matsumoto
7   Department of Gastroenterology, Iwate Medical University, Morioka, Japan (Ringgold ID: RIN12833)
,
8   Department of Molecular Gastroenterology and Hepatology, Kyoto Prefectural University of Medicine, Kyoto, Japan (Ringgold ID: RIN12898)
,
Motohiro Esaki
9   Division of Gastroenterology, Department of Internal Medicine, Faculty of Medicine, Saga University, Saga, Japan (Ringgold ID: RIN38309)
,
10   Department of Gastroenterology and Hepatology, Gunma University Graduate School of Medicine, Maebashi, Japan (Ringgold ID: RIN38357)
,
Hiroyuki Kato
11   Department of Clinical Laboratory and Endoscopy, Tokyo Women's Medical University Medical Center East, Tokyo, Japan (Ringgold ID: RIN163613)
,
Yuji Inoue
12   Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan (Ringgold ID: RIN13131)
,
5   Department of Medicine, Division of Gastroenterology, Jichi Medical University, Shimotsuke, Japan (Ringgold ID: RIN12838)
,
Xin Zhu
3   Biomedical Information Engineering Lab, The University of Aizu, Aizuwakamatsu, Japan (Ringgold ID: RIN13132)
,
2   Department of Coloproctology, Aizu Medical Center, Fukushima Medical University, Aizuwakamatsu, Japan (Ringgold ID: RIN38219)
› Author Affiliations

Abstract

Background and study aims Diagnostic performance of a computer-aided diagnosis (CAD) system for deep submucosally invasive (T1b) colorectal cancer was excellent, but the “regions of interest” (ROI) within images are not obvious. Class activation mapping (CAM) enables identification of the ROI that CAD utilizes for diagnosis. The purpose of this study was a quantitative investigation of the difference between CAD and endoscopists.

Patients and methods Endoscopic images collected for validation of a previous study were used, including histologically proven T1b colorectal cancers (n = 82; morphology: flat 36, polypoid 46; median maximum diameter 20 mm, interquartile range 15–25 mm; histological subtype: papillary 5, well 51, moderate 24, poor 2; location: proximal colon 26, distal colon 27, rectum 29). Application of CAM was limited to one white light endoscopic image (per lesion) to demonstrate findings of T1b cancers. The CAM images were generated from the weights of the previously fine-tuned ResNet50. Two expert endoscopists depicted the ROI in identical images. Concordance of the ROI was rated by intersection over union (IoU) analysis.

Results Pixel counts of ROIs were significantly lower using 165K[x103] [108K-227K] than by endoscopists (300K [208K-440K]; P < 0.0001) and median [interquartile] of the IoU was 0.198 [0.024-0.349]. IoU was significantly higher in correctly identified lesions (n = 54, 0.213 [0.116-0.364]) than incorrect ones (n=28, 0.070 [0.000-0.2750, P= 0.033).

Concusions IoU was larger in correctly diagnosed T1b colorectal cancers. Optimal annotation of the ROI may be the key to improving diagnostic sensitivity of CAD for T1b colorectal cancers.

Supplementary Material



Publication History

Received: 09 January 2024

Accepted after revision: 23 August 2024

Accepted Manuscript online:
04 September 2024

Article published online:
07 November 2024

© 2024. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).

Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany

 
  • References

  • 1 Japanese Society for Cancer of the Colon and Rectum. Japanese Classification of Colorectal, Appendiceal, and Anal Carcinoma: the 3d English Edition Secondary Publication. J Anus Rectum Colon 2019; 3: 175-195
  • 2 Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T. et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy 2015; 47: 829-854
  • 3 Draganov P, Wang A, Othman M. et al. AGA Institute clinical practice update: endoscopic submucosal dissection in the United States. Clin Gastroenterol Hepatol 2019; 17: 16-25
  • 4 Saitoh Y, Obara T, Watari J. et al. Invasion depth diagnosis of depressed type early colorectal cancers by combined use of videoendoscopy and chromoendoscopy. Gastrointest Endosc 1998; 48: 362-370
  • 5 Horie H, Togashi K, Kawamura YJ. et al. Colonoscopic stigmata of 1mm or deeper submucosal invasion in colorectal cancer. Dis Colon Rectum 2008; 51: 1529-1534
  • 6 Matsuda T, Fujii T, Saito Y. et al. Efficacy of the invasive/non-invasive pattern by magnifying chromoendoscopy to estimate the depth of invasion of early colorectal neoplasms. Am J Gastroenterol 2008; 103: 2700-2706
  • 7 Mukae M, Kobayashi K, Sada M. et al. Diagnostic performance of EUS for evaluating the invasion depth of early colorectal cancers. Gastrointest Endosc 2015; 81: 682-690
  • 8 Backes Y, Schwartz MP, Ter Borg F. et al. Multicentre prospective evaluation of real-time optical diagnosis of T1 colorectal cancer in large non-pedunculated colorectal polyps using narrow band imaging (the OPTICAL study). Gut 2019; 68: 271-279
  • 9 Puig I, López-Cerón M, Arnau A. et al. Accuracy of the narrow-band imaging international colorectal endoscopic classification system in identification of deep invasion in colorectal polyps. Gastroenterology 2019; 156: 75-87
  • 10 Takeda K, Kudo SE, Mori Y. et al. Accuracy of diagnosing invasive colorectal cancer using computer-aided endocytoscopy. Endoscopy 2017; 49: 798-802
  • 11 Ito N, Kawahira H, Nakashima H. et al. Endoscopic diagnostic support system for cT1b colorectal cancer using deep learning. Oncology 2019; 96: 44-50
  • 12 Lui TKL, Wong KKY, Mak LLY. et al. Endoscopic prediction of deeply submucosal invasive carcinoma with use of artificial intelligence. Endosc Int Open 2019; 7: E514-E520
  • 13 Nakajima Y, Zhu X, Nemoto D. et al. Diagnostic performance of artificial intelligence to identify deeply invasive colorectal cancer on non-magnified plain endoscopic images. Endosc Int Open 2020; 8: E1341-E1348
  • 14 Tokunaga M, Matsumura T, Nankinzan R. et al. Computer-aided diagnosis system using only white-light endoscopy for the prediction of invasion depth in colorectal cancer. Gastrointest Endosc 2021; 93: 647-653
  • 15 Nemoto D, Guo Z, Katsuki S. et al. Computer-aided diagnosis of early-stage colorectal cancer using nonmagnified endoscopic white-light images (with videos). Gastrointest Endosc 2023; 98: 90-99
  • 16 Zhou B, Khosla A, Lapedriza A. et al. Learning deep features for discriminative localization. In: 2016 IEEE conference on computer vision and pattern recognition. Las Vegas, NV: IEEE; 2016: 2921-2929
  • 17 Jaccard P. The distribution of the flora in the Alpine Zone.1. New Phytologist 1912; 11: 37-50
  • 18 Selvaraju RR, Cogswell M, Abhishek D. et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV). Venice, Italy: IEEE; 2017.