Download PDF
CC BY-NC-ND 4.0 · Indian J Radiol Imaging
DOI: 10.1055/s-0044-1800804
Original Article

Deep Learning for Detecting and Subtyping Renal Cell Carcinoma on Contrast-Enhanced CT Scans Using 2D Neural Network with Feature Consistency Techniques

Amit Gupta
1   Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, India
,
Rohan Raju Dhanakshirur
2   Amarnath and Shashi Khosla School of Information Technology, Indian Institute of Technology Delhi, New Delhi, India
,
Kshitiz Jain
3   Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, India
,
Sanil Garg
1   Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, India
,
Neel Yadav
1   Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, India
,
Amlesh Seth
4   Department of Urology, All India Institute of Medical Sciences, New Delhi, India
,
Chandan J. Das 
1   Department of Radiodiagnosis and Interventional Radiology, All India Institute of Medical Sciences, New Delhi, India
› Author Affiliations Funding None.
› Further Information
Also available at
   Permissions and Reprints

Abstract

Objective The aim of this study was to explore an innovative approach for developing deep learning (DL) algorithm for renal cell carcinoma (RCC) detection and subtyping on computed tomography (CT): clear cell RCC (ccRCC) versus non-ccRCC using two-dimensional (2D) neural network architecture and feature consistency modules.

Materials and Methods This retrospective study included baseline CT scans from 196 histopathologically proven RCC patients: 143 ccRCCs and 53 non-ccRCCs. Manual tumor annotations were performed on axial slices of corticomedullary phase images, serving as ground truth. After image preprocessing, the dataset was divided into training, validation, and testing subsets. The study tested multiple 2D DL architectures, with the FocalNet-DINO demonstrating highest effectiveness in detecting and classifying RCC. The study further incorporated spatial and class consistency modules to enhance prediction accuracy. Models' performance was evaluated using free-response receiver operating characteristic curves, recall rates, specificity, accuracy, F1 scores, and area under the curve (AUC) scores.

Results The FocalNet-DINO architecture achieved the highest recall rate of 0.823 at 0.025 false positives per image (FPI) for RCC detection. The integration of spatial and class consistency modules into the architecture led to 0.2% increase in recall rate at 0.025 FPI, along with improvements of 0.1% in both accuracy and AUC scores for RCC classification. These enhancements allowed detection of cancer in an additional 21 slices and reduced false positives in 126 slices.

Conclusion This study demonstrates high performance for RCC detection and classification using DL algorithm leveraging 2D neural networks and spatial and class consistency modules, to offer a novel, computationally simpler, and accurate DL approach to RCC characterization.

Keywords

renal cell carcinoma - deep learning - classification - detection - F1 score


Publication History

Article published online:
11 December 2024

© 2024. Indian Radiological Association. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Thieme Medical and Scientific Publishers Pvt. Ltd.
A-12, 2nd Floor, Sector 2, Noida-201301 UP, India

 

  • References

  • 1 Moch H, Cubilla AL, Humphrey PA, Reuter VE, Ulbright TM. The 2016 WHO classification of tumours of the urinary system and male genital organs-part A: renal, penile, and testicular tumours. Eur Urol 2016; 70 (01) 93-105
    CrossrefPubMedSearch in Google Scholar
  • 2 Capitanio U, Cloutier V, Zini L. et al. A critical assessment of the prognostic value of clear cell, papillary and chromophobe histological subtypes in renal cell carcinoma: a population-based study. BJU Int 2009; 103 (11) 1496-1500
    CrossrefPubMedSearch in Google Scholar
  • 3 Patard JJ, Leray E, Rioux-Leclercq N. et al. Prognostic value of histologic subtypes in renal cell carcinoma: a multicenter experience. J Clin Oncol 2005; 23 (12) 2763-2771
    CrossrefPubMedSearch in Google Scholar
  • 4 Lee CH, Motzer R. Combination VEGFR/immune checkpoint inhibitor therapy: a promising new treatment for renal cell carcinoma. Br J Cancer 2018; 119 (08) 911-912
    CrossrefPubMedSearch in Google Scholar
  • 5 Atkins MB, Tannir NM. Current and emerging therapies for first-line treatment of metastatic clear cell renal cell carcinoma. Cancer Treat Rev 2018; 70: 127-137
    CrossrefPubMedSearch in Google Scholar
  • 6 Abel EJ, Carrasco A, Culp SH. et al. Limitations of preoperative biopsy in patients with metastatic renal cell carcinoma: comparison to surgical pathology in 405 cases. BJU Int 2012; 110 (11) 1742-1746
    CrossrefPubMedSearch in Google Scholar
  • 7 Abel EJ, Culp SH, Matin SF. et al. Percutaneous biopsy of primary tumor in metastatic renal cell carcinoma to predict high risk pathological features: comparison with nephrectomy assessment. J Urol 2010; 184 (05) 1877-1881
    CrossrefPubMedSearch in Google Scholar
  • 8 Karlo CA, Di Paolo PL, Chaim J. et al. Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. Radiology 2014; 270 (02) 464-471
    CrossrefPubMedSearch in Google Scholar
  • 9 Young JR, Margolis D, Sauk S, Pantuck AJ, Sayre J, Raman SS. Clear cell renal cell carcinoma: discrimination from other renal cell carcinoma subtypes and oncocytoma at multiphasic multidetector CT. Radiology 2013; 267 (02) 444-453
    CrossrefPubMedSearch in Google Scholar
  • 10 Xu L, Yang C, Zhang F. et al. Deep learning using CT images to grade clear cell renal cell carcinoma: development and validation of a prediction model. Cancers (Basel) 2022; 14 (11) 2574
    CrossrefPubMedSearch in Google Scholar
  • 11 Yao N, Hu H, Chen K. et al. A robust deep learning method with uncertainty estimation for the pathological classification of renal cell carcinoma based on CT images. J Imaging Inform Med 2024 (e-pub ahead of print). https://doi.org/10.1007/s10278-024-01276-7
    Crossref
  • 12 Wang Z, Zhang X, Wang X. et al. Deep learning techniques for imaging diagnosis of renal cell carcinoma: current and emerging trends. Front Oncol 2023; 13: 1152622
    CrossrefPubMedSearch in Google Scholar
  • 13 Uhm KH, Jung SW, Choi MH. et al. Deep learning for end-to-end kidney cancer diagnosis on multi-phase abdominal computed tomography. NPJ Precis Oncol 2021; 5 (01) 54
    CrossrefPubMedSearch in Google Scholar
  • 14 Amador S, Beuschlein F, Chauhan V. et al. Deep learning approaches applied to image classification of renal tumors: a systematic review. Arch Comput Methods Eng 2024; 31 (02) 615-622
    Search in Google Scholar
  • 15 Dai C, Xiong Y, Zhu P. et al. Deep learning assessment of small renal masses at contrast-enhanced multiphase CT. Radiology 2024; 311 (02) e232178
    CrossrefPubMedSearch in Google Scholar
  • 16 Mahootiha M, Qadir HA, Bergsland J, Balasingham I. Multimodal deep learning for personalized renal cell carcinoma prognosis: integrating CT imaging and clinical data. Comput Methods Programs Biomed 2024; 244: 107978
    CrossrefPubMedSearch in Google Scholar
  • 17 Yang YQ, Guo YX, Xiong JY. et al. Swin3d: a pretrained transformer backbone for 3d indoor scene understanding. arXiv preprint arXiv:2304.06906. 2023
  • 18 Zhang Y, Shi L, Wu Y, Cheng K, Cheng J, Lu H. Gesture recognition based on deep deformable 3D convolutional neural networks. Pattern Recognit 2020; 107: 107416
    CrossrefSearch in Google Scholar
  • 19 Ying X. An overview of overfitting and its solutions. J Phys Conf Ser 2019; 1168 (02) 022022
    CrossrefSearch in Google Scholar
  • 20 Zheng Q, Delingette H, Duchateau N, Ayache N. 3-D consistent and robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans Med Imaging 2018; 37 (09) 2137-2148
    CrossrefPubMedSearch in Google Scholar
  • 21 Tanaka T, Huang Y, Marukawa Y. et al. Differentiation of small (≤ 4 cm) renal masses on multiphase contrast-enhanced CT by deep learning. AJR Am J Roentgenol 2020; 214 (03) 605-612
    CrossrefPubMedSearch in Google Scholar
  • 22 Oberai A, Varghese B, Cen S. et al. Deep learning based classification of solid lipid-poor contrast enhancing renal masses using contrast enhanced CT. Br J Radiol 2020; 93 (1111) 20200002
    CrossrefPubMedSearch in Google Scholar
  • 23 Zabihollahy F, Schieda N, Krishna S, Ukwatta E. Automated classification of solid renal masses on contrast-enhanced computed tomography images using convolutional neural network with decision fusion. Eur Radiol 2020; 30 (09) 5183-5190
    CrossrefPubMedSearch in Google Scholar
  • 24 Han S, Hwang SI, Lee HJ. The classification of renal cancer in 3-phase CT images using a deep learning method. J Digit Imaging 2019; 32 (04) 638-643
    CrossrefPubMedSearch in Google Scholar
  • 25 Amador S, Beuschlein F, Chauhan V. et al. Deep learning approaches applied to image classification of renal tumors. a systematic review. Arch Computat Methods Eng 2024; 31: 615-622
    CrossrefSearch in Google Scholar
  • 26 Zheng Y, Wang S, Chen Y, Du HQ. Deep learning with a convolutional neural network model to differentiate renal parenchymal tumors: a preliminary study. Abdom Radiol (NY) 2021; 46 (07) 3260-3268
    CrossrefPubMedSearch in Google Scholar
  • 27 Zuo T, Zheng Y, He L. et al. Automated classification of papillary renal cell carcinoma and chromophobe renal cell carcinoma based on a small computed tomography imaging dataset using deep learning. Front Oncol 2021; 11: 746750
    CrossrefPubMedSearch in Google Scholar