The International Radiomics Platform – An Initiative of the German and Austrian Radiological Societies – First Application Examples

Abstract

Purpose The DRG-ÖRG IRP (Deutsche Röntgengesellschaft-Österreichische Röntgengesellschaft international radiomics platform) represents a web-/cloud-based radiomics platform based on a public-private partnership. It offers the possibility of data sharing, annotation, validation and certification in the field of artificial intelligence, radiomics analysis, and integrated diagnostics. In a first proof-of-concept study, automated myocardial segmentation and automated myocardial late gadolinum enhancement (LGE) detection using radiomic image features will be evaluated for myocarditis data sets.

Materials and Methods The DRG-ÖRP IRP can be used to create quality-assured, structured image data in combination with clinical data and subsequent integrated data analysis and is characterized by the following performance criteria: Possibility of using multicentric networked data, automatically calculated quality parameters, processing of annotation tasks, contour recognition using conventional and artificial intelligence methods and the possibility of targeted integration of algorithms. In a first study, a neural network pre-trained using cardiac CINE data sets was evaluated for segmentation of PSIR data sets. In a second step, radiomic features were applied for segmental detection of LGE of the same data sets, which were provided multicenter via the IRP.

Results First results show the advantages (data transparency, reliability, broad involvement of all members, continuous evolution as well as validation and certification) of this platform-based approach. In the proof-of-concept study, the neural network demonstrated a Dice coefficient of 0.813 compared to the expert's segmentation of the myocardium. In the segment-based myocardial LGE detection, the AUC was 0.73 and 0.79 after exclusion of segments with uncertain annotation.

The evaluation and provision of the data takes place at the IRP, taking into account the FAT (fairness, accountability, transparency) and FAIR (findable, accessible, interoperable, reusable) criteria.

Conclusion It could be shown that the DRG-ÖRP IRP can be used as a crystallization point for the generation of further individual and joint projects. The execution of quantitative analyses with artificial intelligence methods is greatly facilitated by the platform approach of the DRG-ÖRP IRP, since pre-trained neural networks can be integrated and scientific groups can be networked.

In a first proof-of-concept study on automated segmentation of the myocardium and automated myocardial LGE detection, these advantages were successfully applied.

Our study shows that with the DRG-ÖRP IRP, strategic goals can be implemented in an interdisciplinary way, that concrete proof-of-concept examples can be demonstrated, and that a large number of individual and joint projects can be realized in a participatory way involving all groups.

Key Points: 

• The DRG-ÖRG IRP is a web/cloud-based radiomics platform based on a public-private partnership.

• The DRG-ÖRG IRP can be used for the creation of quality-assured, structured image data in combination with clinical data and subsequent integrated data analysis.

• First results show the applicability of left ventricular myocardial segmentation using a neural network and segment-based LGE detection using radiomic image features.

• The DRG-ÖRG IRP offers the possibility of integrating pre-trained neural networks and networking of scientific groups.

Citation Format

• Overhoff D, Kohlmann P, Frydrychowicz A et al. The International Radiomics Platform – An Initiative of the German and Austrian Radiological Societies. Fortschr Röntgenstr 2021; 193: 276 – 287

Key words

artificial intelligence - myocarditis - magnetic resonance imaging - neural networks

Publication History

Received: 02 June 2020

Accepted: 17 July 2020

Article published online:
26 November 2020

• References

• 1 Coroller TP, Grossmann P, Hou Y. et al CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother Oncol 2015; 114: 345-350 . doi:10.1016/j.radonc.2015.02.015
• 2 Vaidya P, Bera K, Gupta A. et al CT derived radiomic score for predicting the added benefit of adjuvant chemotherapy following surgery in stage I, II resectable non-small cell lung cancer: a retrospective multicohort study for outcome prediction. The Lancet Digital Health 2020; 2: e116-e128
• 3 Coroller TP, Agrawal V, Narayan V. et al Radiomic phenotype features predict pathological response in non-small cell lung cancer. Radiotherapy and Oncology 2016; 119: 480-486
• 4 Lambin P, Leijenaar RTH, Deist TM. et al Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 2017; 14: 749-762 . doi:10.1038/nrclinonc.2017.141
• 5 Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology 2016; 278: 563-577
• 6 Sanduleanu S, Woodruff HC, de Jong EEC. et al Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score. Radiother Oncol 2018; 127: 349-360 . doi:10.1016/j.radonc.2018.03.033
• 7 Baessler B, Weiss K, Pinto Dos Santos D. Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study. Invest Radiol 2019; 54: 221-228 . doi:10.1097/rli.0000000000000530
• 8 Hahn HK. Radiomics & Deep Learning: Quo vadis?. Forum 2020; 35: 117-124 . doi:10.1007/s12312-020-00761-8
• 9 Bundesministerium für Bildung und Forschung. Forschungscampus. Im Internet (Stand: 20.05.2020): https://www.forschungscampus.bmbf.de
• 10 Klein J, Wenzel M, Romberg D. et al QuantMed: Component-based deep learning platform for translational research. In, Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications: International Society for Optics and Photonics 2020; 113180U
• 11 MEVIS Fraunhofer. Deep Learning in Medical Imaging. Im Internet (Stand: 20.05.2020): https://www.mevis.fraunhofer.de/en/solutionpages/deep-learning-in-medical-imaging.html
• 12 grand-challenge.org. Grand Challenges in Biomedical Image Analysis. Im Internet (Stand: 20.05.2020): https://grand-challenge.org/
• 13 Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In, International Conference on Medical image computing and computer-assisted intervention Springer; 2015: 234-241
• 14 Zou KH, Warfield SK, Bharatha A. et al Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol 2004; 11: 178-189 . doi:10.1016/s1076-6332(03)00671-8
• 15 van Griethuysen JJM, Fedorov A, Parmar C. et al Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res 2017; 77: e104-e107 . doi:10.1158/0008-5472.Can-17-0339
• 16 Schönberger D. Artificial intelligence in healthcare: a critical analysis of the legal and ethical implications. International Journal of Law and Information Technology 2019; 27: 171-203
• 17 Wilkinson MD, Dumontier M, Aalbersberg IJ. et al The FAIR Guiding Principles for scientific data management and stewardship. Scientific data. 2016 3.
• 18 Grothues F, Moon JC, Bellenger NG. et al Interstudy reproducibility of right ventricular volumes, function, and mass with cardiovascular magnetic resonance. American heart journal 2004; 147: 218-223
• 19 Maceira A, Prasad S, Khan M. et al Normalized left ventricular systolic and diastolic function by steady state free precession cardiovascular magnetic resonance. Journal of Cardiovascular Magnetic Resonance 2006; 8: 417-426
• 20 Avendi M, Kheradvar A, Jafarkhani H. A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI. Medical image analysis 2016; 30: 108-119
• 21 Ngo TA, Lu Z, Carneiro G. Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Medical image analysis 2017; 35: 159-171
• 22 Codella NC, Weinsaft JW, Cham MD. et al Left ventricle: automated segmentation by using myocardial effusion threshold reduction and intravoxel computation at MR imaging. Radiology 2008; 248: 1004-1012
• 23 Mahnken AH, Muhlenbruch G, Koos R. et al Automated vs. manual assessment of left ventricular function in cardiac multidetector row computed tomography: comparison with magnetic resonance imaging. European radiology 2006; 16: 1416-1423 . doi:10.1007/s00330-006-0226-1
• 24 Zwanenburg A, Vallières M, Abdalah MA. et al The Image Biomarker Standardization Initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 2020; 295: 191145
• 25 Lurz P, Luecke C, Eitel I. et al Comprehensive Cardiac Magnetic Resonance Imaging in Patients With Suspected Myocarditis: The MyoRacer-Trial. J Am Coll Cardiol 2016; 67: 1800-1811 . doi:10.1016/j.jacc.2016.02.013
• 26 Ferreira VM, Schulz-Menger J, Holmvang G. et al Cardiovascular Magnetic Resonance in Nonischemic Myocardial Inflammation: Expert Recommendations. J Am Coll Cardiol 2018; 72: 3158-3176 . doi:10.1016/j.jacc.2018.09.072
• 27 Bernard O, Lalande A, Zotti C. et al Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?. IEEE Trans Med Imaging 2018; 37: 2514-2525 . doi:10.1109/TMI.2018.2837502
• 28 Huang S, Liu J, Lee LC. et al An image-based comprehensive approach for automatic segmentation of left ventricle from cardiac short axis cine MR images. J Digit Imaging 2011; 24: 598-608 . doi:10.1007/s10278-010-9315-4
• 29 Liu H, Hu H, Xu X. et al Automatic left ventricle segmentation in cardiac MRI using topological stable-state thresholding and region restricted dynamic programming. Acad Radiol 2012; 19: 723-731 . doi:10.1016/j.acra.2012.02.011
• 30 Tao Q, Piers SR, Lamb HJ. et al Automated left ventricle segmentation in late gadolinium-enhanced MRI for objective myocardial scar assessment. J Magn Reson Imaging 2015; 42: 390-399 . doi:10.1002/jmri.24804
• 31 Zabihollahy F, White JA, Ukwatta E. Convolutional neural network-based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images. Med Phys 2019; 46: 1740-1751 . doi:10.1002/mp.13436
• 32 Baessler B, Luecke C, Lurz J. et al Cardiac MRI and Texture Analysis of Myocardial T1 and T2 Maps in Myocarditis with Acute versus Chronic Symptoms of Heart Failure. Radiology 2019; 292: 608-617 . doi:10.1148/radiol.2019190101
• 33 Langlotz CP, Allen B, Erickson BJ. et al A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH/RSNA/ACR/The Academy Workshop. Radiology 2019; 291: 781-791 . doi:10.1148/radiol.2019190613
• 34 Deutsche Röntgengesellschaft (DRG) e.V. Radiomics in der Radiologie. Im Internet (Stand: 22.05.2020): https://www.drg.de/de-DE/3601/radiomics/
• 35 Recht MP, Dewey M, Dreyer K. et al Integrating artificial intelligence into the clinical practice of radiology: challenges and recommendations. European radiology 2020; DOI: 10.1007/s00330-020-06672-5.