Sensor, Signal, and Imaging Informatics in 2017

Summary

Objective: To summarize significant contributions to sensor, signal, and imaging informatics literature published in 2017.

Methods: PubMed^® and Web of Science^® were searched to identify the scientific publications published in 2017 that addressed sensors, signals, and imaging in medical informatics. Fifteen papers were selected by consensus as candidate best papers. Each candidate article was reviewed by section editors and at least two other external reviewers. The final selection of the four best papers was conducted by the editorial board of the International Medical Informatics Association (IMIA) Yearbook.

Results: The selected papers of 2017 demonstrate the important scientific advances in management and analysis of sensor, signal, and imaging information.

Conclusion: The growth of signal and imaging data and the increasing power of machine learning techniques have engendered new opportunities for research in medical informatics. This synopsis highlights cutting-edge contributions to the science of Sensor, Signal, and Imaging Informatics.

Keywords

Signal processing - biomedical imaging - deep learning - radiomics

Introduction

The discipline of “Sensor, Signal, and Imaging Informatics” (SSII) continues to grow and forms a vibrant area of scientific growth within the broader field of biomedical informatics. Advances in sensor technology and growing adoption of wearable devices have yielded greater quantities and varieties of signal and sensor data. Medical imaging has been a dynamic field for applications of automated approaches for image segmentation, classification, and diagnosis. Advances in machine learning and the rise of deep learning techniques in a wide spectrum of clinical applications have had significant impact in fields related to signals and imaging. The large scale and high dimensionality of signal and imaging datasets make them well suited for machine learning approaches to identify spatial and temporal patterns.

The many important contributions of medical informatics research in the fields of medical signals and imaging are illustrated by the publications from 2017 reviewed here. The four articles selected as 2017 best papers demonstrate the high quality of research conducted in this area. In addition, the survey paper by Nagarajan et al. reviews the application of deep learning techniques on biosignals[1].

About the Paper Selection

To compile a list of eligible papers, we conducted a search of the PubMed/Med-line® and Web of Science® electronic databases in December 2017 to identify peer-reviewed journal articles published in 2017, in the English language and related to SSII research in medical informatics. As in previous years, a wide spectrum of MeSH® keywords and topics was considered, including image and signal processing, pattern recognition and information extraction, telemedicine, sensor monitoring, and computer aided diagnosis. Keywords used included both free-text and coded keywords. PubMed/Medline^® was queried to test keywords in an iterative process. Consequently, two queries were built: one based on MeSH® terms used to search the major topics in the PubMed/Medline® database, the second one based on free-text keywords searched in titles or abstracts through PubMed/Medline^® and Web of Science^® databases. We also added keywords that had been trending this past year such as deep learning. One of the three section editors (WH) performed the searches. In addition to the search of electronic databases, manual searches of key themes were performed in leading journals of biomedical informatics, imaging informatics, and imaging specialty journals, such as Journal of the American Medical Informatics Association, Journal of Digital Imaging, and Radiology.

The search results were reconciled into a single list of 441 papers. The three section editors independently screened the titles and abstracts to identify relevant papers. The section editors classified the papers into three categories: accepted, rejected, or pending. They then reviewed in detail the accepted and pending full-text articles to finally reach a consensus list of 15 candidate papers. Papers were considered according to their originality, scientific and/ or clinical impact, and scientific quality. In accordance with the IMIA Yearbook selection process, the 15 candidate best papers were evaluated in detail by the section editors and by at least two additional external reviewers. Four papers were selected as best papers ([Table 1]). A content summary of the selected best papers can be found in the appendix of this synopsis.

Table 1 Best paper selection of articles for the IMIA Yearbook of Medical Informatics 2018 in the section ‘Sensor, Signal, and Imaging Informatics'. The articles are listed in alphabetical order of the first author's surname.

Section Sensor, Signal, and Imaging Informatics
▪ Bote JM, Recas J, Rincon F, Atienza D, Hermida R. A modular low-complexity ECG delineation algorithm for real-time embedded systems. IEEE J Biomed Health Inform 2018;22(2):429-41.
▪ Grossmann P, Stringfield O, El-Hachem N, Bui MM, Rios Velazquez E, Parmar C, Leijenaar RT, Haibe-Kains B, Lambin P, Gillies RJ, Aerts HJ. Defining the biological basis of radiomic phenotypes in lung cancer. ELife 2017;6.
▪ Larson DB, Chen MC, Lungren MP, Halabi SS, Stence NV, Langlotz CP. Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 2018;287(1):31 3-22.
▪ Satija U, Ramkumar B, Manikandan MS. Automated ECG noise detection and classification system for unsupervised healthcare monitoring. IEEE J Biomed Health Inform 2018;22(3):722-32.

Results

Machine learning has been widely applied to discern patterns in biomedical images and signal data, and 2017 has seen further advances in this area. Deep learning - a particular form of machine learning that typically applies multiple layers of neural networks - has been applied to numerous challenges in medical imaging. Larson et al. developed and tested a deep-learning convolutional neural network model for the interpretation of children's hand radiographs; their model estimated skeletal maturity with accuracy similar to that of expert radiologists[2]. In patients with suspected acute stroke, the time to diagnosis and treatment is critical to preserve brain function. Prevedello et al. applied deep learning to identify hemorrhage, mass effect, or hydroceph-alus on head computed tomographic (CT) examinations, and achieved 90% sensitivity and 85% specificity[3]. Dawes et al. applied semi-automated segmentation of magnetic resonance (MR) images of the heart to create a three-dimensional model of right ventricular motion, from which their machine-learning survival model predicted patient outcomes independent of conventional risk factors in patients with newly diagnosed pulmonary hypertension[4]. Deep learning is an emerging field in the analysis of histological images, as well. Sharma et al. explored deep learning methods for computer-aided classification in hematoxylin and eosin (H&E)-stained histopathological whole slide images of gastric carcinoma to classify cancers based on immunohistochemical response and to detect tumor necrosis[5].

Radiomics is an emerging field that extracts quantitative data from radiological images to enable phenotypic proiling of tumors. Extracting that information requires software tools that yield reliable segmentation of tumors and consistent imaging features to overcome the inherent inter-rater and intra-rater variability. Lee et al. evaluated the reliability and quality of radiomic features in glioblastoma using semi-automated tumor segmentation software[6]. Grossman et al. used radiomic information to identify relationships between imaging features, immune response, inflammation, and survival in patients with lung cancer[7].

Radiology procedure codes are fundamental to most radiology workflows, such as ordering, scheduling, billing, and image interpretation. Wang et al. described an extensible standardized nomenclature that harmonizes the Radiological Society of North America (RSNA) RadLex Playbook with the Logical Observation Identifiers Names and Codes (LOINC) standard to promote interoperability of imaging information[8]. As public collections of medical images become increasingly available for machine-learning investigations, such imaging data can engender privacy concerns. In particular, Parks and Monson found that individuals could be identified with moderately high probability from large collections of photographs based on the facial images extracted from medical image data[9]. Thus, the facial image data inherent in CT and MRI data may need to be considered as potentially identifiable information.

Information and communication technologies such as smart phones, smart watches, smart glasses, and portable health monitoring devices have made mobile health (mHealth) an emerging research area. Wearable biomedical sensors can provide a wealth of data; their increased use promises to herald significant advances in health monitoring. Despite numerous advances, battery runtime remains a critical limitation for the practical use of wearable sensors. Tobola et al. described a “self-powered” sensor platform that incorporates an efficient body heat harvester[10]. Coronary heart disease is a leading cause ofpremature death worldwide, and there is a growing demand for a reliable system to detect critical cardiac abnormalities that lead to sudden death. Sahoo et al. described a novel cardiac data acquisition method for combined analysis of electrocardiography (ECG) and multi-channel seismo-cardiography (SCG) data that achieved 88% accuracy as an early warning system[11].

Monitoring of sensor devices and analysis of signal data require careful attention to eliminate noise and correctly delineate the meaningful information. Satija et al. described a novel unified framework for automatic detection, localization, and classification of single and combined ECG noises, which achieved an average sensitivity of 99.12% and specificity of 98.56%[12]. Bote et al. presented a new, modular, low-complexity algorithm to perform highly accurate real-time ECG analysis on resource-constrained embedded systems. Such a platform could be useful in ultralow-power mobile or wearable devices[13]. ECG data often are accompanied by high-frequency electromyographic (EMG) noise, which is difficult to filter due to overlapping frequency spectra. Christov et al. developed a dynamic filter that strongly suppressed EMG noise while preserving ECG high-frequency components[14]. Te et al. developed a novel signal analysis method to identify the origin of idiopathic right ventricular outflow tract ventricular tachycardia (RVOT-VT) during sinus rhythm; their approach predicted the VT origins with 92% sensitivity and 78% specificity[15]. Sleep-disordered breathing is both a clinical and a social problem. Mobile health sensor technologies were explored to simplify screening and diagnosis. Mlybczak et al. investigated the sensitivity and specificity of a novel wireless system in detecting breathing and snoring episodes during sleep[16].

Conclusions and Outlook

The selected papers provide a small sampling of the many efforts that are advancing the science of informatics in healthcare. The growing volumes of biomedical signal data and medical imaging, increasingly powerful approaches to analyze and classify these data, and advances in computing power have created new opportunities to support precision medicine. In future, we expect more applications and systems integrating the novel sensors into signal and image analysis pipelines.

Acknowledgement

The section editors wish to express their appreciation to Brigitte Séroussi, Adrien Ugon, and John H. Holmes for editorial guidance and support. We thank the reviewers for participating in the selection process.

• References

• 1 Ganapathy N, Swaminathan R, Deserno TM. Deep learning on 1D biosignals: a taxonomy-based survey. Yearb Med Inform 2018; 98-109
• 2 Larson DB, Chen MC, Lungren MP, Halabi SS, Stence NV, Langlotz CP. Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 2018; 287 (01) 313-22
• 3 Prevedello LM, Erdal BS, Ryu JL, Little KJ, Demirer M, Qian S. et al. Automated critical test findings identification and online notification system using artificial intelligence in imaging. Radiology 2017; 285 (03) 923-31
• 4 Dawes TJW, de Marvao A, Shi W, Fletcher T, Watson GMJ, Wharton J. et al. Machine learning of three-dimensional right ventricular motion enables outcome prediction in pulmonary hypertension: a cardiac MR imaging study. Radiology 2017; 283 (02) 381-90
• 5 Sharma H, Zerbe N, Klempert I, Hellwich O, Hufnagl P. Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology. Comput Med Imaging Graph 2017; 61: 2-13
• 6 Lee M, Woo B, Kuo MD, Jamshidi N, Kim JH. Quality of radiomic features in glioblastoma multiforme: Impact of semi-automated tumor segmentation software. Korean J Radiol 2017; 18 (03) 498-509
• 7 Grossmann P, Stringfield O, El-Hachem N, Bui MM, Rios Velazquez E, Parmar C. et al. Defining the biological basis of radiomic phenotypes in lung cancer. ELife 2017; 6
• 8 Wang KC, Patel JB, Vyas B, Toland M, Collins B, Vreeman DJ. et al. Use of radiology procedure codes in health care: The need for standardization and structure. RadioGraphics 2017; 37 (04) 1099-110
• 9 Parks CL, Monson KL. Automated facial recognition of computed tomography-derived facial images: Patient privacy implications. J Digit Imaging 2017; 30 (02) 204-14
• 10 Tobola A, Leutheuser H, Pollak M, Spies P, Hofmann C, Weigand C. et al. Self-powered multiparameter health sensor. IEEE J Biomed Health Inform 2018; 22 (01) 15-22
• 11 Sahoo PK, Thakkar HK, Lee MY. A cardiac early warning system with multi channel SCG and ECG monitoring for mobile health. Sensors (Basel) 2017;17(4):
• 12 Satija U, Ramkumar B, Manikandan MS. Automated ECG noise detection and classification system for unsupervised healthcare monitoring. IEEE J Biomed Health Inform 2018; 22 (03) 722-32
• 13 Bote JM, Recas J, Rincon F, Atienza D, Hermida R. A modular low-complexity ECG delineation algorithm for real-time embedded systems. IEEE J Biomed Health Inform 2018; 22 (02) 429-41
• 14 Christov I, Neycheva T, Schmid R, Stoyanov T, Abacherli R. Pseudo-real-time low-pass filter in ECG self-adjustable to the frequency spectra of the waves. Med Biol Eng Comput 2017; 55 (09) 1579-88
• 15 Te AL, Higa S, Chung FP, Lin CY, Lo MT, Liu CA. et al. The use of a novel signal analysis to identify the origin of idiopathic right ventricular outflow tract ventricular tachycardia during sinus rhythm: Simultaneous amplitude frequency electrogram transformation mapping. PLoS One 2017; 12 (03) e0173189
• 16 Młyńczak M, Migacz E, Migacz M, Kukwa W. Detecting breathing and snoring episodes using a wireless tracheal sensor -- a feasibility study. IEEE J Biomed Health Inform 2017; 21 (06) 1504-10