Visual Clustering Analysis of CIS Logs to Inform Creation of a User-configurable Web CIS Interface

Summary

Background: In this paper, we describe a new method for the study of clinical information system (CIS) logfiles joined with information in the clinical data warehouse. This method uses heatmap representations and clustering techniques to examine clinicians’ viewing patterns of laboratory test results. The context of our application of these techniques is to inform the creation of a widget-based interface to the CIS.

Objectives: We address the rationale, feasibility, and usefulness of our method through examination of three hypotheses:

1) The frequency distribution of laboratory test viewing will follow a ’long tail’ pattern, indicating that patterns are highly variable and supporting the rationale for a widget-based configurable system.

2) Patterns of laboratory testing viewing (by clinician, specialty, clinician/patient/day, and ICD-9-CM codes) can be distinguished by our methods.

3) The identified clusters will include more than 80% of the laboratory test elements found in 30 randomly selected patient records for one day.

Methods: The data were plotted as heatmaps and clustered using hierarchical clustering software. Various parameters were tested to give the optimal clusters.

Results: All the hypotheses were supported. For Hypothesis 3, 91.4% of information elements in the records were covered by the generated clusters.

Conclusions: Study findings support the rationale, feasibility, and usefulness of our methods to examine patterns of information access among clinicians and to inform the creation of widget-based interfaces. The results also contribute to our general understanding of clinicians’ CIS use.

Keywords

Clinician information needs - widget-based interface - clinical information system interface - web2.0

• References

• 1 Senathirajah Y, Bakken S. A User-Configurable EHR using Web 2.0 Approaches. AMIA Spring Congress. Phoenix, AZ: AMIA; 2008
• 2 Senathirajah Y, Bakken S. Architectural and Usability Considerations in the Development of a Web 2.0-based EHR. Advances in Information Technology and Communication in Health. IOS Press; 2009. pp 315-321.
• 3 Senathirajah Y, Bakken S. Rapid configuration of a widget-based EHR interface to meet an emerging need. Public Health Informatics Pre-meeting, NLM Trainee Conference, Portland, OR: 2009
• 4 Senathirajah Y, Bakken S. Development of User-configurable Information Source Pages for Medical Information Retrieval. AMIA 2007 Symposium Proceedings. Page 2007: 1109
• 5 Chen ES, Cimino JJ. Patterns of usage for a Web-based clinical information system. Stud Health Technol Inform 2004; 107 Pt 1 18-22.
• 6 Chen E. Knowledge discovery in clinical information system log files and the implications for wireless handheld clinical applications (Doctoral dissertation). New York: Columbia University; 2004
• 7 Anderson C. The Long Tail: Why the Future of Business is Selling Less of More. Wired; 2004
• 8 Anderson C. The Long Tail: Why the Future of Business is Selling Less of More. New York: Hyperion; 2008
• 9 Brynjolfsson E, Hu Y, Smith M. From Niches to Riches: Anatomy of the Long Tail. MIT Sloan Management Review 2006; 47 (04) 67-71.
• 10 Hripcsak G, Cimino JJ, Sengupta S. WebCIS: Large Scale Deployment of a Web-based Clinical Information System. AMIA Annu Symp Proc. 1999 pp 804-808.
• 11 Cimino J. From data to knowledge through concept-oriented terminologies: experience with the Medical Entities Dictionary. J Am Med Inform Assoc 2007; 7: 288-297.
• 12 Wright A, Sittig D. Automated Development of Order Sets and Corollary Orders by Data Mining in an Ambulatory Computerized Physician Order Entry System. AMIA Annu Symp Proc 2006 pp 819-823.
• 13 Kriegel H, Kröger P, Zimek A. Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering. ACM Transactions on Knowledge Discovery from Data 2009; 3 (01) 1-58.
• 14 Eisen M, Spellman P, Brown P, Botstein D. Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA 1998; 8: 14863-14868.
• 15 Golub T, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP. et al. Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring. Science 1999; 286: 531-537.
• 16 Madeira S, Oliveira A. Biclustering Algorithms for Biological Data Analysis: A Survey. IEEE/ACM Transactions on Computational Biology and Bioinformatics 2004; 1: 24-45.
• 17 Quackenbush J. Computational analysis of microarray data. Nat Rev Genet 2001; 2: 418-427.
• 18 Madeira S, Oliveira A. Biclustering Algorithms for Biological Data Analysis: A Survey. IEEE/ACM Transactions on Computational Biology and Bioinformatics 2004; 1 (01) 24-45.
• 19 Auman JT, Boorman GA, Wilson RE, Travlos GS, Paules RS. Heat map visualization of high-density clinical chemistry data. Physiol Genomics 2007; 31 (02) 352-356.
• 20 Melcher J, Seese D. Visualization and Clustering of Business Process Collections Based on Process Metric Values. 10th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing 2008 pp 572-575.
• 21 Moona J, Hyun-Jin J, Moon MH, Chunga BC, Choia MH. Heat-Map Visualization of Gas Chromatography-Mass Spectrometry Based Quantitative Signatures on Steroid Metabolism. Journal of the American Society for Mass Spectrometry 2009; 20 (09) 1626-1637.
• 22 Datta S, Datta S. Evaluation of clustering algorithms for gene expression data. BMC Bioinformatics 2006; 7 (04) 17.
• 23 Datta S, Datta S. Comparisons and validation of statistical clustering techniques for microarray gene expression data. Bioinformatics 2003; 19 (04) 459-466.
• 24 Mobasher B, Dai H, Sun Y, Zhu J. Integrating Web Usage and Content Mining for More Effective Personalization. Web Mining for E-commerce Workshop (WebKDD‘2000) in conjunction with ACMSIGKDD Conference on Knowledge Discovery in Databases 2000
• 25 Gemmell J, Sehepitsen A, Mobasher B, Burke R. Personalization in Folksonomies Based on Tag Clustering. 6th Workshop on Intelligent Techniques for Web Personalization and Recommender Systems, held at AAAI; Chicago, USA: 2008
• 26 Horsky J, Kaufman, Patel VL. The Cognitive Complexity of a Provider Order Entry Interface. AMIA Annu Symp Proc. 2003 pp 294-298.
• 27 Horsky J, Kaufman D, Oppenheim M, Patel V. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. Journal of Biomedical Informatics 2003; 36 1–2 4-22.
• 28 Patel V, Kushniruk A. Cognitive and usability engineering methods for the evaluation of clinical information systems. Journal of Biomedical Informatics 2004; 37 (01) 56-76.
• 29 Seo J. Hierarchical Clustering Explorer. 2004 Available from: http://www.cs.umd.edu/hcil/hce
• 30 Ho Y. Heuristics, Rules of Thumb, and the 80/20 Proposition. IEEE Transactions on Automatic Control 1994; 39 (05) 1025-1026.