Outcomes Research: Methods and Implications

ABSTRACT

Outcomes research is a life sciences field that focuses on patient-oriented outcomes, which are important to a wide range of stakeholders, including patients, physicians, health care systems and payers, and society. An important emphasis of outcomes research is assessment of medical processes and interventions in “real world” settings rather than under experimental conditions. A condition of this approach is that many studies are observational in design. This article reviews the methodologies that are typical of outcomes research and discusses the strengths and weaknesses of these methodologies. Controversial topics in respiratory diseases such as intensive care unit (ICU) organization and relationships of hospital volume to patient mortality are discussed to illustrate how different study designs and analytic techniques can lead to discrepant study results. Outcomes research will increase in importance and application as health care systems and payers become more interested in maximizing patient outcomes relative to resources used. Resources should be made available to enhance the training of new investigators and provide sufficient expertise for the design and analysis of influential studies.

Outcomes research - methodologies - intensive care units

REFERENCES

• 1 Rubenfeld G D, Angus D C, Pinsky M R, Curtis J R, Connors Jr A F, Bernard G R. Outcomes research in critical care: results of the American Thoracic Society Critical Care Assembly Workshop on Outcomes Research. The Members of the Outcomes Research Workshop.  Am J Respir Crit Care Med. 1999;  160 358-367
• 2 Curtis J R, Rubenfeld G D, Hudson L D. Training pulmonary and critical care physicians in outcomes research: should we take the challenge?.  Am J Respir Crit Care Med. 1998;  157(4 Pt 1) 1012-1015
• 3 Webb S A, Pettila V, Seppelt I ANZIC Influenza Investigators et al.. Critical Care Services and 2009 H1N1 Influenza in Australia and New Zealand.  N Engl J Med. 2009;  361 1925-1934
• 4 Kumar A, Zarychanski R, Pinto R Canadian Critical Care Trials Group H1N1 Collaborative et al. Critically ill patients with 2009 influenza A(H1N1) infection in Canada.  JAMA. 2009;  302 1872-1879
• 5 Dowdy D W, Needham D M, Mendez-Tellez P A, Herridge M S, Pronovost P J. Studying outcomes of intensive care unit survivors: the role of the cohort study.  Intensive Care Med. 2005;  31 914-921
• 6 Ashbaugh D G, Bigelow D B, Petty T L, Levine B E. Acute respiratory distress in adults.  Lancet. 1967;  2 319-323
• 7 Milberg J A, Davis D R, Steinberg K P, Hudson L D. Improved survival of patients with acute respiratory distress syndrome (ARDS): 1983–1993.  JAMA. 1995;  273 306-309
• 8 Nasraway S A, Button G J, Rand W M, Hudson-Jinks T, Gustafson M. Survivors of catastrophic illness: outcome after direct transfer from intensive care to extended care facilities.  Crit Care Med. 2000;  28 19-25
• 9 Petty T L. Long-term trends in mortality in the intensive care unit.  JAMA. 2002;  287 1805 author reply 1805
• 10 Davidson T A, Caldwell E S, Curtis J R, Hudson L D, Steinberg K P. Reduced quality of life in survivors of acute respiratory distress syndrome compared with critically ill control patients.  JAMA. 1999;  281 354-360
• 11 Herridge M S, Cheung A M, Tansey C M Canadian Critical Care Trials Group et al. One-year outcomes in survivors of the acute respiratory distress syndrome.  N Engl J Med. 2003;  348 683-693
• 12 Cheung A M, Tansey C M, Tomlinson G et al.. Two-year outcomes, health care use, and costs of survivors of acute respiratory distress syndrome.  Am J Respir Crit Care Med. 2006;  174 538-544
• 13 De Jonghe B, Sharshar T, Lefaucheur J P Groupe de Réflexion et d'Etude des Neuromyopathies en Réanimation et al. Paresis acquired in the intensive care unit: a prospective multicenter study.  JAMA. 2002;  288 2859-2867
• 14 Fletcher S N, Kennedy D D, Ghosh I R et al.. Persistent neuromuscular and neurophysiologic abnormalities in long-term survivors of prolonged critical illness.  Crit Care Med. 2003;  31 1012-1016
• 15 Schweickert W D, Pohlman M C, Pohlman A S et al.. Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial.  Lancet. 2009;  373 1874-1882
• 16 Ely E W, Shintani A, Truman B et al.. Delirium as a predictor of mortality in mechanically ventilated patients in the intensive care unit.  JAMA. 2004;  291 1753-1762
• 17 Hopkins R O, Jackson J C. Long-term neurocognitive function after critical illness.  Chest. 2006;  130 869-878
• 18 Jones C, Griffiths R D, Humphris G, Skirrow P M. Memory, delusions, and the development of acute posttraumatic stress disorder-related symptoms after intensive care.  Crit Care Med. 2001;  29 573-580
• 19 Jones C, Skirrow P, Griffiths R D et al.. Post-traumatic stress disorder-related symptoms in relatives of patients following intensive care.  Intensive Care Med. 2004;  30 456-460
• 20 Weinert C R, Gross C R, Kangas J R, Bury C L, Marinelli W A. Health-related quality of life after acute lung injury.  Am J Respir Crit Care Med. 1997;  156(4 Pt 1) 1120-1128
• 21 Cox C E, Docherty S L, Brandon D H et al.. Surviving critical illness: acute respiratory distress syndrome as experienced by patients and their caregivers.  Crit Care Med. 2009;  37 2702-2708
• 22 Hofhuis J GM, van Stel H F, Schrijvers A JP, Rommes J H, Bakker J, Spronk P E. Conceptual issues specifically related to health-related quality of life in critically ill patients.  Crit Care. 2009;  13 118
• 23 Scales D C, Tansey C M, Matte A, Herridge M S. Difference in reported pre-morbid health-related quality of life between ARDS survivors and their substitute decision makers.  Intensive Care Med. 2006;  32 1826-1831
• 24 Gartlehner G, Hansen R A, Carson S S, Lohr K N. Efficacy and safety of inhaled corticosteroids in patients with COPD: a systematic review and meta-analysis of health outcomes.  Ann Fam Med. 2006;  4 253-262
• 25 Cox G, Thomson N C, Rubin A S AIR Trial Study Group et al. Asthma control during the year after bronchial thermoplasty.  N Engl J Med. 2007;  356 1327-1337
• 26 Zinner D E, Campbell E G. Life-science research within US academic medical centers.  JAMA. 2009;  302 969-976
• 27 Cooke C R, Kahn J M, Caldwell E et al.. Predictors of hospital mortality in a population-based cohort of patients with acute lung injury.  Crit Care Med. 2008;  36 1412-1420
• 28 Carson S S, Garrett J, Hanson L C et al.. A prognostic model for one-year mortality in patients requiring prolonged mechanical ventilation.  Crit Care Med. 2008;  36 2061-2069
• 29 Harrell Jr F E. Predicting Outcomes: Applied Survival Analysis and Logistic Regression. Charlottesville; University of Virginia 1997
• 30 Lynn J, Teno J M, Harrell Jr F E. Accurate prognostications of death: opportunities and challenges for clinicians.  West J Med. 1995;  163 250-257
• 31 White D B, Engelberg R A, Wenrich M D, Lo B, Curtis J R. Prognostication during physician-family discussions about limiting life support in intensive care units.  Crit Care Med. 2007;  35 442-448
• 32 Christakis N A. Death Foretold: Prophecy and Prognosis in Medical Care. Chicago; University of Chicago Press 1999
• 33 Christakis N A, Iwashyna T J. Attitude and self-reported practice regarding prognostication in a national sample of internists.  Arch Intern Med. 1998;  158 2389-2395
• 34 Freeman Jr R B. Model for end-stage liver disease (MELD) for liver allocation: a 5-year score card.  Hepatology. 2008;  47 1052-1057
• 35 Davis S Q, Garrity Jr E R. Organ allocation in lung transplant.  Chest. 2007;  132 1646-1651
• 36 Huh J W, Song K, Yum J S, Hong S B, Lim C M, Koh Y. Association of mannose-binding lectin-2 genotype and serum levels with prognosis of sepsis.  Crit Care. 2009;  13 R176
• 37 Yan S B, Helterbrand J D, Hartman D L, Wright T J, Bernard G R. Low levels of protein C are associated with poor outcome in severe sepsis.  Chest. 2001;  120 915-922
• 38 Bernard G R, Vincent J L, Laterre P F Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group et al. Efficacy and safety of recombinant human activated protein C for severe sepsis.  N Engl J Med. 2001;  344 699-709
• 39 Meisel C, Schefold J C, Pschowski R et al.. Granulocyte-macrophage colony-stimulating factor to reverse sepsis-associated immunosuppression: a double-blind, randomized, placebo-controlled multicenter trial.  Am J Respir Crit Care Med. 2009;  180 640-648
• 40 Wiedemann H P, Wheeler A P, Bernard G R National Heart, Lung, and Blood Institute Acute Respiratory Distress Syndrome (ARDS) Clinical Trials Network et al. Comparison of two fluid-management strategies in acute lung injury.  N Engl J Med. 2006;  354 2564-2575
• 41 Barrett-Connor E, Grady D. Hormone replacement therapy, heart disease, and other considerations.  Annu Rev Public Health. 1998;  19 55-72
• 42 Grady D, Rubin S M, Petitti D B et al.. Hormone therapy to prevent disease and prolong life in postmenopausal women.  Ann Intern Med. 1992;  117 1016-1037
• 43 Stampfer M J, Colditz G A. Estrogen replacement therapy and coronary heart disease: a quantitative assessment of the epidemiologic evidence.  Prev Med. 1991;  20 47-63
• 44 Manson J E, Hsia J, Johnson K C Women's Health Initiative Investigators et al. Estrogen plus progestin and the risk of coronary heart disease.  N Engl J Med. 2003;  349 523-534
• 45 Prentice R L, Langer R, Stefanick M L Women's Health Initiative Investigators et al. Combined postmenopausal hormone therapy and cardiovascular disease: toward resolving the discrepancy between observational studies and the Women's Health Initiative clinical trial.  Am J Epidemiol. 2005;  162 404-414
• 46 Hernán M A, Alonso A, Logan R et al.. Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease.  Epidemiology. 2008;  19 766-779
• 47 Benson K, Hartz A J. A comparison of observational studies and randomized, controlled trials.  N Engl J Med. 2000;  342 1878-1886
• 48 Terblanche M, Almog Y, Rosenson R S, Smith T S, Hackam D G. Statins and sepsis: multiple modifications at multiple levels.  Lancet Infect Dis. 2007;  7 358-368
• 49 Almog Y, Shefer A, Novack V et al.. Prior statin therapy is associated with a decreased rate of severe sepsis.  Circulation. 2004;  110 880-885
• 50 Mortensen E M, Restrepo M I, Anzueto A, Pugh J. The effect of prior statin use on 30-day mortality for patients hospitalized with community-acquired pneumonia.  Respir Res. 2005;  6 82
• 51 Mortensen E M, Restrepo M I, Copeland L A et al.. Impact of previous statin and angiotensin II receptor blocker use on mortality in patients hospitalized with sepsis.  Pharmacotherapy. 2007;  27 1619-1626
• 52 Majumdar S R, McAlister F A, Eurich D T, Padwal R S, Marrie T J. Statins and outcomes in patients admitted to hospital with community acquired pneumonia: population based prospective cohort study.  BMJ. 2006;  333 999
• 53 Thomsen R W, Hundborg H H, Johnsen S P et al.. Statin use and mortality within 180 days after bacteremia: a population-based cohort study.  Crit Care Med. 2006;  34 1080-1086
• 54 Yang K C, Chien J Y, Tseng W K, Hsueh P R, Yu C J, Wu C C. Statins do not improve short-term survival in an oriental population with sepsis.  Am J Emerg Med. 2007;  25 494-501
• 55 Tleyjeh I M, Kashour T, Hakim F A et al.. Statins for the prevention and treatment of infections: a systematic review and meta-analysis.  Arch Intern Med. 2009;  169 1658-1667
• 56 Carson S S, Stocking C, Podsadecki T et al.. Effects of organizational change in the medical intensive care unit of a teaching hospital: a comparison of ‘open’ and ‘closed’ formats.  JAMA. 1996;  276 322-328
• 57 Ghorra S, Reinert S E, Cioffi W, Buczko G, Simms H H. Analysis of the effect of conversion from open to closed surgical intensive care unit.  Ann Surg. 1999;  229 163-171
• 58 Multz A S, Chalfin D B, Samson I M et al.. A “closed” medical intensive care unit (MICU) improves resource utilization when compared with an “open” MICU.  Am J Respir Crit Care Med. 1998;  157(5 Pt 1) 1468-1473
• 59 Pronovost P J, Angus D C, Dorman T, Robinson K A, Dremsizov T T, Young T L. Physician staffing patterns and clinical outcomes in critically ill patients: a systematic review.  JAMA. 2002;  288 2151-2162
• 60 Levy M M, Rapoport J, Lemeshow S, Chalfin D B, Phillips G, Danis M. Association between critical care physician management and patient mortality in the intensive care unit.  Ann Intern Med. 2008;  148 801-809
• 61 Treggiari M M, Martin D P, Yanez N D, Caldwell E, Hudson L D, Rubenfeld G D. Effect of intensive care unit organizational model and structure on outcomes in patients with acute lung injury.  Am J Respir Crit Care Med. 2007;  176 685-690
• 62 Wunsch H, Harrison D A, Rowan K. Health services research in critical care using administrative data.  J Crit Care. 2005;  20 264-269
• 63 Needham D M, Bronskill S E, Rothwell D M et al.. Hospital volume and mortality for mechanical ventilation of medical and surgical patients: a population-based analysis using administrative data.  Crit Care Med. 2006;  34 2349-2354
• 64 Kahn J M, Goss C H, Heagerty P J, Kramer A A, O'Brien C R, Rubenfeld G D. Hospital volume and the outcomes of mechanical ventilation.  N Engl J Med. 2006;  355 41-50
• 65 Kahn J M, Ten Have T R, Iwashyna T J. The relationship between hospital volume and mortality in mechanical ventilation: an instrumental variable analysis.  Health Serv Res. 2009;  44 862-879
• 66 Harris K M, Remler D K. Who is the marginal patient? Understanding instrumental variables estimates of treatment effects.  Health Serv Res. 1998;  33(5 Pt 1) 1337-1360
• 67 Iglehart J K. Prioritizing comparative-effectiveness research—IOM recommendations.  N Engl J Med. 2009;  361 325-328
• 68 Clement F M, Harris A, Li J J, Yong K, Lee K M, Manns B J. Using effectiveness and cost-effectiveness to make drug coverage decisions: a comparison of Britain, Australia, and Canada.  JAMA. 2009;  302 1437-1443