Performance Characteristics of Gas Analysis Systems: What We Know and What We Need to Know

G. Atkinson; R. C. R. Davison; A. M. Nevill

doi:10.1055/s-2004-830505

International Journal of Sports Medicine, Table of Contents

Int J Sports Med 2005; 26: S2-S10
DOI: 10.1055/s-2004-830505

Performance Characteristics of Gas Analysis Systems: What We Know and What We Need to Know

G. Atkinson¹ , R. C. R. Davison² , A. M. Nevill³

¹Research Institute for Sport and Exercise Sciences, Liverpool John Moores University, UK
²Department of Sport and Exercise Science, University of Portsmouth, UK
³School of Sport, Performing Arts and Leisure, University of Wolverhampton, UK

Abstract

It is important that sources of variation in gas analysis measurements are identified and described in an accurate and informative manner. In this paper, we discussed the potential sources of error, which should be considered in any measurement study on gas analysis systems. We then covered how errors in various terms associated with gas laws propagate to outcome measurements of gas exchange to help quantify the relative importance of sources of error. Finally, we performed a literature survey to explore the statistical methods researchers have employed to arrive at conclusions on the performance characteristics of gas analysis methods. We found examples of excellent practice in the literature, but there were also gaps in the knowledge of error in gas analysis systems. Consequently, we supplied guidelines for future method comparison studies. These guidelines included (i) a sample size of at least 40 participants and the citation of confidence intervals, (ii) a description of the relationships between systematic and random errors and the size of measured value, (iii) the parallel examination of test-retest error within a method comparison study, and (iv) an a priori-made judgement on how much systematic and random error between methods is acceptable for practical applications. We stressed that this judgement should be based on expert-agreed position statements about acceptable error, which unfortunately have yet to be formulated for gas analysis systems.

Key words

Calibration - error sources - systematic and random errors - uniform and proportional errors - precision of estimate

Full Text

References

1 Atkinson G. What is this thing called measurement error?. Reilly T, Marfell-Jones M Kinanthropometry VIII: Proceedings of the 8th International Conference of the International Society for the Advancement of Kinanthropometry (ISAK). London; Taylor and Francis 2003: 3-14
2 Atkinson G, Nevill A M. Statistical methods in assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998; 26 217-238
3 Atkinson G, Nevill A M. Heart rate and performance parameters in cyclists (letter to the editor). Med Sci Sports Exerc. 2001; 33 852
4 Atkinson G, Nevill A M. Selected issues in the design and analysis of sport performance research. J Sports Sci. 2001; 19 811-827
5 Bassett Jr D R, Howley E T, Thompson D L, King G A, Strath S J, McLaughlin J E, Parr B B. Validity of inspiratory and expiratory methods of measuring gas exchange with a computerized system. J Appl Physiol. 2001; 91 218-224
6 Bigard A X, Guezennec C Y. Evaluation of the Cosmed K2 telemetry system during exercise at moderate altitude. Med Sci Sports Exerc. 1995; 27 1333-1338
7 Bland J M, Altman D G. Applying the right statistics: analysis of measurement studies. Ultrasound Obstet Gynecol. 2003; 22 85-93
8 Bland J M, Altman D G. Comparing methods of measurement: why plotting difference against the standard method is misleading. Lancet. 1995; 346 1085-1087
9 Bland J M, Altman D G. Measuring agreement in method comparison studies. Stat Meth Med Res. 1999; 8 135-160
10 Bland J M, Altman D G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 1 307-310
11 Carter J, Jeukendrup A E. Validity and reliability of three commercially available breath-by-breath respiratory systems. Eur J Appl Physiol. 2002; 86 435-441
12 Crandall C G, Taylor S L, Raven P B. Evaluation of the Cosmed K2 portable telemetric oxygen uptake analyser. Med Sci Sports Exerc. 1994; 26 108-111
13 Davis J A. Direct determination of aerobic power. Maud PJ, Foster C Physiological Assessment of Human Fitness. Champaign; Human Kinetics 1995: 9-17
14 Eisenmann J C, Brisko N, Shadrick D, Welsh S. Comparative analysis of the Cosmed Quark b2 and K4b2 gas analysis systems during submaximal exercise. J Sports Med Phys Fit. 2003; 43 150-155
15 Elia M, Mc Donald T, Crisp A. Errors in measurement of CO₂ with the use of drying agents. Clin Chim Acta. 1986; 158 237-244
16 Green I D, Nesarajah M S. Water-vapor pressure of end-tidal air of normals and chronic bronchitics. J Appl Physiol. 1968; 24 229-232
17 Hausswirth C, Bigard A X, LeChevalier J M. The Cosmed K4 telemetry system as an accurate device for oxygen uptake measurements during exercise. Int J Sports Med. 1997; 18 449-453
18 ISO .Accuracy (Trueness and Precision) of Measurement Methods and Results. Use in Practice of Accuracy Values. Geneva; International Standards Publication 1994: ISO 5725 (part 6)
19 James D VB, Doust J H. Reliability of pulmonary V·O₂ measurement and implications for determination of recovery from running. J Sports Sci. 1997; 15 30
20 Jensen K, Johansen L. Reproducibility and validity of physiological parameters measured in cyclists riding on racing bikes placed on a stationary magnetic brake. Scand J Med Sci Sports. 1998; 8 1-6
21 Katch V L, Sady S S, Freedson P. Biological variability in maximal aerobic power. Med Sci Sports Exerc. 1982; 14 21-25
22 Kawakami Y, Nozaki D, Matsuo A, Fukunaga T. Reliability of measurement of oxygen uptake by a portable telemetric system. Eur J Appl Physiol. 1992; 65 409-414
23 King G A, McLaughlin J E, Howley E T, Bassett D R, Ainsworth B E. Validation of aerosport KB1-C portable metabolic system. Int J Sports Med. 1999; 20 304-308
24 Lamarra N, Whipp B. Measurement of pulmonary gas exchange. Maud PJ, Foster C Physiological Assessment of Human Fitness. Champaign; Human Kinetics 1995: 19-35
25 Lothian F, Farrally M R, Mahoney C. Validity and reliability of the Cosmed K2 to measure oxygen uptake. Can J Appl Physiol. 1993; 18 197-206
26 Lucia A, Fleck S J, Gotshall R W, Kearney J T. Validity and reliability of the Cosmed K2 instrument. Int J Sports Med. 1993; 14 380-386
27 Ludbrook J. Comparing methods of measurement. Clin Exp Pharm Physiol. 1997; 24 193-203
28 Macfarlane D J. Automated metabolic gas analysis systems: a review. Sports Med. 2001; 31 841-861
29 McLaughlin J E, King G A, Howley E T, Bassett D R, Ainsworth B E. Validation of the COSMED K4 b2 portable metabolic system. Int J Sports Med. 2001; 22 280-284
30 Meyer T, Georg T, Becker C, Kindermann W. Reliability of gas exchange measurements from two different spiroergometry systems. Int J Sports Med. 2001; 22 593-597
31 Morrow J R, Jackson A W. How “significant” is your reliability?. Res Quart Exerc Sport. 1993; 64 352-355
32 Myers J, Walsh M, Sullivan M, Froelicher V. Effect of sampling on variability and plateau in oxygen uptake. J Appl Physiol. 1990; 68 404-410
33 Nevill A M, Atkinson G. Assessing agreement between measurements recorded on a ratio scale in sports medicine and sports science. Br J Sports Med. 1997; 31 314-318
34 Novitsky S, Segal K R, Chatr-Aryamontri B, Guvakov D, Katch V L. Validity of a new portable indirect calorimeter: the AeroSport TEEM 100. Eur J Appl Physiol. 1995; 70 462-467
35 Peel C, Utsey C. Oxygen-consumption using the K2 telemetry system and a metabolic cart. Med Sci Sports Exerc. 1993; 25 396-400
36 Rietjens G JWM, Kuipers H, Kester A DM, Keizer H A. Validation of a computerised metabolic measurement system (Oxycon-Pro) during low and high intensity exercise. Int J Sports Med. 2001; 22 291-294
37 Unnithan V B, Wilson J, Buchanan D, Timmons J A, Paton J Y. Validation of the sensormedics (S2900 Z) metabolic cart for pediatric exercise testing. Can J Appl Physiol. 1994; 19 472-479
38 Whipp B J, Ward S A, Lamarra N, Davis J A, Wasserman K. Parameters of ventilatory and gas exchange dynamics during exercise. J Appl Physiol. 1982; 52 1506-1513
39 Wideman L, Stoudemire N M, Pass K A, McGinnes C L, Gaesser G A, Weltman A. Assessment of the Aerosport TEEM 100 portable metabolic system. Med Sci Sports Exerc. 1996; 28 509-515
40 Withers R, Gore C, Gass G, Hahn A. Determination of maximal oxygen consumption (V·O_2max) or maximal aerobic power. Gore C Australia Sports Commission: Physiological Tests for Elite Athletes. Champaign; Human Kinetics 2000: 114-127
41 Yamaya Y, Bogaard H J, Wagner P D, Niizeki K, Hopkins S R. Validity of pulse oximetry during maximal exercise in normoxia, hypoxia and hyperoxia. J Appl Physiol. 2002; 92 162-168
42 Yeh M P, Adams T D, Gardner R M, Yanowitz F G. Turbine flowmeter vs. Fleish pneumotachometer: a comparative study for exercise testing. J Appl Physiol. 1987; 63 1289-1295

Dr. G. Atkinson

School of Sport and Exercise Sciences, Liverpool John Moores University

L3 3TU Liverpool

United Kingdom

Phone: + 44(0)1509228444

Email: G.Atkinson@livjm.ac.uk