Intra and interobserver reliability of the interpretation of high-resolution computed tomography on the lungs of premature infants
Keywords:
Tomography, X-ray computed, Infant, premature, Lung, Bronchopulmonary dysplasia, Reproducibility of results, InfantAbstract
CONTEXT AND OBJECTIVE: High-resolution computed tomography (HRCT) of the lungs is more sensitive than radiographs for evaluating pulmonary disease, but little has been described about HRCT interpretation during the neonatal period or shortly afterwards. The aim here was to evaluate the reliability of the interpretation of HRCT among very low birth weight premature infants (VLBWPI; < 1500 g). DESIGN AND SETTING: Cross-sectional study on intra and interobserver reliability of HRCT on VLBWPI. METHODS: 86 VLBWPI underwent HRCT. Two pediatric radiologists analyzed the HRCT images. The reliability was measured by the proportion of agreement, kappa coefficient (KC) and positive and negative agreement indices. RESULTS: For radiologist A, the intraobserver reliability KC was 0.79 (confidence interval, CI: 0.54-1.00) for normal/abnormal examinations; for each abnormality on CT, KC ranged from 0.05 to 1.00. For radiologist B, the intraobserver reliability KC was 0.79 (CI: 0.54-1.00) for normal/abnormal examinations; for each abnormality on CT, KC ranged from 0.37 to 0.83. The interobserver agreement was 88% for normal/abnormal examinations and KC was 0.71 (CI: 0.5- 0.93); for most abnormal findings, KC ranged from 0.51-0.67. CONCLUSION: For normal/abnormal examinations, the intra and interobserver agreements were substantial. For most of the imaging findings, the intraobserver agreement ranged from moderate to substantial. Our data demonstrate that in clinical practice, there is no reason for more than one tomographic image evaluator, provided that this person is well trained in VLBWPI HRCT interpretation. Analysis by different observers should be reserved for research and for difficult cases in clinical contexts.
Downloads
References
Clark PW, Bloomfield FH, Harding JE, Teele RL. Early chest radiographs in very low birth weight babies receiving corticosteroids for lung disease. Pediatr Pulmonol. 2001;31(4): 297-300.
Clark RH, Gerstmann DR, Jobe AH, et al. Lung injury in neonates: causes, strategies for prevention, and long-term consequences. J Pediatr. 2001;139(4):478-86.
Coalson JJ. Pathology of new bronchopulmonary dysplasia. Semin Neonatol. 2003;8(1): 73-81.
Jobe AH, Ikegami M. Mechanisms initiating lung injury in preterm. Early Hum Dev. 1998;53(1):81-94.
Speer CP. Inflammation and bronchopulmonary dysplasia. Semin Neonatol. 2003;8(1):29-38.
Palta M, Sadek M, Barnet JH, et al. Evaluation of criteria for chronic lung disease in surviving very low birth weight infants. Newborn Lung Project. J Pediatr. 1998;132(1):57-63.
Tapia JL, Agost D, Alegria A, et al. Bronchopulmonary dysplasia: incidence, risk factors and resource utilization in a population of South American very low birth weight infants. J Pediatr (Rio J). 2006;82(1):15-20.
Davis JM, Dickerson B, Metlay L, Penney DP. Differential effects of oxygen and barotrauma on lung injury in the neonatal piglet. Pediatr Pulmonol. 1991;10(3):157-63.
Lucaya J, Le Pointe. High-resolution CT of the lung in children. technique, indications, ana- tomy, features of lung disease, and clinical application. In: Lucaya J, Strife JL, editors. Pedia- tric chest imaging: Chest imaging in infants and children. Berlin: Springer Verlag; 2002. p. 55-92.
Lynch DA, Hay T, Newell JD Jr, Divgi VD, Fan LL. Pediatric diffuse lung disease: diagnosis and classification using high-resolution CT. AJR Am J Roentgenol. 1999;173(3):713-8.
Aquino SL, Schechter MS, Chiles C, et al. High-resolution inspiratory and expiratory CT in older children and adults with bronchopulmonary dysplasia. AJR Am J Roentgenol. 1999;173(4):963-7.
Aukland SM, Halvorsen T, Fosse KR, Daltveit AK, Rosendahl K. High-resolution CT of the chest in children and young adults who were born prematurely: findings in a population-based study. AJR Am J Roentgenol. 2006;187(4):1012-8.
Howling SJ, Northway WH Jr, Hansell DM, et al. Pulmonary sequelae of bronchopulmona- ry dysplasia survivors: high-resolution CT findings. AJR Am J Roentgenol. 2000;174(5): 1323-6.
Mello RR, Dutra MV, Ramos JR, et al. Lung mechanics and high-resolution computed tomography of the chest in very low birth weight premature infants. Sao Paulo Med J. 2003;121(4):167-72.
Oppenheim C, Mamou-Mani T, Sayegh N, et al. Bronchopulmonary dysplasia: value of CT in identifying pulmonary sequelae. AJR Am J Roentgenol. 1994;163(1):169-72.
Mahut B, De Blic J, Emond S, et al. Chest computed tomography findings in bronchopul- monary dysplasia and correlation with lung function. Arch Dis Child Fetal Neonatal Ed. 2007;92(6):F459-64.
Ochiai M, Hikino S, Yabuuchi H, et al. A new scoring system for computed tomography of the chest for assessing the clinical status of bronchopulmonary dysplasia. J Pediatr. 2008;152(1):90-5, 95.e1-3.
Bloomfield FH, Teele RL, Voss M, Knight DB, Harding JE. Inter- and intra-observer variability in the assessment of atelectasis and consolidation in neonatal chest radiographs. Pediatr Radiol. 1999;29(6):459-62.
Fitzgerald DA, Van Asperen PP, Lam AH, De Silva M, Henderson-Smart DJ. Chest radiograph abnormalities in very low birthweight survivors of chronic neonatal lung disease. J Paediatr Child Health. 1996;32(6):491-4.
Moya MP, Bisset GS 3rd, Auten RL Jr, et al. Reliability of CXR for the diagnosis of bronchopul- monary dysplasia. Pediatr Radiol. 2001;31(5):339-42.
Jobe AH, Bancalari E. Bronchopulmonary dysplasia. Am J Respir Crit Care Med. 2001; 163(7):1723-9.
Mello RR, Dutra MV, Lopes JMA. Morbidade respiratória no primeiro ano de vida de pre- maturos egressos de uma unidade pública de tratamento intensivo neonatal [Respiratory morbidity in the first year of life of preterm infants discharged from a neonatal intensive care unit]. J Pediatr (Rio J). 2004;80(6):503-10.
Seely JM, Effmann EL, Müller NL. High-resolution CT of pediatric lung disease: imaging findings. AJR Am J Roentgenol. 1997;168(5):1269-75.
Lucaya J, Piqueras J, García-Peña P, et al. Low-dose high-resolution CT of the chest in chil- dren and young adults: dose, cooperation, artifact incidence, and image quality. AJR Am J Roentgenol. 2000;175(4):985-92.
Webb WR, Müller NL, Naidich DP. High-resolution CT of the lung. 3rd ed. Philadelphia: Lippin- cott Williams & Wilkins; 2000.
Fleiss JL. Statistical methods for rates and proportions. 2nd ed. New York: Wiley Interscience; 1981.
Brennan P, Silman A. Statistical methods for assessing observer variability in clinical mea- sures. BMJ. 1992;304(6840):1491-4.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biome- trics. 1977;33(1):159-74.
Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990;43(6):551-8.
Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543-9.
Albaum MN, Hill LC, Murphy M, et al. Interobserver reliability of the chest radiograph in community-acquired pneumonia. PORT Investigators. Chest. 1996;110(2):343-50.
