Methods Inf Med 2008; 47(04): 328-335
DOI: 10.3414/ME0500
Original Article
Schattauer GmbH

Predictive Value of ICD-9-CM Codes Used in Vaccine Safety Research

J. P. Mullooly
1   Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA
,
J. G. Donahue
2   Marshfield Clinic, Marshfield, WI, USA
,
F. DeStefano
3   Centers for Disease Control and Prevention, Atlanta, GA, USA
,
J. Baggs
1   Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA
,
E. Eriksen
1   Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA
,
for the VSD Data Quality Working Group› Author Affiliations
Further Information

Publication History

Received: 20 July 2007

accepted: 25 February 2008

Publication Date:
18 January 2018 (online)

Preview

Summary

Objectives: To assess how well selected ICD-9-CM diagnosis codes predict adverse events; to model bias and power loss when vaccine safety analyses rely on unverified codes.

Methods: We extracted chart verification data for ICD-9-CM diagnosis codes from six Vaccine Safety Datalink (VSD) publications and modeled biases and power losses using positive predictive value (PPV) estimates and ranges of code sensitivity.

Results: Positive predictive values were high for type 1 diabetes (80%) in children, relative to WHO criteria, and intussusception (81%) in young children, relative to a standard published case definition. PPVs were moderate (65%) for inpatient and emergency department childhood seizures and low (21%) for outpatient childhood seizures, both relative to physician investigator judgment. Codes for incident central nervous system demyelinating disease in adults had high PPV for inpatient codes (80%) and low PPV for outpatient codes (42%) relative to physicians’ diagnoses. Modeled biases were modest, but large increases in frequencies of adverse events are required to achieve adequate power if unverified ICD-9-CM codes are used, especially when vaccine associations are weak.

Conclusions: ICD-9-CM codes for type 1 diabetes in children, intussusception in young children, childhood seizures in inpatient and emergency care settings, and inpatient demyelinating disease in adults were sufficiently predictive for vaccine safety analyses to rely on unverified diagnosis codes. Adverse event misclassification should be accounted for in statistical power calculations.