Agreement between an Early-Onset Neonatal Sepsis Risk Calculator and the Colombian Clinical Practice Guideline in Three Tertiary-Care Centers in Bogotá, Colombia

Abstract

Objective Clinical practice guidelines (CPG) worldwide help steer the management of early-onset neonatal sepsis (EONS). These documents typically discourage the use of risk assessment tools. However, prior work has shown that the Kaiser Permanente calculator (Early-Onset Sepsis Calculator [EOScalc]) could be a useful tool in EONS risk assessment. This study aimed to determine the agreement between the recommendations of the Colombian EONS CPG and those of the EOSCalc tool in a cohort of newborns in Bogotá, Colombia.

Study Design Multicenter retrospective observational cohort study. We included newborns with a gestational age ≥ 34 weeks who were admitted to the neonatal care unit with a suspected diagnosis of EONS between 2017 and 2019. Agreement between the two tools was examined using Cohen's kappa under two scenarios (unequivocal and cautious).

Results Of the 23.490 live births, 470 (1.71%) were admitted to the neonatal care unit with a presumptive diagnosis of EONS. This diagnosis was confirmed in seven patients by means of blood cultures, with group B streptococcus the most common organism (57%; 95% confidence interval [CI]: 18.4–90.1). A single death occurred among the patients with confirmed EONS (lethality: 14.3%). The overall incidence of EONS was 0.298 per 1,000 live births. After splitting the recommendations into two scenarios regarding antibiotic use, unequivocal and cautious, the agreement between EOSCalc and the CPG was below 15% (6 and 14%, respectively).

Conclusion Recommendations from the Colombian EONS CPG show poor agreement with the EOSCalc, with the latter detecting all newborns with EONS. Although the use of EOSCalc is clinically and administratively advantageous, further prospective studies are warranted to determine the safety of its implementation.

Key Points

• Colombian EONS CPGs recommend that an outsized number of newborns be given antibiotics.

• The KP EOSCalc risk assessment calculator shows poor agreement with CPG recommendations.

• The Colombian CPGs should be updated to include the use of risk assessment calculators.

Keywords

neonatal sepsis - newborn - Early-Onset Sepsis Calculator - practice guideline

Publication History

Received: 22 November 2022

Accepted: 09 December 2022

Accepted Manuscript online:
20 December 2022

Article published online:
24 January 2023

• References

• 1 Kimpton JA, Verma A, Thakkar D. et al; Neonatal Trainee-Led Research and Improvement Projects (NeoTRIPs). Comparison of NICE Guideline CG149 and the Sepsis Risk Calculator for the management of early-onset sepsis on the postnatal ward. Neonatology 2021; 118 (05) 562-568
• 2 Good PI, Hooven TA. Evaluating newborns at risk for early-onset sepsis. Pediatr Clin North Am 2019; 66 (02) 321-331
• 3 Benitz WE, Long SS. The holy grail of ascertainment of early-onset neonatal sepsis. J Pediatr 2019; 213: 10-12
• 4 Dhudasia MB, Mukhopadhyay S, Puopolo KM. Implementation of the sepsis risk calculator at an academic birth hospital. Hosp Pediatr 2018; 8 (05) 243-250
• 5 Ministerio de Salud y Protección Social de la República de Colombia, Colciencias, Instituto de Evaluación Tecnológica en Salud. Guía de Práctica Clínica (GPC) Reciín Nacido: Sepsis Neonatal Temprana. 2013. Accessed May 22, 2022. https://www.minsalud.gov.co/sites/rid/Lists/BibliotecaDigital/RIDE/INEC/IETS/GPC_Completa_Sepsis.pdf
• 6 National Institute for Health and Care Excellence (NICE). Neonatal Infection (Early Onset): Antibiotics for Prevention and Treatment. NICE; 2012:222. Accessed July 14, 2022 at: https://www.nice.org.uk/guidance/cg149
• 7 Ji H, Bridges M, Pesek E, Graham K, Tan L, Chabra S. Acute funisitis correlates with the risk of early-onset sepsis in term newborns assessed using the Kaiser Sepsis Calculator. Pediatr Dev Pathol 2019; 22 (06) 523-531
• 8 Eason J, Ward H, Danko O, Richardson K, Vaitkute R, McKeon-Carter R. Early-onset sepsis: can we screen fewer babies safely?. Arch Dis Child 2021; 106 (01) 86-88
• 9 Leonardi BM, Binder M, Griswold KJ, Yalcinkaya GF, Walsh MC. Utilization of a neonatal early-onset sepsis calculator to guide initial newborn management. Pediatr Qual Saf 2019; 4 (05) e214
• 10 Akangire G, Simpson E, Weiner J, Noel-MacDonnell J, Petrikin J, Sheehan M. Implementation of the neonatal sepsis calculator in early-onset sepsis and maternal chorioamnionitis. Adv Neonatal Care 2020; 20 (01) 25-32
• 11 Hershkovich-Shporen C, Ujirauli N, Oren S. et al. Not all newborns born to mothers with clinical chorioamnionitis need to be treated. J Matern Fetal Neonatal Med 2021; 34 (12) 1949-1954
• 12 Goel N, Shrestha S, Smith R. et al. Screening for early onset neonatal sepsis: NICE guidance-based practice versus projected application of the Kaiser Permanente sepsis risk calculator in the UK population. Arch Dis Child Fetal Neonatal Ed 2020; 105 (02) 118-122
• 13 Sharma V, Adkisson C, Gupta K. Managing infants exposed to maternal chorioamnionitis by the use of early-onset sepsis calculator. Glob Pediatr Health 2019; 6: X19833711
• 14 Bridges M, Pesek E, McRae M, Chabra S. Use of an early onset-sepsis calculator to decrease unnecessary NICU admissions and increase exclusive breastfeeding. J Obstet Gynecol Neonatal Nurs 2019; 48 (03) 372-382
• 15 Helmbrecht AR, Marfurt S, Chaaban H. Systematic review of the effectiveness of the neonatal early-onset sepsis calculator. J Perinat Neonatal Nurs 2019; 33 (01) 82-88
• 16 Strunk T, Buchiboyina A, Sharp M, Nathan E, Doherty D, Patole S. Implementation of the neonatal sepsis calculator in an Australian tertiary perinatal centre. Neonatology 2018; 113 (04) 379-382
• 17 Achten NB, Visser DH, Tromp E, Groot W, van Goudoever JB, Plötz FB. Early onset sepsis calculator implementation is associated with reduced healthcare utilization and financial costs in late preterm and term newborns. Eur J Pediatr 2020; 179 (05) 727-734
• 18 Warren S, Garcia M, Hankins C. Impact of neonatal early-onset sepsis calculator on antibiotic use within two tertiary healthcare centers. J Perinatol 2017; 37 (04) 394-397
• 19 Kuzniewicz MW, Puopolo KM, Fischer A. et al. A quantitative, risk-based approach to the management of neonatal early-onset sepsis. JAMA Pediatr 2017; 171 (04) 365-371
• 20 Deshmukh M, Mehta S, Patole S. Sepsis calculator for neonatal early onset sepsis - a systematic review and meta-analysis. J Matern Fetal Neonatal Med 2021; 34 (11) 1832-1840
• 21 Sloane AJ, Coleman C, Carola DL. et al. Use of a modified early-onset sepsis risk calculator for neonates exposed to chorioamnionitis. J Pediatr 2019; 213: 52-57
• 22 Al-Lawama M, AlZaatreh A, Elrajabi R, Abdelhamid S, Badran E. Prolonged Rupture of membranes, neonatal outcomes and management guidelines. J Clin Med Res 2019; 11 (05) 360-366
• 23 Beavers JB, Bai S, Perry J, Simpson J, Peeples S. Implementation and evaluation of the early-onset sepsis risk calculator in a high-risk university nursery. Clin Pediatr (Phila) 2018; 57 (09) 1080-1085
• 24 Escobar GJ, Li DK, Armstrong MA. et al. Neonatal sepsis workups in infants >/=2000 grams at birth: a population-based study. Pediatrics 2000; 106 (2 Pt 1): 256-263
• 25 Allan D. Sample size requirements for interval estimation of the intraclass kappa statistic. Commun Stat Simul Comput 1999; 28 (02) 415-429
• 26 Kuzniewicz MW, Walsh EM, Li S, Fischer A, Escobar GJ. Development and Implementation of an early-onset sepsis calculator to guide antibiotic management in late preterm and term neonates. Jt Comm J Qual Patient Saf 2016; 42 (05) 232-239
• 27 Puopolo KM, Draper D, Wi S. et al. Estimating the probability of neonatal early-onset infection on the basis of maternal risk factors. Pediatrics 2011; 128 (05) e1155-e1163
• 28 Morris R, Jones S, Banerjee S. et al. Comparison of the management recommendations of the Kaiser Permanente neonatal early-onset sepsis risk calculator (SRC) with NICE guideline CG149 in infants ≥34 weeks' gestation who developed early-onset sepsis. Arch Dis Child Fetal Neonatal Ed 2020; 105 (06) 581-586
• 29 Rallis D, Balomenou F, Karantanou K, Kappatou K, Tzoufi M, Giapros V. A comparison between risk-factor guidance for neonatal early-onset sepsis and Kaiser Permanente sepsis risk calculator in a Greek cohort. Early Hum Dev 2021; 155: 105331
• 30 Okike IO, Lamont RF, Heath PT. Do we really need to worry about Listeria in newborn infants?. Pediatr Infect Dis J 2013; 32 (04) 405-406
• 31 Wang Z, Tao X, Liu S, Zhao Y, Yang X. An update review on Listeria infection in pregnancy. Infect Drug Resist 2021; 14: 1967-1978
• 32 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33 (01) 159-174
• 33 Benitz WE, Achten NB. Technical assessment of the neonatal early-onset sepsis risk calculator. Lancet Infect Dis 2021; 21 (05) e134-e140
• 34 Mukhopadhyay S, Taylor JA, Von Kohorn I. et al. Variation in sepsis evaluation across a national network of nurseries. Pediatrics 2017; 139 (03) e20162845