Development and Performance of Electronic Acute Kidney Injury Triggers to Identify Pediatric Patients at Risk for Nephrotoxic Medication-associated Harm

Summary

Background: Nephrotoxic medication-associated acute kidney injury (NTMx-AKI) is a costly clinical phenomenon and more common than previously recognized. Prior efforts to use technology to identify AKI have focused on detection after renal injury has occurred.

Objectives: Describe an approach and provide a technical framework for the creation of risk-stratifying AKI triggers and the development of an application to manage the AKI trigger data. Report the performance characteristics of those triggers and the refinement process and on the challenges of implementation.

Methods: Initial manual trigger screening guided design of an automated electronic trigger report. A web-based application was designed to alleviate inefficiency and serve as a user interface and central workspace for the project. Performance of the NTMx exposure trigger reports from September 2011 to September 2013 were evaluated using sensitivity (SN), specificity (SP), positive and negative predictive values (PPV, NPV).

Results: Automated reports were created to replace manual screening for NTMx-AKI. The initial performance of the NTMx exposure triggers for SN, SP, PPV, and NPV all were 0.78, and increased over the study, with all four measures reaching 0.95 consistently. A web-based application was implemented that simplifies data entry and couriering from the reports, expedites results viewing, and interfaces with an automated data visualization tool. Sociotechnical challenges were logged and reported.

Conclusion: We have built a risk-stratifying system based on electronic triggers that detects patients at-risk for NTMx-AKI before injury occurs. The performance of the NTMx-exposed reports has neared 100% through iterative optimization. The complexity of the trigger logic and clinical work-flows surrounding NTMx-AKI led to a challenging implementation, but one that has been successful from technical, clinical, and quality improvement standpoints. This report summarizes the construction of a trigger-based application, the performance of the triggers, and the challenges uncovered during the design, build, and implementation of the system.

Citation: Kirkendall ES, Spires WL, Mottes TA, Schaffzin JK, Barclay C, Goldstein SL. Development and performance of electronic acute kidney injury triggers to identify pediatric patients at risk for nephrotoxic medication-associated harm. Appl Clin Inf 2014; 5: 313–333 http://dx.doi.org/10.4338/ACI-2013-12-RA-0102

Keywords

Electronic health record - electronic medical record - patient safety - acute kidney injury - clinical decision support systems

• References

• 1 Hui-Stickle S, Brewer ED, Goldstein SL. Pediatric ARF epidemiology at a tertiary care center from 1999 to 2001. Am J Kidney Dis 2005; 45 (Suppl. 01) 96-101.
• 2 Moffett BS, Goldstein SL. Acute kidney injury and increasing nephrotoxic-medication exposure in noncritically-ill children. Clinical journal of the American Society of Nephrology CJASN 2011; 6 (Suppl. 04) 856-863.
• 3 Zappitelli M, Moffett BS, Hyder A, Goldstein SL. Acute kidney injury in non-critically ill children treated with aminoglycoside antibiotics in a tertiary healthcare centre: a retrospective cohort study. Nephrol Dial Transplant 2011; 26 (Suppl. 01) 144-150.
• 4 Goldstein SL. et al. Electronic health record identification of nephrotoxin exposure and associated acute kidney injury. Pediatrics 2013; 132 (Suppl. 03) e756-767.
• 5 Resar RK, Rozich JD, Classen D. Methodology and rationale for the measurement of harm with trigger tools. Qual Saf Health Care 2003; 12 (Suppl. 02) ii39-ii45.
• 6 Rozich JD, Haraden CR, Resar RK. Adverse drug event trigger tool: a practical methodology for measuring medication related harm. Qual Saf Health Care 2003; 12 (Suppl. 03) 194-200.
• 7 Doupi P. Using EHR data for Monitoring and Promoting Patient Safety: Reviewing the Evidence on Trigger Tools. Stud Health Technol Inform 2012; 180: 786-790.
• 8 Muething SE. et al. Identifying causes of adverse events detected by an automated trigger tool through in-depth analysis. In: Qual Saf Health Care 2010; 19: 435-439.
• 9 Mull HJ, Nebeker JR. Informatics tools for the development of action-oriented triggers for outpatient adverse drug events. AMIA Annu Symp Proc 2008: 505-509.
• 10 Naessens JM. et al. A comparison of hospital adverse events identified by three widely used detection methods. In: Int J Qual Health Care 2009; 21: 301-307.
• 11 Colpaert K. et al. Implementation of a real-time electronic alert based on the RIFLE criteria for acute kidney injury in ICU patients. Acta clinica Belgica Supplementum 2007; 2: 322-325.
• 12 Colpaert K. et al. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med 2012; 40 (Suppl. 04) 1164-1170.
• 13 Galanter WL, Moja J, Lambert BL. Using computerized provider order entry and clinical decision support to improve prescribing in patients with decreased GFR. Am J Kidney Dis 2010; 56 (Suppl. 05) 809-812.
• 14 Chertow GM. et al. Guided medication dosing for inpatients with renal insufficiency. JAMA 2001; 286 (22) 2839-2844.
• 15 Matheny ME. et al. Development of inpatient risk stratification models of acute kidney injury for use in electronic health records. Medical decision making : an international journal of the Society for Medical Decision Making 2010; 30 (Suppl. 06) 639-650.
• 16 McCoy AB. et al. A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report. Am J Kidney Dis 2010; 56 (Suppl. 05) 832-841.