Subscribe to RSS
DOI: 10.1055/a-2702-6872
Applying an Empirical Taxonomy to Alert Malfunctions in a Pragmatic Trial for Hypertension Management in Chronic Kidney Disease
Authors
Funding This work was supported by a grant from the National Institutes of Health (grant no.: 5R01DK116898). The National Institutes of Health had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Abstract
Background
Clinical decision support (CDS) systems have been widely adopted across clinical settings to promote evidence-based practice for clinicians. CDS malfunctions often affect the user experience and indirectly or directly interfere with patient care. To enhance optimal performance, it is critical to constantly monitor the performance of the tool and react promptly when malfunctions are identified.
Objectives
This study aimed to describe malfunctions identified in the development and implementation of a CDS alert as well as lessons learned.
Methods
A pragmatic randomized controlled trial of a CDS alert for primary care patients with chronic kidney disease and uncontrolled blood pressure was conducted. The alert included prechecked default orders for medication initiation or titration, basic metabolic panel, and nephrology electronic consult. Alert monitoring involved retrospective chart review and review of alert firing reports.
Results
Eight CDS malfunctions were identified. The most common causes of malfunctions were due to conceptualization and build errors. Provider feedback and retrospective chart review were the primary methods of identifying the root cause of malfunctions.
Conclusion
Our findings highlight the need for CDS interventions to be continuously monitored through chart review, alert firing reports, and opportunities for provider feedback. Lessons learned from CDS malfunctions can be implemented to improve provider trust in automated electronic health record-based alerts, reduce administrative burden, and prevent inappropriate alert recommendations that can negatively affect patient outcomes. This study is registered with Clinivaltrials.gov (identifier: NCT03679247).
Keywords
clinical decision support - electronic health records and systems - alerting - error management and prevention - ambulatory care - primary careData Sharing Statement
To protect patient privacy and confidentiality, we will not be sharing individual-level deidentified data. Aggregate datasets will be made available upon reasonable request.
Protection of Human and Animal Subjects
This study was approved by the Mass General Brigham Institutional Review Board.
* Denotes equal contribution.
Publication History
Received: 19 February 2025
Accepted: 16 September 2025
Article published online:
28 October 2025
© 2025. Thieme. All rights reserved.
Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany
-
References
- 1 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3: 17
- 2 Sirajuddin AM, Osheroff JA, Sittig DF, Chuo J, Velasco F, Collins DA. Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag 2009; 23 (04) 38-45
- 3 Wright A, Hickman TT, McEvoy D. et al. Analysis of clinical decision support system malfunctions: a case series and survey. J Am Med Inform Assoc 2016; 23 (06) 1068-1076
- 4 Wright A, Ai A, Ash J. et al. Clinical decision support alert malfunctions: analysis and empirically derived taxonomy. J Am Med Inform Assoc 2018; 25 (05) 496-506
- 5 Kassakian SZ, Yackel TR, Gorman PN, Dorr DA. Clinical decisions support malfunctions in a commercial electronic health record. Appl Clin Inform 2017; 8 (03) 910-923
- 6 Wright A, Ash JS, Aaron S. et al. Best practices for preventing malfunctions in rule-based clinical decision support alerts and reminders: results of a Delphi study. Int J Med Inform 2018; 118: 78-85
- 7 Yoshida E, Fei S, Bavuso K, Lagor C, Maviglia S. The value of monitoring clinical decision support interventions. Appl Clin Inform 2018; 9 (01) 163-173
- 8 Kilgallon JL, Gannon M, Burns Z. et al. Multicomponent intervention to improve blood pressure management in chronic kidney disease: a protocol for a pragmatic clinical trial. BMJ Open 2021; 11 (12) e054065
- 9 Meeker D, Linder JA, Fox CR. et al. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA 2016; 315 (06) 562-570
- 10 Samal L, Wu E, Aaron S. et al. Refining clinical phenotypes to improve clinical decision support and reduce alert fatigue: a feasibility study. Appl Clin Inform 2023; 14 (03) 528-537
- 11 Garabedian PM, Gannon MP, Aaron S, Wu E, Burns Z, Samal L. Human-centered design of clinical decision support for management of hypertension with chronic kidney disease. BMC Med Inform Decis Mak 2022; 22 (01) 217
- 12 Samal L, Kilgallon JL, Lipsitz S. et al. Clinical decision support for hypertension management in chronic kidney disease: a randomized clinical trial. JAMA Intern Med 2024; 184 (05) 484-492
- 13 Ash JS, Singh H, Wright A, Chase D, Sittig DF. Essential activities for electronic health record safety: a qualitative study. Health Informatics J 2020; 26 (04) 3140-3151
- 14 Ash JS, Sittig DF, Guappone KP. et al. Recommended practices for computerized clinical decision support and knowledge management in community settings: a qualitative study. BMC Med Inform Decis Mak 2012; 12: 6
- 15 Chaparro JD, Beus JM, Dziorny AC. et al. Clinical decision support stewardship: best practices and techniques to monitor and improve interruptive alerts. Appl Clin Inform 2022; 13 (03) 560-568
- 16 Thayer JG, Miller JM, Fiks AG, Tague L, Grundmeier RW. Assessing the safety of custom web-based clinical decision support systems in electronic health records: a case study. Appl Clin Inform 2019; 10 (02) 237-246
- 17 Aaron S, McEvoy DS, Ray S, Hickman TT, Wright A. Cranky comments: detecting clinical decision support malfunctions through free-text override reasons. J Am Med Inform Assoc 2019; 26 (01) 37-43
- 18 Wright A, McEvoy DS, Aaron S. et al. Structured override reasons for drug-drug interaction alerts in electronic health records. J Am Med Inform Assoc 2019; 26 (10) 934-942
- 19 Jones BE, Collingridge DS, Vines CG. et al. CDS in a learning health care system: identifying physicians' reasons for rejection of best-practice recommendations in pneumonia through computerized clinical decision support. Appl Clin Inform 2019; 10 (01) 1-9
- 20 Yoo J, Lee J, Rhee PL. et al. Alert override patterns with a medication clinical decision support system in an academic emergency department: retrospective descriptive study. JMIR Med Inform 2020; 8 (11) e23351
- 21 Rubins D, Dutta S, Wright A, Zuccotti G. Continuous improvement of clinical decision support via an embedded survey tool. Stud Health Technol Inform 2019; 264: 1763-1764
- 22 Rubins D, McCoy AB, Dutta S. et al. Real-time user feedback to support clinical decision support system improvement. Appl Clin Inform 2022; 13 (05) 1024-1032
- 23 Samal L, Chen SW, Lipsitz S. et al. User actions within a clinical decision support alert for the management of hypertension in chronic kidney disease. Appl Clin Inform 2025; 16 (03) 595-603
- 24 Ray S, McEvoy DS, Aaron S, Hickman TT, Wright A. Using statistical anomaly detection models to find clinical decision support malfunctions. J Am Med Inform Assoc 2018; 25 (07) 862-871
- 25 Guzman-Karlsson MCG, Hess LM, Jeppesen AL, Fortunov RM. Redesigning clinical decision support for retinopathy of prematurity screening after alert failure. Appl Clin Inform 2025; 16 (04) 1024-1030
- 26 Clarke T, Kotarski T, Tobias M. The burden of a highly targeted alert. Appl Clin Inform 2025; 16 (03) 732-735
- 27 Yarahuan JK, Kandaswamy S, Ray E. et al. Clinical decision support to reduce hospital length-of-stay for cancer patients with fever and neutropenia. Appl Clin Inform 2025; 16 (03) 538-543
- 28 Kilgallon JL, Gannon M, Bates DW. et al. Pragmatic clinical decision support trial of pre-checked default orders: monitoring safety and adverse clinical outcomes. J Gen Intern Med 2024;
- 29 Ng HJH, Kansal A, Abdul Naseer JF. et al. Optimizing best practice advisory alerts in electronic medical records with a multi-pronged strategy at a tertiary care hospital in Singapore. JAMIA Open 2023; 6 (03) ooad056
- 30 Wright A, Aaron S, McCoy AB. et al. Algorithmic detection of Boolean logic errors in clinical decision support statements. Appl Clin Inform 2021; 12 (01) 182-189
