Appl Clin Inform 2019; 10(03): 505-512
DOI: 10.1055/s-0039-1693123
Research Article
Georg Thieme Verlag KG Stuttgart · New York

A Quality Improvement Initiative to Decrease Platelet Ordering Errors and a Proposed Model for Evaluating Clinical Decision Support Effectiveness

Julia Whitlow Yarahuan
1   Division of General Pediatrics, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts, United States
,
Amy Billet
2   Division of Hematologic Malignancies and Pediatric Oncology, Dana-Farber Cancer Institute, Boston, Massachusetts, United States
,
Jonathan D. Hron
1   Division of General Pediatrics, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts, United States
› Author Affiliations
Further Information

Publication History

30 March 2019

27 May 2019

Publication Date:
10 July 2019 (online)

Abstract

Background and Objectives Clinical decision support (CDS) and computerized provider order entry have been shown to improve health care quality and safety, but may also generate previously unanticipated errors. We identified multiple CDS tools for platelet transfusion orders. In this study, we sought to evaluate and improve the effectiveness of those CDS tools while creating and testing a framework for future evaluation of other CDS tools.

Methods Using a query of an enterprise data warehouse at a tertiary care pediatric hospital, we conducted a retrospective analysis to assess baseline use and performance of existing CDS for platelet transfusion orders. Our outcome measure was the percentage of platelet undertransfusion ordering errors. Errors were defined as platelet transfusion volumes ordered which were less than the amount recommended by the order set used. We then redesigned our CDS and measured the impact of our intervention prospectively using statistical process control methodology.

Results We identified that 62% of all platelet transfusion orders were placed with one of two order sets (Inpatient Service 1 and Inpatient Service 2). The Inpatient Service 1 order set had a significantly higher occurrence of ordering errors (3.10% compared with 1.20%). After our interventions, platelet transfusion order error occurrence on Inpatient Service 1 decreased from 3.10 to 0.33%.

Conclusion We successfully reduced platelet transfusion ordering errors by redesigning our CDS tools. We suggest that the use of collections of clinical data may help identify patterns in erroneous ordering, which could otherwise go undetected. We have created a framework which can be used to evaluate the effectiveness of other similar CDS tools.

Protection of Human and Animal Subjects

Quality improvement projects that are designed to improve clinical care to better conform to established or accepted standards are considered exempt by our institutional review board.


 
  • References

  • 1 Institute of Medicine Committee on Quality of Health Care in A. In: Kohn LT, Corrigan JM, Donaldson MS. , eds. To Err is Human: Building a Safer Health System. Washington, DC: National Academies Press (US); Copyright 2000 by the National Academy of Sciences. All rights reserved; 2000
  • 2 Institute of Medicine Committee on Quality of Health Care in A. Crossing the Quality Chasm. A New Health System for the 21st Century. Washington, DC: National Academies Press (US); Copyright 2001 by the National Academy of Sciences. All rights reserved; 2001
  • 3 Fact Sheet. Medicare and Medicaid EHR incentive programs: Title IV of Recovery Act; 2009 . Available at: www.cms.gov/EHRIncentivePrograms . Accessed June 15, 2019
  • 4 Wright A, Sittig DF, Ash JS. , et al. Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc 2011; 18 (03) 232-242
  • 5 Jaspers MWM, Smeulers M, Vermeulen H, Peute LW. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc 2011; 18 (03) 327-334
  • 6 Osheroff JA. , Healthcare Information and Management Systems Society. Improving Outcomes with Clinical Decision Support: An Implementer's Guide. 2nd ed. Chicago, IL: HIMSS; 2005
  • 7 Osheroff JA, Teich JM, Middleton B, Steen EB, Wright A, Detmer DE. A roadmap for national action on clinical decision support. J Am Med Inform Assoc 2007; 14 (02) 141-145
  • 8 Middleton B, Sittig DF, Wright A. Clinical decision support: a 25 year retrospective and a 25 year vision. Yearb Med Inform 2016; (Suppl. 01) S103-S116
  • 9 Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J. Effect of point-of-care computer reminders on physician behaviour: a systematic review. CMAJ 2010; 182 (05) E216-E225
  • 10 Kitchlu A, Abdelshaheed T, Tullis E, Gupta S. Gaps in the inpatient management of chronic obstructive pulmonary disease exacerbation and impact of an evidence-based order set. Can Respir J 2015; 22 (03) 157-162
  • 11 Jacobs BR, Hart KW, Rucker DW. Reduction in clinical variance using targeted design changes in computerized provider order entry (CPOE) order sets: impact on hospitalized children with acute asthma exacerbation. Appl Clin Inform 2012; 3 (01) 52-63
  • 12 Chaudhry B, Wang J, Wu S. , et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006; 144 (10) 742-752
  • 13 Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med 2001; 345 (13) 965-970
  • 14 Scheitel MR, Kessler ME, Shellum JL. , et al. Effect of a novel clinical decision support tool on the efficiency and accuracy of treatment recommendations for cholesterol management. Appl Clin Inform 2017; 8 (01) 124-136
  • 15 Utidjian LH, Hogan A, Michel J. , et al. Clinical decision support and palivizumab: a means to protect from respiratory syncytial virus. Appl Clin Inform 2015; 6 (04) 769-784
  • 16 Stürzlinger H, Hiebinger C, Pertl D, Traurig P. Computerized physician order entry - effectiveness and efficiency of electronic medication ordering with decision support systems. GMS Health Technol Assess 2009; 5: Doc07
  • 17 Devine EB, Hansen RN, Wilson-Norton JL. , et al. The impact of computerized provider order entry on medication errors in a multispecialty group practice. J Am Med Inform Assoc 2010; 17 (01) 78-84
  • 18 Wolfstadt JI, Gurwitz JH, Field TS. , et al. The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review. J Gen Intern Med 2008; 23 (04) 451-458
  • 19 Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003; 163 (12) 1409-1416
  • 20 Garg AX, Adhikari NK, McDonald H. , et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005; 293 (10) 1223-1238
  • 21 Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 1998; 280 (15) 1339-1346
  • 22 Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005; 330 (7494): 765
  • 23 Bright TJ, Wong A, Dhurjati R. , et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012; 157 (01) 29-43
  • 24 Bates DW, Pappius E, Kuperman GJ. , et al. Using information systems to measure and improve quality. Int J Med Inform 1999; 53 (2-3): 115-124
  • 25 Sittig DF, Wright A, Simonaitis L. , et al. The state of the art in clinical knowledge management: an inventory of tools and techniques. Int J Med Inform 2010; 79 (01) 44-57
  • 26 Ash JS, Sittig DF, Campbell EM, Guappone KP, Dykstra RH. Some unintended consequences of clinical decision support systems. AMIA Annual Symposium Proceedings. AMIA Symposium; 2007: 26-30
  • 27 Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006; 13 (05) 547-556
  • 28 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2007; 14 (04) 415-423
  • 29 Singh H, Sittig DF. Measuring and improving patient safety through health information technology: the health IT safety framework. BMJ Qual Saf 2016; 25 (04) 226-232
  • 30 Koppel R, Metlay JP, Cohen A. , et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005; 293 (10) 1197-1203
  • 31 Koppel R, Chen Y. Unintended consequences: new problems, new solutions. Contributions from 2015. Yearb Med Inform 2016; (01) 87-92
  • 32 Computerized Provider Order Entry with Decision Support. The Office of the National Coordinator for Health Information Technology; 2016 . Available at: HealthIT.gov . Accessed June 15, 2019
  • 33 Schiffer CA, Bohlke K, Delaney M. , et al. Platelet transfusion for patients with cancer: American Society of Clinical Oncology Clinical Practice guideline update. J Clin Oncol 2018; 36 (03) 283-299
  • 34 Roseff S. Pediatric Transfusion: A Physician’s Handbook. 3rd ed. Bethesda, MD: AABB Press; 2009
  • 35 Heddle NM, Cook RJ, Tinmouth A. , et al; SToP Study Investigators of the BEST Collaborative. A randomized controlled trial comparing standard- and low-dose strategies for transfusion of platelets (SToP) to patients with thrombocytopenia. Blood 2009; 113 (07) 1564-1573
  • 36 Benson AB, Moss M, Silliman CC. Transfusion-related acute lung injury (TRALI): a clinical review with emphasis on the critically ill. Br J Haematol 2009; 147 (04) 431-443
  • 37 Bolton-Maggs PHB, Cohen H. Serious Hazards of Transfusion (SHOT) haemovigilance and progress is improving transfusion safety. Br J Haematol 2013; 163 (03) 303-314
  • 38 Rothschild JM, McGurk S, Honour M. , et al. Assessment of education and computerized decision support interventions for improving transfusion practice. Transfusion 2007; 47 (02) 228-239
  • 39 Chang CS, Lin YC, Wu YC, Yeh CJ, Lin YC. The effects of a computerized transfusion decision support system on physician compliance and its appropriateness for fresh frozen plasma use in a medical center. Am J Clin Pathol 2011; 135 (03) 417-422
  • 40 Speroff T, O'Connor GT. Study designs for PDSA quality improvement research. Qual Manag Health Care 2004; 13 (01) 17-32
  • 41 McQuillan RF, Silver SA, Harel Z. , et al. How to measure and interpret quality improvement data. Clin J Am Soc Nephrol 2016; 11 (05) 908-914
  • 42 Yoshida E, Fei S, Bavuso K, Lagor C, Maviglia S. The value of monitoring clinical decision support interventions. Appl Clin Inform 2018; 9 (01) 163-173
  • 43 Horsky J, Phansalkar S, Desai A, Bell D, Middleton B. Design of decision support interventions for medication prescribing. Int J Med Inform 2013; 82 (06) 492-503
  • 44 Wright A, Sittig DF, Ash JS. , et al. Lessons learned from implementing service-oriented clinical decision support at four sites: a qualitative study. Int J Med Inform 2015; 84 (11) 901-911
  • 45 Wright A, Ai A, Ash J. , et al. Clinical decision support alert malfunctions: analysis and empirically derived taxonomy. J Am Med Inform Assoc 2018; 25 (05) 496-506
  • 46 Kannry J, McCullagh L, Kushniruk A, Mann D, Edonyabo D, McGinn T. A framework for usable and effective clinical decision support: experience from the iCPR randomized clinical trial. EGEMS (Wash DC) 2015; 3 (02) 1150
  • 47 SAFER Guides. Available at: https://www.healthit.gov/topic/safety/safer-guides . Accessed June 15, 2019