Background: Despite their potential, Clinical Decision Support (CDS) systems often
lack alignment with clinicians’ needs and are underutilised in practice. Pilot implementations
can help to improve the fit between systems and local needs by engaging users in real-world
testing and refinement. Although pilot implementations of CDS have been reported,
limited evidence has explored the factors contributing to pilot success.
Objectives: This study aimed to explore the opportunities and challenges associated
with the pilot implementation of a CDS system that ultimately did not progress to
full-scale implementation.
Methods: We conducted interviews with clinicians, health service managers, and vendors
involved in the pilot implementation and use of a mobile application-based CDS and
a dashboard-based CDS in two departments (Emergency and Patient Flow) of a rural Australian
hospital. A semi-structured interview guide was developed using the Non-adoption,
Abandonment, Sustainability, Scale-up, and Spread (NASSS) framework. Interviews were
audio-recorded, transcribed, and thematically analysed.
Results: Analysis revealed four major themes: system performance and design, implementation
processes, organisational support and resources, and perceived benefits of the CDS.
The pilot implementation allowed for greater user input into the iterative design
of CDS in practice, particularly in the Emergency Department, where clinicians had
both the capacity and willingness to engage. However, technical issues encountered
early in the pilot deterred many users who did not re-engage even after issues were
resolved. Although some users remained engaged, they became frustrated as organisational
resource constraints meant that critical issues impacting the CDS’s clinical utility
went unresolved.
Conclusions: Successful CDS pilots depend on the readiness of organisations, departments,
and users to engage in pilot activities. Pilot implementations should be pursued in
settings where users have both the capacity and willingness to participate in iterative
feedback processes and where organisations have sufficient resources to address emerging
needs.