Subscribe to RSS
DOI: 10.1055/s-0044-1787648
Social Media's Lessons for Clinical Decision Support: Strategies to Improve Engagement and Acceptance
- Background
- Translating Social Media to Clinical Decision Support Systems
- Challenges
- Conclusion
- References
Background
Clinical decision support systems (CDSSs) are an important feature within modern electronic health records (EHRs). There are currently two main ways that CDSSs work: (1) knowledge-based CDSS, which applies if-then rules to generate an output, and (2) non-knowledge-based CDSS, which utilizes machine-learning technology rather than expert medical knowledge to analyze data such as user-generated content from patient interactions to enhance decision making.[1] [2] Used appropriately, CDSS can improve processes of care and reduce costs in health care.[3] Despite their utility, these tools create challenges because of workflow disruption, alert fatigue, and cognitive overload.[4]
Social media platforms are ubiquitous and have combined behavioral economics, neuroscience, design, and marketing with data mining to engage users and influence behavior.[5] [6] [7] [8] [9] Platforms such as Facebook and TikTok use complex recommender systems that analyze user data to provide personalized recommendations to reduce information overload of the users.[10] Other authors have explored components of social media's arsenal, especially population-based strategies and behavioral economics.[11]
In this article, we explore two social media principles, microsegmentation and A/B testing, that could be applied to current-day systems to improve engagement and acceptance of CDSS among clinicians.
Translating Social Media to Clinical Decision Support Systems
Microsegmentation
Marketing firms use microsegmentation to break down a customer base into granular groups. Modern strategies include data-driven approaches that harvest user data from sources such as social media and deliver targeted messages back through the same or similar platforms.[12] Compared with population-based approaches, microsegmentation improves messaging to complex markets by customizing these messages based on customer goals, values, and behaviors.[13] [14] One strategy, computer-tailoring health communication, has impacted changes in health behavior.[15] Microsegmentation of EHR users for CDSS content delivery could optimize the Five Rights of clinical decision support (CDS) by aligning closer to the individual.[16]
Collecting user EHR interaction data to power CDSS recommender systems is a novel opportunity for CDSS, even without the degree of profiling used by social media advertisers. For example, interruptive alerts, while effective at directing a user's attention, are disliked by users to the point that they are the targets of initiatives to reduce burnout.[17] User interaction with CDSS could be used to generate behavior profiles such as high versus low adopters, which could be used to tune the degree of interruption to subgroups. Users who demonstrate reliability to digest noninterruptive information and act accordingly would not need to be subjected to more interruptive alerts, sparing them the cognitive intrusion. Alternatively, CDSS can prompt users who fail to reliably act upon noninterruptive information with more interruptive alerts. For instance, consider an interruptive alert that prompts the user to place an order based on an abnormal laboratory result. User A typically ingests laboratory information through chart review and reliably orders the appropriate intervention before exiting the patient's chart, while User B frequently fails to order the intervention within a reasonable amount of time despite the same availability of information. User A may be included in a group that receives standard information delivery, while User B may be included in a group to receive more conspicuous support. There is a spectrum of options to optimize effectiveness and minimize intrusiveness for User B, such as selecting the channel of alert (e.g., pop-up notification) and the trigger for delivery (e.g., time elapsed since result; [Fig. 1]).


Users may move along this spectrum over time, balancing the ability of the tool to generate the desired outcome against intrusiveness to the user. As the quality of user interaction data increases, future support could be specific to clinicians' behavior and practice and delivered in a manner that harmonizes with their decision-making processes. Eventually, the users' predicted reception of specific tools will allocate them into different user segments, as a result of either a change in performance or periodic review.
A/B Testing
A/B testing is a software development strategy to evaluate design choices that are favored by users. These tests involve presenting one of multiple designs to users in a live environment and measuring metrics such as user feedback or likelihood of desired outcome.[18] A/B testing is frequently utilized by social media companies such as Meta and shows promise to optimize CDSS ([Fig. 2]).[18] [19]


A/B testing could be used to assess the impact of microsegmentation and provide data to power the recommender engines that subsegment users. Surrogates of cognitive load available from the EHR that could be considered for optimization via A/B testing include adherence to suggestions, time-to-task completion, and reduced task-switching.[20] [21] Optimizing such targets would shorten the cognitive work between information gathering and action while reducing distraction. In addition to potential increased efficacy of CDSS, this approach could have the benefit of matching information presentation with cognitive preference and avoid unnecessary depletion of cognitive reserves for users.[22]
Evaluation Plan
Appropriate evaluation of health information technology is critical to minimize the disruption of care delivery and prevent adverse outcomes. There are several frameworks and toolkits to consider, such as the AHRQ Health IT Evaluation Toolkit, and it is important to have an evaluation plan that includes quantitative and qualitative metrics.[23] [24] We highlight some metrics to consider.
Assessing these interventions involves evaluating their effects on clinician practice patterns, clinician acceptance, impact on cognitive load, and user well-being. Improvements in practice of care could be measured by assessing adherence to best-practice guidelines. The use of a like/dislike button and the opportunity to provide free-text response could provide insight into clinician acceptance of certain tools. Cognitive load and usability could be evaluated using established tools such as the NASA Task Load Index, the System Usability Scale, or an assessment of within-EHR errors.[25] [26] Lastly, validated survey instruments such as the Maslach Burnout Inventory, Single Item Burnout Measure, or Copenhagen Burnout Inventory may be administered to evaluate impact on health care worker burnout.[27]
Challenges
The implementation and uptake of new technology by a population requires significant effort, as illustrated by the Gartner hype cycle[28] and the Diffusion of Innovations Theory.[29] We identify challenges to these strategies using the eight-dimensional sociotechnical model proposed by Sittig and Singh.[30] Factors from each of these dimensions could contribute to disuse and compromised care, and these risks could be mitigated by a governance structure to ensure safety and efficacy before widespread adoption of these methods.[31]
Hardware and Software Computing Infrastructure
Custom infrastructure is required for these tools to interface with an organization's resources designed to deliver health care.
Clinical Content
Specific user-interaction data need to be selected to power the tools that drive microsegmentation. The relevance of these data and interventions may differ between users.
Human–Computer Interface
The iterative refinement of information delivery may complicate the user's ability to use tools necessary to deliver care.
People
Human resources are required for the development, implementation, and support of hardware and software. Building a detailed profile of clinicians' electronic behaviors may reveal undesirable variations in care delivery that are not attributable to patient-related variables. In addition to traditional adoption challenges, these strategies may be unpalatable to users due to bad press surrounding social media companies' nefarious use of machine-learning algorithms, and there could be backlash against profiling, similar to other industries that monitor employees with machine learning.[32] Partnerships among patients and caregivers to co-develop CDSS lead to a better understanding of actual needs and values of care delivery and may lead to more impactful and meaningful CDS.[33] Organizations should consider opportunities to engage patients and families to help design, implement, and evaluate these tools.
Workflow and Communication
Dynamically changing how information is delivered to health care workers comes with workflow disruption, and changes may force the person into a process that does not match their clinical workflow.
Internal Organizational Policies, Procedures, and Culture
Beyond HIPAA's mandates to protect patient privacy, institutions need to safeguard employee privacy as well. Institutions would need to establish protocols to identify, investigate, and potentially address significant variations in care discovered incidentally.
External Rules, Regulations, and Pressures
The secure monitoring, use, and storage of patient-identifiable information would need to be ensured. Ownership of logged user data would need to be clarified, particularly regarding regulations on consumer privacy such as the California Consumer Privacy Act[34] and the European Union's General Data Protection Regulation.[35]
System Measurement and Monitoring
In addition to the evaluation plan section of this article, machine-learning techniques require each use case to undergo model development, validation, and monitoring.[36]
Conclusion
CDSS is a vital component of the modern EHR with proven success. However, CDSS tools can frustrate clinicians due to irrelevance, redundancy, or poor delivery. Social media combines advanced data-driven techniques with digital marketing that captures users' attention and influences behavior. Data-driven microsegmentation and A/B testing to optimize the user experience may lead to better engagement and acceptance of CDSS. There are several challenges to successful implementation which could be mitigated with proven frameworks, toolkits, and governance structures.
Conflict of Interest
None declared.
Acknowledgments
The authors would like to acknowledge the special contributions of Dr. David Theil, MD, MMCi, to this work.
-
References
- 1 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3: 17
- 2 Yang X, Joukova A, Ayanso A, Zihayat M. Social influence-based contrast language analysis framework for clinical decision support systems. Decis Support Syst 2022; 159: 113813
- 3 Bright TJ, Wong A, Dhurjati R. et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012; 157 (01) 29-43
- 4 Jankovic I, Chen JH. Clinical decision support and implications for the clinician burnout crisis. Yearb Med Inform 2020; 29 (01) 145-154
- 5 Demographics of Social Media Users and Adoption in the United States. Pew Research Center. Accessed February 28, 2023 at: https://www.pewresearch.org/internet/fact-sheet/social-media/
- 6 Acuff SF, MacKillop J, Murphy JG. Applying behavioral economic theory to problematic Internet use: an initial investigation. Psychol Addict Behav 2018; 32 (07) 846-857
- 7 Meshi D, Tamir DI, Heekeren HR. The emerging neuroscience of social media. Trends Cogn Sci 2015; 19 (12) 771-782
- 8 Harris L, Dennis C. Engaging customers on Facebook: challenges for e-retailers. J Consum Behav 2011; 10 (06) 338-346
- 9 Paquette H. Social Media as a Marketing Tool: A Literature Review. University of Rhode Island; 2013. . Accessed February 28, 2023 at: https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1001&context=tmd_major_papers
- 10 Sibanda EM, Zuva T. Systematic review on online social media recommender systems. In: Software Engineering Perspectives in Systems. 2022: 675-684
- 11 Cho I, Bates DW. Behavioral economics interventions in clinical decision support systems. Yearb Med Inform 2018; 27 (01) 114-121
- 12 Customer Micro-segmentation Marketing. Benefits & best practices. Simon Data. Accessed February 5, 2024 at: https://www.simondata.com/blog-posts/customer-micro-segmentation-marketing-benefits-best-practices
- 13 Day GS. Closing the marketing capabilities gap. J Mark 2011; 75 (04) 183-195
- 14 Sgaier S, Engl E, Kretschmer S. Time to scale psycho-behavioral segmentation in global development (SSIR). Stanf Soc Innov Rev 2018; 16 (04) 48-55
- 15 Bol N, Smit ES, Lustria MLA. Tailored health communication: opportunities and challenges in the digital era. Digit Health 2020; 6: 2055207620958913
- 16 Sirajuddin AM, Osheroff JA, Sittig DF, Chuo J, Velasco F, Collins DA. Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag 2009; 23 (04) 38-45
- 17 McCoy AB, Russo EM, Johnson KB. et al. Clinician collaboration to improve clinical decision support: the Clickbusters initiative. J Am Med Inform Assoc 2022; 29 (06) 1050-1059
- 18 Austrian J, Mendoza F, Szerencsy A. et al. Applying A/B testing to clinical decision support: rapid randomized controlled trials. J Med Internet Res 2021; 23 (04) e16651
- 19 About A/B Testing. Meta business help center. Accessed February 5, 2024 at: https://www.facebook.com/business/help/1738164643098669
- 20 Moy AJ, Schwartz JM, Elias J. et al. Time-motion examination of electronic health record utilization and clinician workflows indicate frequent task switching and documentation burden. AMIA Annu Symp Proc 2020; 886-895
- 21 Bartek B, Lou SS, Kannampallil T. Measuring the cognitive effort associated with task switching in routine EHR-based tasks. J Biomed Inform 2023; 141: 104349
- 22 Engin A, Vetschera R. Information representation in decision making: the impact of cognitive style and depletion effects. Decis Support Syst 2017; 103: 94-103
- 23 Magrabi F, Ammenwerth E, Hyppönen H. et al. Improving evaluation to address the unintended consequences of health information technology. a position paper from the Working Group on Technology Assessment & Quality Development. Yearb Med Inform 2016; 25 (01) 61-69
- 24 Cusack CM, Byrne CM, Hook JM, McGowan J, Poon E, Zafar A. Health information technology evaluation toolkit: 2009 Update. Agency for Healthcare Research and Quality. Accessed February 5, 2024 at: https://digital.ahrq.gov/sites/default/files/docs/biblio/09_0083_EF.pdf
- 25 NASA Task Load Index. Agency for Healthcare Research and Quality. Accessed February 28, 2023 at: https://digital.ahrq.gov/health-it-tools-and-resources/evaluation-resources/workflow-assessment-health-it-toolkit/all-workflow-tools/nasa-task-load-index
- 26 System Usability Scale (SUS). U.S. General Services Administration, Technology Transformation Services. Accessed February 28, 2023 at: https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html
- 27 Valid and Reliable Survey Instruments to Measure Burnout. Well-being, and other work-related dimensions. National Academy of Medicine; . Accessed February 28, 2023 at: https://nam.edu/valid-reliable-survey-instruments-measure-burnout-well-work-related-dimensions/
- 28 Definition of Hype Cycle - IT Glossary. Gartner. Accessed February 28, 2023 at: https://www.gartner.com/en/information-technology/glossary/hype-cycle
- 29 Dearing JW, Cox JG. Diffusion of innovations theory, principles, and practice. Health Aff (Millwood) 2018; 37 (02) 183-190
- 30 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; 19 (suppl 3): i68-i74
- 31 Bedoya AD, Economou-Zavlanos NJ, Goldstein BA. et al. A framework for the oversight and local deployment of safe and high-quality prediction models. J Am Med Inform Assoc 2022; 29 (09) 1631-1636
- 32 O'Neil C. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. 1st ed.. New York, NY: Crown; 2016
- 33 van Leeuwen D, Mittelman M, Fabian L, Lomotan EA. Nothing for me or about me, without me: codesign of clinical decision support. Appl Clin Inform 2022; 13 (03) 641-646
- 34 California Consumer Privacy Act (CCPA). State of California - Department of Justice - Office of the Attorney General. Accessed February 28, 2023 at: https://oag.ca.gov/privacy/ccpa
- 35 Rules for business and organisations. European Commission; . Accessed February 28, 2023. https://commission.europa.eu/law/law-topic/data-protection/reform/rules-business-and-organisations_en
- 36 Biderman S, Scheirer WJ. Pitfalls in machine learning research: reexamining the development cycle. PMLR; 2020: 106-117 . Accessed February 28, 2023 at: https://proceedings.mlr.press/v137/biderman20a.html
Address for correspondence
Publication History
Article published online:
03 July 2024
© 2024. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3: 17
- 2 Yang X, Joukova A, Ayanso A, Zihayat M. Social influence-based contrast language analysis framework for clinical decision support systems. Decis Support Syst 2022; 159: 113813
- 3 Bright TJ, Wong A, Dhurjati R. et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012; 157 (01) 29-43
- 4 Jankovic I, Chen JH. Clinical decision support and implications for the clinician burnout crisis. Yearb Med Inform 2020; 29 (01) 145-154
- 5 Demographics of Social Media Users and Adoption in the United States. Pew Research Center. Accessed February 28, 2023 at: https://www.pewresearch.org/internet/fact-sheet/social-media/
- 6 Acuff SF, MacKillop J, Murphy JG. Applying behavioral economic theory to problematic Internet use: an initial investigation. Psychol Addict Behav 2018; 32 (07) 846-857
- 7 Meshi D, Tamir DI, Heekeren HR. The emerging neuroscience of social media. Trends Cogn Sci 2015; 19 (12) 771-782
- 8 Harris L, Dennis C. Engaging customers on Facebook: challenges for e-retailers. J Consum Behav 2011; 10 (06) 338-346
- 9 Paquette H. Social Media as a Marketing Tool: A Literature Review. University of Rhode Island; 2013. . Accessed February 28, 2023 at: https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1001&context=tmd_major_papers
- 10 Sibanda EM, Zuva T. Systematic review on online social media recommender systems. In: Software Engineering Perspectives in Systems. 2022: 675-684
- 11 Cho I, Bates DW. Behavioral economics interventions in clinical decision support systems. Yearb Med Inform 2018; 27 (01) 114-121
- 12 Customer Micro-segmentation Marketing. Benefits & best practices. Simon Data. Accessed February 5, 2024 at: https://www.simondata.com/blog-posts/customer-micro-segmentation-marketing-benefits-best-practices
- 13 Day GS. Closing the marketing capabilities gap. J Mark 2011; 75 (04) 183-195
- 14 Sgaier S, Engl E, Kretschmer S. Time to scale psycho-behavioral segmentation in global development (SSIR). Stanf Soc Innov Rev 2018; 16 (04) 48-55
- 15 Bol N, Smit ES, Lustria MLA. Tailored health communication: opportunities and challenges in the digital era. Digit Health 2020; 6: 2055207620958913
- 16 Sirajuddin AM, Osheroff JA, Sittig DF, Chuo J, Velasco F, Collins DA. Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag 2009; 23 (04) 38-45
- 17 McCoy AB, Russo EM, Johnson KB. et al. Clinician collaboration to improve clinical decision support: the Clickbusters initiative. J Am Med Inform Assoc 2022; 29 (06) 1050-1059
- 18 Austrian J, Mendoza F, Szerencsy A. et al. Applying A/B testing to clinical decision support: rapid randomized controlled trials. J Med Internet Res 2021; 23 (04) e16651
- 19 About A/B Testing. Meta business help center. Accessed February 5, 2024 at: https://www.facebook.com/business/help/1738164643098669
- 20 Moy AJ, Schwartz JM, Elias J. et al. Time-motion examination of electronic health record utilization and clinician workflows indicate frequent task switching and documentation burden. AMIA Annu Symp Proc 2020; 886-895
- 21 Bartek B, Lou SS, Kannampallil T. Measuring the cognitive effort associated with task switching in routine EHR-based tasks. J Biomed Inform 2023; 141: 104349
- 22 Engin A, Vetschera R. Information representation in decision making: the impact of cognitive style and depletion effects. Decis Support Syst 2017; 103: 94-103
- 23 Magrabi F, Ammenwerth E, Hyppönen H. et al. Improving evaluation to address the unintended consequences of health information technology. a position paper from the Working Group on Technology Assessment & Quality Development. Yearb Med Inform 2016; 25 (01) 61-69
- 24 Cusack CM, Byrne CM, Hook JM, McGowan J, Poon E, Zafar A. Health information technology evaluation toolkit: 2009 Update. Agency for Healthcare Research and Quality. Accessed February 5, 2024 at: https://digital.ahrq.gov/sites/default/files/docs/biblio/09_0083_EF.pdf
- 25 NASA Task Load Index. Agency for Healthcare Research and Quality. Accessed February 28, 2023 at: https://digital.ahrq.gov/health-it-tools-and-resources/evaluation-resources/workflow-assessment-health-it-toolkit/all-workflow-tools/nasa-task-load-index
- 26 System Usability Scale (SUS). U.S. General Services Administration, Technology Transformation Services. Accessed February 28, 2023 at: https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html
- 27 Valid and Reliable Survey Instruments to Measure Burnout. Well-being, and other work-related dimensions. National Academy of Medicine; . Accessed February 28, 2023 at: https://nam.edu/valid-reliable-survey-instruments-measure-burnout-well-work-related-dimensions/
- 28 Definition of Hype Cycle - IT Glossary. Gartner. Accessed February 28, 2023 at: https://www.gartner.com/en/information-technology/glossary/hype-cycle
- 29 Dearing JW, Cox JG. Diffusion of innovations theory, principles, and practice. Health Aff (Millwood) 2018; 37 (02) 183-190
- 30 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; 19 (suppl 3): i68-i74
- 31 Bedoya AD, Economou-Zavlanos NJ, Goldstein BA. et al. A framework for the oversight and local deployment of safe and high-quality prediction models. J Am Med Inform Assoc 2022; 29 (09) 1631-1636
- 32 O'Neil C. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. 1st ed.. New York, NY: Crown; 2016
- 33 van Leeuwen D, Mittelman M, Fabian L, Lomotan EA. Nothing for me or about me, without me: codesign of clinical decision support. Appl Clin Inform 2022; 13 (03) 641-646
- 34 California Consumer Privacy Act (CCPA). State of California - Department of Justice - Office of the Attorney General. Accessed February 28, 2023 at: https://oag.ca.gov/privacy/ccpa
- 35 Rules for business and organisations. European Commission; . Accessed February 28, 2023. https://commission.europa.eu/law/law-topic/data-protection/reform/rules-business-and-organisations_en
- 36 Biderman S, Scheirer WJ. Pitfalls in machine learning research: reexamining the development cycle. PMLR; 2020: 106-117 . Accessed February 28, 2023 at: https://proceedings.mlr.press/v137/biderman20a.html



