Subscribe to RSS
DOI: 10.1055/a-2207-7396
Developing a Quality Improvement Implementation Taxonomy for Organizational Employee Wellness Initiatives
Funding The project was supported by the VAQS fellowship, through the VA Office of Academic Affiliations Advanced Fellowships Program.
- Abstract
- Background and Significance
- Objectives
- Methods
- Results
- Discussion
- Conclusion
- Clinical Relevance Statement
- Multiple Choice Questions
- References
Abstract
Background Standardized taxonomies (STs) facilitate knowledge representation and semantic interoperability within health care provision and research. However, a gap exists in capturing knowledge representation to classify, quantify, qualify, and codify the intersection of evidence and quality improvement (QI) implementation. This interprofessional case report leverages a novel semantic and ontological approach to bridge this gap.
Objectives This report had two objectives. First, it aimed to synthesize implementation barrier and facilitator data from employee wellness QI initiatives across Veteran Affairs health care systems through a semantic and ontological approach. Second, it introduced an original framework of this use-case-based taxonomy on implementation barriers and facilitators within a QI process.
Methods We synthesized terms from combined datasets of all-site implementation barriers and facilitators through QI cause-and-effect analysis and qualitative thematic analysis. We developed the Quality Improvement and Implementation Taxonomy (QIIT) classification scheme to categorize synthesized terms and structure. This framework employed a semantic and ontological approach. It was built upon existing terms and models from the QI Plan, Do, Study, Act phases, the Consolidated Framework for Implementation Research domains, and the fishbone cause-and-effect categories.
Results The QIIT followed a hierarchical and relational classification scheme. Its taxonomy was linked to four QI Phases, five Implementing Domains, and six Conceptual Determinants modified by customizable Descriptors and Binary or Likert Attribute Scales.
Conclusion This case report introduces a novel approach to standardize the process and taxonomy to describe evidence translation to QI implementation barriers and facilitators. This classification scheme reduces redundancy and allows semantic agreements on concepts and ontological knowledge representation. Integrating existing taxonomies and models enhances the efficiency of reusing well-developed taxonomies and relationship modeling among constructs. Ultimately, employing STs helps generate comparable and sharable QI evaluations for forecast, leading to sustainable implementation with clinically informed innovative solutions.
Keywords
evidence - quality improvement - standardized taxonomy - implementation barriers - implementation facilitatorsBackground and Significance
Standardized Taxonomies, Quality Improvement, and Implementation Science
Standardized terminologies or taxonomies (STs) compile agreed-upon terms to represent clinical knowledge.[1] They foster semantic interoperability in health care documentation and clinical practice,[2] [3] [4] improve knowledge representation, and support evidence-based (EB) interpretation of disease and well-being, thus aiding health care provision and clinical research.[5] Quality improvement (QI) involves continuous efforts to enhance patient outcomes, system performance, and professional development[6] that drive quality, efficiency, safety, timeliness, patient-centeredness, and equity improvement.[7] Implementation science addresses challenges in integrating research findings and EB practice into routine health care to improve quality and effectiveness.[8] [9] In the United States, where health systems have undergone full-scale digitalization,[10] [11] STs are crucial for achieving semantic and ontological interoperability and evidence translation into QI through implementation and innovation.
However, existing taxonomies have primarily concentrated on implementation outcomes[12] [13] and strategies,[14] [15] [16] [17] leaving gaps in capturing implementation barriers and facilitators. Implementation theories and frameworks often describe similar or identical barriers and facilitators as influential or determinant factors with different names,[18] [19] making it challenging to create digital solutions that facilitate consistent and efficient evidence translation within QI efforts.
Semantic and Ontological Approaches and Use Cases
Semantic and ontology-driven approaches can digitally capture and represent concepts and processes to close these gaps. Semantic-based solutions that address data semantic heterogeneity and leverage conceptual attributes to formulate semantic meanings and relations with domain-specific solutions have improved health care effectiveness and efficiency.[20] [21] Ontology-oriented approaches aim to create shared knowledge representation that can be reused across systems and databases,[20] for example, the creation of an ontology toolkit for chronic disease management.[21]
Use cases, introduced in the late-1980s to represent specific user–system interactions,[22] have evolved into a unifying element for project activities.[23] They have found applications in health care to ensure consistent data feeds for clinical data, such as lab results, vital signs, and medication allergies.[24] These approaches hold promise for improving the implementation of EB practice through QI.
Commonly Employed Quality Improvement and Implementation Science Vocabulary and Models
Utilizing established terminology and models from QI and implementation science can enhance semantic and ontological agreements. Without semantic interoperability, similar or identical concepts may be captured by different terms perceived or constructed as separate or multiple entities.[25] Well-known models and taxonomies like the QI Plan–Do–Study–Act (PDSA) model, Consolidated Framework for Implementation Research (CFIR), and cause-and-effect analysis can promote interoperability in managing and exchanging digital information through collective applications in use cases.
PDSA, which originated in industry with widespread applicability in health care, employs a standardized four-step iterative model for process improvement using STs.[26] Its model begins with developing a “plan” phase comprising articulated outcomes and assigned tasks, followed by a “do” phase to implement the plan. Data collection and analysis are performed in the next “study” phase. Based on evaluations, the final “act” phase is concluded with adoption, adaptation, or termination. CFIR is an implementation framework that systematically assesses barriers and facilitators to tailor implementation strategies and explain outcomes from design to evaluation.[27] [28] It consolidates implementation theories from different sources into 5 standardized domains and 39 constructs,[16] [19] [28] adaptable to research needs.[29] The five domains include innovation, outer setting, inner setting, individuals, and implementation process. Cause-and-effect analysis, represented as fishbone diagrams, offers customizable structured schemes and terminology for classifying root causes of quality-of-care issues.[27] [30] [31]
Objectives
This interprofessional case report intended to introduce novel semantic and ontological approaches to construct a use-case-based taxonomy within a classification scheme, integrating existing taxonomies and models from QI and implementation science to capture implementation barriers and facilitators within a QI process. Employing accepted taxonomies and models from these fields can expedite the development of this new taxonomy. This approach helps bridge the gap in classifying, quantifying, qualifying, and codifying evidence with QI implementation, particularly in knowledge representation of barriers and facilitators.
This report had two objectives. The first objective was to utilize semantic and ontological approaches to synthesize barrier and facilitator data from the use case of implementing employee wellness QI initiatives across multisite of Veteran Affairs (VA) health care systems. The second objective was to propose an original framework for this use-case-based taxonomy on implementation barriers and facilitators within a QI process.
Methods
Datasets, Sources, and Procedures
The datasets originated from a program evaluation of implementation barriers and facilitators to QI employee wellness initiatives performed by the VA Quality Scholars (VAQS) programs' 2022 incoming fellows. This 2-year advanced interprofessional program focuses on improvement research and initiatives, implementation science, operation leadership, and quality and safety training.[32] [33] [34] Fellows from eight sites collected and analyzed barrier and facilitator data for employee wellness initiatives' implementation. Seventy-one semistructured interviews were conducted using an adaptable interview guide with key stakeholders at various levels of local leadership in different departments. This use case combined the datasets from all sites synthesized and coded by two fellows (E.C.K. and K.S.) using Excel QI Macros. This process involved QI cause-and-effect process analysis and qualitative thematic analysis (see [Fig. 1]). This report did not require Institutional Review Board review and approval as it was related to QI in operations.


Semantic and Ontological Approaches for the Proposed Taxonomy Classification Scheme
The employee wellness initiatives were launched across VA in 2017 to provide collaborative EB resources for employee wellness.[35] Since this initiative spanned all phases of a QI process related to EB wellness implementation, we created an ontological knowledge representation by selecting relevant, well-established QI and implementation models to cover the spectrum from evidence translation through QI to implementation barriers and facilitators. We employed a semantic approach to extract structured terms and concepts from these models and an ontological approach to represent knowledge exchange (see [Fig. 2]). This led to developing the Quality Improvement and Implementation Taxonomy (QIIT) classification scheme, which incorporated elements from the QI PDSA phases, CFIR domains, and fishbone cause-and-effect analysis categories.


To structure the QI process, we adopted PDSA phases. We integrated implementation domains from the five CFIR domains: innovation, outer setting, inner setting, individuals, and implementation process. We delineated barriers and facilitators as conceptual determinants and grouped them into six categories using the fishbone cause-and-effect diagram: people, process, policy, management, materials, and environment. Notably, we applied cause-and-effect categories, typically used for root cause problem analysis, in a novel way to classify influencing factors as both barriers and facilitators. We connected conceptual determinants to a customizable descriptor, further modified using binary and Likert scales. The binary scale captured barriers or facilitators, while the Likert scale quantified the varying barrier or facilitator degrees.
Results
The QIIT followed a two-level hierarchical and relational classification scheme (see [Fig. 3]). This taxonomy originated from Evidence-Based Use Case of QI employee wellness initiatives focusing on implementation barriers and facilitators characterized by Population, Setting, Topic, and Level of Evidence. These characteristics were directly linked to QI Phases, Implementing Domains, Conceptual Determinants modified by customizable Descriptors, and Binary or Likert Attribute Scales at the first level.


At the second level, it branched into four components of Plan, Do, Study, Act of the PDSA phases, five components of Innovation, Outer Setting, Inner Setting, Individuals, and Implementation Process of the CFIR five domains, and six components of People, Process, Policy, Management, Materials, and Environment following the fishbone diagram groupings under Conceptual Determinants.
Conceptual Determinants were further connected to two types of modifiers at a sublevel. The first type was a customizable Descriptor that further delineated a Determinant. The second type was an Attribute Scale calibrated in a binary Positive “ + ” or Negative “–” configuration or a Likert scale. The “–” symbol indicates barriers or attributes with negative connotations, representing what hinders or decreases. In contrast, the “ + ” symbol signifies facilitators or attributes with positive connotations, suggesting what promotes or increases. A Likert Attribute Scale, ranging from “0” to “5,” denoted varying degrees of facilitators and barriers from least (1) to greatest (5), with “0” as “none.”
The synthesized barriers covered all six cause-and-effect categories (see [Table 1]), for example, “Employee burnout” and “Shortage of time” under “People” and “Lack of protected time” under “Policy.” Facilitators were found in five of the six categories, excluding “People.” Facilitators included “Employee rest and protection” under “Policy” and “Wellness staff and leaders” with knowledge of institutional needs under “Management.” Interestingly, some synthesized facilitators overlapped with barriers, such as “Culture,” which was found to promote wellness at some sites and hinder at others.
Abbreviation: COVID-19, coronavirus disease 2019.
Identical QI Phases, Implementing Domains, and Conceptual Determinants captured structured processes and vocabulary that illustrated synthesized barriers and facilitators specific to this use case (see [Table 2]). The Binary Attribute Scale differentiated between barriers and facilitators associated with the same terms. Reused terms like “Communication” stemming from different “Conceptual Determinants” of “Management,” “Material,” or “Process” depicted different QI and implementation process barriers. Common terms like “lack” typically suggested barriers and were given a “–” designation. The neutral term “variable” was used to indicate various degrees of barriers and facilitators not explicitly defined by the Likert Attribute Scale.
Abbreviations: COVID-19, coronavirus disease 2019; QI, quality improvement.
Discussion
This case report introduces a novel approach to standardize the process and taxonomy for describing evidence translation into QI implementation. The results reveal recurring and overlapping terms that describe barriers and facilitators across various QI phases and implementation domains. The QIIT framework, conceptualized according to semantic and ontological approaches, facilitates semantic agreements, simplifies knowledge representation, and encourages efficient reuse of well-developed taxonomies and relationship modeling. This framework serves as a prototype for a digital solution to document barriers and facilitators in evidence translation into QI project implementation.
While prior works have primarily focused on taxonomies for implementation outcomes[12] [13] and strategies,[14] [15] [16] [17] our work emphasizes terminology consistency and offers a taxonomy for implementation barriers and facilitators. We observed descriptor variations of similar concepts and interchangeable use of certain terms, highlighting the need for a common terminology in characterizing the health care field efficiently.
Improving terminology clarity through heuristic definitions yields a functional implementation taxonomy.[13] The semantic and ontological approach in developing the QIIT's working taxonomy promotes conceptual consistency and reduces redundancy, aligning with the QI Lean tenets of standardization, waste reduction, and process improvement.[36] The hierarchical relational scheme ensures a consistent taxonomy of “Determinants” for barriers and facilitators applicable and reusable across “QI Phases” and “Implementing Domains.” Using symbols to denote facilitators and barriers for identical terms simplifies the language and eliminates redundancy, thereby offering an economical representation of knowledge.
By framing both barriers and facilitators as effects in cause-and-effect analysis, we shift from problem-based analysis to encompass root cause analysis of both problems and assets.[37] This approach allows the taxonomy to capture multiple contextual dimensions efficiently. For example, the term “Culture,” representing both a barrier and a facilitator, can be captured once with denotations of “ + ” for the facilitator and “–” for the barrier.
The use of the term “variable” to represent different levels of barriers and facilitators lacked a clear definition in the comprehensive cause-and-effect analysis across all sites. Consequently, it could not be quantified using the Likert Attribute Scale, as shown in [Table 2]. This underscores the need for a standardized method to quantify variations of barriers and facilitators in QI implementation.
It is essential to acknowledge that our work is limited to the data from a single local environment involving multisite QI initiatives focusing on employee wellness. Further work is needed for a more comprehensive evaluation and testing the prespecified domains of the QIIT framework on a larger scale.
Conclusion
The absence of STs for tracking and measuring the implementation of EB practices in QI initiatives hinders the efficiency of QI efforts. Standardization is vital for improving knowledge representation in health care, leading to increased efficiency, quality, and timeliness.[13] [14] Employing STs can create comparable and sharable evaluations of QI-related outcomes for forecast, contributing to sustainable QI implementation with clinically informed innovative solutions.
Further evaluation is imperative and should refine the taxonomy and establish rules for an organized and interconnected framework, enabling comparable and sharable assessments of both barriers and facilitators across and beyond enterprises. Furthermore, we should explore the potential integration of this approach with STs in designing and executing implementation strategies and outcomes.
Clinical Relevance Statement
The proposed framework and taxonomy hold significant clinical relevance by addressing the need for a comprehensive system to classify, quantify, qualify, and codify the intersection of evidence and QI implementation. This framework is valuable for efficiently representing the implementation barriers and facilitators of evidence translation through QI efforts in clinical practice. Ultimately, it contributes to the achievement of health care quality and outcomes.
Multiple Choice Questions
-
What is one benefit of adopting a semantic approach to taxonomy development?
-
Improving quality
-
Enhancing meanings
-
Reducing redundancies
-
Deconstructing structure
Correct answer: c.
Rationale: A semantic approach in taxonomy development seeks semantic agreements in meanings and thus helps reduce terminology redundancies.
-
-
What QI tenet is reflected in the reuse of existing QI taxonomies?
-
Model for improvement
-
Plan, Do, Study, Act model
-
Root cause analysis
-
Lean
Correct answer: d.
Rationale: The reuse of existing QI taxonomies demonstrates the Lean QI tenet to reduce waste.
-
Conflict of Interest
None declared.
Acknowledgments
The content is solely the responsibility of the authors and does not necessarily represent the official views of the VAQS program or the Department of VA. Special thanks to VAQS 2022 incoming fellows and the VAQS coordinating center.
Protection of Human and Animal Subjects
No human subjects were involved in this project.
-
References
- 1 Executive Board 118. eHealth: Standardized Terminology: Report by the Secretariat,. 2006 . Accessed August, 23, 2023 at: https://iris.who.int/handle/10665/21530
- 2 Sundling KE, Kurtycz DFI. Standardized terminology systems in cytopathology. Diagn Cytopathol 2019; 47 (01) 53-63
- 3 Mezei T. Current classification systems and standardized terminology in cytopathology. Rom J Morphol Embryol 2020; 61 (03) 655-663
- 4 SNOMED CT Starter Guide. SNOMED International, 2022 . Accessed August 23, 2023 at: https://confluence.ihtsdotools.org/display/DOCSTART/SNOMED+CT+Starter+Guide
- 5 Arvanitis TN. Semantic interoperability in healthcare. Stud Health Technol Inform 2014; 202: 5-8
- 6 Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare?. Qual Saf Health Care 2007; 16 (01) 2-3
- 7 Institute of Medicine (IOM). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C:: National Academy Press;; 2001
- 8 Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci 2015; 10: 53
- 9 Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci 2006; 1: 1
- 10 Washington V, DeSalvo K, Mostashari F, Blumenthal D. The HITECH era and the path forward. N Engl J Med 2017; 377 (10) 904-906
- 11 Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med 2009; 360 (15) 1477-1479
- 12 Powell BJ, Fernandez ME, Williams NJ. et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Health 2019; 7: 3
- 13 Proctor E, Silmere H, Raghavan R. et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011; 38 (02) 65-76
- 14 Waltz TJ, Powell BJ, Matthieu MM. et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci 2015; 10: 109
- 15 Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. “Psychological Theory” Group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005; 14 (01) 26-33
- 16 Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009; 4 (01) 40
- 17 Grimshaw J, Eccles M, Thomas R. et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med 2006; 21 (Suppl. 02) S14-S20
- 18 Breimaier HE, Heckemann B, Halfens RJ, Lohrmann C. The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice. BMC Nurs 2015; 14: 43
- 19
Damschroder LJ,
Aron DC,
Keith RE,
Kirsh SR,
Alexander JA,
Lowery JC.
Fostering implementation of health services research findings into practice: a consolidated
framework for advancing implementation science. Implement Sci 2009; 4: 50
MissingFormLabel
- 20 Hammad R, Barhoush M, Abed-Alguni BH. A semantic-based approach for managing healthcare big data: a survey. J Healthc Eng 2020; 2020: 8865808
- 21 Liyanage H, Krause P, De Lusignan S. Using ontologies to improve semantic interoperability in health data. J Innov Health Inform 2015; 22 (02) 309-315
- 22 Jacobson I. Object-oriented development in an industrial environment. Paper presented at: OOPSLA '87: Conference Proceedings on Object-oriented Programming Systems, Languages and Applications. December 1987: 183-191 . Orlando, Fl
- 23 Jacobson I. Use cases - Yesterday, today, and tomorrow. SoSyM 2004; 3 (03) 210-220
- 24 Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 2016; 23 (05) 899-908
- 25 Bestek M, Grönvall E, Saad-Sulonen J. Commoning semantic interoperability in healthcare. Int J Commons 2022; 16 (01) 225-242
- 26 Christoff P. Running PDSA cycles. Curr Probl Pediatr Adolesc Health Care 2018; 48 (08) 198-201
- 27 Harel Z, Silver SA, McQuillan RF. et al. How to diagnose solutions to a quality of care problem. Clin J Am Soc Nephrol 2016; 11 (05) 901-907
- 28 Consolidated Framework for Implementation Research. Qualitative data. 2023 . Accessed January 2023 at: https://cfirguide.org/evaluation-design/qualitative-data/
- 29 Ridde V, Pérez D, Robert E. Using implementation science theories and frameworks in global health. BMJ Glob Health 2020; 5 (04) e002269
- 30 Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Syst 2019; 4 (01) e10201
- 31 Cox M, Sandberg K. Modeling causal relationships in quality improvement. Curr Probl Pediatr Adolesc Health Care 2018; 48 (07) 182-185
- 32 Patrician PA, Dolansky M, Estrada C. et al. Interprofessional education in action: the VA Quality Scholars fellowship program. Nurs Clin North Am 2012; 47 (03) 347-354
- 33 Watkins KE, Pincus HA, Smith B. et al. Veterans Health Administration Mental Health Program Evaluation: Capstone Report. Santa Monica, CA: : RAND Corporation, TR-956-VHA; 2011
- 34 Holleran L, Baker S, Cheng C. et al. Using multisite process mapping to aid care improvement: an examination of inpatient suicide-screening procedures. J Healthc Qual 2019; 41 (02) 110-117
- 35 Reddy KP, Schult TM, Whitehead AM, Bokhour BG. Veterans Health Administration's Whole Health System of Care: supporting the health, well-being, and resiliency of employees. Glob Adv Health Med 2021; 10: 21 649561211022698
- 36 Joosten T, Bongers I, Janssen R. Application of lean thinking to health care: issues and observations. Int J Qual Health Care 2009; 21 (05) 341-347
- 37 Gao G, Kerr MJ, Lindquist RA. et al. A strengths-based data capture model: mining data-driven and person-centered health assets. JAMIA Open 2018; 1 (01) 11-14
Address for correspondence
Publication History
Received: 24 August 2023
Accepted: 07 November 2023
Accepted Manuscript online:
09 November 2023
Article published online:
31 January 2024
© 2024. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Executive Board 118. eHealth: Standardized Terminology: Report by the Secretariat,. 2006 . Accessed August, 23, 2023 at: https://iris.who.int/handle/10665/21530
- 2 Sundling KE, Kurtycz DFI. Standardized terminology systems in cytopathology. Diagn Cytopathol 2019; 47 (01) 53-63
- 3 Mezei T. Current classification systems and standardized terminology in cytopathology. Rom J Morphol Embryol 2020; 61 (03) 655-663
- 4 SNOMED CT Starter Guide. SNOMED International, 2022 . Accessed August 23, 2023 at: https://confluence.ihtsdotools.org/display/DOCSTART/SNOMED+CT+Starter+Guide
- 5 Arvanitis TN. Semantic interoperability in healthcare. Stud Health Technol Inform 2014; 202: 5-8
- 6 Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare?. Qual Saf Health Care 2007; 16 (01) 2-3
- 7 Institute of Medicine (IOM). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, D.C:: National Academy Press;; 2001
- 8 Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci 2015; 10: 53
- 9 Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci 2006; 1: 1
- 10 Washington V, DeSalvo K, Mostashari F, Blumenthal D. The HITECH era and the path forward. N Engl J Med 2017; 377 (10) 904-906
- 11 Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med 2009; 360 (15) 1477-1479
- 12 Powell BJ, Fernandez ME, Williams NJ. et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Health 2019; 7: 3
- 13 Proctor E, Silmere H, Raghavan R. et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011; 38 (02) 65-76
- 14 Waltz TJ, Powell BJ, Matthieu MM. et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci 2015; 10: 109
- 15 Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. “Psychological Theory” Group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005; 14 (01) 26-33
- 16 Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009; 4 (01) 40
- 17 Grimshaw J, Eccles M, Thomas R. et al. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med 2006; 21 (Suppl. 02) S14-S20
- 18 Breimaier HE, Heckemann B, Halfens RJ, Lohrmann C. The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice. BMC Nurs 2015; 14: 43
- 19
Damschroder LJ,
Aron DC,
Keith RE,
Kirsh SR,
Alexander JA,
Lowery JC.
Fostering implementation of health services research findings into practice: a consolidated
framework for advancing implementation science. Implement Sci 2009; 4: 50
MissingFormLabel
- 20 Hammad R, Barhoush M, Abed-Alguni BH. A semantic-based approach for managing healthcare big data: a survey. J Healthc Eng 2020; 2020: 8865808
- 21 Liyanage H, Krause P, De Lusignan S. Using ontologies to improve semantic interoperability in health data. J Innov Health Inform 2015; 22 (02) 309-315
- 22 Jacobson I. Object-oriented development in an industrial environment. Paper presented at: OOPSLA '87: Conference Proceedings on Object-oriented Programming Systems, Languages and Applications. December 1987: 183-191 . Orlando, Fl
- 23 Jacobson I. Use cases - Yesterday, today, and tomorrow. SoSyM 2004; 3 (03) 210-220
- 24 Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 2016; 23 (05) 899-908
- 25 Bestek M, Grönvall E, Saad-Sulonen J. Commoning semantic interoperability in healthcare. Int J Commons 2022; 16 (01) 225-242
- 26 Christoff P. Running PDSA cycles. Curr Probl Pediatr Adolesc Health Care 2018; 48 (08) 198-201
- 27 Harel Z, Silver SA, McQuillan RF. et al. How to diagnose solutions to a quality of care problem. Clin J Am Soc Nephrol 2016; 11 (05) 901-907
- 28 Consolidated Framework for Implementation Research. Qualitative data. 2023 . Accessed January 2023 at: https://cfirguide.org/evaluation-design/qualitative-data/
- 29 Ridde V, Pérez D, Robert E. Using implementation science theories and frameworks in global health. BMJ Glob Health 2020; 5 (04) e002269
- 30 Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Syst 2019; 4 (01) e10201
- 31 Cox M, Sandberg K. Modeling causal relationships in quality improvement. Curr Probl Pediatr Adolesc Health Care 2018; 48 (07) 182-185
- 32 Patrician PA, Dolansky M, Estrada C. et al. Interprofessional education in action: the VA Quality Scholars fellowship program. Nurs Clin North Am 2012; 47 (03) 347-354
- 33 Watkins KE, Pincus HA, Smith B. et al. Veterans Health Administration Mental Health Program Evaluation: Capstone Report. Santa Monica, CA: : RAND Corporation, TR-956-VHA; 2011
- 34 Holleran L, Baker S, Cheng C. et al. Using multisite process mapping to aid care improvement: an examination of inpatient suicide-screening procedures. J Healthc Qual 2019; 41 (02) 110-117
- 35 Reddy KP, Schult TM, Whitehead AM, Bokhour BG. Veterans Health Administration's Whole Health System of Care: supporting the health, well-being, and resiliency of employees. Glob Adv Health Med 2021; 10: 21 649561211022698
- 36 Joosten T, Bongers I, Janssen R. Application of lean thinking to health care: issues and observations. Int J Qual Health Care 2009; 21 (05) 341-347
- 37 Gao G, Kerr MJ, Lindquist RA. et al. A strengths-based data capture model: mining data-driven and person-centered health assets. JAMIA Open 2018; 1 (01) 11-14





