Download PDF
CC BY-NC-ND 4.0 · Yearb Med Inform 2021; 30(01): 091-099
DOI: 10.1055/s-0041-1726511
Section 2: Human Factors and Organizational Issues
Survey

Human Factors and Organizational Issues in Health Informatics: Innovations and Opportunities

Jenna Marquard
1   University of Massachusetts Amherst, Amherst, MA, USA
› Author Affiliations
› Further Information
   Permissions and Reprints

Summary

Objective: Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community.

Methods: Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020.

Results: HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction.

Conclusion: HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.

Keywords

Human factors and ergonomics - human centered design - user computer interface - health informatics - health information technology


Publication History

Article published online:
03 September 2021

© 2021. IMIA and Thieme. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Lee JD, Wickens CD, Liu Y, Boyle LN. Designing for people: An introduction to human factors engineering. CreateSpace. 2017
    PubMedGoogle Scholar
  • 2 Carayon P, Hoonakker P. Human Factors and Usability for Health Information Technology: Old and New Challenges. Yearb Med Inform 2019; 28 (01) 71-7
    Article in Thieme ConnectPubMedGoogle Scholar
  • 3 Abbott PA, Weinger MB. Health information technology: Fallacies and Sober realities - Redux A homage to Bentzi Karsh and Robert Wears. Appl Ergon [Internet] 2020 Jan. 82. (October 2019):102973. Available from: https://doi.org/10.1016/j.apergo.2019.102973
    CrossrefPubMedGoogle Scholar
  • 4 DIS ISO, 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems (formerly known as 13407) [Internet]. International Standardization Organization (ISO); Switzerland: 2010. . Available from: https://www.iso.org/obp/ui/#iso:std:iso:9241:-210:ed-1:v1:en
    Google Scholar
  • 5 IDEO.org. The Field Guide to Human-Centered Design. 1st ed.. Determann's Field Guide To Data Privacy Law. IDEO.org; 2015
    Google Scholar
  • 6 Office of the Federal Register. Federal Register. Vol. 77. 2012: 13869
    Google Scholar
  • 7 Schumacher. Robert M, Lowry SZ. NISTIR 7741: NIST Guide to the Processes Approach for Improving the Usability of Electronic Health Records. NISTIR Tech [Internet] 2010; 7741: 1-62 . Available from: http://www.nist.gov/itl/hit/upload/Guide_Final_Publication_Version.pdf
    PubMedGoogle Scholar
  • 8 Ratwani RM, Fairbanks RJ, Zachary Hettinger A, Benda NC. Electronic health record usability: Analysis of the user-centered design processes of eleven electronic health record vendors. J Am Med Inform Assoc 2015; 22 (06) 1179-82
    CrossrefPubMedGoogle Scholar
  • 9 Fareed N, Swoboda CM, Jonnalagadda P, Griesenbrock T, Gureddygari HR, Aldrich A. Visualizing Opportunity Index Data Using a Dashboard Application: A Tool to Communicate Infant Mortality-Based Area Deprivation Index Information. Appl Clin Inform 2020; 11 (04) 515-27
    Article in Thieme ConnectPubMedGoogle Scholar
  • 10 Dixit RA, Hurst S, Adams KT, Boxley C, Lysen-Hendershot K, Bennett SS. et al. Rapid development of visualization dashboards to enhance situation awareness of COVID-19 telehealth initiatives at a multihospital healthcare system. J Am Med Inform Assoc 2020; 27 (09) 1456-61
    CrossrefPubMedGoogle Scholar
  • 11 Kim S, Trinidad B, Mikesell L, Aakhus M. Improving prognosis communication for patients facing complex medical treatment: A user-centered design approach. Int J Med Inform [Internet]. 2020 141. (2019 December):104147. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104147
    CrossrefPubMedGoogle Scholar
  • 12 Holden RJ, Cornet VP, Valdez RS. Patient ergonomics: 10-year mapping review of patient-centered human factors. Appl Ergon [Internet]. 2020 82. (October 2019):102972. Available from: https://doi.org/10.1016/j.apergo.2019.102972
    CrossrefPubMedGoogle Scholar
  • 13 Fausett C, Lee J, Godwin E, Palmer E, Fouquet S. Informing the Design of Mental Health Smartphone Apps for Adolescents. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 218-22
    CrossrefPubMedGoogle Scholar
  • 14 Su YY, Huang ST, Wu YH, Chen CM. Factors Affecting Patients’ Acceptance of and Satisfaction with Cloud-Based Telehealth for Chronic Disease Management: A Case Study in the Workplace. Appl Clin Inform 2020; 11 (02) 286-94
    Article in Thieme ConnectPubMedGoogle Scholar
  • 15 Iribarren SJ, Rodriguez Y, Lin L, Chirico C, Discacciati V, Schnall R. et al. Converting and expanding a mobile support intervention: Focus group and field-testing findings from individuals in active tuberculosis treatment. Int J Med Inform [Internet]. 2020 136. (December 2019):104057. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104057
    CrossrefPubMedGoogle Scholar
  • 16 Pierce RP, Eskridge BR, Rehard LA, Ross B, Day MA, Belden JL. The Effect of Electronic Health Record Usability Redesign on Annual Screening Rates in an Ambulatory Setting. Appl Clin Inform 2020; 11 (04) 580-8
    Article in Thieme ConnectPubMedGoogle Scholar
  • 17 Salwei ME, Carayon P, Hoonakker P, Hundt AS, Novak C, Wang Y. et al. Assessing workflow of emergency physicians in the use of clinical decision support. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 772-6
    CrossrefPubMedGoogle Scholar
  • 18 Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform 2004; 37 (01) 56-76
    CrossrefPubMedGoogle Scholar
  • 19 Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc 2012; 19 (03) 413-22
    CrossrefPubMedGoogle Scholar
  • 20 Cohen DJ, Wyte-Lake T, Dorr DA, Gold R, Holden RJ, Koopman RJ. et al. Unmet information needs of clinical teams delivering care to complex patients and design strategies to address those needs. J Am Med Inform Assoc 2020; 27 (05) 690-9
    CrossrefPubMedGoogle Scholar
  • 21 Esmaeilzadeh P, Mirzaei T, Dharanikota S. The impact of data entry structures on perceptions of individuals with chronic mental disorders and physical diseases towards health information sharing. Int J Med Inform [Internet]. 2020 141. 104157 . Available from: https://doi.org/10.1016/j.ijmedinf.2020.104157
    CrossrefPubMedGoogle Scholar
  • 22 Sockolow PS, Bowles KH, Wojciechowicz C, Bass EJ. Incorporating home healthcare nurses’ admission information needs to inform data standards. J Am Med Inform Assoc 2020; 27 (08) 1278-86
    CrossrefPubMedGoogle Scholar
  • 23 Johnson AJ, Bisantz AM, Reynolds AL, Meier ST. Assessing Decision Support Needs of those in Mental Health Crisis Utilizing Cognitive Task Analysis. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 46-46
    CrossrefPubMedGoogle Scholar
  • 24 Jahn Holbrook M, Caldwell BS. Development of a Multi-Layer Systems Engineering Visualization for Diabetes Team Coordination. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 643-7
    CrossrefPubMedGoogle Scholar
  • 25 Ishak T, Torres A, Asan O. Developing Technology-Enabled Solutions for College Students to Cope with Factors Leading to Health Problems. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 56-60
    CrossrefPubMedGoogle Scholar
  • 26 Marcu G, Aizen R, Roth AM, Lankenau S, Schwartz DG. Acceptability of smartphone applications for facilitating layperson naloxone administration during opioid overdoses. JAMIA Open 2020; 3 (01) 44-52
    CrossrefPubMedGoogle Scholar
  • 27 Lorca-Cabrera J, Martí-Arques R, Albacar-Riobóo N, Raigal-Aran L, Roldan-Merino J, FerréGrau C. Mobile Applications for Caregivers of Individuals with Chronic Conditions and/or Diseases: Quantitative Content Analysis. Int J Med Inform 2020; 145 (July 2020): 104310
    CrossrefPubMedGoogle Scholar
  • 28 Burgermaster M, Son JH, Davidson PG, Smaldone AM, Kuperman G, Feller DJ. et al. A new approach to integrating patient-generated data with expert knowledge for personalized goal setting: A pilot study. Int J Med Inform [Internet]. 2020 139. (October 2019):104158. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104158
    CrossrefPubMedGoogle Scholar
  • 29 Benda NC, Das LT, Abramson EL, Blackburn K, Thoman A, Kaushal R. et al. “how did you get to this number?” Stakeholder needs for implementing predictive analytics: A pre-implementation qualitative study. J Am Med Inform Assoc 2020; 27 (05) 709-16
    CrossrefPubMedGoogle Scholar
  • 30 Zachary WW, Wilkin T, Puglisi L, Butler M, Ferdousi I, Smart J. et al. Designing a Cardiovascular Health App for Citizens Returning from Incarceration: Where You Start May Not Be Where You End Up. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 34-42
    CrossrefPubMedGoogle Scholar
  • 31 Kabukye JK, de Keizer N, Cornet R. Elicitation and prioritization of requirements for electronic health records for oncology in low resource settings: A concept mapping study. Int J Med Inform [Internet]. 2020 135. (December 2019):104055. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104055
    CrossrefPubMedGoogle Scholar
  • 32 Schubel L, Stein L, Barrientos RR, Valdiviezo C, Townsend M, Basch P. et al. Bridging the gap: Workflow analysis evaluating “work-as-imagined” versus “work-as-done” for cardiac risk calculation. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 767-71
    CrossrefPubMedGoogle Scholar
  • 33 Ash JS, Chase D, Baron S, Filios MS, Shiffman RN, Marovich S. et al. Clinical Decision Support for Worker Health: A Five-Site Qualitative Needs Assessment in Primary Care Settings. Appl Clin Inform 2020; 11 (04) 635-43
    Article in Thieme ConnectPubMedGoogle Scholar
  • 34 Ostropolets A, Chen RJ, Zhang L, Hripcsak G. Characterizing physicians’ information needs related to a gap in knowledge unmet by current evidence. JAMIA Open 2020; 3 (02) 281-9
    CrossrefPubMedGoogle Scholar
  • 35 Austin E, Lee JR, Amtmann D, Bloch R, Lawrence SO, McCall D. et al. Use of patient-generated health data across healthcare settings: implications for health systems. JAMIA Open 2020; 3 (01) 70-6
    CrossrefPubMedGoogle Scholar
  • 36 Ozkaynak M, Metcalf N, Cohen DM, May LS, Dayan PS, Mistry RD. Considerations for Designing EHR-Embedded Clinical Decision Support Systems for Antimicrobial Stewardship in Pediatric Emergency Departments. Appl Clin Inform 2020; 11 (04) 589-97
    Article in Thieme ConnectPubMedGoogle Scholar
  • 37 Bhat S, Derington CG, Derington CG, Trinkley KE, Trinkley KE. Clinicians’ Values and Preferences for Medication Adherence and Cost Clinical Decision Support in Primary Care: A Qualitative Study. Appl Clin Inform 2020; 11 (03) 405-14
    Article in Thieme ConnectPubMedGoogle Scholar
  • 38 Knisely BM, Vaughn-Cooke M. A Comprehensive Survey of Preference for Personal Health Record Features in Patients with Diabetes. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 171-5
    CrossrefPubMedGoogle Scholar
  • 39 Daei A, Soleymani MR, Ashrafi-rizi H, Zargham-Boroujeni A, Kelishadi R. Clinical information seeking behavior of physicians: A systematic review. Int J Med Inform 2020. 139. (April):
    PubMedGoogle Scholar
  • 40 Paricio-Talayero JM, Mena-Tudela D, Cervera-Gasch Á, González-Chordá VM, Paricio-Burtin Y, Sánchez-Palomares M. et al. Is it compatible with breastfeeding? www.e-lactancia.org: Analysis of visits, user profile and most visited products. Int J Med Inform [Internet]. 2020 141. (November 2019):104199. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104199
    CrossrefPubMedGoogle Scholar
  • 41 Rau NM, Hasan K, Ahamed SI, Asan O, Flynn KE, Basir MA. Designing a tablet-based prematurity education app for parents hospitalized for preterm birth. Int J Med Inform [Internet]. 2020 141. (December 2019):104200. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104200
    CrossrefPubMedGoogle Scholar
  • 42 Esmaeilzadeh P, Mirzaei T, Maddah M. The effects of data entry structure on patients’ perceptions of information quality in Health Information Exchange (HIE). Int J Med Inform [Internet]. 2020 135. (December 2019):104058. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104058
    CrossrefPubMedGoogle Scholar
  • 43 Kannampallil T, Abraham J. Listening and question-asking behaviors in resident and nurse handoff conversations: a prospective observational study. JAMIA Open 2020; 3 (01) 87-93
    CrossrefPubMedGoogle Scholar
  • 44 Stone JA, Watterson T, Xiong KZ, Ramly E, Kleinschmidt P, Seminak M. et al. Identifying Vulnerabilities in HealthIT: A Case Study of CancelRx Implementation in Clinic and Pharmacy Sociotechnical Systems. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 64-6
    CrossrefPubMedGoogle Scholar
  • 45 Cho I, Lee M, Kim Y. What are the main patient safety concerns of healthcare stakeholders: a mixed-method study of Web-based text. Int J Med Inform [Internet] 2020; 140: 104162 . Available from: https://doi.org/10.1016/j.ijmedinf.2020.104162
    CrossrefPubMedGoogle Scholar
  • 46 Tennant R, Leggett A, Smith C, Tan L, Mercer K, Burns CM. Addressing Human Factor Challenges in Paediatric Home Care: Development and Evaluation of a Mobile Home Care Communication App. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 37-9
    CrossrefPubMedGoogle Scholar
  • 47 Abdolkhani R, Gray K, Borda A, DeSouza R. Patient-generated health data management and quality challenges in remote patient monitoring. JAMIA Open 2019; 2 (04) 471-8
    CrossrefPubMedGoogle Scholar
  • 48 Taber P, Ghani P, Schiffman JD, Kohlmann W, Hess R, Chidambaram V. et al. Physicians’ strategies for using family history data: having the data is not the same as using the data. JAMIA Open 2020; 3 (October): 378-85
    CrossrefPubMedGoogle Scholar
  • 49 Ozkaynak M, Bisantz A, Militello L, Miller K, Rayo M, Slagle J. What Makes a Difference in Patient Safety when Designing, Implementing and Evaluating Clinical Decision Support Systems?. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 693-7
    CrossrefPubMedGoogle Scholar
  • 50 Gilbank P, Johnson-Cover K, Truong T. Designing for Physician Trust: Toward a Machine Learning Decision Aid for Radiation Toxicity Risk. Ergon Des 2020; 28 (03) 27-35
    PubMedGoogle Scholar
  • 51 Calzoni L, Clermont G, Cooper GF, Visweswaran S, Hochheiser H. Graphical Presentations of Clinical Data in a Learning Electronic Medical Record. Appl Clin Inform 2020; 11 (04) 680-91
    Article in Thieme ConnectPubMedGoogle Scholar
  • 52 Curran RL, Kukhareva PV, Taft T, Weir CR, Reese TJ, Nanjo C. et al. Integrated displays to improve chronic disease management in ambulatory care: A SMART on FHIR application informed by mixed-methods user testing. J Am Med Inform Assoc 2020; 27 (08) 1225-34
    CrossrefPubMedGoogle Scholar
  • 53 Schubel L, Stein L, Romero R, Miller K. Mitigating Cardiovascular Risk Through User Informed Clinical Decision Support. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 67-9
    CrossrefPubMedGoogle Scholar
  • 54 Boillat T, Siebert JN, Alduaij N, Ehrler F. GOFlow: Smartwatch app to deliver laboratory results in emergency departments - A feasibility study. Int J Med Inform [Internet]. 2020 134. (July 2019):104034. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104034
    CrossrefPubMedGoogle Scholar
  • 55 Stonbraker S, Porras T, Schnall R. Patient preferences for visualization of longitudinal patient-reported outcomes data. J Am Med Inform Assoc 2020; 27 (02) 212-24
    CrossrefPubMedGoogle Scholar
  • 56 Park S, Oh H, Choi J, Jang W. A Design of Mobile Application for Ultrasound Bladder Monitoring System Based on Usability Engineering. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 177-80
    CrossrefPubMedGoogle Scholar
  • 57 Yoo S, Lim K, Baek H, Jang SK, Hwang Gyoung, Kim H. et al. Developing a mobile epilepsy management application integrated with an electronic health record for effective seizure management. Int J Med Inform [Internet]. 2020 134. (December 2019):104051. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104051
    CrossrefPubMedGoogle Scholar
  • 58 Kelley M, Foraker R, Lin E-JD, Kulkarni M, Lustberg M, Weaver KE. Oncologists’ Perceptions of a Digital Tool to Improve Cancer Survivors’ Cardiovascular Health. ACI Open 2019; 03 (02) e78-87
    Article in Thieme ConnectPubMedGoogle Scholar
  • 59 Scott K, Hathaway E, Sharp K, Smailes P. The Development and Evaluation of an Electronic Health Record Efficiency Workshop for Providers. Appl Clin Inform 2020; 11 (02) 336-41
    Article in Thieme ConnectPubMedGoogle Scholar
  • 60 Wosik J, Fudim M, Cameron B, Gellad ZF, Cho A, Phinney D. et al. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc 2020; 27 (06) 957-62
    CrossrefPubMedGoogle Scholar
  • 61 Foster M, Albanese C, Chen Q, Sethares KA, Evans S, Lehmann LS. et al. Heart Failure Dashboard Design and Validation to Improve Care of Veterans. Appl Clin Inform 2020; 11 (01) 153-9
    Article in Thieme ConnectPubMedGoogle Scholar
  • 62 Chaparro JD, Hussain C, Lee JA, Hehmeyer J, Nguyen M, Hoffman J. Reducing Interruptive Alert Burden Using Quality Improvement Methodology. Appl Clin Inform 2020; 11 (01) 46-58
    Article in Thieme ConnectPubMedGoogle Scholar
  • 63 Choi W, Wang S, Lee Y, Oh H, Zheng Z. A systematic review of mobile health technologies to support self-management of concurrent diabetes and hypertension. J Am Med Inform Assoc 2020; 27 (06) 939-45
    CrossrefPubMedGoogle Scholar
  • 64 Martikainen S, Kaipio J, Lääveri T. End-user participation in health information systems (HIS) development: Physicians’ and nurses’ experiences. Int J Med Inform [Internet]. 2020 137. (December 2019):104117. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104117
    CrossrefPubMedGoogle Scholar
  • 65 Challen R, Tsaneva-Atanasova K, Edwards T, Gompels L, Dayer M, Pitt M. et al. Factors influencing digital review of pathology test results in an inpatient setting: a cross-sectional study. JAMIA Open 2020; 3 (02) 290-8
    CrossrefPubMedGoogle Scholar
  • 66 Yu SC, Lai AM, Smyer J, Flaherty J, Mangino JE, McAlearney AS. et al. Novel Visualization of Clostridium difficile Infections in Intensive Care Units. ACI Open 2019; 03 (02) e71-7
    Article in Thieme ConnectPubMedGoogle Scholar
  • 67 Schubel L, Littlejohn R, Barrientos RR, Arnold R, Capan M, Miller K. Everything but the Kitchen Sink: A Mixed Methods Approach to Health IT Usability Testing. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 718-22
    CrossrefPubMedGoogle Scholar
  • 68 Alfano M, Lenzitti B, Lo Bosco G, Muriana C, Piazza T, Vizzini G. Design, development and validation of a system for automatic help to medical text understanding. Int J Med Inform [Internet]. 2020 138. (August 2018):104109. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104109
    CrossrefPubMedGoogle Scholar
  • 69 Abdel-Rahman SM, Gill H, Carpenter SL, Gueye P, Wicklund B, Breitkreutz M. et al. Design and Usability of an Electronic Health Record-Integrated, Point-of-Care, Clinical Decision Support Tool for Modeling and Simulation of Antihemophilic Factors. Appl Clin Inform 2020; 11 (02) 253-64
    Article in Thieme ConnectPubMedGoogle Scholar
  • 70 Patterson ES, DiLoreto GN, Vanam R, Hade E, Hebert C. Enhancing Usefulness and Usability of a Clinical Decision Support Prototype for Antibiotic Stewardship. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 61-5
    CrossrefPubMedGoogle Scholar
  • 71 Kandaswamy S, Hettinger AZ, Hoffman DJ, Ratwani RM, Marquard J. Communication through the electronic health record: frequency and implications of free text orders. JAMIA Open 2020; 3 (02) 154-9
    CrossrefPubMedGoogle Scholar
  • 72 Bockhacker M, Syrek H, Elstermann Von Elster M, Schmitt S, Roehl H. Evaluating Usability of a Touchless Image Viewer in the Operating Room. Appl Clin Inform 2020; 11 (01) 88-94
    Article in Thieme ConnectPubMedGoogle Scholar
  • 73 Wyatt KD, Willaert BN, Lohse CM, Pallagi PJ, Yiannias JA, Hellmich TR. Experiences of Health Care Providers Using a Mobile Medical Photography Application. Appl Clin Inform 2020; 11 (01) 122-9
    Article in Thieme ConnectPubMedGoogle Scholar
  • 74 Feller DJ, Lor M, Zucker J, Yin MT, Olender S, Ferris DC. et al. An investigation of the information technology needs associated with delivering chronic disease care to large clinical populations. Int J Med Inform [Internet]. 2020 137. (October 2019):104099 Available from: https://doi.org/10.1016/j.ijmedinf.2020.104099
    CrossrefPubMedGoogle Scholar
  • 75 Esposito M, Rocq PL, Novy E, Remen T, Losser MR, Guerci P. Smartphone to-do list application to improve workflow in an intensive care unit: A superiority quasi-experimental study. Int J Med Inform [Internet]. 2020 136. (January):104085. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104085
    CrossrefPubMedGoogle Scholar
  • 76 Hilliard RW, Haskell J, Gardner RL. Are specific elements of electronic health record use associated with clinician burnout more than others?. J Am Med Inform Assoc 2020; 27 (09) 1401-10
    CrossrefPubMedGoogle Scholar
  • 77 Van Laere S, Cornu P, Buyl R. A cross-sectional study of the Belgian community pharmacist's satisfaction with the implementation of the electronic prescription. Int J Med Inform [Internet]. 2020 135. (December 2019):104069. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104069
    CrossrefPubMedGoogle Scholar
  • 78 Rogith D, Satterly T, Singh H, Sittig DF, Russo E, Smith MW. et al. Application of Human Factors Methods to Understand Missed Follow-up of Abnormal Test Results. Appl Clin Inform 2020; 11 (05) 692-8
    Article in Thieme ConnectPubMedGoogle Scholar
  • 79 Dullabh P, Hovey L, Heaney-Huls K, Rajendran N, Wright A, Sittig DF. Application Programming Interfaces in Health Care: Findings from a Current-State Sociotechnical Assessmen. Appl Clin Inform 2020; 11 (01) 59-69
    Article in Thieme ConnectPubMedGoogle Scholar
  • 80 Sinsky CA, Rule A, Cohen G, Arndt BG, Shanafelt TD, Sharp CD. et al. Metrics for assessing physician activity using electronic health record log data. J Am Med Inform Assoc 2020; 27 (04) 639-43
    CrossrefPubMedGoogle Scholar
  • 81 Valvona SN, Rayo MF, Abdel-Rasoul M, Locke LJ, Rizer MK, Moffatt-Bruce SD. et al. Comparative Effectiveness of Best Practice Alerts with Active and Passive Presentations: A Retrospective Study. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 105-9
    CrossrefPubMedGoogle Scholar
  • 82 Klappe ES, De Keizer NF, Cornet R. Factors Influencing Problem List Use in Electronic Health Records-Application of the Unified Theory of Acceptance and Use of Technology. Appl Clin Inform 2020; 11 (03) 415-26
    Article in Thieme ConnectPubMedGoogle Scholar
  • 83 Askari M, Tam JLYY, Aarnoutse MF, Meulendijk M. Perceived effectiveness of clinical pathway software: A before-after study in the Netherlands. Int J Med Inform. 2020 135. (December 2019)
    PubMedGoogle Scholar
  • 84 Khasnabish S, Burns Z, Couch M, Mullin M, Newmark R, Dykes PC. Best practices for data visualization: creating and evaluating a report for an evidence-based fall prevention program. J Am Med Inform Assoc 2020; 27 (02) 308-14
    CrossrefPubMedGoogle Scholar
  • 85 Lin CJ, Ho SH. Prediction of the use of mobile device interfaces in the progressive aging process with the model of Fitts’ law. J Biomed Inform [Internet] 2020; 107 (43) 103457 . Available from: https://doi.org/10.1016/j.jbi.2020.103457
    CrossrefPubMedGoogle Scholar
  • 86 Orenstein EW, Ferro DF, Bonafide CP, Landrigan CP, Gillespie S, Muthu N. Hidden health IT hazards: a qualitative analysis of clinically meaningful documentation discrepancies at transfer out of the pediatric intensive care unit. JAMIA Open 2019; 2 (03) 392-8
    CrossrefPubMedGoogle Scholar
  • 87 Romero-Brufau S, Wyatt KD, Boyum P, Mickelson M, Moore M, Cognetta-Rieke C. A lesson in implementation: A pre-post study of providers’ experience with artificial intelligence-based clinical decision support. Int J Med Inform [Internet]. 2020 137. (December 2019):104072. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104072
    CrossrefPubMedGoogle Scholar
  • 88 Gill E, Dykes PC, Rudin RS, Storm M, McGrath K, Bates DW. Technology-facilitated care coordination in rural areas: What is needed?. Int J Med Inform [Internet]. 2020 137. (February):104102. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104102
    CrossrefPubMedGoogle Scholar
  • 89 Rangraz Jeddi F, Nabovati E, Bigham R, Khajouei R. Usability evaluation of a comprehensive national health information system: relationship of quality components to users’ characteristics. Int J Med Inform [Internet]. 2020 133. (October 2018):104026. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104026
    CrossrefPubMedGoogle Scholar
  • 90 Pennathur PR. A Theoretical Framework for Understanding Creator-Consumer Information Interaction Behaviors in Healthcare Documentation Systems. Appl Ergon [Internet]. 2020 84. (December 2019):103034. Available from: https://doi.org/10.1016/j.apergo.2019.103034
    CrossrefPubMedGoogle Scholar
  • 91 El Mikati HK, Yazel-Smith L, Grout RW, Downs SM, Carroll AE, Hannon TS. Clinician Perceptions of a Computerized Decision Support System for Pediatric Type 2 Diabetes Screening. Appl Clin Inform 2020; 11 (02) 350-5
    Article in Thieme ConnectPubMedGoogle Scholar
  • 92 Lasko TA, Owens DA, Fabbri D, Wanderer JP, Genkins JZ, Novak LL. User-Centered Clinical Display Design Issues for Inpatient Providers. Appl Clin Inform 2020; 11 (05) 700-9
    Article in Thieme ConnectPubMedGoogle Scholar
  • 93 Blackley SV, Schubert VD, Goss FR, Al Assad W, Garabedian PM, Zhou L. Physician use of speech recognition versus typing in clinical documentation: A controlled observational study. Int J Med Inform [Internet]. 2020 141. (April):104178. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104178
    CrossrefPubMedGoogle Scholar
  • 94 Kaur D, Panos RJ, Badawi O, Bapat SS, Wang L, Gupta A. Evaluation of clinician interaction with alerts to enhance performance of the tele-critical care medical environment. Int J Med Inform [Internet]. 2020 139. (April):104165. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104165
    CrossrefPubMedGoogle Scholar
  • 95 Devin J, Costello J, McCallion N, Higgins E, Kehoe B, Cleary BJ. et al. Impact of an electronic health record on task time distribution in a neonatal intensive care unit. Int J Med Inform [Internet]. 2021 145. (April 2020):104307. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104307
    CrossrefPubMedGoogle Scholar
  • 96 Reese TJ, Del Fiol G, Tonna JE, Kawamoto K, Segall N, Weir C. et al. Impact of integrated graphical display on expert and novice diagnostic performance in critical care. J Am Med Inform Assoc 2020; 27 (08) 1287-92
    CrossrefPubMedGoogle Scholar
  • 97 Leander DM, Gifford AH, Mecchella JN, Sabadosa KA, Van Citters A, Snide JA. et al. Design and Implementation of a Novel Electronic Health Record Tool to Enhance the Care of Individuals with Cystic Fibrosis: The Cystic Fibrosis Note Template. ACI Open 2019; 03 (01) e26-36
    Article in Thieme ConnectPubMedGoogle Scholar
  • 98 Reading Turchioe M, Grossman LV, Myers AC, Baik D, Goyal P, Masterson Creber RM. Visual analogies, not graphs, increase patients’ comprehension of changes in their health status. J Am Med Inform Assoc 2020; 27 (05) 677-89
    CrossrefPubMedGoogle Scholar
  • 99 Williams A, Turer C, Smith J, Nievera I, McCulloch L, Wareg N. et al. Adoption of an Electronic Medical Record Tool for Childhood Obesity by Primary Care Providers. Appl Clin Inform 2020; 11 (02) 210-7
    Article in Thieme ConnectPubMedGoogle Scholar
  • 100 Fraczkowski D, Matson J, Lopez KD. Nurse workarounds in the electronic health record: An integrative review. J Am Med Inform Assoc 2020; 27 (07) 1149-65
    CrossrefPubMedGoogle Scholar
  • 101 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: Time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-8
    CrossrefPubMedGoogle Scholar
  • 102 McLaurin E, Bass EJ, Bowles KH, Sockolow P. Assessing the Usability of Medication Information Layouts in a Home Healthcare Electronic Health Record. Proc Int Symp Hum Factors Ergon Heal Care 2020; 9 (01) 183-5
    CrossrefPubMedGoogle Scholar
  • 103 Kaipio J, Kuusisto A, Hyppönen H, Heponiemi T, Lääveri T. Physicians’ and nurses’ experiences on EHR usability: Comparison between the professional groups by employment sector and system brand. Int J Med Inform [Internet]. 2020 134. (June 2019):104018. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104018
    CrossrefPubMedGoogle Scholar
  • 104 Moore EC, Tolley CL, Bates DW, Slight SP. A systematic review of the impact of health information technology on nurses’ time. J Am Med Inform Assoc 2020; 27 (05) 798-807
    CrossrefPubMedGoogle Scholar
  • 105 Kandaswamy S, Hettinger AZ, Ratwani RM. What Did You Order? Developing Models to Measure the Impact of Usability on Emergency Physician Accuracy Using Computerized Provider Order Entry. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 713-7
    CrossrefPubMedGoogle Scholar
  • 106 Kandaswamy S, Wei J, Will A, Savage E, Ratwani RM, Hettinger AZ. et al. Variation in Electronic Health Record Workflow Patterns: A Multisite study. ACI Open 2020; 04 (01) e83-90
    Article in Thieme ConnectPubMedGoogle Scholar
  • 107 Diprose WK, Buist N, Hua N, Thurier Q, Shand G, Robinson R. Physician understanding, explainability, and trust in a hypothetical machine learning risk calculator. J Am Med Inform Assoc 2020; 27 (04) 592-600
    CrossrefPubMedGoogle Scholar
  • 108 Wu D, Lowry PB, Zhang D, Parks RF. Patients’ compliance behavior in a personalized mobile patient education system (PMPES) setting: Rational, social, or personal choices?. Int J Med Inform. 2021 145. (September 2020)
    PubMedGoogle Scholar
  • 109 Wong JIS, Steitz BD, Rosenbloom ST. Characterizing the impact of health literacy, computer ability, patient demographics, and portal usage on patient satisfaction with a patient portal. JAMIA Open 2019; 2 (04) 456-64
    CrossrefPubMedGoogle Scholar
  • 110 Oh J, Jang S, Kim H, Kim JJ. Efficacy of mobile app-based interactive cognitive behavioral therapy using a chatbot for panic disorder. Int J Med Inform [Internet]. 2020 140. (May):104171. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104171
    CrossrefPubMedGoogle Scholar
  • 111 Richards S, Carlson K, Matthias T, Birge J. Perception versus reality: Does provider documentation behavior change when clinic notes are shared electronically with patients?. Int J Med Inform [Internet]. 2021 145. (September 2020):104304. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104304
    CrossrefPubMedGoogle Scholar
  • 112 Li RC, Pereira RAM, Jatobá A, Vidal MCR, de Carvalho PVR, Grindrod K. et al. Information Technology Systems at the sharp end of medication therapy management. Proc Hum Factors Ergon Soc Annu Meet 2019; 63 (01) 698-702
    CrossrefPubMedGoogle Scholar
  • 113 Fortman E, Hettinger AZ, Howe JL, Fong A, Pruitt Z, Miller K. et al. Varying rates of patient identity verification when using computerized provider order entry. J Am Med Inform Assoc 2020; 27 (06) 924-8
    CrossrefPubMedGoogle Scholar
  • 114 Butler JM, Gibson B, Lewis L, Reiber G, Kramer H, Rupper R. et al. Patient-centered care and the electronic health record: exploring functionality and gaps. JAMIA Open 2020; 3 (October): 360-8
    CrossrefPubMedGoogle Scholar
  • 115 Saleem JJ, Read JM, Loehr BM, Frisbee KL, Wilck NR, Murphy JJ. et al. Veterans’ response to an automated text messaging protocol during the COVID-19 pandemic. J Am Med Inform Assoc 2020; 27 (08) 1300-5
    CrossrefPubMedGoogle Scholar
  • 116 Wang H, Tao D, Yu N, Qu X. Understanding consumer acceptance of healthcare wearable devices: An integrated model of UTAUT and TTF. Int J Med Inform. 2020 139. (October 2019)
    PubMedGoogle Scholar
  • 117 O’Grady M, Kapoor S, Gilmer E, Neighbors C, Conigliaro J, Kwon N. et al. Point-of-Care Mobile Application to Guide Health Care Professionals in Conducting Substance Use Screening and Intervention: A Mixed-Methods User Experience Study. ACI Open 2019; 03 (01) e1-12
    Article in Thieme ConnectPubMedGoogle Scholar
  • 118 Tomasi JN, Hamilton MV, Fan M, Pinkney SJ, Middaugh KL, Parshuram CS. et al. Assessing the electronic Bedside Paediatric Early Warning System: A simulation study on decision-making and usability. Int J Med Inform [Internet]. 2020 133. (June 2019):103969. Available from: https://doi.org/10.1016/j.ijmedinf.2019.103969
    CrossrefPubMedGoogle Scholar
  • 119 Oyugi B, Makunja S, Kabuti W, Nyongesa C, Schömburg M, Kibe V. et al. Improving the management of hypertension and diabetes: An implementation evaluation of an electronic medical record system in Nairobi County, Kenya. Int J Med Inform [Internet]. 2020 141. (May):104220. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104220
    CrossrefPubMedGoogle Scholar
  • 120 Richter Lagha R, Burningham Z, Sauer BC, Leng J, Peters C, Huynh T. et al. Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process. Appl Clin Inform 2020; 11 (04) 528-34
    Article in Thieme ConnectPubMedGoogle Scholar
  • 121 Morey SA, Stuck RE, Chong AW, Barg-Walkow LH, Mitzner TL, Rogers WA. Mobile Health Apps: Improving Usability for Older Adult Users. Ergon Des 2019; 27 (04) 4-13
    PubMedGoogle Scholar
  • 122 Avila-Garcia P, Hernandez-Ramos R, Nouri SS, Cemballi A, Sarkar U, Lyles CR. et al. Engaging users in the design of an mHealth, text message-based intervention to increase physical activity at a safety-net health care system. JAMIA Open 2019; 2 (04) 489-97
    CrossrefPubMedGoogle Scholar
  • 123 Fuller TE, Garabedian PM, Lemonias DP, Joyce E, Schnipper JL, Harry EM. et al. Assessing the cognitive and work load of an inpatient safety dashboard in the context of opioid management. Appl Ergon [Internet]. 2020 85. (December 2019):103047. Available from: https://doi.org/10.1016/j.apergo.2020.103047
    CrossrefPubMedGoogle Scholar
  • 124 Bersani K, Fuller TE, Garabedian P, Espares J, Mlaver E, Businger A. et al. Use, Perceived Usability, and Barriers to Implementation of a Patient Safety Dashboard Integrated within a Vendor EHR. Appl Clin Inform 2020; 11 (01) 34-45
    Article in Thieme ConnectPubMedGoogle Scholar
  • 125 Fischer SH, Safran C, Gajos KZ, Wright A. Visualization of Electronic Health Record Data for Decision-Making in Diabetes and Congestive Heart Failure. ACI Open 2020; 04 (01) e35-43
    Article in Thieme ConnectPubMedGoogle Scholar
  • 126 Tsang JY, Brown B, Peek N, Campbell S, Blakeman T. Mixed methods evaluation of a computerised audit and feedback dashboard to improve patient safety through targeting acute kidney injury (AKI) in primary care. Int J Med Inform [Internet]. 2021 145. 104299 . Available from: https://doi.org/10.1016/j.ijmedinf.2020.104299
    CrossrefPubMedGoogle Scholar
  • 127 Navarro-Alamán J, Lacuesta R, Garcia-Magariño I, Gallardo J. A methodology for the design and development of gamified mobile apps for monitoring cancer survivors. J Biomed Inform [Internet]. 2020 106. (April):103439. Available from: https://doi.org/10.1016/j.jbi.2020.103439
    CrossrefPubMedGoogle Scholar
  • 128 Dykes PC, Cullen TA. AMIA 2019 Annual Meeting Full Proceedings. 2019
    PubMedGoogle Scholar
  • 129 Olakotan OO, Yusof MM. Evaluating the alert appropriateness of clinical decision support systems in supporting clinical workflow. J Biomed Inform [Internet]. 2020 106. (October 2019):103453. Available from: https://doi.org/10.1016/j.jbi.2020.103453
    CrossrefPubMedGoogle Scholar
  • 130 Rundo L, Pirrone R, Vitabile S, Sala E, Gambino O. Recent advances of HCI in decision-making tasks for optimized clinical workflows and precision medicine. J Biomed Inform [Internet]. 2020 108. (April):103479. Available from: https://doi.org/10.1016/j.jbi.2020.103479
    CrossrefPubMedGoogle Scholar
  • 131 Yang X, Ma L, Zhao X, Kankanhalli A. Factors influencing user's adherence to physical activity applications: A scoping literature review and future directions. Int J Med Inform [Internet]. 2020 134. (November 2019):104039. Available from: https://doi.org/10.1016/j.ijmedinf.2019.104039
    CrossrefPubMedGoogle Scholar
  • 132 Babione JN, Ocampo W, Haubrich S, Yang C, Zuk T, Kaufman J. et al. Human-centred design processes for clinical decision support: A pulmonary embolism case study. Int J Med Inform [Internet]. 2020 142. (March):104196. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104196
    CrossrefPubMedGoogle Scholar
  • 133 Hochheiser H, Valdez RS. Human-Computer Interaction, Ethics, and Biomedical Informatics. Yearb Med Inform 2020; 93-8
    PubMedGoogle Scholar
  • 134 Humphrey KE, Mirica M, Phansalkar S, Ozonoff A, Harper MB. Clinician Perceptions of Timing and Presentation of Drug-Drug Interaction Alerts. Appl Clin Inform 2020; 11 (03) 487-96
    Article in Thieme ConnectPubMedGoogle Scholar
  • 135 Rajaram A, Hickey Z, Patel N, Newbigging J, Wolfrom B. Training medical students and residents in the use of electronic health records: A systematic review of the literature. J Am Med Inform Assoc 2020; 27 (01) 174-80
    CrossrefPubMedGoogle Scholar
  • 136 Patel VL, Kannampallil TG. Cognitive informatics in biomedicine and healthcare. J Biomed Inform [Internet] 2015; 53: 3-14 . Available from: http://dx.doi.org/10.1016/j.jbi.2014.12.007
    CrossrefPubMedGoogle Scholar
  • 137 Holden RJ, Professor A, Carayon P, Gurses AP, Professor A, Hoonakker P. et al. SEIPS 2.0: A human factors framework for studying and improving the work of healthcare professionals and patients NIH Public Access. Ergonomics [Internet] 2013; 56 (11) 1-30 . Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3835697/pdf/nihms521772.pdf
    CrossrefPubMedGoogle Scholar
  • 138 Carayon P, Schoofs Hundt A, Karsh BT, Gurses AP, Alvarado CJ, Smith M. et al. Work system design for patient safety: The SEIPS model. Qual Saf Heal Care 2006; 15 (SUPPL. 1): 50-8
    CrossrefPubMedGoogle Scholar
  • 139 Sittig. Dean F, Singh H. A New Socio-technical Model for Studying Health Information Technology in Complex Adaptive Healthcare Systems. Qual Saf Heal Care 2010; 19 (Suppl 3): i68-74
    CrossrefPubMedGoogle Scholar
  • 140 Kermani F, Orooji A, Sheikhtaheri A. Teleoncology for children with cancer: A scoping review on applications and outcomes. Int J Med Inform [Internet]. 2020 139. (November 2019):104118. Available from: https://doi.org/10.1016/j.ijmedinf.2020.104118
    CrossrefPubMedGoogle Scholar
  • 141 Kondylakis H, Koumakis L, Tsiknakis M, Kiefer S. Personally Managed Health Data: Barriers, Approaches, and a Roadmap for the Future. J Biomed Inform 2020; 106
    PubMedGoogle Scholar
  • 142 Gambino O, Rundo L, Pirrone R, Vitabile S. HCI for biomedical decision-making: From diagnosis to therapy. J Biomed Inform 2020; 111: 103593
    CrossrefPubMedGoogle Scholar
  • 143 McGreevey JD, Mallozzi CP, Perkins RM, Shelov E, Schreiber R. Reducing Alert Burden in Electronic Health Records: State of the Art Recommendations from Four Health Systems. Appl Clin Inform 2020; 11 (01) 1-12
    Article in Thieme ConnectPubMedGoogle Scholar
  • 144 Venkatesh V, Morris MG, Davis GB, Davis FD. Quarterly. 2003; 27 (03) 425-78
    PubMedGoogle Scholar
  • 145 Zhou T, Lu Y, Wang B. Integrating TTF and UTAUT to explain mobile banking user adoption. Comput Human Behav [Internet] 2010; 26 (04) 760-7 . Available from: http://dx.doi.org/10.1016/j.chb.2010.01.013
    CrossrefPubMedGoogle Scholar