Quality Requirements for Electronic Health Record Systems^[*]

Summary

Background: For more than 30 years, there has been close cooperation between Japanese and German scientists with regard to information systems in health care. Collaboration has been formalized by an agreement between the respective scientific associations. Following this agreement, two joint workshops took place to explore the similarities and differences of electronic health record systems (EHRS) against the background of the two national healthcare systems that share many commonalities.

Objectives: To establish a framework and requirements for the quality of EHRS that may also serve as a basis for comparing different EHRS.

Methods: Donabedian’s three dimensions of quality of medical care were adapted to the outcome, process, and structural quality of EHRS and their management. These quality dimensions were proposed before the first workshop of EHRS experts and enriched during the discussions.

Results: The Quality Requirements Framework of EHRS (QRF-EHRS) was defined and complemented by requirements for high quality EHRS. The framework integrates three quality dimensions (outcome, process, and structural quality), three layers of information systems (processes and data, applications, and physical tools) and three dimensions of information management (strategic, tactical, and operational information management).

Conclusions: Describing and comparing the quality of EHRS is in fact a multidimensional problem as given by the QRF-EHRS framework. This framework will be utilized to compare Japanese and German EHRS, notably those that were presented at the second workshop.

Keywords

Electronic health records - quality - information systems in healthcare - information management

^* Supplementary material published on our website https://doi.org/10.3414/ME17-05-0002

• References

• 1 Haux R. Medical informatics: past, present, future. Int J Med Inform 2010; 79 (Suppl. 09) 599-610.
• 2 Abrahamsson S, Bergstrom S, Larsson K, Tillman S. Danderyd Hospital computer system. II. Total regional system for medical care. Comput Biomed Res 1970; 3 (Suppl. 01) 30-46.
• 3 Friedman CP, Owens DK, Wyatt JC. Evaluation and Technology Assessment. In: Shortliffe EH, Cimino JJ. editors. Biomedical Informatics: Computer Applications in Health Care and Biomedicine. New York: Springer; 2006. p. 403-446.
• 4 Garets D, Davis M. Electronic Medical Records vs. Electronic Health Records: Yes, There Is a Difference. Chicago, IL: HIMSS Analytics; 2006. Available from: http://s3.amazonaws.com/rdcms-himss/files/production/public/HIMSSorg/Con-tent/files/WP_EMR_EHR.pdf.
• 5 International Organization for Standardization (ISO).. ISO 18308: 2011 Requirements for an electronic health record architecture. 2011 [cited 2014 Jan 23].
• 6 Takabayashi K, Doi S, Suzuki T. Japanese EMRs and IT in Medicine: Expansion, Integration, and Reuse of Data. Healthc Inform Res 2011; 17 (Suppl. 03) 178-183.
• 7 Hoerbst A, Ammenwerth E. Electronic health records. A systematic review on quality requirements. Methods Inf Med 2010; 49 (Suppl. 04) 320-336.
• 8 Prokosch HU, Ganslandt T. Perspectives for medical informatics.: Reusing the electronic medical record for clinical research. Methods Inf Med 2009; 48 (Suppl. 01) 38-44.
• 9 Kimura E, Kobayashi S, Kanatani Y, Ishihara K, Mimori T, Takahashi R. et al. Developing an electronic health record for intractable diseases in Japan. In: User Centred Networked Health Care: Proceedings of MIE 2011. Amsterdam: IOS Press; 2011. p. 255-259 (Stud Health Technol Inform; vol. 169).
• 10 Health Level Seven International.. HL7 EHR System Functional Model: Health Level Seven International. 2007 Jan 1.
• 11 Winter A, Haux R, Ammenwerth E, Brigl B, Hellrung N, Jahn F. Health Information Systems-Architectures and Strategies. London: Springer; 2011
• 12 Winter A, Brigl B, Wendt T. Modeling Hospital Information Systems (Part 1): The Revised Three-Layer Graph-Based Meta Model 3LGM² . Methods Inf Med 2003; 42 (Suppl. 05) 544-551.
• 13 Staemmler M. Towards sustainable e-health networks: does modeling support efficient management and operation?. In: Kuhn KA, Warren JR, Leong T-Y. editors. Proceedings of Medinfo 2007 (Part 1). Amsterdam: IOS Press; 2007. p. 53-57 (Stud Health Technol Inform; vol. 129).
• 14 Jahn F, Ißler L, Winter A, Takabayashi K. Comparing a Japanese and a German Hospital Information System - Assessing Structural Quality by 3LGM² Models. Methods Inf Med 2009; 48 (Suppl. 06) 531-539.
• 15 Weill P, Ross JW. IT Governance - How top performers manage IT decisions right for superior results. Boston, Massachusetts: Harvard Business School Press;; 2004
• 16 Kabachinski J. Have you heard of ITIL?: It’s time you did. Biomed Instrum Technol 2011; 45 (Suppl. 01) 59-62.
• 17 Dögl R. Strategisches Qualitätsmanagement im Industriebetrieb: pragmatischer Ansatz zur Erklärung und methodischen Handhabung des Qualitätsphenomens. Göttingen: Vandenhoeck & Ruprecht; 1986. German.
• 18 Liebe J-D, Hübner U, Straede M-C, Thye J. A top-down approach for developing a workflow composite score to measure clinical information logistics. Methods Inf Med 2015; 54 (Suppl. 05) 424-433.
• 19 Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q 1966; 44 (Suppl. 03) 166.
• 20 Donabedian A. Criteria and Standards for Quality Assessment and Monitoring. Quality Review Bulletin 1986; 12 (Suppl. 03) 99-108.
• 21 Ammenwerth E. Evidence-based Health Informatics: How Do We Know What We Know?. Methods Inf Med 2015; 54 (Suppl. 04) 298-307.
• 22 Ancker JS, Kern LM, Abramson E, Kaushal R. The Triangle Model for evaluating the effect of health information technology on healthcare quality and safety. J Am Med Inform Assoc 2012; 19 (Suppl. 01) 61-65.
• 23 Jahn F, Takabayashi K, Suzuki T, Fujita S, Winter A. Comparison between German and Japanese Hospital Information Systems by 3LGM2 analysis. In: Proceedings of the 27th Joint Conference of Medical Informatics (JCMI). Kobe: November 23-25 2007. p. 840-843.
• 24 Takabayashi K. From Marco Polo Islands. Methods Inf Med 2007; 46 (Suppl. 06) 669-670.
• 25 Takabayashi K, Hasegawa K, Yamazaki S, Oshima H, Okamura H, Uchida T. [EMI net - electronic medical record sharing in local community for home care medicine]. Gan To Kagaku Ryoho 2003; 30 Suppl 1: 169-172. Japanese.
• 26 Matsumoto T, Honda M. The evaluation of the need to share medical data on the community medical ICT network service in Nagasaki, Japan. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 1017 (Stud Health Technol Inform; vol. 192).
• 27 Haux R, Hein A, Kolb G, Kunemund H, Eichelberg M. Five years of interdisciplinary research on ageing and technology: Outcomes of the Lower Saxony Research Network Design of Environments for Ageing (GAL) - an Introduction to this Special Issue on Ageing and Technology. Inform Health Soc Care 2014; 39 3-4 161-165.
• 28 Kobayashi K, Nakashima N, Inoguchi T, Takaya-nagi R. [Disease management for diabetes mellitus to prevent the onset and progression of complications]. Rinsho Byori 2012; 60 (Suppl. 11) 1101-1106. Japanese.
• 29 Miyo K, Nittami YS, Kitagawa Y, Ohe K. Development of case-based medication alerting and rec-ommender system: a new approach to prevention for medication error. In: Kuhn KA, Warren JR, Leong T-Y. editors. Proceedings of Medinfo 2007 (Part 2). Amsterdam: IOS Press; 2007. p. 871-874 (Stud Health Technol Inform; vol. 129).
• 30 Ammenwerth E, Aly AF, Burkle T, Christ P, Dormann H, Friesdorf W. et al. Memorandum on the Use of Information Technology to Improve Medication Safety. Methods Inf Med 2014; 2014 53(5) 336-343.
• 31 Prokosch HU, Beck A, Ganslandt T, Hummel M, Kiehntopf M, Sax U. et al. IT Infrastructure Components for Biobanking. Appl Clin Inform 2010; 1 (Suppl. 04) 419-429.
• 32 Jahn F, Winter A. A KPI Framework for Process-based Benchmarking of Hospital Information Systems. In: User Centred Networked Health Care: Proceedings of MIE 2011. Amsterdam: IOS Press; 2011. p. 542-6 (Stud Health Technol Inform; vol. 169).
• 33 Hübner U, Ammenwerth E, Flemming D, Schaubmayr C, Sellemann B. IT adoption of clinical information systems in Austrian and German hospitals: results of a comparative survey with a focus on nursing. BMC Med Inform Decis Mak 2010; 10: 8.
• 34 Aamot H, Kohl CD, Richter D, Knaup-Gregori P. Pseudonymization of patient identifiers for translational research. BMC Med Inform Decis Mak 2013; 13: 75.
• 35 Farfán FJSedano, Terrón Cuadrado M, Castellanos Clemente Y, Serrano Balazote P, Moner Cano D, Robles Viejo M. Patient Summary and medicines reconciliation: application of the ISO/CEN EN 13606 standard in clinical practice. Stud Health Technol Inform 2011; 166: 189-196.
• 36 Garde S, Chen R, Leslie H, Beale T, McNicoll I, Heard S. Archetype-based knowledge management for semantic interoperability of electronic health records. In: Medical informatics in a united and healthy Europe: Proceedings of MIE 2009, the XXII International Congress of the European Federation for Medical Informatics. Amsterdam: IOS Press; 2009. p. 1007-1011 (Stud Health Technol Inform; vol. 150).
• 37 Kohl CD, Garde S, Knaup P. Facilitating secondary use of medical data by using openEHR archetypes. In: Safran C, Marin H, Reti S. editors. MEDINFO 2010 Partnerships for Effective eHealth Solutions. Amsterdam: IOS Press; 2010. p. 1117-1121 (Stud Health Technol Inform; vol. 160).
• 38 Kobayashi S, Kimura E, Ishihara K. Archetype Model-Driven Development Framework for EHR Web System. Healthc Inform Res 2013; 19 (Suppl. 04) 271-277.
• 39 Gottesman O, Kuivaniemi H, Tromp G, Faucett WA, Li R, Manolio TA. et al. The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future. Genet Med 2013; 15 (Suppl. 10) 761-771.
• 40 van Horn JD, Toga AW. Human neuroimaging as a “Big Data” science. Brain Imaging Behav 2014; 8 (Suppl. 02) 323-331.
• 41 Gupta P, Janodia MD, Jagadish PC, Udupa N. Medical device vigilance systems: India, US, UK, and Australia. Med Devices (Auckl) 2010; 3: 67-79.
• 42 Karmen C, Ganzinger M, Kohl CD, Firnkorn D, Knaup-Gregori P. A framework for integrating heterogeneous clinical data for a disease area into a central data warehouse. In: EHealth - for continuity of care: Proceedings of MIE2014. Amsterdam: IOS Press; 2014. p. 1060-1064 (Stud Health Technol Inform; vol. 205).
• 43 Berg M. Medical Work and the Computer-Based Patient Record: A Sociological Perspective. Methods Inf Med 1998; 37: 294-301.
• 44 Juhr M, Haux R, Suzuki T, Takabayashi K. Overview of recent trans-institutional health network projects in Japan and Germany. J Med Syst 2015; 39 (Suppl. 05) 234.
• 45 Schwartze J, Haarbrandt B, Rochon M, Wagner M, Haux R, Kleinschmidt T. et al. Design and implementation of an informed consent process for a standardized health information exchange solution on the example of the lower saxony bank of health. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 318-322 (Stud Health Technol Inform; vol. 192).
• 46 Neubert A, Dormann H, Prokosch HU, Burkle T, Rascher W, Sojer R. et al. E-pharmacovigilance: development and implementation of a computable knowledge base to identify adverse drug reactions. Br J Clin Pharmacol 2013; 76 Suppl 1: 69-77.
• 47 EUROREC Institute.. The EuroRec EHR Quality Seal. 2015 [cited 2015 Jan 15].
• 48 Burkle T, Baur T, Hoss N. Clinical pathways development and computer support in the EPR: lessons learned. In: Ubiquity: Technologies for better health in aging societies: Proceedings of MIE2006. Amsterdam: IOS Press; 2006. p. 1025-1030 (Stud Health Technol Inform; vol. 124).
• 49 Malin JL. Envisioning Watson as a rapid-learning system for oncology. J Oncol Pract 2013; 9 (Suppl. 03) 155-157.
• 50 Marincola FM. Translational Medicine: A two-way road. J Transl Med 2003; 1 (Suppl. 01) 1.
• 51 Matsumura Y, Hattori A, Manabe S, Takeda T, Takahashi D, Yamamoto Y. et al. Interconnection of electronic medical record with clinical data management system by CDISC ODM. In: EHealth - for continuity of care: Proceedings of MIE2014. Amsterdam: IOS Press; 2014. p. 868-872 (Stud Health Technol Inform; vol. 205).
• 52 Matsumura Y, Kuwata S, Yamamoto Y, Izumi K, Okada Y, Hazumi M. et al. Template-based data entry for general description in medical records and data transfer to data warehouse for analysis. In: Kuhn KA, Warren JR, Leong T-Y. editors. Proceedings of Medinfo 2007 (Part 1). Amsterdam: IOS Press; 2007. p. 412-416 (Stud Health Technol Inform; vol. 129).
• 53 Hruby GW, McKiernan J, Bakken S, Weng C. A centralized research data repository enhances retrospective outcomes research capacity: a case report. J Am Med Inform Assoc 2013; 20 (Suppl. 03) 563-567.
• 54 Ganslandt T, Mate S, Helbing K, Sax U, Prokosch HU. Unlocking Data for Clinical Research - The German i2b2 Experience. Appl Clin Inform 2011; 2 (Suppl. 01) 116-127.
• 55 Stäubert S, Winter A, Speer R, Loffler M. Designing a Concept for an IT-Infrastructure for an Integrated Research and Treatment Center. In: Safran C, Marin H, Reti S. editors. MEDINFO 2010 Partnerships for Effective eHealth Solutions. Amsterdam: IOS Press; 2010. p. 1319-1323 (Stud Health Technol Inform; vol. 160).
• 56 Takabayashi K, Ho TB, Yokoi H, Nguyen TD, Kawasaki S, Le SQ. et al. Temporal abstraction and data mining with visualization of laboratory data. In: Kuhn KA, Warren JR, Leong T-Y. editors. Proceedings of Medinfo 2007 (Part 2). Amsterdam: IOS Press; 2007. p. 1304-1308 (Stud Health Technol Inform; vol. 129).
• 57 McGlynn EA, Lieu TA, Durham ML, Bauck A, Laws R, Go AS. et al. Developing a data infrastructure for a learning health system: the PORTAL network. J Am Med Inform Assoc 2014; 21 (Suppl. 04) 596-601.
• 58 Danciu I, Cowan JD, Basford M, Wang X, Saip A, Osgood S. et al. Secondary use of clinical data: the Vanderbilt approach. J Biomed Inform 2014; 52: 28-35.
• 59 Suzuki T, Doi S, Fujita S, Hatakeyama Y, Honda M, Matsumura Y. et al. Construction of the integrated multicentre discharge summary database. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 1064 (Stud Health Technol Inform; vol. 192).
• 60 Löpprich M, Krauss F, Ganzinger M, Senghas K, Riezler S, Knaup P. Automated classification of selected data elements from free-text diagnostic reports for clinical research. Methods Inf Med 2016; 55 (Suppl. 04) 373-380.
• 61 Dykes PC, Samal L, Donahue M, Greenberg JO, Hurley AC, Hasan O. et al. A patient-centered longitudinal care plan: vision versus reality. J Am Med Inform Assoc 2014; 21 (Suppl. 06) 1082-1090.
• 62 S&I Framework.. Longitudinal Coordination of Care - Interoperable Care Plan Exchange - Use Case v2.0: Framework, S&I; 2014 Jan 1 [cited 2016 Jan 31]. Available from: http://wiki.siframe-work.org/file/detail/LCC%20Care%20Plan%20Ex-change%20Use%20Case%20Finalv2.pdf.
• 63 Honda M, Matsumoto T, Hirose M. A system for health promotion using tele-homecare technology in community. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 940 (Stud Health Technol Inform; vol. 192).
• 64 Loya SR, Kawamoto K, Chatwin C, Huser V. Service oriented architecture for clinical decision support: a systematic review and future directions. J Med Syst 2014; 38 (Suppl. 12) 140.
• 65 Staemmler M, Walz M, Weisser G, Engelmann U, Weininger R, Ernstberger A. et al. Establishing end-to-end security in a nationwide network for telecooperation. In: Quality of life through quality of information: Proceedings of MIE2012. Amsterdam: IOS Press; 2012. p. 512-516 (Stud Health Technol Inform; vol. 180).
• 66 Fonseca M, Karkaletsis K, Cruz IA, Berler A, Oliveira IC. OpenNCP: a novel framework to foster cross-border e-Health services. In: Digital Healthcare Empowering Europeans: Proceedings of MIE2015. Amsterdam: IOS Press; 2015. p. 617-621 (Stud Health Technol Inform; vol. 210).
• 67 Stäubert S, Schaaf M, Jahn F, Brandner R, Winter A. Modeling Interoperable Information Systems with 3LGM² and IHE. Methods Inf Med 2015; 54 (Suppl. 05) 398-405.
• 68 ASTM E2369-12. Standard Specification for Continuity of Care Record (CCR). 2012 Available from: www.astm.org.
• 69 HL7.. HL7/ASTM Implementation Guide for CDA^® R2 -Continuity of Care Document (CCD*) Release 1. 2014 [cited 2014 Dec 04].
• 70 Eizen K, Masato S, Kazukuni K, Yoshihito N, Ta-kuji K, Ken I. Securing SSL-VPN with LR-AKE to access personal health record. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 930 (Stud Health Technol Inform; vol. 192).
• 71 Bellazzi R. Big data and biomedical informatics: a challenging opportunity. Yearb Med Inform 2014; 9 (Suppl. 01) 8-13.
• 72 Staemmler M. Service delivery for e-Health applications. In: User Centred Networked Health Care: Proceedings of MIE 2011. Amsterdam: IOS Press; 2011. p. 537-541 (Stud Health Technol Inform; vol. 169).
• 73 Holden RJ, Brown RL, Alper SJ, Scanlon MC, Patel NR, Karsh B-T. That’s nice, but what does IT do? Evaluating the impact of bar coded medication administration by measuring changes in the process of care. Int J Ind Ergon 2011; 41 (Suppl. 04) 370-379.
• 74 Hofdijk J, Séroussi B, Lovis C, Ehrler F, Sieverink F, Ugon A. et al., editors. Transforming Healthcare with the Internet of Things: Proceedings of the EFMI Special Topic Conference 2016. Amsterdam: IOS Press; 2016. (vol 221).
• 75 Oberlander M, Linnebacher M, Konig A, Bogoevska V, Brodersen C, Kaatz R. et al. The “North German Tumor Bank of Colorectal Cancer”: status report after the first 2 years of support by the German Cancer Aid Foundation. Langenbecks Arch Surg 2013; 398 (Suppl. 02) 251-258.
• 76 ISACA.. COBIT 5: A Business Framework for the Governance and Management of Enterprise IT; 2013 [cited 2013 Nov 14]. Available from: http://www.isaca.org/cobit/pages/default.aspx.
• 77 Brigl B, Ammenwerth E, Dujat C, Graber S, Grosse A, Haber A. et al. Preparing strategic information management plans for hospitals: a practical guideline: SIM plans for hospitals: a guideline. Int J Med Inform 2005; 74 (Suppl. 01) 51-65.
• 78 Haux R. Health information systems - past, present, future. Int J Med Inform 2006; 75 3-4 268-281.
• 79 World Health Organization, International Telecommunication Union.. National eHealth Strategy Toolkit. Geneva: World Health Organization; 2012. Jan 1. Available from: http://www.itu.int/pub/D-STR-E_HEALTH.05-2012.
• 80 Shabo A. It’s time for health record banking!. Methods Inf Med 2014; 53 (Suppl. 02) 63-65.
• 81 Plischke M, Wagner M, Haarbrandt B, Rochon M, Schwartze J, Tute E. et al. The lower saxony bank of health. Rationale, principles, services, organization and architectural framework. Methods Inf Med 2014; 53 (Suppl. 02) 73-81.
• 82 AXELOS Ltd.. PRINCE2; 2014 [cited 2014 Mar 5]. Available from: http://www.prince-officialsite.com/.
• 83 Ammenwerth E, Haux R, Bess A, Blomer R, Bott O, Häber A. et al. IT-Projektmanagement in Krankenhaus und Gesundheitswesen - Einführendes Lehrbuch und Projektleitfaden für das taktische Management von Informationssystemen. Stuttgart: Schattauer;; 2005
• 84 ServiceNow.. KPI LIBRARY; 2014 [cited 2014 Mar 5]. Available from: http://kpilibrary.com/.
• 85 Hoerbst A, Ammenwerth E. Quality and Certification of Electronic Health Records: An overview of current approaches from the US and Europe. Appl Clin Inform 2010; 1 (Suppl. 02) 149-164.
• 86 Ammenwerth E, Rigby M. editors. Evidence-based health informatics: Promoting safety and efficiency through scientific methods and ethical policy. Amsterdam, Netherlands: IOS Press; 2016. (Stud Health Technol Inform; vol 222).
• 87 Hellrung N, Gusew N, Willkomm M, Haux R. IT-based information management in health care networks: the MedoCom approach. In: EHealth Beyond the Horizon-Get IT There: Proceedings of MIE2008. Amsterdam: IOS Press; 2008. p. 623-628 (Stud Health Technol Inform; vol. 136).
• 88 Mantas J, Ammenwerth E, Demiris G, Hasman A, Haux R, Hersh W. et al. Recommendations of the International Medical Informatics Association (IMIA) on Education in Biomedical and Health Informatics. First Revision. Methods Inf Med 2010; 49 (Suppl. 02) 105-120.
• 89 Nakashima N, Nohara Y, Ahamed A, Kuroda M, Inoue S, Ghosh PP. et al. An affordable, usable and sustainable preventive healthcare system for unreached people in Bangladesh. In: Lehmann CU, Ammenwerth E, Nohr C. editors. Medinfo 2013. Amsterdam: IOS Press; 2013. p. 1051 (Stud Health Technol Inform; vol. 192).
• 90 Hafen E, Kossmann D, Brand A. Health data cooperatives - citizen empowerment. Methods Inf Med 2014; 53 (Suppl. 02) 82-86.
• 91 Kelbert F, Pretschner A. Data usage control enforcement in distributed systems. In: Proceedings of the third ACM conference on Data and application security and privacy. New York, NY, USA: ACM; 2013. p. 71-82.
• 92 Calvillo J, Roman I, Roa LM. Empowering citizens with access control mechanisms to their personal health resources. Int J Med Inform 2013; 82: 58-72.
• 93 The Open Group.. The Open Group IT4IT Reference Architecture v1.3; 2014. Available from: https://collaboration.opengroup.org/data/IT4IT/RA_1.3/index.htm?goto=2:1:1:205.
• 94 Pettit L. Understanding EMRAM and how it can be used by policy-makers, hospital CIOs and their IT teams. World Hosp Health Serv 2013; 49 (Suppl. 03) 7-9.
• 95 DeLone WH, McLean ER. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. Journal of Management Information Systems 2003; 19 (Suppl. 04) 9-30.