Evaluation of Electronic Health Record Systems

Summary

Objectives

The objective of this article is to present an overview of the various considerations to be made prior to evaluating electronic health record (EHR) systems.

Methods

From the methodological literature, a number of themes for decisions are presented and related to the contemporary EHR situation. Special attention is paid to a number of important methodological themes.

Results

Definitive checklists for evaluation of EHR systems can not be recommended, but seven key steps are listed to guide the design of evaluation projects.

Conclusion

It is concluded that the issues presented are not completely exhausted and the seven key steps might have to include iterative loops because of interdependencies between some of the steps.

Keywords

Evaluation methodology - medical record - health informatics - electronic health record

• References

• 1 Ammenwerth E, de Keizer N. An inventory of evaluation studies of information technology in health care trends in evaluation research 19822002. Methods Inf Med 2005; 44 (01) 44-56.
• 2 Schloeffel P. Current EHR Developments: an Australian and International Perspective Part 1. Health Care and Informatics Review Online ^TM. 2004. Available from: http://www.enigma.co.nz/hcro/website/index.cfm?fuseaction=articledisplay &featureid=010904.
• 3 Australian Health Information Council. National Strategy. 2004 Available from: http://www.ahic. org.au/strategy/index.html.
• 4 Canada Health Infoway. 2003-2004 Annual Report 2004-2005 Corporate Plan Summary. 2004 Available from: http://www.infoway-inforoute.ca/Admin/Upload/Dev/Document/200304_CHIAnnualReport.pdf.
• 5 Danish Ministry of the Interior and Health. National IT Strategy 2003-2007 for the Danish Health Care Service. 2003 Available from: http://www.sst.dk/publ/publ2004/National_IT_Strategy. pdf.
• 6 The WAVE Advisory Borad to the Director-General of Health. From Strategy to Reality The Working to Add Value Through e-Informaation (WAVE) Project: Health Information and Management and Technology Plan. 2001 Available from: http://www.moh.govt.nz/moh.nsf/0/F34F8959738E992CCC256AF400177998/$File/ TheWAVEreport.pdf.
• 7 Aarts J. Understanding Implementation. A sociotechnical appraisal of the introduction of computerized physician order entry systems in Dutch and American Hospitals. [dissertation] Erasmus University Rotterdam. 2005
• 8 Anderson JG, Aydin CE, Jay SJ. Evaluating Health Care Information Systems. Methods and Applications. Thousand Oaks: Sage Publications; 2005
• 9 Brender J. Metodehåndbog i teknologivurdering af it-baserede løsninger inden for sundhedssektoren. EPJ-Observatoriet. 2004
• 10 Brender J. Methodology for Assessment of Medical IT-based Systems in an Organisational Context. Amsterdam: IOS Press; 1997
• 11 Brender J. Handbook of Evaluation Methods for Health Informatics. Elsevier Academic Press; 2006
• 12 Friedman CP, Wyatt JC. Evaluation Methods in Medical Informatics. New York, Berlin, Heidelberg: Springer-Verlag; 1997
• 13 van Gennip E, Talmon J. Assessment and Evaluation of Information Technologies in Medicine. Amsterdam: IOS Press; 1994
• 14 Lorenzi NM, Riley RT. Organisational Aspects of Health Informatics. Managing Technological Change. New York: Springer-Verlag; 1995
• 15 Lorenzi NM, Riley RT. Managing Technological Change. Organisational Aspects of Health Informatics. 2nd ed.. New York, Berlin, Heidelberg: Springer-Verlag; 2004
• 16 Leavitt H. Applied Organizational Change in Industry: Structural, Technological and Humanistic approaches. In: March JG, editor. Handbook of Organizations. Chicago: Rand McNelly; 1965: 1144-70.
• 17 Scott WR. Organisations: Rational, Natural and Open Systems; 4th ed.. Englewood Cliffs: Prentice Hall; 1998
• 18 Tryggestad K, Borum F. Organisationen. In: Kristensen FB, Hørder M, Poulsen PB. editors. Metodehåndbog for Medicinsk Teknologivurdering. Copenhagen: Statens Institut for Medicinsk Teknologivurdering; 2001: 85-95
• 19 Stoop A, Heathfield H, de Mul M, Berg M. Evaluation of patient care information systems. Theory and practice. In: Berg M. editor. Health Information Management. Integrating Information Technology in Health Care Work. Routledge: 2005: 206-29.