Improving Bridging from Informatics Practice to Theory

Summary

Background: In 1962, Methods of Information in Medicine (MIM) began to publish papers on the methodology and scientific fundamentals of organizing, representing, and analyzing data, information, and knowledge in biomedicine and health care. Considered a companion journal, Applied Clinical Informatics (ACI) was launched in 2009 with a mission to establish a platform that allows sharing of knowledge between clinical medicine and health IT specialists as well as to bridge gaps between visionary design and successful and pragmatic deployment of clinical information systems. Both journals are official journals of the International Medical Informatics Association.

Objectives: As a follow-up to prior work, we set out to explore congruencies and interdependencies in publications of ACI and MIM. The objectives were to describe the major topics discussed in articles published in ACI in 2014 and to determine if there was evidence that theory in 2014 MIM publications was informed by practice described in ACI publications in any year. We also set out to describe lessons learned in the context of bridging informatics practice and theory and offer opinions on how ACI editorial policies could evolve to foster and improve such bridging.

Methods: We conducted a retrospective observational study and reviewed all articles published in ACI during the calendar year 2014 (Volume 5) for their main theme, conclusions, and key words. We then reviewed the citations of all MIM papers from 2014 to determine if there were references to ACI articles from any year. Lessons learned in the context of bridging informatics practice and theory and opinions on ACI editorial policies were developed by consensus among the two authors.

Results: A total of 70 articles were published in ACI in 2014. Clinical decision support, clinical documentation, usability, Meaningful Use, health information exchange, patient portals, and clinical research informatics emerged as major themes. Only one MIM article from 2014 cited an ACI article. There are several lessons learned including the possibility that there may not be direct links between MIM theory and ACI practice articles. ACI editorial policies will continue to evolve to reflect the breadth and depth of the practice of clinical informatics and articles received for publication. Efforts to encourage bridging of informatics practice and theory may be considered by the ACI editors.

Conclusions: The lack of direct links from informatics theory-based papers published in MIM in 2014 to papers published in ACI continues as was described for papers published during 2012 to 2013 in the two companion journals. Thus, there is little evidence that theory in MIM has been informed by practice in ACI.

Keywords

Clinical informatics - biomedical informatics - informatics practice - informatics theory

• References

• 1 Methods of Information in Medicine http://www.methods-online.com Last accessed: October 15 2014
• 2 McCray AT, Gefeller O, Aronsky D, Leong TY, Sarkar IN, Bergemann D, Lindberg DA, van Bemmel JH, Haux R. The birth and evolution of a discipline devoted to information in biomedicine and health care. As reflected in its longest running journal. Methods Inf Med 2011; 50 (06) 491-507.
• 3 Applied Clinical Informatics http://aci.schattauer. de/en/home.html Last accessed: October 10 2015
• 4 Lehmann CU, Altuwaijri MM, Li YC, Ball MJ, Haux R. Translational research in medical informatics or from theory to practice. A call for an applied informatics journal. Methods Inf Med 2008; 47 (01) 1-3.
• 5 Kim GR, Lehmann CU. In search of dialogue and discourse in applied clinical informatics. Appl Clin Inform 2009; 0: 1-7.
• 6 International Medical Informatics Association http://www.imia.org Last accessed: October 10 2015
• 7 Schattauer Verlag, Stuttgart, Germany http:// www.schattauer.de/nc/en/home.html Last accessed: October 10 2015
• 8 Haux R. IMIA: the global informatics perspective for good health. Yearb Med Inform 2010: 1-5.
• 9 Haux R, Ball M. From Theory into Practice: Bridging the Clinical Informatics Divide! Appl Clin Inform. 2009; 0: 8-11.
• 10 Haux R, Lehmann CU. From bed to bench: bridging from informatics practice to theory: an exploratory analysis. Appl Clin Inform 2014; 5 (04) 907-915.
• 11 Lehmann CU, Haux R. From bench to bed: bridging from informatics theory to practice. An exploratory analysis. Methods Inf Med 2014; 53 (06) 511-515.
• 12 Haux R, Koch S. Improving bridging from informatics theory to practice. Appl Clin Inform (to appear)
• 13 PubMed http://www.ncbi.nlm.nih.gov/pubmed/ Last accessed: October 10 2015
• 14 Wood NM, D’Amore JD, Jones SL, Sittig DF, Ness RB. Death: taxes and advance directives. Appl Clin Inform 2014; 5 (02) 589-593. doi: 10.4338/ ACI-2013-12-IE-0099. eCollection 2014
• 15 Vito D, Diltz M, Porter M, White P, Luberti A. Symposium highlights and synopses of the scientific program: the Sixth Annual Mid-Atlantic Healthcare Informatics Symposium. Appl Clin Inform 2014; 5 (01) 85-91. doi: 10.4338/ACI-2013–10-IE-0082. eCollection 2014
• 16 German Research Association. Proposals for Safeguarding Good Scientific Practice. Bonn, 1998 http://www.dfg.de/download/pdf/foerderung/rechtliche_rahmenbedingungen/gute_ wissenschaftliche_praxis/self_regulation_98.pdf Last accessed: October 15 2014
• 17 PubMedCentral http://www.ncbi.nlm.nih.gov/pmc/ Last accessed October 10 2015
• 18 Jacobs J, Weir C, Evans RS, Staes C. Assessment of readiness for clinical decision support to aid laboratory monitoring of immunosuppressive care at U.S. liver transplant centers. Appl Clin Inform 2014; 5 (04) 988-1004. doi: 10.4338/ACI-2014–08-RA-0060. eCollection 2014
• 19 Tariq A, Lehnbom E, Oliver K, Georgiou A, Rowe C, Osmond T, Westbrook J. Design challenges for electronic medication administration record systems in residential aged care facilities: a formative evaluation. Appl Clin Inform 2014; 5 (04) 971-987. doi: 10.4338/ACI-2014–08-RA-0062. eCollection 2014
• 20 Boyce RD, Perera S, Nace DA, Culley CM, Handler SM. A survey of nursing home physicians to determine laboratory monitoring adverse drug event alert preferences. Appl Clin Inform 2014; 5 (04) 895-906. doi: 10.4338/ACI-2014–06-RA-0053. eCollection 2014
• 21 Bryant AD, Fletcher GS, Payne TH. Drug interaction alert override rates in the Meaningful Use era: no evidence of progress. Appl Clin Inform 2014; 5 (03) 802-813. doi: 10.4338/ACI-2013–12-RA-0103. eCollection 2014
• 22 Rinner C, Sauter SK, Neuhofer LM, Edlinger D, Grossmann W, Wolzt M, Endel G, Gall W. Estimation of severe drug-drug interaction warnings by medical specialist groups for Austrian nationwide eMedication. Appl Clin Inform 2014; 5 (03) 603-611. doi: 10.4338/ACI-2014–04-RA-0030. eCollection 2014
• 23 Cho I, Lee J, Han H, Phansalkar S, Bates DW. Evaluation of a Korean version of a tool for assessing the incorporation of human factors into a medication-related decision support system: the I-MeDeSA. Appl Clin Inform 2014; 5 (02) 571-588. doi: 10.4338/ACI-2014–01-RA-0005. eCollection 2014
• 24 Mann D, Knaus M, McCullagh L, Sofianou A, Rosen L, McGinn T, Kannry J. Measures of user experience in a streptococcal pharyngitis and pneumonia clinical decision support tools. Appl Clin Inform 2014; 5 (03) 824-835. doi: 10.4338/ACI-2014–04-RA-0043. eCollection 2014
• 25 Hum RS, Cato K, Sheehan B, Patel S, Duchon J, DeLaMora P, Ferng YH, Graham P, Vawdrey DK, Perlman J, Larson E, Saiman L. Developing clinical decision support within a commercial electronic health record system to improve antimicrobial prescribing in the neonatal ICU. Appl Clin Inform 2014; 5 (02) 368-387. doi: 10.4338/ACI-2013–09-RA-0069 eCollection 2014
• 26 Schnall R, Liu N, Sperling J, Green R, Clark S, Vawdrey D. An electronic alert for HIV screening in the emergency department increases screening but not the diagnosis of HIV. Appl Clin Inform 2014; 5 (01) 299-312. doi: 10.4338/ACI-2013–09-RA-0075 eCollection 2014
• 27 Donsa K, Beck P, Plank J, Schaupp L, Mader JK, Truskaller T, Tschapeller B, Höll B, Spat S, Pieber TR. A toolbox to improve algorithms for insulin-dosing decision support. Appl Clin Inform 2014; 5 (02) 548-556. doi: 10.4338/ACI-2014–04-RA-0033 eCollection 2014
• 28 Kirkendall ES, Kouril M, Minich T, Spooner SA. Analysis of electronic medication orders with large overdoses: opportunities for mitigating dosing errors. Appl Clin Inform 2014; 5 (01) 25-45. doi: 10.4338/ACI-2013–08-RA-0057. eCollection 2014
• 29 Huang Y, Hanauer DA. Patient no-show predictive model development using multiple data sources for an effective overbooking approach. Appl Clin Inform 2014; 5 (03) 836-860. doi: 10.4338/ ACI-2014-04-RA-0026 eCollection 2014
• 30 Olson CH, Dierich M, Adam T, Westra BL. Optimization of decision support tool using medication regimens to assess rehospitalization risks. Appl Clin Inform 2014; 5 (03) 773-788. doi: 10.4338/ ACI-2014–04-RA-0026. eCollection 2014
• 31 Kirkendall ES, Spires WL, Mottes TA, Schaffzin JK, Barclay C, Goldstein SL. Development and performance of electronic acute kidney injury triggers to identify pediatric patients at risk for nephrotoxic medication-associated harm. Appl Clin Inform 2014; 5 (02) 313-333. doi: 10.4338/ ACI-2013-12-RA-0102 eCollection 2014
• 32 Ahmed A, Thongprayoon C, Pickering BW, Akhoundi A, Wilson G, Pieczkiewicz D, Herasevich V. Towards prevention of acute syndromes: electronic identification of at-risk patients during hospital admission. Appl Clin Inform 2014; 5 (01) 58-72. doi: 10.4338/ACI-2013–07-RA-0045. eCollection 2014
• 33 Edlinger D, Sauter SK, Rinner C, Neuhofer LM, Wolzt M, Grossmann W, Endel G, Gall W. JADE: a tool for medical researchers to explore adverse drug events using health claims data. Appl Clin Inform 2014; 5 (03) 621-629. doi: 10.4338/ ACI-2014-04-RA-0036 eCollection 2014
• 34 Zuccotti G, Maloney FL, Feblowitz J, Samal L, Sato L, Wright A. Reducing risk with clinical decision support: a study of closed malpractice claims. Appl Clin Inform 2014; 5 (03) 746-756. doi: 10.4338/ ACI-2014-02-RA-0018 eCollection 2014
• 35 Levison J, Triant V, Losina E, Keefe K, Freedberg K, Regan S. An algorithm to determine whether a person is foreign-born using structured and unstructured data elements from the EMR. Appl Clin Inform 2014; 5 (02) 557-570. doi: 10.4338/ACI-2014-02-RA-0013 eCollection 2014
• 36 Finnell SM, Stanton JL, Downs SM. Actionable recommendations in the Bright Futures child health supervision guidelines. Appl Clin Inform 2014; 5 (03) 651-659. doi: 10.4338/ACI-2014–02-RA-0012 eCollection 2014
• 37 Ho YX, Gadd CS, Kohorst KL, Rosenbloom ST. A qualitative analysis evaluating the purposes and practices of clinical documentation. Appl Clin Inform 2014; 5 (01) 153-168. doi: 10.4338/ ACI-2013-10-RA-0081. eCollection 2014
• 38 Herasevich V, Ellsworth MA, Hebl JR, Brown MJ, Pickering BW. Information needs for the OR and PACU electronic medical record. Appl Clin Inform 2014; 5 (03) 630-641. doi: 10.4338/ ACI-2014-02-RA-0015. eCollection 2014
• 39 Jurkovich MW, Ophaug M, Salberg S, Monsen K. Investigation of The Omaha System for dentistry. Appl Clin Inform 2014; 5 (02) 491-502. doi: 10.4338/ACI-2014–01-RA-0001. eCollection 2014
• 40 Zhou L, Lu Y, Vitale CJ, Mar PL, Chang F, Dhopeshwarkar N, Rocha RA. Representation of information about family relatives as structured data in electronic health records. Appl Clin Inform 2014; 5 (02) 349-367. doi: 10.4338/ACI-2013–10-RA-0080 eCollection 2014
• 41 Ranegger R, Hackl WO, Ammenwerth E. A proposal for an Austrian Nursing Minimum Data Set (NMDS): a Delphi study. Appl Clin Inform 2014; 5 (02) 538-547. doi: 10.4338/ACI-2014–04-RA-0027. eCollection 2014
• 42 Chen E, Garcia-Webb M. An analysis of free-text alcohol use documentation in the electronic health record: early findings and implications. Appl Clin Inform 2014; 5 (02) 402-415. doi: 10.4338/ ACI-2013-12-RA-0101. eCollection 2014
• 43 Hua L, Wang S, Gong Y. Text prediction on structured data entry in healthcare: a two-group randomized usability study measuring the prediction impact on user performance. Appl Clin Inform 2014; 5 (01) 249-263. doi: 10.4338/ACI-2013–11-RA-0095. eCollection 2014
• 44 Neri PM, Volk LA, Samaha S, Pollard SE, Williams DH, Fiskio JM, Burdick E, Edwards ST, Ramelson H, Schiff GD, Bates DW. Relationship between documentation method and quality of chronic disease visit notes. Appl Clin Inform 2014; 5 (02) 480-490. doi: 10.4338/ACI-2014–01-RA-0007. eCollection 2014
• 45 Sockolow PS, Bowles KH, Adelsberger MC, Chittams JL, Liao C. Impact of homecare electronic health record on timeliness of clinical documentation: reimbursement: and patient outcomes. Appl Clin Inform 2014; 5 (02) 445-462. doi: 10.4338/ACI-2013–12-RA-0106. eCollection 2014
• 46 Martínez-Costa C, Schulz S. Ontology content patterns as bridge for the semantic representation of clinical information. Appl Clin Inform 2014; 5 (03) 660-669. doi: 10.4338/ACI-2014–04-RA-0031. eCollection 2014
• 47 Højen AR, Sundvall E, Gøeg KR. Methods and applications for visualization of SNOMED CT concept sets. Appl Clin Inform 2014; 5 (01) 127-152. doi: 10.4338/ACI-2013–09-RA-0071. eCollection 2014
• 48 McCullagh LJ, Sofianou A, Kannry J, Mann DM, McGinn TG. User centered clinical decision support tools: adoption across clinician training level. Appl Clin Inform 2014; 5 (04) 1015-1025. doi: 10.4338/ACI-2014–05-RA-0048. eCollection 2014
• 49 Baucom RB, Ousley J, Poulose BK, Rosenbloom ST, Jackson GP. Case report: patient portal versus telephone recruitment for a surgical research study. Appl Clin Inform 2014; 5 (04) 1005-1014. doi: 10.4338/ACI-2014–07-CR-0059. eCollection 2014
• 50 Shriner AR, Webber EC. Attitudes and perceptions of pediatric residents on transitioning to CPOE. Appl Clin Inform 2014; 5 (03) 721-730. doi: 10.4338/ACI-2014–04-RA-0045. eCollection 2014
• 51 Hackl WO, Hoerbst A, Duftschmid G, Gall W, Janzek-Hawlat S, Jung M, Woertz K, Dorda W, Ammenwerth E. Crucial factors for the acceptance of a computerized national medication list: insights into findings from the evaluation of the Austrian e-Medikation pilot. Appl Clin Inform 2014; 5 (02) 527-537. doi: 10.4338/ACI-2014–04-RA-0032. eCollection 2014
• 52 Turchin A, Sawarkar A, Dementieva YA, Breydo E, Ramelson H. Effect of EHR user interface changes on internal prescription discrepancies. Appl Clin Inform 2014; Aug 6 5 (03) 708-20. doi: 10.4338/ACI-2014–03-RA-0023. eCollection 2014
• 53 Dhavle AA, Corley ST, Rupp MT, Ruiz J, Smith J, Gill R, Sow M. Evaluation of a user guidance reminder to improve the quality of electronic prescription messages. Appl Clin Inform 2014; 5 (03) 699-707. doi: 10.4338/ACI-2014–03-CR-0022. eCollection 2014
• 54 Xie M, Weinger MB, Gregg WM, Johnson KB. Presenting multiple drug alerts in an ambulatory electronic prescribing system: a usability study of novel prototypes. Appl Clin Inform 2014; 5 (02) 334-348. doi: 10.4338/ACI-2013–10-RA-0092. eCollection 2014
• 55 Schweitzer M, Lasierra N, Oberbichler S, Toma I, Fensel A, Hoerbst A. Structuring clinical workflows for diabetes care: an overview of the OntoHealth approach. Appl Clin Inform 2014; 5 (02) 512-526. doi: 10.4338/ACI-2014–04-RA-0039. eCollection 2014
• 56 Lucero R, Sheehan B, Yen P, Velez O, Nobile-Hernandez D, Tiase V. Identifying consumer’s needs of health information technology through an innovative participatory design approach among English- and Spanish-speaking urban older adults. Appl Clin Inform 2014; 5 (04) 943-957. doi: 10.4338/ACI-2014–07-RA-0058. eCollection 2014. Erratum in: Appl Clin Inform 2015 6: (1): 210
• 57 Nagykaldi ZJ, Jordan M, Quitoriano J, Ciro CA, Mold JW. User-centered design and usability testing of an innovative health-related quality of life module. Appl Clin Inform 2014; 5 (04) 958-970. doi: 10.4338/ACI-2014–08-RA-0067. eCollection 2014
• 58 Tang D, Rutala M, Ihde C, Bills A, Mollon L, Warholak T. An exploratory: population-based: mixed-methods program evaluation of user satisfaction of services provided by a regional extension center (REC). Appl Clin Inform 2014; 5 (01) 1-24. doi: 10.4338/ACI-2013–06-RA-0037. eCollection 2014
• 59 Emani S, Ting DY, Healey M, Lipsitz SR, Karson AS, Einbinder JS, Leinen L, Suric V, Bates DW. Physician beliefs about the impact of meaningful use of the EHR: a cross-sectional study. Appl Clin Inform 2014; 5 (03) 789-801. doi: 10.4338/ ACI-2014-05-RA-0050. eCollection 2014
• 60 Benkert R, Dennehy P, White J, Hamilton A, Tanner C, Pohl JM. Diabetes and hypertension quality measurement in four safety-net sites: lessons learned after implementation of the same commercial electronic health record. Appl Clin Inform 2014; 5 (03) 757-772. doi: 10.4338/ACI-2014-03-RA-0019. eCollection 2014
• 61 Schreiber R, Peters K, Shaha SH. Computerized provider order entry reduces length of stay in a community hospital. Appl Clin Inform 2014; 5 (03) 685-698. doi: 10.4338/ACI-2014–04-RA-0029. eCollection 2014
• 62 Kern LM, Silver M, Kaushal R. HITEC Investigators. State funding for health information technology and selected ambulatory healthcare quality measures. Appl Clin Inform 2014; 5 (02) 594-602. doi: 10.4338/ACI-2013–12-RA-0108. eCollection 2014
• 63 Craven CK, Sievert MC, Hicks LL, Alexander GL, Hearne LB, Holmes JH. CAH to CAH: EHR implementation advice to critical access hospitals from peer experts and other key informants. Appl Clin Inform 2014; 5 (01) 92-117. doi: 10.4338/ ACI-2013-08-RA-0066. eCollection 2014
• 64 Patterson ME, Marken P, Zhong Y, Simon SD, Ketcherside W. Comprehensive electronic medical record implementation levels not associated with 30-day all-cause read-missions within Medicare beneficiaries with heart failure. Appl Clin Inform 2014; 5 (03) 670-684. doi: 10.4338/ACI-2014–01-RA-0008. eCollection 2014
• 65 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems. J Am Med Inform Assoc 2015; 22 (02) 465-471. doi: 10.1136/amiajnl-2014–003023. Epub 2014 Oct 23. PubMed PMID: 25342181
• 66 Michel J, Hsiao A, Fenick A. Using a scripted data entry process to transfer legacy immunization data while transitioning between electronic medical record systems. Appl Clin Inform 2014; 5 (01) 284-298. doi: 10.4338/ACI-2013–11-RA-0096. eCollection 2014
• 67 Kierkegaard P, Kaushal R, Vest JR. How could health information exchange better meet the needs of care practitioners?. Appl Clin Inform 2014; 5 (04) 861-877. doi: 10.4338/ACI-2014–06-RA-0055. eCollection 2014
• 68 Richardson JE, Malhotra S, Kaushal R. HITEC Investigators. A case report in health information exchange for inter-organizational patient transfers. Appl Clin Inform 2014; 5 (03) 642-650. doi: 10.4338/ACI-2014–02-CR-0016. eCollection 2014
• 69 Winden TJ, Boland LL, Frey NG, Satterlee PA, Hokanson JS. Care everywhere: a point-to-point HIE tool: utilization and impact on patient care in the ED. Appl Clin Inform 2014; 5 (02) 388-401. doi: 10.4338/ACI-2013–12-RA-0100. eCollection 2014
• 70 Vest JR, Kern LM, Campion Jr TR , Silver MD, Kaushal R. Association between use of a health information exchange system and hospital admissions. Appl Clin Inform 2014; 5 (01) 219-231. doi: 10.4338/ACI-2013–10-RA-0083. eCollection 2014
• 71 Hagiwara H, Nemoto A, Inoue T. Burden on university hospitals of handling portable data for imaging (PDI) media. Appl Clin Inform 2014; 5 (01) 46-57. doi: 10.4338/ACI-2013–07-RA-0052. eCollection 2014
• 72 Wells S, Rozenblum R, Park A, Dunn M, Bates DW. Personal health records for patients with chronic disease: a major opportunity. Appl Clin Inform 2014; 5 (02) 416-429. doi: 10.4338/ ACI-2014-01-RA-0002. eCollection 2014
• 73 Wright A, Feblowitz J, Maloney FL, Henkin S, Ramelson H, Feltman J, Bates DW. Increasing patient engagement: patients’ responses to viewing problem lists online. Appl Clin Inform 2014; 5 (04) 930-942. doi: 10.4338/ACI-2014–07-RA-0057. eCollection 2014
• 74 Shanahan CW, Sorensen-Alawad A, Carney BL, Persand I, Cruz A, Botticelli M, Pressman K, Adams WG, Brolin M, Alford DP. The implementation of an integrated information system for substance use screening in general medical settings. Appl Clin Inform 2014; 5 (04) 878-894. doi: 10.4338/ACI-2014–03-RA-0025. eCollection 2014
• 75 Ralston JD, Cook AJ, Anderson ML, Catz SL, Fishman PA, Carlson J, Johnson R, Green BB. Home blood pressure monitoring: secure electronic messaging and medication intensification for improving hypertension control: a mediation analysis. Appl Clin Inform 2014; 5 (01) 232-248. doi: 10.4338/ACI-2013–10-RA-0079. eCollection 2014
• 76 Hameed AS, Sauermann S, Schreier G. The impact of adherence on costs and effectiveness of telemedical patient management in heart failure: a systematic review. Appl Clin Inform 2014; 5 (03) 612-620. doi: 10.4338/ACI-2014–04-RA-0037. eCollection 2014. Review
• 77 Piro NE, Baumann L, Tengler M, Piro L, Blechschmidt-Trapp R. Telemonitoring of patients with Parkinson’s disease using inertia sensors. Appl Clin Inform 2014; 5 (02) 503-511. doi: 10.4338/ ACI-2014-04-RA-0046. eCollection 2014
• 78 Alexander GL, Wilbik A, Keller JM, Musterman K. Generating sensor data summaries to communicate change in elders’ health status. Appl Clin Inform 2014; 5 (01) 73-84. doi: 10.4338/ ACI-2013-07-RA-0050. eCollection 2014
• 79 Klipin M, Mare I, Hazelhurst S, Kramer B. The process of installing REDCap: a web based database supporting biomedical research: the first year. Appl Clin Inform 2014; 5 (04) 916-929. doi: 10.4338/ACI-2014–06-CR-0054. eCollection 2014
• 80 Muthalagu A, Pacheco JA, Aufox S, Peissig PL, Fuehrer JT, Tromp G, Kho AN, Rasmussen-Torvik LJ. A rigorous algorithm to detect and clean inaccurate adult height records within EHR systems. Appl Clin Inform 2014; 5 (01) 118-126. doi: 10.4338/ACI-2013–09-RA-0074. eCollection 2014
• 81 Scott J, Botsis T, Ball R. Simulating adverse event spontaneous reporting systems as preferential attachment networks: application to the Vaccine Adverse Event Reporting System. Appl Clin Inform 2014; 5 (01) 206-218. doi: 10.4338/ACI-2013–11-RA-0097. eCollection 2014
• 82 Trinczek B, Köpcke F, Leusch T, Majeed RW, Schreiweis B, Wenk J, Bergh B, Ohmann C, Röhrig R, Prokosch HU, Dugas M. Design and multicentric implementation of a generic software architecture for patient recruitment systems re-using existing HIS tools and routine patient data. Appl Clin Inform 2014; 5 (01) 264-283. doi: 10.4338/ ACI-2013-07-RA-0047. eCollection 2014
• 83 Weng C, Li Y, Ryan P, Zhang Y, Liu F, Gao J, Bigger JT, Hripcsak G. A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records. Appl Clin Inform 2014; 5 (02) 463-479. doi: 10.4338/ACI-2013–12-RA-0105. eCollection 2014
• 84 Biron P, Metzger MH, Pezet C, Sebban C, Barthuet E, Durand T. An information retrieval system for computerized patient records in the context of a daily hospital practice: the example of the Léon Bérard Cancer Center (France). Appl Clin Inform 2014; 5 (01) 191-205. doi: 10.4338/ACI-2013–08-CR-0065. eCollection 2014
• 85 Saparova D, Belden J, Williams J, Richardson B, Schuster K. Evaluating a federated medical search engine: tailoring the methodology and reporting the evaluation outcomes. Appl Clin Inform 2014; 5 (03) 731-745. doi: 10.4338/ACI-2014–03-RA-0021. eCollection 2014
• 86 Clarke MA, Steege LM, Moore JL, Koopman RJ, Belden JL, Kim MS. Determining primary care physician information needs to inform ambulatory visit note display. Appl Clin Inform 2014; 5 (01) 169-190. doi: 10.4338/ACI-2013–08-RA-0064. eCollection 2014. Erratum in: Appl Clin Inform 2014; 5: (1): 190
• 87 Brown PJ, Marquard JL, Amster B, Romoser M, Friderici J, Goff S, Fisher D. What do physicians read (and ignore) in electronic progress notes?. Appl Clin Inform 2014; 5 (02) 430-444. doi: 10.4338/ACI-2014–01-RA-0003. eCollection 2014
• 88 Tran K, Morra D, Lo V, Quan S, Wu R. The use of smartphones on General Internal Medicine wards: a mixed methods study. Appl Clin Inform 2014; 5 (03) 814-823. doi: 10.4338/ACI-2014–02-RA-0011. eCollection 2014
• 89 ISI Web of KnowledgeSM. Webofknowledge.com Last accessed: October 14 2015
• 90 Eminaga O, Semjonow A, Oezguer E, Herden J, Akbarov I, Tok A, Engelmann U, Wille S. An Electronic Specimen Collection Protocol Schema (eSCPS). Document Architecture for Specimen Management and the Exchange of Specimen Collection Protocols between Biobanking Information Systems. Methods Inf Med 2014; 53 (01) 29-38.
• 91 Prokosch HU, Beck A, Ganslandt T, Hummel M, Kiehntopf M, Sax U. et al. IT Infrastructure Components for Biobanking. Appl Clin Inform 2010; 1 (04) 419-429.