RSS-Feed abonnieren

DOI: 10.1055/s-0041-1735166
Development of Prediction Models for Unplanned Hospital Readmission within 30 Days Based on Common Data Model: A Feasibility Study
Autoren
Funding This work was supported by the Technology Innovation Program (or Industrial Strategic Technology Development Program) (20004927, Advancing and expanding CDM-based distributed biohealth data platform) funded by Korea's Ministry of Trade, Industry, and Energy.
Abstract
Background Unplanned hospital readmission after discharge reflects low satisfaction and reliability in care and the possibility of potential medical accidents, and is thus indicative of the quality of patient care and the appropriateness of discharge plans.
Objectives The purpose of this study was to develop and validate prediction models for all-cause unplanned hospital readmissions within 30 days of discharge, based on a common data model (CDM), which can be applied to multiple institutions for efficient readmission management.
Methods Retrospective patient-level prediction models were developed based on clinical data of two tertiary general university hospitals converted into a CDM developed by Observational Medical Outcomes Partnership. Machine learning classification models based on the LASSO logistic regression model, decision tree, AdaBoost, random forest, and gradient boosting machine (GBM) were developed and tested by manipulating a set of CDM variables. An internal 10-fold cross-validation was performed on the target data of the model. To examine its transportability, the model was externally validated. Verification indicators helped evaluate the model performance based on the values of area under the curve (AUC).
Results Based on the time interval for outcome prediction, it was confirmed that the prediction model targeting the variables obtained within 30 days of discharge was the most efficient (AUC of 82.75). The external validation showed that the model is transferable, with the combination of various clinical covariates. Above all, the prediction model based on the GBM showed the highest AUC performance of 84.14 ± 0.015 for the Seoul National University Hospital cohort, yielding in 78.33 in external validation.
Conclusions This study showed that readmission prediction models developed using machine-learning techniques and CDM can be a useful tool to compare two hospitals in terms of patient-data features.
Note
The CDM-based prediction model has the following advantages. It can be easily reintegrated when migrating to a different EHR with analysis code adoption, either as an embedded frame in the EHR or as a standalone application. In addition, it can be easily expanded to another hospital based on OMOP CDM, which could be easily transferred and further developed with regard to our approach.
Authors' Contributions
B.R. analyzed the data and drafted the manuscript as the first author. S.K. helped prepare and evaluate the data. S.Y. helped analyze the data and managed the overall study, and J.C. supervised the overall study.
* These authors equally contributed to this work as co-corresponding authors.
Publikationsverlauf
Eingereicht: 17. Februar 2021
Angenommen: 05. Juli 2021
Artikel online veröffentlicht:
28. September 2021
© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Toomey SL, Peltz A, Loren S. et al. Potentially preventable 30-day hospital readmissions at a children's hospital. Pediatrics 2016; 138 (02) e20154182
- 2 McIlvennan CK, Eapen ZJ, Allen LA. Hospital readmissions reduction program. Circulation 2015; 131 (20) 1796-1803
- 3 Hong J, Choi K, Lee J, Lee E. A study on the factors related to the readmission and ambulatory visit in an university hospital: using patient care information DB. J Korean Soc Med Informatics 2000; 6 (04) 23-33
- 4 Zuckerman RB, Sheingold SH, Orav EJ, Ruhter J, Epstein AM. Readmissions, observation, and the hospital readmissions reduction program. N Engl J Med 2016; 374 (16) 1543-1551
- 5 Thompson MP, Waters TM, Kaplan CM, Cao Y, Bazzoli GJ. Most hospitals received annual penalties for excess readmissions, but some fared better than others. Health Aff (Millwood) 2017; 36 (05) 893-901
- 6 Hasan O, Meltzer DO, Shaykevich SA. et al. Hospital readmission in general medicine patients: a prediction model. J Gen Intern Med 2010; 25 (03) 211-219
- 7 Nguyen OK, Makam AN, Clark C. et al. Predicting all-cause readmissions using electronic health record data from the entire hospitalization: model development and comparison. J Hosp Med 2016; 11 (07) 473-480
- 8 Kansagara D, Englander H, Salanitro A. et al. Risk prediction models for hospital readmission: a systematic review. JAMA 2011; 306 (15) 1688-1698
- 9 Choudhry SA, Li J, Davis D, Erdmann C, Sikka R, Sutariya B. A public-private partnership develops and externally validates a 30-day hospital readmission risk prediction model. Online J Public Health Inform 2013; 5 (02) 219
- 10 Silverstein MD, Qin H, Mercer SQ, Fong J, Haydar Z. Risk factors for 30-day hospital readmission in patients ≥65 years of age. Proc (Bayl Univ Med Cent) 2008; 21 (04) 363-372
- 11 Swain MJ, Kharrazi H. Feasibility of 30-day hospital readmission prediction modeling based on health information exchange data. Int J Med Inform 2015; 84 (12) 1048-1056
- 12 Rajkomar A, Oren E, Chen K. et al. Scalable and accurate deep learning with electronic health records. npj. Digit Med 2018; 1 (01) 1-10
- 13 Frizzell JD, Liang L, Schulte PJ. et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol 2017; 2 (02) 204-209
- 14 Maali Y, Perez-Concha O, Coiera E, Roffe D, Day RO, Gallego B. Predicting 7-day, 30-day and 60-day all-cause unplanned readmission: a case study of a Sydney hospital. BMC Med Inform Decis Mak 2018; 18 (01) 1-11
- 15 Robinson R, Hudali T. The HOSPITAL score and LACE index as predictors of 30 day readmission in a retrospective study at a university-affiliated community hospital. PeerJ 2017; 5 (03) e3137
- 16 Miller WD, Nguyen K, Vangala S, Dowling E. Clinicians can independently predict 30-day hospital readmissions as well as the LACE index. BMC Health Serv Res 2018; 18 (01) 32
- 17 Shameer K, Johnson KW, Yahi A. et al. Predictive modeling of hospital readmission rates using electronic medical record-wide machine learning: A case-study using Mount Sinai Heart Failure Cohort. Pac Symp Biocomput 2017; 22: 276-287
- 18 Blacketer C. Chapter 4: The Common Data Model. In: The Book of OHDSI. Observational Health Data Sciences and Informatics; Accessed May 31, 2021 at: https://ohdsi.github.io/TheBookOfOhdsi/CommonDataModel.html
- 19 Williams R, Kontopantelis E, Buchan I, Peek N. Clinical code set engineering for reusing EHR data for research: a review. J Biomed Inform 2017; 70: 1-13
- 20 Sentinel Initiative. Homepage. Accessed May 31, 2021 at: http://www.mini-sentinel.org/
- 21 The National Patient-Centered Clinical Research Network. Data. Accessed May 31, 2021 at: https://pcornet.org/data/
- 22 Ross TR, Ng D, Brown JS. et al. The HMO research network virtual data warehouse: a public data model to support collaboration. EGMS (Wash DC) 2014; 2 (01) 1049
- 23 OMOP CDM v6.0. Accessed May 21, 2021 at: https://ohdsi.github.io/CommonDataModel/cdm60.html#OMOP_CDM_v60
- 24 CDISC. SDTM. Accessed May 31, 2021 at: https://www.cdisc.org/standards/foundational/sdtm
- 25 Garza M, Del Fiol G, Tenenbaum J, Walden A, Zozus MN. Evaluating common data models for use with a longitudinal community registry. J Biomed Inform 2016; 64: 333-341
- 26 Overhage JM, Ryan PB, Reich CG, Hartzema AG, Stang PE. Validation of a common data model for active safety surveillance research. J Am Med Inform Assoc 2012; 19 (01) 54-60
- 27 FitzHenry F, Resnic FS, Robbins SL. et al. Creating a common data model for comparative effectiveness with the Observational Medical Outcomes Partnership. Appl Clin Inform 2015; 6 (03) 536-547
- 28 OHDSI – Observational Health Data Sciences and Informatics. Accessed December 29, 2020 at: https://www.ohdsi.org/
- 29 Park RW. Sharing clinical big data while protecting confidentiality and security: observational health data sciences and informatics. Healthc Inform Res 2017; 23 (01) 1-3
- 30 Hripcsak G, Duke JD, Shah NH. et al. Observational Health Data Sciences and Informatics (OHDSI): opportunities for observational researchers. Stud Health Technol Inform 2015; 216: 574-578
- 31 OMOP CDM Specifications. Accessed June 29, 2021 at: https://ohdsi.github.io/CommonDataModel/
- 32 Dreiseitl S, Ohno-Machado L. Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform 2002; 35 (5–6): 352-359
- 33 Podgorelec V, Kokol P, Stiglic B, Rozman I. Decision trees: an overview and their use in medicine. J Med Syst 2002; 26 (05) 445-463
- 34 Breiman L. Random forests. Mach Learn 2001; 45 (01) 5-32
- 35 Freund Y, Schapire RE. A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 1997; 55 (01) 119-139
- 36 Ke G, Meng Q, Finley T. et al. Lightgbm: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems 2017; 30: 3146-3154
- 37 Zhou H, Della PR, Roberts P, Goh L, Dhaliwal SS. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review. BMJ Open 2016; 6 (06) e011060
- 38 Smith DM, Giobbie-Hurder A, Weinberger M. et al; Department of Veterans Affairs Cooperative Study Group on Primary Care and Readmissions. Predicting non-elective hospital readmissions: a multi-site study. J Clin Epidemiol 2000; 53 (11) 1113-1118
- 39 Robinson R. The HOSPITAL score as a predictor of 30 day readmission in a retrospective study at a university affiliated community hospital. PeerJ 2016; 4 (09) e2441
- 40 Jiang S, Chin KS, Qu G, Tsui KL. An integrated machine learning framework for hospital readmission prediction. Knowl Base Syst 2018; 146: 73-90
- 41 Jamei M, Nisnevich A, Wetchler E, Sudat S, Liu E. Predicting all-cause risk of 30-day hospital readmission using artificial neural networks. PLoS One 2017; 12 (07) e0181173