From the Divisions of Hospital Medicine (Drs. Dawson, Chirila, Bhide, and Burton) and Biomedical Statistics and Informatics (Ms. Thomas), Mayo Clinic, Jacksonville, FL, and the Division of Hospital Medicine, Mayo Clinic, Phoenix, AZ (Dr. Cannon).
Abstract
- Objective: To validate an electronic tool created to identify inpatients who are at risk of readmission within 30 days and quantify the predictive performance of the readmission risk score (RRS).
- Methods: Retrospective cohort study including inpa-tients who were discharged between 1 Nov 2012 and 31 Dec 2012. The ability of the RRS to discriminate between those who did and did not have a 30-day urgent readmission was quantified by the c statistic. Calibration was assessed by plotting the observed and predicted probability of 30-day urgent readmission. Predicted probabilities were obtained from generalized estimating equations, clustering on patient.
- Results: Of 1689 hospital inpatient discharges (1515 patients), 159 (9.4%) had a 30-day urgent readmission. The RRS had some discriminative ability ( c statistic: 0.612; 95% confidence interval: 0.570–0.655) and good calibration.
- Conclusions: Our study shows that the RRS has some discriminative ability. The automated tool can be used to estimate the probability of a 30-day urgent readmission.
Hospital readmissions are increasingly scrutinized by the Center for Medicare and Medicaid Services and other payers due to their frequency and high cost. It is estimated that up to 25% of all patients discharged from acute care hospitals are readmitted within 30 days [1]. To address this problem, the Center for Medicare and Medicaid Services is using these rates as one of the benchmarks for quality for hospitals and health care organizations and has begun to assess penalties to those institutions with the highest rates. This scrutiny and the desire for better patient care transitions has resulted in most hospitals implementing various initiatives to reduce potentially avoidable readmissions.
Multiple interventions have been shown to reduce readmissions [2,3]. These interventions have varying effectiveness and are often labor intensive and thus costly to the institutions implementing them. In fact, no one intervention has been shown to be effective alone [4], and it may take several concurrent interventions targeting the highest risk patients to improve transitions of care at discharge that result in reduced readmissions. Many experts do recommend risk stratifying patients in order to target interventions to the highest risk patients for effective use of resources [5,6]. Several risk factor assessments have been proposed with varying success [7–13]. Multiple factors can limit the effectiveness of these risk stratification profiles. They may have low sensitivity and specificity, be based solely on retrospective data, be limited to certain populations, or be created from administrative data only without taking psychosocial factors into consideration [14].
An effective risk assessment ideally would encompass multiple known risk factors including certain comorbidities such as malignancy and heart failure, psychosocial factors such as health literacy and social support, and administrative data including payment source and demographics. All of these have been shown in prior studies to contribute to readmissions [7–13]. In addition, availability of the assessment early in the hospitalization would allow for interventions throughout the hospital stay to mitigate the effect of these factors where possible. To address these needs, our institution formed a readmission task force in January 2010 to review published literature on hospital 30-day readmissions and create a readmission risk score (RRS). The aim of this study was to quantify the predictive performance of the RRS after it was first implemented into the electronic medical record (EMR) in November 2012.