Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study
BMC Research Notes volume 9, Article number: 356 (2016)
Evaluation of functional status is difficult in neurological and neurosurgical early rehabilitation patients. The Early Rehabilitation Index (ERI) was introduced in Germany over 20 years ago, but since then validation studies are lacking. The ERI (range −325 to 0 points) includes highly relevant items including the necessity of intermittent mechanical ventilation or tracheostomy.
The present paper analyzed data from a German multi-center study, enrolling 754 neurological early rehabilitation patients. Together with ERI, Barthel Index (BI), Glasgow Coma Scale (GCS), Glasgow Outcome Score Extended, Coma Remission Scale (CRS), Functional Ambulation Categories and length of stay were obtained.
ERI showed significant improvements from admission to discharge (p < 0.001). In addition, there were significant correlations of the ERI upon admission and at discharge with BI, CRS and GCS.
Evaluation of our study data suggest that the ERI may be used as a valid assessment instrument for neurological and neurosurgical early rehabilitation patients.
Treatment facilities for neurological and neurosurgical early rehabilitation in Germany focus on severely impaired patients, immediately after acute-care hospital treatment [1, 2]. Early rehabilitation facilities carry on intensive and intermediate care treatment including weaning from mechanical ventilation, management of tracheotomy tube and other medical devices [2, 3]. Parallel to intensive care, rehabilitation is commenced in order to improve disturbances of consciousness, swallowing, mobility, coordination and cognition.
Early rehabilitation patients are characterized by high morbidity and frequent colonization with multi-drug resistant (MDR) bacteria [4, 5]. Depending on the diagnosis, prognosis may be poor, in particular among hypoxic brain damage patients .
It is difficult to assess neurological early rehabilitation patients and their outcome. Traditional scales including the Glasgow Coma Scale (GCS)  or Coma Remission Scale (CRS)  focus solely on disorders of consciousness. Other well established assessments such as the Barthel Index (BI)  are highly relevant with respect to activities of daily living (ADL). However, a floor effect is commonly seen with the BI since most of the early rehabilitation patients are completely dependent on nursing throughout the whole rehabilitation process. Another scale, called early functional abilities (EFA)  is common among early rehabilitation facilities, but there exists only scant data on its validation.
More than 20 years ago, the Early Rehabilitation Barthel Index (ERBI) was introduced into clinical practice as an extension of the traditional BI . The ERBI is a sum score of BI and Early Rehabilitation Index (ERI). The ERI comprises highly relevant items to assess neurological and neurosurgical early rehabilitation patients, such as intensive care monitoring, tracheostoma management, mechanical ventilation or swallowing disorders, see Table 1. Each ERI-item—if applicable—has a negative value of −50 or −25 points. To compute the ERBI, ERI sum (0 to −325 points) is subtracted from the BI (0 to +100 points), resulting in an ERBI ranging from −325 to 100 points. While ERBI has even entered the German DRG- (Diagnosis Related Groups) system to define the early rehabilitation procedure 8-552 , data on its criterion validity is scarce and the definition of ERI items is often inprecise . Two German expert groups have published criteria for operationalization of the ERI yielding broad consent [13, 14].
The ERI has been used to assess patients suffering from locked-in-syndrome , dysphagia , traumatic brain injury  and hypoxic brain damage . In addition, ERI was applied in some multi-center studies on the outcome of early rehabilitation patients [2, 18].
Another publication demonstrated that patients with a low ERBI have a significantly longer length of stay (LOS) . A one-center study focused on reliability and validity of the ERI in a large sample of neurological and neurosurgical early rehabilitation patients . In one sample (n = 1,669), estimates of morbidity and LOS were compared with ERI categories . In addition, inter-rater reliability (nurses vs. physicians) was examined in a second sample of 273 patients . Patients with low ERBI had a significantly longer LOS than those with high ERBI values (p < 0.001) . Further, parameters of morbidity (patient clinical complexity level, number of co-diagnoses) were significantly higher in a subgroup with lower ERBI . Inter-rater reliability was high (r = 0.849, p < 0.001) . The findings suggested that the ERI might be a reliable and valid scale to assess early neurological rehabilitation patients .
The present paper is based upon data from a 2014 German multi-center study on neurological and neurosurgical early rehabilitation . The main focus was to examine the criterion validity of the ERI .
The prospective multi-center study enrolled data of 754 patients admitted to 16 German neurological early rehabilitation centers in 2014 . Inclusion and exclusion criteria have been published in a previous paper .
Age, gender, main diagnosis, medical devices, Glasgow Coma Scale (GCS) , Coma Remission Scale (CRS) , Barthel Index (BI) , Early Rehabilitation Index (ERI)  and FAC (Functional Ambulation Categories)  upon admission and at discharge were documented. FAC categorizes patients according to basic motor skills necessary for functional ambulation ranging from 0 (“nonfunctional”) to 5 (“independent, level and non-level surfaces” ). In addition, Glasgow Outcome Scale-Extended (GOSE)  was obtained at discharge.
In line with previous studies [6, 22], patients were assigned to a dichomotous outcome: poor (BI at discharge <50) vs. good (BI at discharge ≥50). According to this definition, 630 (83.6 %) patients had a poor and only 124 (16.4 %) a good outcome at the end of the early rehabilitation. It has to be pointed out that even patients belonging to the poor outcome group might have a good functional status, finally, after subsequent rehabilitation .
Statistics: Since main variables including ERI upon admission and at discharge were not normally distributed, non-parametric testing was performed. Statistical analyses included χ2-for categorical variables, Mann–Whitney-U- and Kruskal–Wallis-tests for independent, Wilcoxon-tests for paired samples. In addition, Spearman-Rho correlations were computed. Differences were regarded as significant with p < 0.05. Nonetheless, in the results section, mean values and standard deviations are displayed. Interquartile ranges (Q3–Q1) were computed for the main clinical scales. For statistical analyses, SPSS® (version 21) was used.
Ethics: The study required no ethical approval since it was a data analysis, relying on measurements and data acquisition applied as part of routine care in neurological early rehabilitation. The need for ethical approval has been deemed unnecessary according to national legislation. Patient data were anonymized prior to analysis.
Mean age of the whole study sample was 68.0 ± 14.8 years, 297 (39.4 %) subjects were female, 457 (60.6 %) male.
Primary diagnoses can be found in Table 2 demonstrating that most of the early rehabilitation patients were suffering from ischemic stroke (31.7 %) or intracranial hemorrhage (20.4 %).
Analyzing the changes from admission to discharge, all assessments (ERI, BI, CRS, GCS) showed significant improvements (p < 0.001), see Table 3. Interquartile ranges for the clinical scales may be found in Table 4. Significant changes were also demonstrated with FAC (χ2-test, p < 0.001), see Table 5. GOSE revealed that most patients were still severely disabled at discharge from early rehabilitation, mortality was 9.5 %, see Table 6.
Spearman-Rho correlations showed a significant negative correlation between changes in ERI and age, suggesting that smaller improvements were found the older the patients were, see Table 7. However, the correlation coefficient was small. In addition, ERI upon admission, at discharge and ΛERI (discharge minus admission) correlated significantly and positively with GCS, CRS and BI upon admission and at discharge (Table 7). LOS was longer when ERI was lower (admission: rs = −0.367, p < 0.001; discharge: rs = −0.152, p < 0.001).
Patients belonging to the good outcome group (BI ≥50) had a significantly better ERI value at discharge (Mann–Whitney-U-test: p < 0.001) and bigger ERI improvements (Mann–Whitney-U-test: p < 0.001) than poor outcome subjects.
Focusing on the three most frequent diagnoses (ischemic stroke, intracranial hemorrhage, polyneuropathy or other peripheral nerve impairment), a Kruskal–Wallis-test revealed that ΛERI differed significantly between the three groups (mean rank: polyneuropathy = 282.99, intracranial hemorrhage = 251.29, ischemic stroke 212.51; p < 0.001) indicating smaller changes when the central nervous system was affected compared to peripheral damage.
Neurological early rehabilitation patients constitute a sample of severely disabled persons. Frequently, they suffer from extreme morbidity, high mortality, low functional status and they may be colonized with MDRs [1–5]. The fact that functional improvements are limited during early rehabilitation is illustrated by the finding that only 16.4 % of our study sample had a BI of at least 50 points (“good outcome”) at discharge from early rehabilitation. Of course, many of the “poor outcome” patients enter subsequent rehabilitation programs where they may further improve their ADL [1, 2, 23].
Since functional improvements are small, traditional ADL scales such as BI are of limited value to assess neurological early rehabilitation patients. Together with other scales like EFA , the ERI has been introduced employing highly relevant items like mechanical ventilation or intensive medical monitoring . Even if no BI changes are observed, it is obvious that a patient successfully weaned from ventilation made a fine step forward. There is no doubt that it is much easier to take care of a spontaneously breathing subject than to transfer patients on home ventilation to nursing facilities.
However, only little data is available on the criterion validity, sensitivity to change and inter-rater reliability of the ERI [13, 19]. There is at least one study suggesting that the ERI might be a valid clinical assessment with satisfactory reliability .
The present study analyzed data from a multi-center study, enrolling a large number of patients . ERI scores were compared with traditional scales, such as BI, CRS and GCS used to assess severely disabled neurological patients [7–9].
First, all scales proved their sensitivity to change because there were significant changes from admission to discharge. As with BI, GCS and CRS, ERI also showed significant improvements at discharge from early rehabilitation. However, interquartile ranges (IQR) of all main clinical scales (BI, ERI, CRS and CRS) upon admission and at discharge were small indicating that scores were close together and that it was difficult to differentiate between patients. ERI on admission had an IQR of 125, BI of 15. This does not necessarily mean that ERI scores had a larger dispersion than BI because in both scales, the IQR resembles a difference of only three steps (BI: 5, 10, 15; ERI: −125, −75, −50). However, making a sum of BI and ERI (the so-called Early Rehabilitation Barthel Index—ERBI) increases IQR and thus might help to better differentiate patients.
In addition, Spearman-Rho correlations showed a small but significant correlation between changes in ERI and age. This finding suggests that age may have a palpable negative impact on the outcome of these patients. This result is not surprising because age has shown to have a negative correlation with BI changes in many studies on neurological rehabilitation .
There was also a small negative correlation between ERI and LOS. This finding is in line with results from a previous study . It may be hypothesized that ERI is an estimate of patients` morbidity contributing to a longer LOS .
Furthermore, we found that ERI upon admission, at discharge and ΛERI (discharge minus admission) correlated significantly and positively with GCS, CRS and BI upon admission and at discharge. The fact that ERI scores correlated with well-established scales like GCS, CRS and BI supports the hypothesis that it might be a valid instrument to assess neurological early rehabilitation patients. It has to be pointed out that correlations were moderate indicating that the ERI measures aspects which are not completely covered by other assessments and thus adds additional relevant information.
There was also an interrelation between ERI and outcome (functional independence measured with BI): Patients belonging to the good outcome group (BI ≥50) had a significantly better ERI value at discharge and bigger ERI improvements than poor outcome subjects. This finding also supports the assumption that ERI is of satisfactory criterion validity.
The findings from our multi-center study suggest that the ERI is a valid scale in assessing neurological and neurosurgical early rehabilitation patients and their rehabilitation progress. There exist significant correlations between ERI and well-established scales like BI, CRS and GCS. ERI, however, adds additional relevant information for the rehabilitation process. The ERI provides additional information on patients` status and improvement and could be used together with the BI as ERBI.
Activities of daily living
Coma Remission Scale
Diagnosis related groups
Early functional abilities
Early Rehabilitation Barthel Index
Early Rehabilitation Index
Functional Ambulation Categories
Glasgow Coma Scale
Glasgow Outcome Scale Extended
Length of stay
Rollnik JD, Janosch U. Current trends in the length of stay in neurological early rehabilitation. Dtsch Arztebl Int. 2010;107:286–92.
Pohl M, Bertram M, Bucka C, Hartwich M, Jöbges M, Ketter G, Leineweber B, Mertl-Rötzer M, Platz T, Rollnik JD, Scheidtmann K, Thomas R, von Rosen F, Wallesch C, Woldag H, Peschel P, Mehrholz J: [Course of Rehabilitation in the Early Neurological/Neurosurgical Rehabilitation: Results of a Multi-Centre Evaluation in Germany 2014]. Nervenarzt 2016, in press.
Oehmichen F, Ketter G, Mertl-Rötzer M, Platz T, Puschendorf W, Rollnik JD, Schaupp M, Pohl M. Weaning from prolonged mechanical ventilation in neurological weaning units: an evaluation of the German Working Group for early Neurorehabilitation. Nervenarzt. 2012;83:1300–7.
Rollnik JD. Outcome of MRSA carriers in neurological early rehabilitation. BMC Neurol. 2014;14:34.
Rollnik JD. Outcome of neurological early rehabilitation patients colonized with extended-spectrum beta-lactamase (ESBL) producing bacteria. Open J Therapy Rehabil. 2015;3:1–8.
Heinz U, Rollnik JD. Outcome of hypoxic brain damage patients undergoing neurological early rehabilitation. BMC Res Notes. 2015;8:243.
Teasdale G, Jennett B. Assessment of coma and impaired consciousness. A practical scale. Lancet. 1974;2:81–3.
Ortega-Suhrkamp E, von Wild KR. Standards of neurologic-neurosurgical early rehabilitation—a concept of the study group neurological-neurosurgical early rehabilitation. Acta Neurochir Supp. 2002;79:11–9.
Mahoney FI, Barthel DW. Functional evaluation: the Barthel index. Md State Med J. 1965;14:61–5.
Hankemeier A, Rollnik JD. The Early Functional Abilities (EFA) scale to assess neurological and neurosurgical early rehabilitation patients. BMC Neurol. 2015;15:207.
Schönle PW. The Early Rehabilitation Barthel Index—an early rehabilitation-oriented extension of the Barthel Index. Rehabilitation (Stuttg). 1995;34:69–73.
Wallesch CW. Early neurological rehabilitation in the German DRG-system. Akt Neurol. 2009;36:93–7.
Pohl M, Bertram M, Hoffmann B, Jöbges M, Ketter G, Krusch C, Pause M, Platz T, Puschendorf W, Rollnik J, von Rosen F, Schleep J, Schaupp M, Spranger M, Steube D, Thomas R, Voss A. The Frühreha-Index (FRI): a manual for its operationalization. Rehabilitation (Stuttg). 2010;49:22–9.
Rollnik JD, Neunzig HP, Seger W. Operationalization and feasibility of the early rehabilitation index (“lower-saxony early rehabilitation index”). Rehabilitation (Stuttg). 2012;51:194–9.
Pantke KH. Locked-in-syndrome after thrombosis of the a. basilaris: evaluation of motor deficits and their description by neurological scales. Neurol Rehabil. 2006;12:14–21.
Seidl RO, Nusser-Müller-Busch R, Hollweg W, Westhofen M, Ernst A. Pilot study of a neuropsychological dysphagia therapy for neurological patients. Clin Rehabil. 2007;21:686–97.
Choi JH, Jakob M, Stapf C, Marshall RS, Hartmann A, Mast H. Multimodal early rehabilitation and predictors of outcome in survivors of severe traumatic brain injury. J Trauma. 2008;65:1028–35.
Spranger M, Hoffmann B, Karbe H, Krusch C, Müller B, Pause M, Prosiegel M, Puschendorf W, Schleep J, Steube D, Voss A. The role of neurological-neurosurgical early onset rehabilitation for the treatment of patients with severe neurological diseases. Neurol Rehabil. 2005;11:317–22.
Rollnik JD. The Early Rehabilitation Barthel Index (ERBI). Rehabilitation (Stuttg). 2011;50:408–11.
Lord SE, McPherson K, McNaughton HK, Rochester L, Weatherall M. Community ambulation after stroke: how important and obtainable is it and what measures appear predictive? Arch Phys Med Rehabil. 2004;8:234–9.
Wilson JTL, Pettigrew LEL, Teasdale GM. Structured interviews for the Glasgow Outcome Scale and the Extended Glasgow Outcome Scale: guidelines for Their Use. J Neurotrauma. 1997;15:573–85.
Franke CL, Palm R, Dalby M, Schoonderwaldt HC, Hantson L, Eriksson B. Flunarizine in stroke treatment (FIST): a double- blind, placebocontrolled trial in Scandinavia and the Netherlands. Acta Neurol Scand. 1996;93:56–60.
Rollnik JD. Barthel index as a length of stay predictor in neurological rehabilitation. Rehabilitation (Stuttg). 2009;48:91–4.
JDR as the first author made statistical analyses, drafted and wrote the paper. MP as senior author was director of the multi-center study on neurological early rehabilitation  and approved the final version of this paper. All other authors contributed data, critically reviewed and approved the paper. All authors read and approved the final manuscript.
The authors are thankful for the support by the Dept. of Public Health, University of Dresden, Germany.
Availability of data and materials
The dataset supporting the conclusions of this article is available on request. Please contact last author for the data file (email@example.com).
All authors declare that they have no financial or non-financial competing interests.
About this article
Cite this article
Rollnik, J.D., Bertram, M., Bucka, C. et al. Criterion validity and sensitivity to change of the Early Rehabilitation Index (ERI): results from a German multi-center study. BMC Res Notes 9, 356 (2016). https://doi.org/10.1186/s13104-016-2154-8