Reanalysis of the physical and mental health summary scores of dialysis versus conservative care in older patients with advanced chronic kidney disease: a critical appraisal

Objective

Non-dialytic conservative care is argued to be a reasonable treatment alternative for dialysis in selected older patients with advanced chronic kidney disease. We evaluated patient-relevant outcomes including health-related quality of life in a previous study. However, the scoring algorithm we used to calculate the physical and mental component summary scores of the Short Form-36 (SF-36) turned out to differ from comparable studies on this topic. The aim of this critical appraisal was to reanalyze the SF-36 summary scores in our patient cohort (≥ 70 years) using the more widely used scoring algorithm.

Results

Patients on conservative care (n = 23) had lower physical and mental component summary scores compared to patients not yet started on dialysis (n = 39), but similar compared to patients on dialysis (n = 34). These findings were similar to our original findings and did not change the conclusions. Several scoring algorithms are used for the SF-36 summary scores. Researchers should be aware of this fact and should use the same scoring algorithm across similar studies in a specific field to increase comparability. Using the more widely used scoring algorithm, the recalculated SF-36 summary scores of our patient cohort can now be compared to other studies.

Non-dialytic conservative care is argued to be a reasonable treatment alternative for dialysis in selected older patients with advanced chronic kidney disease [1,2,3]. Comparative data on patient-relevant outcomes are, however, limited. Such data is needed to evaluate treatment effectiveness and may help to inform shared decision-making on preferred treatment [1, 4, 5]. We compared survival, health-related quality of life, and treatment burden in older patients choosing dialysis or conservative care in a previous observational cohort study [6]. The outcomes on health-related quality of life were assessed with the Kidney Disease Quality of Life Short Form (KDQOL-SF™) [7, 8], which includes the widely used Short-Form 36 Health Survey (SF-36, version 1) [9]. In the original publication [6], we reported the summary scores on physical health (physical component summary, PCS) and mental health (mental component summary, MCS) of the SF-36 as calculated with the scoring algorithm used by Kalantar-Zadeh et al. [10]. This scoring algorithm appeared to differ from the scoring algorithm used in similar studies reporting PCS and MCS scores in dialysis and conservative care patient groups [11,12,13,14]. Their scoring algorithm involved orthogonal rotation and norm-based scoring [15]. To enable meaningful comparisons of findings across studies, use of the same scoring algorithm would be preferable. The aim of this critical appraisal was (1) to recalculate the PCS and MCS scores in our patient cohort using the same scoring algorithm as in similar studies to enable comparisons of results across studies, and (2) to determine whether the recalculated PCS and MCS scores change our original study results or conclusions.

Methods

The methods of the original cohort study on dialysis versus conservative care were published elsewhere in detail [6]. To summarize, we retrospectively included patients aged ≥ 70 years old with advanced chronic kidney disease who chose dialysis or conservative care after shared decision-making in a non-academic teaching hospital in The Netherlands between October 31, 2004 and May 1, 2016. Health-related quality of life outcomes were assessed cross-sectionally in patients alive in 2015 and 2016 who consented to participate. We used the validated Dutch version of the KDQOL-SF™ to assess eight generic SF-36 domains and seven kidney disease-specific domains of health-related quality of life [7, 8]. Questionnaires were self-completed or interviewer-administered. The KDQOL-SF™ items were coded and scored according to the manual [16]. The eight SF-36 domains were used to calculate the PCS and MCS scores, by using the scoring algorithm by Kalantar-Zadeh et al. in our original publication [6, 10]. Scores range between 0 and 100; higher scores indicate better health-related quality of life. Baseline data, including age, sex, and comorbidities, were collected from electronic medical records. Comorbidities were scored according to the Davies comorbidity score, which is based on the presence of seven comorbid conditions and produces three risk groups (no comorbidity, intermediate comorbidity, severe comorbidity) [17]. All analyses were performed according to the original treatment choice. We compared the outcomes on health-related quality of life between patients on conservative care, patients who chose dialysis but were not yet treated with dialysis, and patients treated with dialysis. Students t-tests were used to test differences in the PCS and MCS scores between the three patient groups. Multiple linear regression analyses were performed on the PCS and MCS to evaluate their association with treatment pathway, adjusting for age, sex, Davies comorbidity score, and way of administration (self or by interviewer) with backward elimination. A P value < 0.05 was considered statistically significant. Statistical analyses were performed using IBM SPSS 24.0.

New analysis

In this critical appraisal, we have recalculated the PCS and MCS scores by applying norm-based scoring with orthogonal rotation as used in similar studies reporting on this topic [11,12,13,14,15]. We used the SF-36 norms from the Dutch general population [18]. One-way analysis of variance (ANOVA) and Tukey HSD (Honestly Significant Difference) post hoc tests were used to test differences in the recalculated PCS and MCS scores respectively between and within the three patient groups. We checked the assumption of homogeneity. We have also repeated the multiple linear regression analyses on the recalculated PCS and MCS scores to evaluate their association with treatment modality (using dummy coding with conservative care as reference group), with adjustment for age, sex, Davies comorbidity score, and way of administration of the questionnaire (self or by interviewer).

99 of 128 eligible patients (77%) gave written informed consent to participate in the assessment of health-related quality of life outcomes. We excluded three patients from the analysis because of too many missing answers, resulting in 96 patients overall: 39 patients not yet started on dialysis, 34 patients started on dialysis, and 23 patients on conservative care. Compared to both patient groups on a dialysis pathway, patients on conservative care were older (mean age [standard deviation]: 83.8 [5.0] years in patients on conservative care, versus 79.8 [5.1] years in patients not yet started on dialysis, versus 80.1 [3.3] years in patients started with dialysis), and more often female (48% versus 31% versus 24%, respectively). There were no differences in Davies comorbidity score between the three patient groups (no comorbidity: 9% versus 13% versus 9%; intermediate comorbidity: 65% versus 59% versus 59%; severe comorbidity: 26% versus 28% versus 32%). Questionnaires were more frequently administered by an interviewer in patients started with dialysis (26% versus 18% versus 53%).

Table 1 shows the recalculated PCS and MCS scores, using the norm-based scoring algorithm with orthogonal rotation. There were significant differences between the three patient groups on the mean PCS as determined by one-way ANOVA (F(2,93) = 4.779, P = 0.01). Patients on conservative care scored lower on the PCS compared to patients not yet started on dialysis (P < 0.01), but similar compared to patients on dialysis (P = 0.38). A similar trend was seen in the unadjusted MCS scores, although no significant difference between the three patient groups was found (F(2,93) = 1.666, P = 0.20). Table 2 shows the multiple linear regression models on the recalculated PCS and MCS scores. These models confirmed the unadjusted findings on the PCS and MCS scores between the three patient groups: patients on conservative care scored lower on the PCS and MCS compared to patients not yet started on dialysis, but similar compared to patients on dialysis. An additional file shows the original results on the PCS and MCS scores based on the scoring algorithm by Kalantar-Zadeh et al. [10] (see Additional file 1: Tables S1 and S2).

In this critical appraisal, we recalculated the summary scores on physical health (PCS) and mental health (MCS) of the SF-36 in our cohort of patients ≥ 70 years old with advanced chronic kidney disease who chose either dialysis or conservative care, using the same scoring algorithm as in similar studies. Patients who had chosen dialysis but were not yet started on dialysis had higher scores on the recalculated PCS and MCS compared to patients on conservative care. No differences were observed in the recalculated PCS and MCS scores between patients on dialysis or conservative care. These findings were similar to our original findings on the PCS and MCS [6]. We therefore conclude that the reanalysis of the PCS and MCS did not change the direction or significance of the results, interpretations, or conclusions of our original article. Conservative care could be a viable treatment option in selected older patients with advanced chronic kidney disease to achieve similar health-related quality of life outcomes compared to dialysis.

The main advantage of the recalculated PCS and MCS is that it enables appropriate comparison of our results to other studies using the same scoring algorithm. This is specifically relevant when comparing the absolute scores on the PCS and MCS across studies, as only the absolute values have changed in our reanalysis. We found that the recalculated PCS and MCS scores in our patient groups were within the range of results of comparable studies [11,12,13,14]. The mean or median PCS score in patients on a dialysis pathway, including patients not yet started on dialysis and patients on dialysis, was between 25 and 38 in previous studies (34.2 and 38.3 in our patient groups on a dialysis pathway), and 18–34 in patients on conservative care (30.9 in our patient group on conservative care) [11,12,13,14]. Similarly for the MCS, studies found a mean or median MCS score of 43–50 in patients on a dialysis pathway (50.5 and 52.8 in our patient groups on a dialysis pathway), and 46–52 in patients on conservative care (47.5 in our patient group on conservative care) [11,12,13,14]. When comparing the PCS and MCS scores between patients on a dialysis pathway and patients on conservative care, previous studies found no statistically differences between the treatment pathways. We only observed a higher PCS score in patients not yet started on dialysis compared to the conservative care patient group, but this finding might be explained by the age difference between the patient groups. To conclude, our results on physical and mental health, including the absolute PCS and MCS scores, were consistent with the findings in comparable studies.

After publishing our original study, we have discovered that at least four different scoring algorithms have been used to calculate the PCS and MCS of the SF-36 [10, 15, 19, 20]. The most used scoring algorithms appear to be norm-based scoring with orthogonal rotation or oblique rotation [15, 19]. While it is unclear which scoring algorithm would be best to use [20,21,22,23,24,25,26], an important advantage of norm-based scoring is that such scores are standardized relative to the general population scores which makes interpretation easier. We think it is an important warning to other researchers that different scoring algorithms are being used to calculate the PCS and MCS of the SF-36. We recommend that the scoring algorithm used should be reported explicitly in publications, including which norm scores were used in case of norm-based scoring. Moreover, we recommend to use the same scoring algorithm in similar studies in a specific field to enable comparisons of results across studies, and allow qualitative synthesis of study findings such as in a meta-analysis. Such standardized approach increases the efficacy of studies and patient input.

Our reanalysed findings on physical and mental health in older patients on dialysis versus conservative care had several limitations similar to those described in the original publication [6]. Treatment allocation bias and confounding were potential flaws due to the observational study design and non-random treatment decision. We observed that patients who chose conservative care were older and more often female than patients who chose dialysis, while comorbidity level was similar between patient groups. We adjusted for several confounders in the multivariable regression analysis to overcome this problem. Yet, residual confounding might be possible. Other limitations to our findings were the small sample size and cross-sectional assessment of health-related quality of life. Large comparative studies with longitudinal assessment of health-related quality of life outcomes in older patients on dialysis and conservative care are needed to confirm current findings.

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

CI:

confidence interval

KDQOL-SF™:

Kidney Disease Quality of Life Short Form

MCS:

mental component summary

PCS:

physical component summary

SF-36:

Short Form-36

SPSS:

Statistical Package for the Social Science

Vs.:

versus

Not applicable.

Funding

The study was funded by an unrestricted grant from the St. Antonius Research Fund, from Roche (Woerden, The Netherlands) to the St. Antonius Research Fund, and from Zilveren Kruis Health Insurance. The funders played no role in study design; collection, analysis, and interpretation of data; writing of the report; or in the decision to submit the article for publication.

Affiliations

1. Department of Internal Medicine, St Antonius Hospital, Koekoekslaan 1, 3435 CM, Nieuwegein, The Netherlands

   • Wouter R. Verberne
   • , Janneke Dijkers
   • , Wilbert T. Jellema
   •  & Willem Jan W. Bos

2. Department of Internal Medicine, Leiden University Medical Center, Leiden, The Netherlands

   • Wouter R. Verberne
   •  & Willem Jan W. Bos

3. Department of Clinical Epidemiology and Medical Statistics, St Antonius Hospital, Nieuwegein, The Netherlands

   • Johannes C. Kelder

4. Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, The Netherlands

   • Johannes J. M. van Delden

Contributions

Research idea and study design: WV, JVD, WB; data acquisition: WV, JD; data analysis and interpretation: WV, JD, JK, WJ, JVD, WB; statistical analysis: WV, JD, JK, WB; supervision or mentorship: JVD, WB. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Wouter R. Verberne.

Ethics approval and consent to participate

Ethical approval for the original cohort study was obtained from the local research ethics committee (Verenigde Commissies Mensgebonden Onderzoek; reference W14.053). Informed written consent was obtained from patients prior to data collection.

Competing interests

WV was research fellow of the International Consortium for Health Outcomes Measurement (ICHOM) Chronic Kidney Disease (CKD) Working Group. WB chaired the ICHOM CKD Working Group. The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Reprints and Permissions