- Research note
- Open Access
Measuring the health-related quality of life of children with impaired mobility: examining correlation and agreement between children and parent proxies
BMC Research Notesvolume 10, Article number: 377 (2017)
The objective of this research project was to evaluate the validity of proxy health-related quality of life measures in the context of paediatric mobility impairment. Accurate health-related quality of life data is essential for quality-adjusted life year calculation; a key outcome in economic evaluation. Thirteen child-parent dyads (13 children with mobility impairments, 13 parent proxies) were asked to complete a range of outcome measures (EQ-5D-Y, VAS and HUI2/3) relating to the child’s health. The relationship between respondent outcomes was examined using tests of respondent type effect (Wilcoxon signed-rank), correlation (Spearman’s rank-order) and agreement (Bland–Altman plots).
Parent proxies significantly undervalued the health-related quality of life of their mobility-impaired children: children rated their health-related quality of life higher than their parents by proxy on all measures. The VAS had the highest overall mean score for children and proxies (79.50 [SD = 15.01] and 75.77 [SD = 14.70] respectively). Child and proxy results were significantly different (p < 0.05) for all measures besides the VAS (p = 0.138). Strong correlation and acceptable agreement were observed for equivalent child/proxy VAS and HUI measures. The EQ-5D-Y exhibited the least agreement between children and proxies. Sufficient association between child/proxy VAS and HUI measures indicated a degree of interchangeability.
Preference-based measures of health-related quality of life (HRQoL) are used to assess the utility gains associated with clinical, social care and public health interventions. Utility refers to the subjective level of wellbeing experienced in different states of health . Each potential health state is assigned a utility weight derived from the social desirability of that state, for instance ranging from death to perfect health . The most commonly used measure of utility is the quality adjusted life-year (QALY), which is an aggregate of both quantity and quality of life. In order to calculate QALYs preference-based HRQoL data is required.
HRQoL is a subjective and multi-dimensional construct defined as the perceived impact of health status on quality of life, including physical, psychological and social functioning . Definitions of paediatric HRQoL must take into account the unique social contexts of childhood, including family, friends and school .
Standard measures of HRQoL, such as the EQ-5D  and Health Utilities Index (HUI) , are supported by a wealth of validation literature and value sets to ascribe weights to utility functions [5,6,7,8,9,10].
In paediatric research it is common place for parents and/or carers to report outcomes on behalf of their child when age, ability or capacity precludes inclusion of the child directly. However, proxy reports are often significantly different to self-reports, particularly for children with disabilities [11, 12]. Understanding the relationship between child self-reported data and parental proxy data is important to assess the relative validity of different sources of data in economic analyses .
Previous research has demonstrated the holistic benefits of wheelchairs for children, however there is practically no evidence to demonstrate the relative cost-effectiveness of paediatric wheelchair provision . To facilitate future economic evaluations in this context, there is a need to understand how best to measure the HRQoL of children with mobility impairments.
The overarching aim of this pilot study was to compare how children with mobility impairments and their parents (by proxy) report HRQoL using standard outcome measures. Our secondary objective was to determine if there are statistically significant differences between the self-reported outcomes of children with mobility impairments and the proxy-reported outcomes of their parents.
Sampling and recruitment
Inclusion and exclusion criteria are presented in Table 1. The sampling frame comprised dyads of children with mobility impairments (aged 18 or under; hereafter referred to as ‘children’) and one of their parents. Participants were offered a small financial incentive (a £10 retail voucher) for taking part in the study. Children under the age of 16 completed an assent form and their parents completed a proxy consent form. A sample size calculation was not undertaken due to the small scale of the pilot.
Participants were recruited between June and October 2013 from two UK recruitment sites: a Welsh National Health Service (NHS) wheelchair service and a children’s wheelchair charity based in England.
Data were collected using postal questionnaire surveys. Questionnaires contained outcome measures (EQ-5D-Y, HUI, VAS) and demographic questions. Child questionnaires contained self-administered versions of measures, while parent questionnaires contained proxy versions.
The EQ-5D-Y is a validated HRQoL measure for use in children and parent proxies . A pre-existing UK general adult population value set was used to assign weights for domain levels, on a death to perfect health scale (0 to 1) . At present there are no specific value sets for children or parent proxies.
The HUI is a validated HRQoL measure containing the HUI2 and HUI3 systems . Multi-attribute utility functions were used to assign utility scores to HUI2/3 attribute levels, on a death to perfect health scale (0 to 1) [9, 10]. Both the EQ-5D-Y and HUI measures have health states considered worse than death, and thus some states can have negative values.
The VAS (EQ-VAS) is typically presented alongside the EQ-5D-Y, and measures self-rated health status on a scale from worst imaginable to best imaginable health (0 to 100). In order to aid comparison with the EQ-5D-Y and HUI measures the VAS scoring system was converted from a 0 to 100 scale to a 0 to 1 scale during certain analyses.
Statistical analysis of mean scores All analyses were conducted using SPPS v20. Data were not normally distributed therefore non-parametric statistical methods were used. Wilcoxon signed-rank tests were used to analyse statistically significant (p < 0.05) differences between children and parent proxies, based on EQ-5D-Y, VAS and HUI total score mean ranks for dyads.
Correlation between children and parent proxies Spearman’s rank-order was used to test correlation. Correlation was assessed between dyads of child and parent proxy total scores to examine whether they were associated. In order for child and parent proxy measures to be considered sufficiently associated, correlation coefficients had to be defined as moderate or strong (r s of <0.20 = absent; r s of 0.20 to 0.35 = weak; r s of 0.35 to 0.50 = moderate; r s of ≥0.50 = strong) .
Agreement between children and parent proxies Bland–Altman plots were used to assess agreement between children and parent proxy results. On the plot 95% of differences should lie between the established limits of agreement (mean difference ± 1.96 SD) , represented as dashed lines. Where bias or limits of agreement are beyond those deemed acceptable for clinical use, the measures lack agreement to be used interchangeably to measure the same construct. A confidence limit of 0.50 was chosen.
Response rate, sample size and missing data
Study invitation packs were sent to 64 eligible children and their parents. In total 28 questionnaires were returned; 15 child participants and 13 parent proxies. Two child participants returned questionnaires without parent proxy data, and thus were excluded from the dyad analyses. This provided a full sample of 13 dyads of children and their parents. Data from two dyads were excluded from the EQ-5D-Y analyses due to incompletion of the measure, giving an overall completion rate of 84.6% for this measure. All other measures were completed in full without error or missing data. Demographic details for the dyads of children and parents are presented in Table 2.
HRQoL total score results
Descriptive statistics are presented in Table 3. The overall mean scores on all of the measures were higher for child self-reports than for parent proxies (see Fig. 1). The VAS had the highest overall mean score for children and parent proxies (79.50 [SD = 15.01] and 75.77 [SD = 14.70] respectively), followed by the HUI2 (0.53 [SD = 0.07] and 0.49 [SD = 0.09] respectively). Children scored the EQ-5D-Y higher than the HUI3 (0.24 [SD = 0.30] and 0.22 [SD = 0.09] respectively), while parent proxies scored the EQ-5D-Y lower than the HUI3 (0.01 [SD = 0.14] and 0.16 [SD = 0.10] respectively). All scores were below child population norms: 0.89 for EQ-5D-Y ; 83.17 for VAS ; 0.95 for HUI2 [21, 22]; and 0.85 to 0.92 for HUI3 .
Statistical analysis of child and parent proxy dyads HRQoL scores
A significant effect of respondent type was found for all measures besides the VAS. Child self-reported total scores were significantly higher for the EQ-5D-Y (Z = −2.525, p = 0.012), HUI2 (Z = −2.310, p = 0.021) and HUI3 (Z = −2.599, p = 0.009). Mean child VAS scores were higher, but not significantly (Z = −1.483, p = 0.138). See Table 3 for median score results.
Correlation between child self-report and parent proxy measures
Correlation coefficients are presented in Table 4. Significant strong (p < 0.05) correlations were found between dyads of child and parent proxy results for the EQ-5D-Y (r s = 0.665, p = 0.026), HUI2 (r s = 0.728, p = 0.005) and HUI3 (r s = 0.842, p < 0.001). Strong significant correlation was also found between the child HUI3 and parent proxy HUI2 (r s = 0.567, p = 0.043); the child HUI2 and parent proxy HUI3 (r s = 0.932, p < 0.001); and the child EQ-5D-Y and parent proxy HUI2 (r s = 0.637, p = 0.039). A strong but non-significant correlation was found between the child and parent proxy VAS (r s = 0.545, p = 0.054). Therefore, convergence between equivalent child and parent proxy measures was sufficient, with only the parent HUI3 and child HUI2 exhibiting stronger correlations with non-equivalent measures.
Agreement between child self-report and parent proxy measures (dyads)
Sufficient agreement was found between the child and parent proxy HUI2 (confidence limit [CL] = 0.22), HUI3 (CL = 0.22) and VAS measures (CL = 0.32) (see Table 5; Fig. 2), with the HUI measures showing the most agreement between child and parent scores. The EQ-5D-Y exhibited clinically important discrepancies between child and parent proxy responses (CL = 1.04) thus showing insufficient agreement to be used interchangeably in this cohort.
The EQ-5D-Y did not sufficiently measure HRQoL in accordance with how the sampled children and parents defined overall health status. This is likely due to general population health state preferences being unrepresentative of how children with mobility impairments (and their parents by proxy) value their own health state.
The simple descriptive system of the EQ-5D-Y lacks nuance for children with mobility impairments. For instance, the EQ-5D-Y mobility domain has no consideration for mobility beyond walking and thus automatically discounts the HRQoL of a mobility impaired child, even though they may be mobile using assistive technology solutions. The relationship between gross motor function is often contradictory , thus measures such as the EQ-5D and HUI lack sufficient sensitivity to be used appropriately in mobility impaired populations.
VAS mean scores were to a large extent higher than the other measures in this study, which raises questions about the validity of the HRQoL measures, in particular the value sets used, as the VAS is a clear indicator of self and proxy reported health status. Future research into child-specific value sets could help to improve sensitivity of HRQoL measures, however it is currently unclear whether young children can adequately value health states, or whether it is appropriate to use preference weights from wider society or proxy reports .
Previous research has similarly demonstrated the issue of using proxy HRQoL data, as proxy scores are often systematically lower than self-reports of children with disabilities [11, 12]. In practice child self-reported data should be prioritised over proxy data. In circumstances where this is not possible, the VAS appears to be more valid than the EQ-5D-Y and HUI2/3 for measuring health outcomes of children with mobility impairments. Further research should focus on establishing whether systematic differences between child and proxy reports can be sufficiently predicted and used to adjust proxy outcomes.
Significant differences were found between child and parent proxy measures, and yet they were also correlated. These two concepts would appear to be mutually exclusive, but in fact demonstrate the issue with using just statistical analysis of respondent type effect or correlation to assess relationships between measures. Statistically significant differences in mean scores demonstrate that mean scores are sufficiently different to be significant, however this does not indicate the relationship between scores across the cohort. Correlation is an indication of association, for instance as child scores goes up so do parent scores. This, however, does not give an indication as to whether these scores are in agreement; a large difference between child and parent scores may exist but they may also vary in a similar manner, and thus still be correlated. Tests of agreement should supplement analyses of correlation in order to gain a better understanding of the relationship between measures and/or respondents.
The size of the sample was small and thus the analyses lacked power. Furthermore, the demographic characteristics were not representative of the wider population of children with mobility impairments in the UK. Dyads with missing data were excluded from analyses, which reduced the sample size. In future research a larger sampling frame is required. Comparing the results of the VAS with validated HRQoL measures raises some issues, as the VAS is not preference-based and thus does not provide an indication of the relative societal value of different states of health. Therefore, VAS results are not directly comparable with more complex preference-based measures. EuroQoL do not recommend the use of the adult EQ-5D value set for scoring the EQ-5D-Y. Despite these shortcomings, this pilot demonstrates that children with mobility impairments can assess their own HRQoL and health status, thus their views should be prioritised in outcome measurement.
child health utility nine dimension
electrically powered indoor/outdoor chair
EuroQoL five dimension
EuroQoL five dimension youth version
health-related quality of life
health utilities index
National Health Service
National Institute for Health and Care Excellence
quality-adjusted life year
visual analogue scale
Robinson R. Cost-utility analysis. BMJ. 1993;307:859–62.
Stevens K, Palfreyman S. The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation. Value Health. 2012;15(8):991–8.
Leidy NK, Rich M, Geneste B. Recommendations for evaluating the validity of quality of life claims for labelling and promotion. Value Health. 1999;2(2):113–27.
Matza LS, Swensen AR, Flood EM, Secnik K, Leidy NK. Assessment of health-related quality of life in children: a review of conceptual, methodological, and regulatory issues. Value Health. 2004;7(1):79–92.
EuroQol Group. EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.
Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1:54.
Dolan P, Gudex C, Kind P, Williams A. The time trade-off method: results from a general population study. Health Econ. 1996;5:141–5.
Pogany L, Barr RD, Shaw A, Speechley KN, Barrera M, Maunsell E. Health status in survivors of cancer in childhood and adolescence. Qual Life Res. 2006;15(1):143–57.
Torrance GW, Feeny DH, Furlong WJ, Barr RD, Zhang Y, Wang Q. Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. Med Care. 1996;34(7):702–22.
Feeny DH, Furlong WJ, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, Denton M, Boyle M. Multi-attribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care. 2002;40(2):113–28.
Varni JW, Burwinkle TM, Sherman SA, Hanna K, Berrin SJ, Malcarne VL, Chambers HG. Health-related quality of life of children and adolescents with cerebral palsy: hearing the voices of the children. Dev Med Child Neurol. 2007;47:592–7.
Bray P, Bundy AC, Ryan MM, North KN, Everett A. Health-related quality of life in boys with Duchenne muscular dystrophy: agreement between parents and their sons. J Child Neurol. 2010;25(10):1188–94.
Eiser C, Morse R. Quality-of-life measures in chronic diseases of childhood. Health Technol Assess. 2001;5(4):1–157.
Bray N, Noyes J, Edwards RT, Harris N. Wheelchair interventions, services and provision for disabled children: a mixed-method systematic review and conceptual framework. BMC Health Serv Res. 2014;14:309.
Bray N, Yeo ST, Noyes J, Harris N, Edwards RT. Prioritising wheelchair services for children: a pilot discrete choice experiment to understand how child wheelchair users and their parents prioritise different attributes of wheelchair services. Pilot Feasibility Stud. 2016;2:32.
Bray N, Noyes J, Harris N, Edwards RT. Defining health-related quality of life for young wheelchair users: a qualitative health economics study. PLoS ONE. 2017;12(6):e0179269.
van Reenen M, Janssen B, Oppe M, Kreimeier S, Greiner W. EQ-5D-Y user guide: basic information on how to use the EQ-5D-Y instrument. Rotterdam: EuroQoL Group; 2014.
Juniper EF, Guyatt GH, Jaeshke R. How to develop and validate a new health-related quality of life instrument. In: Spiker B, editor. Quality of life and pharmacoeconomics in clinical trials. Philadelphia: Lippincott-Raven Publishers; 1996. p. 49–56.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;8(i):307–10.
Noyes J. Evaluation of health and social provision for ventilator dependent children in the UK: costs and outcomes [dissertation]. York: University of York; 2004.
Saigal S, Feeny D, Furlong W, Rosenbaum P, Burrows E, Torrance G. Comparison of the health-related quality of life of extremely low birth weight children and a reference group of children at age eight years. J Pediatr. 1994;125(3):418–25.
Feeny DH, Furlong W, Saigal S, Sun J. Comparing directly measured standard gamble scores to HUI2 and HUI3 utility scores: group- and individual-level comparisons. Soc Sci Med. 2004;58:799–809.
Livingston MH, Rosenbaum PL, Russell DJ, Palisano RJ. Quality of life among adolescents with cerebral palsy: what the literature tell us? Dev Med Child Neurol. 2007;49:225–31.
Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, Egmar A-N, Greiner W, Gusi N, Herdman M, Jelsma J, Kind P, Scalone L, Ravens-Sieberer U. Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Qual Life Res. 2010;19(6):875–86.
NB, JN, RTE and NH were responsible for the study conception/design and the development of the study protocol. NB was responsible for all major study tasks, which included setting up the study, designing study documentation, applying for ethical approval, engaging with study sites, collecting data, analysing/interpreting results and writing the manuscript. JN, RTE and NH provided feedback on study design and documentation. JN provided expertise and guidance on the ethical application process. All authors were involved in revising the manuscript. All authors read and approved the final manuscript.
NB is a Research Officer at the Centre for Health Economics and Medicines Evaluation (CHEME), Bangor University and a Health and Care Research Wales Fellow. NB’s Ph.D. research focussed on applying health economics methods to paediatric wheelchair provision. JN has experience in child health research, health services research with embedded health economics and evidence synthesis. NH is a Clinical Scientist and Director of the Designability. NH's recent research projects include the use of assistive technology to support home based rehabilitation following stroke and monitoring patterns of physical activity during rehabilitation. RTE is Professor of Health Economics at CHEME, Bangor University. RTE has expertise in economic evaluation alongside trials of complex public health and psychosocial interventions, and an interest in the health economics of disability.
We would like to acknowledge the work of Nina Evans for assisting in the design of the study and the recruitment of participants. We would also like acknowledge the support of Carol McCudden, Fiona McNaught, Amanda Hopkin and Mark Lovell for aiding in the recruitment of participants, and Emma Bray for assisting in editing and proofreading the manuscript. We would like to thank our wheelchair service partners for their support in recruitment and data collection throughout the study.
The authors declare that they have no competing interests.
Availability of data and supporting materials
The datasets generated and/or analysed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethical approval and consent to participate
The study was granted ethical approval by the North West Wales NHS research ethics committee (Reference: 13/WA/0143) and an academic ethics committee at Bangor University. The study conformed to the tenets of the Declaration of Helsinki. Written informed consent was obtained from all participants prior to participation in the study. Children under the age of 16 completed an assent form and their parents completed a proxy consent form.
The study was funded by the National Institute for Social Care and Health Research (NISCHR) as part of a Ph.D. studentship award. The funding organisation had no role in the design, conduct, analysis or interpretation of this research.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.