- Research note
- Open access
- Published:
Responsiveness of Persian 12-Item multiple sclerosis walking scale: a replication study
BMC Research Notes volume 16, Article number: 45 (2023)
Abstract
Objective
To re-explore the responsiveness of the Persian version of Multiple Sclerosis Walking Scale-12 (MSWS-12p) to physiotherapy intervention and determine the minimally clinically important change (MCIC). This study followed a prospective cohort design. Patients with MS (PwMS) underwent physiotherapy treatment for 10 sessions. The outcome measures were the MSWS-12p and Timed 25-Foot Walk test (T25-FW). Data was collected before and after ten sessions of physiotherapy. The effect sizes and the area under receiver operating characteristics curve (AUC) and MCIC were calculated.
Results
Thirty PwMS (16 female, mean age 43.07 years) participated in the study. The effect sizes for MSWS-12p were moderate (0.52, 0.64). The change scores of MSWS-12p showed excellent correlation with the dichotomized smallest detectable change (SDC) criterion (Eta coefficient test = 0.84). There was no correlation between the MSWS-12p total change scores and the T25-FW (r = − 0.14, p = 0.45). The AUC was perfect and the MCIC for the MSWS-12p was calculated 10.0 points. The MSWS-12p is responsive and demonstrates changes after physiotherapy. Changes > 10.0 points on MSWS-12p total score should be considered as true improvement after physiotherapy.
Introduction
Multiple sclerosis (MS) is a prevalent disabling disease of the central nervous system. The prevalence of MS in Iran is 16.5 and 44.8 per 100,000 people in men and women, respectively [1]. Walking dysfunction is a common symptom affecting approximately 80% of patients with MS (PwMS) [2, 3]. Walking dysfunction limits the daily life activities and increases fall risk [3,4,5]. There are multiple scales for measuring walking in PwMS, including the Timed 25-Foot Walk (T25-FW) [6] and Multiple Sclerosis Walking Scale-12 (MSWS-12) [7].
The MSWS-12 is a self-reported questionnaire that is widely used to measure the impact of MS on walking ability and to detect meaningful changes after treatment of PwMS. Most self-reported questionnaires are in English and for use in other languages must be well translated and adapted culturally for the content validity and equivalency with the source version. The adapted version of a questionnaire needs to be examined for other measurement properties through the process of validation one of which is responsiveness. Validity ensures the scores of a questionnaire are consistent with the construct being measured.
The responsiveness is the ability of a questionnaire to accurately detect any clinical important change, when even small change is occurred. The responsiveness of a questionnaire indicates that the real important change is distinguished from the change due to measurement error.
The MSWS-12 has been adapted and validated into Persian language (MSWS-12p) [8]. A recent study evaluated the responsiveness of MSWS-12p in PwMS and found a minimally clinically important change (MCIC) of 7.5 based on the summed score of the MSWS-12p items (range score 12–60) [9]. However, the validation study of the MSWS-12p used the total score from “0” to “80”. Based on the data provided in the validation study of the MSWS-12p [8], we calculated the smallest detectable change (SDC) of 8.8 points. This indicates that the MCIC of 7.5 is within the measurement error associated with the MSWS-12p. Further, the authors used the global rating of change score (GRCS) [10] to estimate the MCIC for MSWS-12p. The GRCS is influenced by the patients’ interactions with physiotherapists and may result in an erroneous MCIC, and hence the smallest detectable change (SDC) is recommended for receiver operator characteristic (ROC) analysis [11]. We aimed to reevaluate the responsiveness of MSWS-12p in PwMS according to the scoring system used in the previous validation study of the MSWS-12p and use the SDC criterion for ROC analysis to determine the MCIC.
Materials and methods
Design and participants
PwMS who were referred to Physiotherapy Clinic of Iran MS Society were included in the study. This prospective, pretest-posttest study was conducted from March 2019 to March 2020 in Tehran, Iran.
Inclusion criteria were: (1) ability to walk with or without walking aids (Expanded Disability Status Scale, EDSS score 4.5–7.5); (2) ability to read and write in Persian; (3) ability to follow the commands; and (4) giving consent to participate in the study. Exclusion criteria were: (1) presence of other neurological disorders; (2) not completing the physiotherapy program; and (3) not completing the all questionnaire items.
Procedure
Patients willing to participate in the study were evaluated for eligibility. Demographic and basic characteristics of patients including age, gender, body mass index (BMI), and years since MS diagnosis were recorded. The patients were then asked to complete the MSWS-12p questionnaire. Thereafter, patients were tested using the T25-FW before initiating physiotherapy. Physiotherapy in the form of exercise therapy was presented to the patients, three days per week, and 45 min for each session. The physiotherapy treatment was individualized for each patient and consisted of muscle stretching, general conditioning exercises, walking and balance exercises. At the end of the 10th session of physiotherapy, the participants completed the MSWS-12p questionnaire and were re-tested for the T25-FW.
The MSWS-12p is a patient-reported outcome measure that includes 12 items, each item is scored from “1” (not at all) to “5” (extremely affected) with the summed score ranging from 12 to 60. The total score from 0 to 80 was calculated [patient’s score – 12 (minimum score possible)/60 (the maximum score) ×100] [8]. The higher scores on MSWS-12p indicated greater walking disability.
.
The T25-FW is a measure of walking speed [12, 13]. The patient was asked to walk 25 feet (7.62 m) as quickly as possible from a clearly marked start line to a clearly marked finish line. A stopwatch was used to measure the time in seconds. The use of an assistive device, such as a cane, was allowed; the same walking device was used at the follow-up session after treatment. The average of two completed trials was used as the patient’s score. A higher time on the T25-FW indicated greater walking disability.
Statistical analysis
The mean and standard deviation (SD) were calculated for quantitative variables. Kolmogorov-Smirnov (KS) test was used to examine the normality of the data. Paired T-tests were used to examine the change before and after physiotherapy. The standardized effect size (SES) was used to calculate the effect size (Mpre – Mpost/SDpre). The standardized response mean (SRM) was calculated by dividing the mean change scores by the SD of change scores. Effect sizes of 0.2, 0.5, and 0.8 were interpreted as small, medium, and large, respectively [14]. Pearson’s correlation coefficient was calculated to determine the association between the MSWS-12p and the T25-FW. Correlation threshold of > 0.30 was considered as acceptable [15]. Eta Coefficient test was used to examine the strength of association between the MSWS-12p total score change and the SDC based categorical variable of “Improved” and “Unimproved”. The correlation coefficients and Eta coefficient test statistic were interpreted Excellent (0.81-1.00); Very good (0.61–0.80); Good (0.41–0.60); Fair (0.21–0.40); and Poor (0.00-0.20) [16].
The ROC was used to evaluate the responsiveness of MSWS-12p. Sensitivity and specificity were defined as the ability of the MSWS-12p to discriminate the “Improved” (scores > 8.8) from “Unimproved” (< 8.8) patients according to the SDC cut-off of 8.8 points for MSWS-12p; Independent-Samples T-Tests was used to examine the difference between two groups on the MSWS-12p and T25-FW mean change scores [11]. The area under the curve AUC was calculated and represents the probability that the MSWS-12p correctly discriminates the patients as improved or unimproved. The AUC of at least 0.7 was considered as sufficient [17]. The SPSS version 18 (SPSS Inc., Chicago, IL, USA) was used for analyzing the data. P-value ≤ 0.05 was considered statistically significant.
Results
Thirty patients with a mean age of 43.1 years (SD = 9.1, range = 22–59) participated in the study, of whom 16 were female. The mean duration of MS disease was 13.75 years (SD = 6.31). The mean BMI of participants was 23.97 (SD = 4.6).
The mean and SD for MSWS-12p and T25-FW with effects sizes are shown in Table 1. There were significant improvements in the MSWS-12 scores after physiotherapy (p = 0.008); however the change scores for T25-FW were not significant (p = 0.26). The results on MSWS-12p showed that 11 patients improved (mean change 40.30 ± 20.92) and 19 patients did not (-2.54 ± 8.06); the difference between the two groups was statistically significant (t=-6.52, df = 11.74, p < 0.001). The mean change on the T25-FW was not significant between the two groups improved and unimproved (t = 0.81, df = 28, p = 0.42). The correlation between MSWS-12p and T25-FW mean change was not significant (r = -0.14, p = 0.45). The Eta coefficient test showed an excellent association between MSWS-12p total score change and categorical variable of improvement (Eta = 0.84).
ROC analysis of the MSWS-12p showed the AUC = 1.0. The best MCIC for MSWS-12p was 10.0 points (both sensitivity and specificity 100%) to distinguish PwMS who had an improvement in walking from those who had not (Fig. 1).
Discussion
The current study aimed to reevaluate the responsiveness of the MSWS-12p and determine the MSWS-12p MCIC to observe whether the prior findings recur. In this study, both distribution-and anchor-based methods were applied [18, 19]. The beneficial effects of physiotherapy on walking were demonstrated in significant changes of MSWS-12p scores similar to previous reports [20, 21] and recent studies on the MSWS-12 responsiveness [9, 22,23,24]. The improvements after physiotherapy in PwMS support the validity and responsiveness of MSWS-12p within the clinical context. The effect size measures of SES and SRM were not evaluated in previous works [9, 22, 23]. The T25-FW did not improve significantly after physiotherapy [6, 25,26,27,28]. The MSWS-12 may be a more appropriate measure than the T25-FW in detecting improvements after physiotherapy [22].
There was a non-significant correlation between the MSWS-12p and the T25-FW consistent with a previous investigation [29]. This indicates that the perceived improvement according to the MSWS-12p is not consistent with the T25-FW measure. However this is not in line with previous reports that found a moderate correlation between the two measures in community PwMS [24, 30]. Poor correlation between the MSWS-12p and the T25-FW suggests they measure different aspects of walking from different perspectives [29].
The correlation between the MSWS-12p and the SDC dichotomized category was excellent and supports its use in identifying patients who are truly improved from those who are unimproved. The SDC implies that the effect of intervention in PwMS using the MSWS-12p as the outcome measure has to be greater than the 8.8 points [8]. Significant differences between the two groups, Improved vs. Unimproved, on the MSWS-12p change scores implies the sensitivity of the MSWS-12p in identifying patients who truly improved after physiotherapy. It follows that the SDC score may be an objective and suitable approach to identify true change in the clinical status of patients after an intervention [11].
In this study, the SDC based analysis of ROC produced a perfect AUC. As well, the MCIC value of 10 points based on SDC criterion for MSWS-12p found in this study is beyond the measurement error. In line with our finding an MCIC of 10.4 was reported previously [22]. However, some reported MCIC of 8.8 [23] and 8 points in PwMS [31]. Recently, the MCIC of 7.5 points reported for the MSWS-12p [9]. A study determined the appropriate and responsive measures based on the AUC > 0.5 and MCIC > SDC as criteria [23]. It follows that the MCIC value must be calculated considering the SDC value of an instrument being evaluated [32, 33].
Conclusions
The MSWS-12p was found to be responsive when applied in PwMS. Based on the SDC value, the MCIC was calculated as 10 points and is beyond the measurement error of 8.8 points. A change of at least 10 points on the MSWS-12p must occur to be considered as an important clinically meaningful change. Further investigations should confirm our approach and MCIC value.
Limitations
First, the sample size was small. At least 50 PwMS is necessary according to COSMIN guideline [34, 35]. We had planned to include at least 50 patients but due to the COVID-19 pandemic and limited time for data gathering, we were not able to continue our study. Second, responsiveness was not determined according to the disability level of PwMS. Third, the study included a physiotherapy program in an outpatient setting, meaning that the results are relevant to an outpatient setting.
Data availability
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- MS:
-
Multiple sclerosis
- MSWS-12:
-
Multiple Sclerosis Walking Scale-12
- PwMS:
-
Patients with MS
- MCIC:
-
minimally clinically important change
- T25-FW:
-
Timed 25-Foot Walk test
- AUC:
-
under receiver operating characteristics curve
- SDC:
-
smallest detectable change
- GRCS:
-
global rating of change score
- ROC:
-
receiver operator characteristic
- EDSS:
-
Expanded Disability Status Scale
- BMI:
-
body mass index
- SD:
-
standard deviation
- KS:
-
Kolmogorov-Smirnov
- SES:
-
standardized effect size
- SRM:
-
standardized response mean
- COSMIN:
-
COnsensus-based Standards for the selection of health status Measurement Instruments
- COVID-19:
-
coronavirus disease of 2019.
References
Azami M, YektaKooshali MH, Shohani M, Khorshidi A, Mahmudi L. Epidemiology of multiple sclerosis in Iran: a systematic review and meta-analysis. PLoS ONE. 2019;14(4):e0214738.
Hobart J, Lamping D, Fitzpatrick R, Riazi A, Thompson A. The multiple sclerosis impact scale (MSIS-29): a new patient-based outcome measure. Brain. 2001;124(Pt 5):962–73.
Larocca NG. Impact of walking impairment in multiple sclerosis: perspectives of patients and care partners. Patient. 2011;4(3):189–201.
Heesen C, Böhm J, Reich C, Kasper J, Goebel M, Gold SM. Patient perception of bodily functions in multiple sclerosis: gait and visual function are the most valuable. Mult Scler. 2008;14(7):988–91.
Sosnoff JJ, Socie MJ, Boes MK, Sandroff BM, Pula JH, Suh Y, et al. Mobility, balance and falls in persons with multiple sclerosis. PLoS ONE. 2011;6(11):e28021.
Kaufman M, Moyer D, Norton J. The significant change for the timed 25-foot walk in the multiple sclerosis functional composite. Mult Scler. 2000;6(4):286–90.
Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ. Measuring the impact of MS on walking ability: the 12-Item MS walking scale (MSWS-12). Neurology. 2003;60(1):31–6.
Nakhostin Ansari N, Naghdi S, Mohammadi R, Hasson S. Multiple sclerosis walking Scale-12, translation, adaptation and validation for the persian language population. Gait Posture. 2015;41(2):420–4.
Monjezi S, Molhemi F, Shaterzadeh Yazdi MJ, Salehi R, Mehravar M, Kashipazha D. Responsiveness and clinically meaningful changes for the persian versions of the multiple sclerosis walking scale-12 and the modified fatigue impact scale following balance and gait rehabilitation in people with multiple sclerosis. Physiother Theory Pract. 2022;38(3):464–70.
Kamper SJ, Maher CG, Mackay G. Global rating of change scales: a review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17(3):163–70.
Komesh S, Nakhostin Ansari N, Naghdi S, Alaei P, Hasson S, Kordi R. Responsiveness and longitudinal validity of the Persian version of COMI to physiotherapy in patients with non-specific chronic low back pain. Scand J Pain. 2020;20(3):483–90.
Fischer JS, Rudick RA, Cutter GR, Reingold SC. The multiple sclerosis functional composite measure (MSFC): an integrated approach to MS clinical outcome assessment. National MS Society Clinical Outcomes Assessment Task Force. Mult Scler. 1999;5(4):244–50.
Motl RW, Cohen JA, Benedict R, Phillips G, LaRocca N, Hudson LD, et al. Validity of the timed 25-foot walk as an ambulatory performance outcome measure for multiple sclerosis. Mult Scler. 2017;23(5):704–10.
Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen’s d, and r. Law Hum Behav. 2005;29(5):615–20.
Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61(2):102–9.
Feise RJ, Michael Menke J. Functional rating index: a new valid and reliable instrument to measure the magnitude of clinical change in spinal conditions. Spine (Phila Pa 1976). 2001;26(1):78–86. discussion 7.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.
Angst F. The new COSMIN guidelines confront traditional concepts of responsiveness. BMC Med Res Methodol. 2011;11:152. author reply.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.
Rietberg MB, Brooks D, Uitdehaag BM, Kwakkel G. Exercise therapy for multiple sclerosis. Cochrane Database Syst Rev. 2005;2005(1):Cd003980.
Snook EM, Motl RW. Effect of exercise training on walking mobility in multiple sclerosis: a meta-analysis. Neurorehabil Neural Repair. 2009;23(2):108–16.
Baert I, Freeman J, Smedal T, Dalgas U, Romberg A, Kalron A, et al. Responsiveness and clinically meaningful improvement, according to disability level, of five walking measures after rehabilitation in multiple sclerosis: a european multicenter study. Neurorehabil Neural Repair. 2014;28(7):621–31.
Baert I, Smedal T, Kalron A, Rasova K, Heric-Mansrud A, Ehling R, et al. Responsiveness and meaningful improvement of mobility measures following MS rehabilitation. Neurology. 2018;91(20):e1880–e92.
McGuigan C, Hutchinson M. Confirming the validity and responsiveness of the multiple sclerosis walking Scale-12 (MSWS-12). Neurology. 2004;62(11):2103–5.
Coleman CI, Sobieraj DM, Marinucci LN. Minimally important clinical difference of the timed 25-Foot walk test: results from a randomized controlled trial in patients with multiple sclerosis. Curr Med Res Opin. 2012;28(1):49–56.
Goldman MD, Motl RW, Scagnelli J, Pula JH, Sosnoff JJ, Cadavid D. Clinically meaningful performance benchmarks in MS: timed 25-foot walk and the real world. Neurology. 2013;81(21):1856–63.
Kragt JJ, van der Linden FA, Nielsen JM, Uitdehaag BM, Polman CH. Clinical impact of 20% worsening on timed 25-foot walk and 9-hole Peg Test in multiple sclerosis. Mult Scler. 2006;12(5):594–8.
Schwid SR, Goodman AD, McDermott MP, Bever CF, Cook SD. Quantitative functional measures in MS: what is a reliable change? Neurology. 2002;58(8):1294–6.
Hobart J, Blight AR, Goodman A, Lynn F, Putzki N. Timed 25-foot walk: direct evidence that improving 20% or greater is clinically meaningful in MS. Neurology. 2013;80(16):1509–17.
Marangoni BE, Pavan K, Tilbery CP. Cross-cultural adaptation and validation of the 12-item multiple sclerosis walking scale (MSWS-12) for the brazilian population. Arq Neuropsiquiatr. 2012;70(12):922–8.
Mehta L, McNeill M, Hobart J, Wyrwich KW, Poon JL, Auguste P, et al. Identifying an important change estimate for the multiple sclerosis walking Scale-12 (MSWS-12v1) for interpreting clinical trial results. Mult Scler J Exp Transl Clin. 2015;1:2055217315596993.
Dutmer AL, Reneman MF, Schiphorst Preuper HR, Wolff AP, Speijer BL, Soer R. The NIH minimal dataset for chronic low back Pain: responsiveness and minimal clinically important change. Spine (Phila Pa 1976). 2019;44(20):E1211–e8.
Rysstad T, Røe Y, Haldorsen B, Svege I, Strand LI. Responsiveness and minimal important change of the norwegian version of the disabilities of the arm, shoulder and hand questionnaire (DASH) in patients with subacromial pain syndrome. BMC Musculoskelet Disord. 2017;18(1):248.
Learmonth YC, Dlugonski DD, Pilutti LA, Sandroff BM, Motl RW. The reliability, precision and clinically meaningful change of walking assessments in multiple sclerosis. Mult Scler. 2013;19(13):1784–91.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.
Acknowledgements
We would like to thank Iran MS Society and all PwMS who participated in this study.
Funding
We appreciate the Sports Medicine Research Center, Neuroscience Institute, Tehran University of Medical sciences for supporting this study [Grant number: 96-02-53-34905].
Author information
Authors and Affiliations
Contributions
Concept and design, SN and NNA; Data collection, MK and RL; Statistical analysis, ANA and NNA; Interpretation, ANA, NNA, AH, SN, and SH; Writing original draft, AH and ANA; Writing, editing, and revising the manuscript for intellectual content, NNA, SH, SN, and MB; Funding acquisition, SN; Supervision, SN; All authors read and approved the final manuscript for submission.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study protocol was approved by the Ethics Committee of Tehran University of Medical Sciences (Ethics code: IR.TUMS.VCR.REC.1396.3029) and was carried out according to the guidelines of the committee. All patients gave their written informed consent prior to participation in the study.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Naghdi, S., Ansari, N.N., Haghparast, A. et al. Responsiveness of Persian 12-Item multiple sclerosis walking scale: a replication study. BMC Res Notes 16, 45 (2023). https://doi.org/10.1186/s13104-023-06316-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13104-023-06316-z