Measuring patient perceptions about osteoporosis pharmacotherapy
BMC Research Notes volume 2, Article number: 133 (2009)
Adherence to osteoporosis pharmacotherapy is poor, and linked with patient perceptions of the benefits of, and barriers to taking these treatments. To better understand the association between patient perceptions and osteoporosis pharmacotherapy, we generated thirteen items that may tap into patient perceptions about the benefits of, and barriers to osteoporosis treatment; and included these items as part of a standardized telephone interview of women aged 65–90 years (n = 871). The purpose of this paper is to report the psychometric evaluation of our scale.
Upon detailed analysis, six of the thirteen items were omitted: four redundant, one did not correlate well with any other item and one factorial complex. From the remaining seven items, two distinct unidimensional domains emerged (variance explained = 78%). Internal consistency of the 5-item osteoporosis drug treatment benefits domain was good (Cronbach's alpha = 0.88), and was supported by construct validity; women reporting a physician-diagnosis or taking osteoporosis pharmacotherapy had higher osteoporosis treatment benefit scores compared to those reporting no osteoporosis diagnosis or treatment respectively. Because only two items were identified as tapping into treatment barriers, we recommend they each be used as a separate item assessing potential barriers to adherence to osteoporosis pharmacotherapy, rather than combined into a single scale.
The 5-item osteoporosis drug treatment benefits scale may be useful to examine perceptions about the benefits of osteoporosis pharmacotherapy. Further research is needed to develop scales that adequately measure perceived barriers to osteoporosis pharmacotherapy.
Osteoporosis is a major public health problem resulting in considerable fracture-related morbidity [1, 2]. Current therapies for osteoporosis maintain or improve bone density by affecting bone remodelling, and thereby reduce fracture risk . However, rates of prescribing among those who would benefit, and adherence to therapy in those prescribed, are suboptimal. For example, fewer than half of fracture patients are treated to reduce the risk of recurrent fractures, and of those who initiate osteoporosis pharmacotherapy, more than 40% discontinue treatment within the year following initiation [4, 5]. The Health Belief Model hypothesizes that individuals will not seek preventive care unless they perceive disease to be threatening, believe that health maintenance is efficacious (benefits), find barriers to care minimal, and receive cues to action . Based on this model, a patient at high risk for fracture would not begin treatment, or adhere to pharmacotherapy, unless they believe the benefits of treatment outweigh its barriers. Consistent with this model, we recently found that patient perceptions of the benefits of pharmacotherapy were independently correlated with osteoporosis treatment . The purpose of this paper is to report our psychometric evaluation of the scale used to examine patient perceptions of osteoporosis treatment benefits and barriers, so that others may benefit from our experience in scale development, and to facilitate future research examining patient perceptions about osteoporosis pharmacotherapy.
Details of study recruitment have been previously published [8, 9]. In brief, we sampled 1,500 women (750 from each of two regions) from a list of residents who had completed a short screener questionnaire about arthritis , for a new study focused on osteoporosis management. Community-dwelling women aged 65–90 years, residing within the two sampled regions, and able to complete the telephone interview were eligible. Data collection was completed by standardized telephone interview in 2003 and 2004. The questionnaire included thirteen items that we generated to measure patient perceptions about the benefits of, and barriers to osteoporosis pharmacotherapy. We generated the thirteen items using a similar format (item wording and response structure) to the Osteoporosis Health Beliefs Scale, that was also included as part of the standardized interview. The Osteoporosis Health Beliefs Scale was developed based on the Health Belief Model to measure six osteoporosis-related health beliefs: susceptibility, severity, exercise benefits, exercise barriers, calcium benefits and calcium barriers; and general health motivation [11, 12]. Each item has a 5-point response option from strongly disagree to strongly agree. In generating our thirteen items, we were careful to include questions about "osteoporosis" separately from "broken bones" to differentiate between respondents who understand that osteoporosis is about brittle bones, from those who may not (e.g., confuse osteoporosis with osteoarthritis).
Measures of central tendency and response distribution were summarized for each of the thirteen items generated. Items to which over 80% of participants either agreed (strongly agree and agree) or disagreed (strongly disagree and disagree) were flagged as having poor discriminative ability . Inter-item correlations were examined using polychoric correlation coefficients in PRELIS 2.72 (Scientific Software International, Lincolnwood, IL, USA). Pairs of items with a correlation of 0.90 or higher were considered redundant. Redundant items do not contribute additional information to the underlying construct being measured, yet add to respondent burden. We thus omitted redundant items to improve the utility of our scale for future use. After excluding redundant items, scale structure was evaluated by exploratory factor analysis using polychoric correlation and asymptotic covariance matrices in LISREL 8.72 (Scientific Software International, Lincolnwood, IL, USA). Our goal was to identify distinct (unidimensional) domains measuring patient perceptions about osteoporosis pharmacotherapy. We therefore excluded complex loading items. Kaiser-Guttman criterion of eigenvalues ≥ 1.0, Cattell's scree plots , and interpretability were used in deciding upon the number of factors to retain . Factor loadings ≥ 0.4 were considered important and loadings ≥ 0.5 significant . Final factor loadings were determined by orthogonal rotation using the normalized Varimax procedure . The internal consistency of each domain was tested using Cronbach's alpha coefficients [15, 18] calculated in SAS 8.02 (SAS, Cary, NC, USA). We calculated summative scores for each domain that demonstrated adequate internal consistency by adding the responses to each item identified by factor analysis.
As a sensitivity analysis, we randomly divided our sample in two, and tested scale structure first using exploratory factor analysis, and then using confirmatory factor analysis. Given that responses were not normally distributed across response options, we focused on the standardized root mean square residual (values < 0.1 being favourable), and the non-normed fit index (values > 0.9 recommended) in evaluating the performance of scale structure based on confirmatory factor analysis [16, 19].
We tested construct validity of raw domain scores by hypothesized relationships using unpaired t tests or ANOVAs. We specifically hypothesized that osteoporosis drug treatment benefit scores would be higher among women reporting physician-diagnosed osteoporosis (versus not) and those currently taking osteoporosis pharmacotherapy (bisphosphonate, calcitonin and/or raloxifene), compared to past use or no osteoporosis drug exposure.
A total of 871 women participated by responding to the standardized telephone interview (participation rate = 84%, response rate = 72%). The mean and median age of study participants was 75 years (SD = 6.1). Participants were similar to nonresponders based on physician-diagnosed osteoporosis, fracture history and treatment with etidronate and hormone therapy, determined by self-report in 1995 and 1997 , Table 1. Participants were also similar in age (as of May 2003) to women refusing to participate (mean age = 76 years), but significantly younger than ineligible women (mean age = 78 years) and those not contacted (mean age = 77 years).
Table 2 lists the thirteen items generated to assess patient perceptions about osteoporosis pharmacotherapy, and summarizes the response distribution for each item. One item was missing data for one respondent. Two items (8 and 9) had poor discriminative ability with over 80% disagreeing with each statement. Items 2, 4, 5 and 6 were redundant (polychoric correlations > 0.9) asking similar questions about "feeling good" or if the participant would "consider" taking drug treatments to prevent osteoporosis or broken bones. In an effort to tap both feelings toward taking drugs to prevent osteoporosis and whether one would consider pharmacotherapy to prevent fractures, two of these items (2 and 6) were retained. The Pearson correlation coefficient between these two items was 0.79 (polychoric correlation coefficient = 0.91). Items 11, 12 and 13 were also redundant, and of the three, item 11 was retained (based on length and clarity). At the other extreme, no item correlated well with item 7 (Drug treatment for osteoporosis cost too much); its highest correlation was with item 10 (r = 0.33). This item was therefore removed from the scale.
After excluding four redundant items (4, 5, 12 and 13) and item 7 that did not correlate well with any other item, the remaining eight items were submitted to exploratory factor analysis resulting in a 2-factor solution. However, item 10 (Taking drug treatments would upset your every day routine) demonstrated complex factor loading. Indeed, weekly bisphosphonates have been available in Canada since July 2002, calling the generalizability of the item into question. Therefore, item 10 was removed from the scale. New evidence has also found that weekly dosing of bisphosphonates after hip fracture in Pennsylvania increased from 26% in 2000 (when weekly regimen first available in the United States), to 100% in 2004 . Subsequent factor analysis resulted in a 2-factor uncorrelated solution, Table 3. Domains were labeled based on the content of their items as: osteoporosis drug treatment benefits (57% variance explained, 5 items) and drug treatment barriers (21% variance explained, 2 items). Similar results were observed in sensitivity analyses. Among the 436 randomly allocated to exploratory factor analysis, we identified the same 2-factor uncorrelated solution (79% variance explained, 57% benefits and 22% barriers). Scale structure was further supported by confirmatory factor analysis among the remaining 435, with standardized root mean square residual of 0.08, and non-normed fit index of 0.98.
Internal consistency of the osteoporosis drug treatment benefits domain was high (Cronbach's alpha = 0.88). With only 2 items in the barriers domain, the internal consistency of the scale was low and we do not report the Cronbach's alpha coefficient. The polychoric correlation coefficient between the two items was 0.46. In addition, in terms of face validity, the items appear to tap unrelated constructs; one taps into subjective impression (too many medication), and the other assesses medical contraindications to therapy/other conditions that affect use of medications (limited due to stomach problems). For these collective reasons, construct validity testing was restricted to the "benefits" domain. As hypothesized, women reporting to have a physician-diagnosis of osteoporosis had higher osteoporosis drug treatment benefit scores compared with those reporting no diagnosis (18.5 vs. 16.6, p < 0.001). Similarly, women taking pharmacotherapy (bisphosphonates, calcitonin and/or raloxifene) had higher osteoporosis drug treatment benefits scores: 19.6 for current use compared with 16.5 among past users and 16.4 for never users (p < 0.001). Although some hypothesized differences were small in magnitude, collectively all of these data (factor analysis, reliability and validity) suggest that the osteoporosis drug treatment benefits scale measures perceived benefits of osteoporosis drug treatment.
Understanding patient perceptions about the benefits of, and barriers to taking medications may help to understand why those with clinical need for a preventive agent may not initiate therapy or do not adhere to long-term therapy. We generated a number of items to tap different aspects of osteoporosis drug treatment attitudes and perceptions. These included issues related to costs of treatment, side effects, prevention of broken bones, and the role of physicians in taking medication. From among these items, a factor emerged related to perceived benefits of osteoporosis pharmacotherapy in preventing broken bones. This factor had good internal consistency and some preliminary validity suggesting that it may be useful to include in studies that examine drug treatment adherence and osteoporosis management more generally.
Nonetheless, more research needs to be conducted to examine whether there are other dimensions that were not sufficiently captured by the thirteen items that we generated. The benefits of pharmacotherapy examined in our scale focused on fracture prevention. Although this is directly in line with the Health Belief Model , suggesting that a woman will not take action unless she believes it to be efficacious, we cannot comment on whether there are other benefits that we did not consider or capture. In particular, we need to learn more about patient perceptions regarding the barriers to osteoporosis pharmacotherapy. Prior research has documented several potential barriers to adhering to osteoporosis pharmacotherapy, including: side effects (e.g., gastrointestinal tolerability), complexity of dosing regimen, patient safety concerns, inadequate patient knowledge, lack of noticeable symptoms or symptom improvements, patient preferences for medication use in general, patient-provider communication, patient involvement in treatment decision making and adequacy of treatment follow-up [22–24]. Our methodology in generating items is limited by not having tapped into all of the potential barriers to osteoporosis pharmacotherapy. Indeed, there are standard methods for generating items when designing multi-items scales. Different strategies may include one or more of the following: conducting focus groups, key informant interviews, clinical observation, theory, research and expert opinion [13, 25]. Although our items are theory-driven (Health Belief Model), they do not cover the potential breadth of barriers to osteoporosis pharmacotherapy. It is therefore not surprising that we were unable to identify different domains tapping into specific barriers to osteoporosis treatment. Being faced with the desire to include patient perceptions regarding the benefits and barriers to osteoporosis pharmacotherapy, and the dilemma of not finding a validated scale at the start of data collection, we opted to modify existing items from the Osteoporosis Health Belief Scale. Although this strategy is not a robust means of creating multi-item scales, by working with a previously validated scale that examines osteoporosis health beliefs, we were able to develop a multi-item scale that measures patient perceptions regarding the benefits of osteoporosis pharmacotherapy.
The 5-item osteoporosis drug treatment benefits scale has good psychometric properties among older women and may be useful in future research studies. However, further examination of the properties of the scale is recommended, and further work to identify and develop methods to measure the diverse barriers to osteoporosis pharmacotherapy is warranted.
U.S. Department of Health and Human Services: Bone health and osteoporosis: a report of the Surgeon General. 2004, Rockville, MD: U.S. Department of Health and Human Services, Office of the Surgeon General
Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A: Incidence and economic burden of osteoporosis-related fractures in the United States, 2005–2025. J Bone Miner Res. 2007, 22: 465-475. 10.1359/jbmr.061113.
Riggs BL, Parfitt AM: Drugs used to treat osteoporosis: the critical need for a uniform nomenclature based on their action on bone remodeling. J Bone Miner Res. 2005, 20 (2): 177-184. 10.1359/JBMR.041114.
Cramer JA, Gold DT, Silverman SL, Lewiecki EM: A systematic review of persistence and compliance with bisphosphonates for osteoporosis. Osteoporos Int. 2007, 18: 1023-1031. 10.1007/s00198-006-0322-8.
Elliott-Gibson V, Bogoch ER, Jamal SA, Beaton DE: Practice patterns in the diagnosis and treatment of osteoporosis after a fragility fracture: a systematic review. Osteoporos Int. 2004, 15: 767-778. 10.1007/s00198-004-1675-5.
Janz NK, Champion VL, Strecher VJ: The health belief model. Health behavior and health education: theory, research, and practice. Edited by: Glanz K, Rimer BK, Lewis FM. 2002, San Francisco: Jossey-Bass, 45-66. 3
Cadarette SM, Gignac MAM, Jaglal SB, Beaton DE, Hawker GA: Access to osteoporosis treatment is critically linked to access to dual-energy x-ray absorptiometry testing. Med Care. 2007, 45: 896-901. 10.1097/MLR.0b013e318054689f.
Cadarette SM, Dickson L, Gignac MAM, Beaton DE, Jaglal SB, Hawker GA: Predictors of locating women six to eight years after contact: Internet resources at recruitment may help to improve response rates in longitudinal research. BMC Med Res Methodol. 2007, 7: 22-10.1186/1471-2288-7-22.
Cadarette SM, Gignac MAM, Beaton DE, Jaglal SB, Hawker GA: Psychometric properties of the "Osteoporosis and You" questionnaire: osteoporosis knowledge deficits among older community-dwelling women. Osteoporos Int. 2007, 18: 981-989. 10.1007/s00198-007-0326-z.
Hawker GA, Wright JG, Coyte PC, Williams JI, Harvey B, Glazier R, Badley EM: Differences between men and women in the rate of use of hip and knee arthroplasty. New Engl J Med. 2000, 342: 1016-1022. 10.1056/NEJM200004063421405.
Kim K, Horan M, Gendler P: Osteoporosis Health Belief Scale. 1991, USA: Grand Valley State University, Allendale, Michigan, 49401
Cadarette SM, Beaton DE, Hawker GA: Osteoporosis Health Belief Scale: minor changes were required after telephone administration among women. J Clin Epidemiol. 2004, 57 (2): 154-166. 10.1016/j.jclinepi.2003.08.005.
Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2008, New York: Oxford University Press, Inc, 4
Cattell RB: The scree test for the number of factors. Multivariate Behav Res. 1966, 1: 245-276. 10.1207/s15327906mbr0102_10.
Nunnally JC, Bernstein IH: Psychometric Theory. 1994, Toronto: McGraw-Hill, Inc, 3
Hair JF, Anderson RE, Tatham RL, Black WC: Multivariate data analysis. 1998, Upper Saddle River, NJ: Prentice Hall, 5
Loehlin JC: Latent variable models: an introduction to factor, path, and structural analysis. 1992, Hillsdale, New Jersey: Lawrence Erlbaum Associates, 2
McHorney CA, Ware JE, Lu JFR, Sherbourne CD: The MOS 36-item Short-Form Health Survey (SF-36): III. Test of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994, 32: 40-66. 10.1097/00005650-199401000-00004.
Kline RB: Principles and practice of structural equation modeling. 2005, New York, NY: Guilford Press, 2
Cadarette SM, Jaglal SB, Hawker GA: Fracture prevalence and treatment with bone-sparing agents: are there urban-rural differences? A population based study in Ontario, Canada. J Rheumatol. 2005, 32: 550-558.
Cadarette SM, Katz JN, Brookhart MA, Levin R, Stedman MR, Choudhry NK, Solomon DH: Trends in drug prescribing for osteoporosis after hip fracture, 1995–2004. J Rheumatol. 2008, 35: 319-326.
Osterberg L, Blaschke T: Adherence to medication. N Engl J Med. 2005, 353 (5): 487-497. 10.1056/NEJMra050100.
Gold DT, Alexander IM, Ettinger MP: How can osteoporosis patients benefit more from their therapy? Adherence issues with bisphosphonate therapy. Ann Pharmacother. 2006, 40 (6): 1143-1150. 10.1345/aph.1G534.
Carr AJ, Thompson PW, Cooper C: Factors associated with adherence and persistence to bisphosphonate therapy in osteoporosis: a cross-sectional survey. Osteoporos Int. 2006, 17 (11): 1638-1644. 10.1007/s00198-006-0166-2.
DeVellis RF: Scale development: theory and applications. 2003, Thousand Oaks, CA: Sage Publications, 26: 2
This study was funded by the Canadian Institutes of Health Research (CIHR). Dr. Cadarette is supported by a CIHR New Investigator Award in the Area of Aging and Osteoporosis, Dr. Jaglal is the Toronto Rehabilitation Institute Chair at the University of Toronto, and Dr. Hawker is the FM Hill Chair in Academic Women's Medicine at the University of Toronto.
The authors declare that they have no competing interests.
All authors contributed to study conception, design, and funding, as well as manuscript revision. SMC also contributed to data collection, completed statistical analyses, and prepared the manuscript for publication (drafted and revised). MAMG and DEB contributed to interpreting statistical analysis. All authors read and approved the final version of the manuscript.
About this article
Cite this article
Cadarette, S.M., Gignac, M.A., Jaglal, S.B. et al. Measuring patient perceptions about osteoporosis pharmacotherapy. BMC Res Notes 2, 133 (2009). https://doi.org/10.1186/1756-0500-2-133