- Research note
Does device matter for inhaled therapies in advanced chronic obstructive pulmonary disease (COPD)? A comparative trial of two devices
BMC Research Notesvolume 12, Article number: 94 (2019)
COPD patients have challenges for effective use of inhalers due to advanced age, fixed airflow obstruction and comorbid medical conditions. Published clinical trials investigate drug efficacy but rarely consider the inhaler device. This trial investigates device efficacy, comparing clinical outcomes for the same medication via two different devices. Our intention was to communicate the results and to critically appraise the study protocol to inform planning of future device comparison research. Subjects with spirometry confirming at least moderate COPD were randomly assigned to inhaler sequence; starting with Accuhaler or metered dose inhaler and spacer (MDI/s). After baseline testing, subjects were assigned to fluticasone propionate/salmeterol xinafoate (SFC) 500/50 mcg twice daily via the first device for 6 weeks’ duration, then changed to the alternate device for the following 6 weeks. Subjects were reassessed in terms of health-related quality of life (HRQL), exercise endurance and lung function after each exposure period.
The recruitment target was not achieved due to unanticipated developments within the pharmaceutical industry, potentially compromising the study’s power. Study outcomes did not differ significantly according to the allocated inhaler device even after adjusting for baseline lung function or inhaler technique. Recommendations for future device comparison protocols are offered.
Trial registration Australia and New Zealand Clinical Trials Registry, Current Controlled Trials ACTRN12618000075280, date of registration: 18.01.2018. Retrospectively registered
In chronic obstructive pulmonary disease (COPD), maintenance of therapeutic medication to relieve symptoms is generally delivered via inhalation, in order to preferentially target airways and to lessen systemic impact. Inhaled therapies for COPD were initially assimilated from asthma treatments. Only recently specific medications have been developed for COPD. Many pharmaceutical trials compared inhaled medication efficacy. However, scant published data consider differing inhaler devices in terms of clinical outcomes for COPD.
Inhaler devices may be breath-actuated, such as dry powder inhalers (DPI), or not breath-actuated; a group which includes the nebuliser, Respimat and pressured metered dose inhaler (pMDI). The pMDI’s main limitation is that patients need to coordinate actuation and inhalation. Administering the medication via a volumatic spacer usually overcomes this problem. For breath-actuated devices, coordination is less critical. However, the patient must generate sufficient inspiratory flow to overcome the intrinsic device resistance for effective actuation and drug deposition. Inherent resistance, and hence inspiratory flow requirement, varies by device. Generally, peak inspiratory flow rate (PIFR) greater than 60 L/min is regarded as optimal and less than 30 L/min is insufficient for effective airway deposition via DPI devices [1,2,3,4,5,6,7]. For the DPI used in this study, the Accuhaler device (also marketed as Diskus), overall drug deposition and fine particle distribution is relatively stable between these flow rates [1, 3, 8, 9]. Device factors and/or drug formulation are already known to influence clinical efficacy. For example, dosing studies in COPD for tiotropium via the Handihaler and Respimat devices, looking at lung function outcomes, resulted in these products being marketed with daily dosing recommendations of 18 mcg and 5 mcg, respectively [10,11,12]. Importantly, there is some evidence that a proportion of COPD patients cannot achieve the required inspiratory flow rate to actuate some DPIs commonly used in COPD treatment, with flow rates being lower for older patients and those with more severely impaired lung function [13,14,15]. Potentially this situation deteriorates further during the state of acute exacerbation (AECOPD), when medication is most needed.
In advanced COPD, respiratory function deteriorates, symptoms are persistent, and many patients develop hyperinflation, gas trapping and respiratory muscle weakness—all factors important in generating inspiratory effort. In patients with severe COPD, a breath-actuated inhaler device might be ineffective, due to limited inspiratory capacity and ergo suboptimal drug delivery. Previous research has demonstrated that drug deposition does occur, even at quite low inspiratory flows, but there may be reduction of the total dose delivered [2, 3, 6]. However, other factors may contribute to device efficacy. In contrast to asthma patients, COPD patients are generally older with increased comorbid medical illness. Commonly associated chronic conditions, such as arthritis, visual, auditory and cognitive impairment may also impact on inhaler capability.
Subjects were consecutively recruited from Respiratory Outpatients’ Clinic at a tertiary hospital in Sydney. Those eligible were aged more than 40 years and had spirometry in stable state within the previous 12 months that was consistent with moderate to severe COPD. Cognitive function or English language mastery insufficient for informed consent or protocol adherence were exclusion factors, as were contraindication to inhaled corticosteroid (ICS), long-acting beta agonist (LABA) or any of the inhaled medication components of commercially available SFC inhalers. Patients with life-limiting disease of any category, or who were physically too frail, or whose psychosocial circumstances meant that they would be unable to complete the requirements of the study protocol, including attendance for study visits, were excluded. Subjects were ineligible in the setting of AECOPD within the previous 6 weeks and excluded for AECOPD that occurred during the study protocol.
The study was a randomised crossover trial. Subjects completed a recruitment interview after screening for recent AECOPD. At study entry, subjects discontinued current inhaled medications which contained ICS or LABA but were advised to continue all other inhaled medications prescribed by their usual treating doctor. They then performed baseline testing, inhaler technique assessment and education on all trial-related and ongoing inhaler devices. At completion of the baseline visit, subjects were randomised to a sequence of devices and received a prescription for either SFC 500/50 mcg twice daily via Accuhaler or via MDI/s (see Additional file 1: Blinding and randomisation processes). Primary outcome was HRQL assessed by the Saint George Respiratory Questionnaire (SGRQ) score, recalled over the previous month. Secondary outcomes were exercise endurance assessed by 6 min walk test distance (6MWT) in accordance with American Thoracic Society recommendations  and lung function measures, such as post-bronchodilator forced expiratory volume in one second (FEV1), residual volume (RV), forced vital capacity (FVC) and maximal inspiratory pressure (MIP). Outcomes were assessed at six and 12 weeks. At each visit, inhaler technique was assessed using checklists available from the Australian Asthma and Respiratory Educators Association. For each device, the subject was assigned a score out of 12 and a rating of optimal, adequate or inadequate, depending on their total score and critical technique errors. At the 6 week visit, subjects received a script for the alternate device and another session of inhaler education. Details of randomization are given in Additional file 1: File S1.
While there were no precedent studies comparing device efficacy for our primary outcome (HRQL), published studies examined during the planning phase of the current study reported statistically significant lung function outcomes for device comparisons with 10–21 participants [17, 18]. Hence, subject recruitment target was set at 40. To impute missing data, multivariate normal imputation was used with 25 imputations , allowing repeated measures analysis of covariance (ANCOVA) to estimate the effect of inhaler device exposure on SGRQ score, its component scores and lung function outcomes, after adjusting for baseline FEV1, RV and device technique. Analogous models having interaction between device exposure and technique were fitted. All models were adjusted by period, sequence and subject (sequence). T-tests evaluated the significance for each effect, with ANCOVA results pooled using Rubin’s method . Effect size was estimated by Cohen’s d with small, moderate and strong effects as 0.20–0.49, 0.5–0.79 and 0.8–1.00, respectively .
Seventeen of 28 subjects completed the study protocol. Eleven subjects discontinued the study; seven due to AECOPD, two withdrew consent and two were lost to follow up. Seven of these subjects were taking MDI/s, three were taking Accuhaler and one failed to fill their prescription. At the time of exclusion due to AECOPD, four subjects were taking MDI/s and three were taking Accuhaler. Figure 1 depicts recruitment and withdrawals.
The subject group had mean age 66 years, slight male predominance (57%) and were mainly former (87%) or current (11%) smokers. They had severe airflow obstruction, moderate gas trapping, substantial symptom burden (as evidenced by SGRQ scores in which a higher score indicates worse quality of life) and significant functional impairment (as indicated by 6MWT results). Baseline characteristics are summarised in Table 1.
Table 2 presents for all outcomes mean difference and effect size by device exposure (Accuhaler versus MDI/s). For the primary outcome (SGRQ score) there was no statistical or clinical difference between the two devices except for impact score which meets criteria for clinical significance. Despite this, a substantial proportion of individual subjects demonstrated a difference in primary outcome and 6MWT for the two devices that was clinically significant (shown in Additional file 2: Figures S2 and Additional file 3: S3).
This study explored the potential for differing treatment benefits in severe COPD, according to device type, specifically the Accuhaler and the MDI/s. It evolved due to clinical concerns that those COPD patients with more impaired lung function, specifically reduced FEV1, significant hyperinflation or gas trapping, might do worse with breath-actuated devices. In fact, there is evidence that for certain devices suboptimal inspiratory flow rates may result in reduced distribution of medication within the lungs [5, 6]. At the time of the study, in Australia, SFC was the sole commercially available, approved medication product containing comparably dosed inhaled long-acting bronchodilator medication, formulated within two different devices, both breath-actuated and non breath-actuated. New treatment options are now available but commercial factors and regulatory requirements mean that COPD patients may need to master multiple devices. In asthma, having an inhaled treatment regimen comprising multiple devices is associated with increased risk of technique errors in all devices used .
Koser et al. compared the Accuhaler and pMDI in terms of safety and efficacy in 247 severe COPD patients, reporting non-inferiority for the pMDI for 2 h post-bronchodilator FEV1 . Drug doses differed marginally between the two devices and the trial used pMDI alone, even though a volumatic spacer is generally recommended. Notably, a recent retrospective database study, evaluating the same devices and medication, using diagnostic codes and prescription records, reported fewer exacerbations and less long-acting antimuscarinic agent (LAMA) use with the pMDI than the DPI at doses 500 mcg/day and 1000 mcg/day, respectively .
For SGRQ, there was no statistically significant difference between the two device exposures, even after adjusting for device technique and baseline lung function (FEV1 and RV). This also applied for the secondary outcomes, including SGRQ components (impact, symptom, activity scores), 6MWT and lung function parameters. Provided that the patient is capable of manipulating the device, for the devices tested, treatment efficacy should not differ significantly according to the device. Individual subjects did show clinically different primary outcome with the two devices, which may relate to other factors, such as patient preference, manual dexterity and strength, visual impairment and cognitive dysfunction, which influence inhaler technique and treatment adherence. Hence, treatment choice can rely on these other factors.
This study’s strengths are the randomised, crossover design, assessor blinding and the use of outcomes reflecting chronic symptom morbidity and functional status. Lung function parameters are the most common measures of treatment efficacy in trials, even though they correlate poorly with symptoms and longitudinal disease progression in COPD . Outcome measures reflecting symptom burden, functional status and quality of life are more meaningful to patients. In addition, we assessed, revised and amended inhaler technique at each study visit. Another strength is to use multiple imputation to handle missing data while performing repeated measures ANCOVA, as it is the recommended approach for such analyses. To better evaluate the validity of our study, we considered both the statistical and clinical significance of our findings . P-values are highly dependent on sample size . Hence, we also calculated effect size, which is independent of sample size  and useful for comparing results from different studies . A statistically non-significant result may mean a small sample size was used, while the measured difference in outcome is actually large. However, even using effect size, the two devices did not differ in terms of the main study outcomes. Mixed effects model was not fitted, as the simpler repeated measures ANCOVA will give same results, when all covariates are measured at a single time point.
Subject discontinuation was mainly attributable to AECOPD, consistent with other COPD trials. The study protocol specified exposure duration of 6 weeks (12 weeks’ total duration) rather than a briefer period in order that our outcome assessments reflected ICS effect in addition to the LABA effects. A shorter study protocol, whilst it would have been insufficient to fully assess ICS effects, certainly would have reduced participant losses to AECOPD. This latter approach would be preferable for subsequent device comparison studies, particularly if solely comparing bronchodilator products, when each exposure duration could be realistically reduced to 24 h with a consequent improvement in subject retention. The main disadvantage of this approach is losing the effect of practice and inability to assess device technique mastery; both factors being important in clinical practice. Potentially both reduced recruitment and discontinuing subjects contributed to lessen the study’s power to differentiate between the two treatment exposures.
The study also has weaknesses. This research was conducted at a single Australian centre and so the results may not be truly representative of COPD patients. Although the study participants were asked at each study visit about compliance with the study medication, we did not formally record treatment adherence. While the data collected about inhaler device capability is crucial, the data about adherence is less critical in determining the study outcomes, even though this information may have been useful in providing underlying reasons for the results obtained. Importantly, the reliability of assessing compliance differs between the two devices used. Both devices have dose counters, which can count extra doses if dropped or struck, falsely elevating the quantity of doses delivered. In addition for the MDI, actuations can be made into the air (rather than inhaled), which will also artificially exaggerate the number of doses delivered, whether using dose counter or cannister weight to measure this variable. Lastly, for the MDI, protocol adherence required use of a volumatic spacer (as this is known to enhance drug delivery). Unfortunately, there is no effective means of assessing spacer compliance beyond enquiring of the patient.
This is a pragmatic study, reflecting real life clinical practice, in which setting we know that inhaler adherence is generally quite poor. Since both interventions required twice daily dosing regimens, we expected that non-specific non-adherence, such as forgetting to take medication, or not wanting to take medication would not be specific to device and so would impact both intervention periods in the same way. However, an important characteristic of inhaler devices is user-friendliness (or user-appeal). We reasoned that a difference between the devices in terms of this would likely be reflected by a device-specific adherence discrepancy and might translate to a device-specific impact on the study outcomes. However, the foremost limitation was the failure to achieve our pre-specified recruitment target. Several new treatments were released into the Australian market midway through the study. The availability of new, effective inhaled treatments hampered recruitment as potential recruits were reluctant to discontinue these products.
chronic obstructive pulmonary disease
metered dose inhaler/spacer
fluticasone propionate/salmeterol xinafoate
South West Sydney Local Health District
Human Research Ethics Committee
Saint George Respiratory Questionnaire
6 min walk test distance
acute exacerbation of chronic obstructive pulmonary disease
dry powder inhaler
pressurised metered dose inhaler
peak inspiratory flow rate
forced vital capacity
forced expiratory volume in one second
maximal inspiratory pressure
American Thoracic Society
long-acting beta agonist
multivariate normal imputation
analysis of variance
analysis of covariance
long-acting muscarinic antagonist
body mass index
Hill LS, Slater ALA. comparison of the performance of two modern multidose dry powder inhalers. Respir Med. 1998;92:105–10.
Borgstrom L, Bondesson E, Moren F, Trofast E, Newman SP. Lung deposition of budesonide via Turbuhaler: a comparison with terbutaline sulphate in normal subjects. Eur Respir J. 1994;7:69–73.
Malton A, Sumby BS, Dandiker Y. A comparison of in vitro drug delivery from salbutamol Diskus and terbutaline Turbohaler inhlers. J Pharmacol Med. 1996;6:35–48.
Olsson BO, Asking L. Critical aspects of the function of inspiratory flow driven inhalers. J Aerosol Med. 1994;7(Supplement 1):43–7.
Pedersen SO, Hansen OR, Fuglsang G. influence of inspiratory flow rate on the effect of of Turbuhaler. Arch Dis Child. 1990;65(3):308–10.
Engel T, Scharling B, Skovsted B, Heinig JH. Effects, side effects and plasma concentrations of terbutaline in adult asthmatics after inhaling from a dry powder inhaler device at different inhalation flows and volumes. Br J Clin Pharmacol. 1992;33:439–44.
Newman SP, Moren F, Trofast E, Talaee N, Clarke SW. Terbutaline sulphate Turbuhaler: effect of inhaled flow rate on drug deposition and efficacy. Int J Pharm. 1991;74:209–13.
Tarsin WT, Pearson SB, Assi KH, Chrystyn H. Emitted dose estimates from Seratide Diskus and Symbicort Turbuhaler following inhalation by severe asthmatics. Int J Pharm. 2006;316:131–7.
Neilsen KG, Auk IL, Bojsen K, Ifversen M, Klug B, Bisgaard H. Clinical effect of Diskus dry powder inhaler at low and high inspiratory flow rates in asthmatic children. Eur Respir J. 1998;11:350–4.
Caillaud D, Le Merre C, Martinat Y, Aguilaniu B, Pavia D. A dose-ranging study of tiotropium delivered via Respimat Soft Mist inhaler or Handihaler in COPD patients. Int J COPD. 2007;2(4):559–65.
Ram FS, Carvallho CR, White J. Clinical effectiveness of the Respimat inhaler device in managing chronic obstructive pulmonary disease: evidence when compared with other handheld inhaler devices. Int J COPD. 2011;6:129–39.
Van Noord JA, Cornelissen PJ, Aumann JL, Platz J, Meuller A, Fogarty C. The efficacy of tiotropium administered via Respimat Soft Mist Inhaler or HandiHaler in COPD patients. Respir Med. 2009;103(1):22–9.
Showair RAM, Tarsin WY, Assi KH, Pearson SB, Chrystyn H. Can all patients with COPD use the correct inhalation flow with all inhalers and does training help? Respir Med. 2007;101:2395–401.
Jarvis S, Ind PW, Shiner RJ. Inhaled Therapy in Elderly COPD patients; time for re-evaluation. Age Ageing. 2007;36:213–8.
Janssens W, VandenBrande P, Hardeman E, De Langhe E, Philps T, Troosters T, Decramer M. Inspiratory flow rates at different levels of resistance in elderly COPD patients. Eur Respir J. 2008;31:78–83.
ATS statement: Guidelines for the six minute walk test. Am J Respir Crit Care Med. 2002;166:111–117.
Broeders EA, Molema J, Hop WCJ, Vermue NA, Folgering HTM. Does the inhalation device affect the bronchodilatory dose response curve of salbutamol in asthma and chronic obstructive pulmonary disease patients? Eur J Clin Pharmacol. 2003;59(5-6):449–55.
Ikeda A, Nishimura K, Koyama H, Tsukino M, Hajiro T, Mishima M, Izumi T. Comparison of the bronchodilator effects of salbutamol delivered via a metered-dose inhaler with sapcer, a dry-powder inhaler and a jet nebulizer in patients with chronic obstructive pulmonary disease. Respiration. 1999;66(2):119–23.
Spratt M, Sterne JAC, Carlin JB, Heron J, Tilling K. Strategies for multiple imputation in longitudinal studies. Am J Epidemiol. 2010;172(4):478–87.
Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.
Rosenthal JA. Qualitative descriptors of strength of association and effect size. J Soc Serv Res. 1996;21(4):37–59.
Van der Palen J, Klein JJ, Van Herwaarden CL, Zielhuis GA, Seydel ER. Multiple inhalers confuse asthma patients. Eur Respir J. 1999;14(5):1034–7.
Koser A, Westerman J, Sharma S, Emmett A, Crater G. Safety and efficacy of fluticasone propionate/salmeterol hydrofluoroalkane 134a metered-dose-inhaler compared with fluticasone propionate/salmeterol Diskus in patients with chronic obstructive pulmonary disease. Open Respir Med J. 2010;4:86–91.
Jones RMJ, Thomas V, Skinner D, Marshall J, Stagno d’Alcontres M, Price D. The comparative effectiveness of initiating fluticasone/salmeterol combination therapy via pMDI versus DPI in reducing exacerbations and treatment escalation in COPD: a UK databasestudy. Int J COPD. 2017;12:2445–54.
Global strategy for the diagnosis, management and prevention of COPD, global initiative for chronic obstructive lung disease: 2017 report. Glob Init Chronic Obstruct Lung Dis. 2017.
Bhardwaj SS, Camacho F, Derrow A, Fleischer AB Jr, Feldman SR. Statistical significance and clinical relevance: the importance of power in clinical trials in dermatology. Arch Dermatol. 2004;140(12):1520–3.
Lang JM, Rothman KJ, Cann CI. That confounded p-value. Epidemiology. 1998;9(1):7–8.
Sullivan GM, Feinn R. Using effect size—or why the P value is not enough. J Grad Med Educ. 2012;4(3):279–82. https://doi.org/10.4300/JGME-D-12-00156.1.
HM performed all statistical analyses and added to literature review. The design of the study was largely performed by BC. Literature review, data collection and subject recruitment were performed by SWF and BC. The manuscript was prepared by HM and BC. All authors read and approved the final manuscript.
Study subjects, who kindly volunteered their time to participate in the study.
Dr. Conceiçao Santos, who helped create the graphs.
Location of research: The study participants were recruited at Campbelltown and Camden Hospitals, New South Wales, Australia. All statistical analyses were conducted at Translational Health Research Institute, Western Sydney University
Haider Mannan has no conflict of interest or disclosure in relation to this study.
Belinda Cochrane has received speaker fees from Bayer within the last 5 years. She has previously received speaker fees from Glaxo Smith Kline, the last occasion being during 2011. She has received sponsorship to attend educational meetings (travel and accommodation expenses) from various pharmaceutical companies.
Soo Wei Foo has received sponsorship to attend educational meetings (travel and accommodation expenses) from various pharmaceutical companies. She has received consultancy fees from Novartis in 2017 but no longer provides ongoing consultation. She also holds a patent in interferon beta/or lamda for use in treating rhinovirus in the elderly which has been assigned to Synairgen.
Glaxo Smith Kline, the manufacturer of Seretide (fluticasone propionate/salmeterol xinafoate) Accuhaler and metered dose inhaler, the investigational products used, provided no funding and had no involvement in this study.
Availability of data and materials
The raw data are not accessible within any public repository but can be requested from A/Prof Cochrane until their destruction at completion of the storage period as specified in the submitted National Ethics Application Form.
Consent for publication
Ethics approval and consent to participate
The trial was approved and overseen by South West Sydney Local Health District’s Human Research Ethics Committee (SWSLHD HREC – HREC/09/LPOOL/15). All participants provided written consent.
Royal Australasian College of Physicians Benevolent Fund.
Western Sydney University Seed Funding.
The funding bodies had no direct role in the study design, in the collection, analysis and interpretation of data, nor in writing the manuscript. Western Sydney University, which provided grant funding for this project in the form of a “Research Futures Grant” is the employer of author HM.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.