More ethical and more efficient clinical research: multiplex trial design
© Keus et al.; licensee BioMed Central Ltd. 2014
Received: 10 February 2014
Accepted: 30 July 2014
Published: 14 August 2014
Today’s clinical research faces challenges such as a lack of clinical equipoise between treatment arms, reluctance in randomizing for multiple treatments simultaneously, inability to address interactions and increasingly restricted resources. Furthermore, many trials are biased by extensive exclusion criteria, relatively small sample size and less appropriate outcome measures.
We propose a ‘Multiplex’ trial design that preserves clinical equipoise with a continuous and factorial trial design that will also result in more efficient use of resources. This multiplex design accommodates subtrials with appropriate choice of treatment arms within each subtrial. Clinical equipoise should increase consent rates while the factorial design is the best way to identify interactions.
The multiplex design may evolve naturally from today’s research limitations and challenges, while principal objections seem absent. However this new design poses important infrastructural, organisational and psychological challenges that need in depth consideration.
Randomised clinical trials (RCT) should provide high-level evidence. However RCT’s often exhibit several important limitations: (A) Clinical equipoise is frequently not present for the interventions that are compared . (B) Patients are often not allowed to participate in multiple trials for mainly non-methodological reasons. (C) The costs to initiate, conduct and successfully conclude trials are high. (D) Trials may only include small proportions of the relevant patients leading to results with low external validity. (E) Frequently, trialists choose surrogate or intermediate outcomes [2, 3]. (F) And unrealistic, small sample sizes may be based on inappropriate optimism regarding the expected effect size . All these factors can increase bias and can thus lead to unreliable conclusions .
Multiplex trial design may offer benefits including a more ethical and more efficient clinical research methodology.
Key elements, requirements and additional benefits of multiplex trial design
A Clinical equipoise between treatment arms
B Factorial design allows simultaneous participation in multiple subtrials
C Continuous design so subtrials are embedded in a permanent infrastructure
D Broad inclusion criteria
E Relevant and robust outcome measures according to GRADE
F Large sample sizes
Treatment arms reflect current practice (A)
Increased involvement of patients (B)
Streamlined consent procedure for multiple subtrials (B)
Multiple principal investigators must closely collaborate (B)
Mutual acceptance of multiple sponsors (B)
Extensive involvement of institutional review board (A,B,C)
Integration with existing outcome registries (C,E,F)
Advanced ICT infrastructure (B,C)
More confidence in clinical research (A,B,E)
Detection of interactions (B)
Results with low risks of bias (A,D,E,F)
Results with low risks of random error (A,D,E,F)
Higher external validity (C,D,F)
More answers to relevant clinical questions (B,C,D,E,F)
More efficient use of resources (B,C,D)
Key elements of multiplex design
(A) The condition of clinical equipoise is often not met by the interventions that are compared , for example because of an inappropriate control arm . Freedman  proposed that ‘clinical equipoise’ should be based on present or imminent controversy in the clinical community over which treatment would be the preferred treatment. Thus this requirement is satisfied if there is genuine uncertainty within the expert medical community - not necessarily on the part of the individual investigator - about the preferred treatment . For example, clinicians could be evenly divided whether epinephrine or norepinephrine would be optimal for a specific condition.
Despite strong debates, the universal nature of this ethical bedrock of trials cannot be ignored [8, 10]. Respecting clinical equipoise may well result in smaller expected differences in outcome. Consequently, the sample size estimation would be larger to adequately address the question of the subtrial.
(B) Patients do usually not participate in more than one trial. Competitive motives, more than scientific or patients’ interests, may explain this phenomenon. A patient who participates in several subtrials at the same time will contribute to several clinical questions in parallel and thus the costs per subtrial will decrease. In real life, patients who receive N different simultaneous treatments are thus subjected to a multitude, i.e. N · (N-1) of potential interactions. Interactions may remain undetected after approval and market launch [11, 12]. If possible, interactions ought to be identified during a trial, rather than many years after introduction of drugs or interventions into clinical practice. In case that a certain combination of treatments from different subtrials is known a priori to be undesired, such a particular combination could be excluded in the multiplex design.
(C) Currently the planning, initiation, conduct, conclusion and analysis of individual trials are associated with large costs. In contrast, the multiplex organisational and logistical structure - because of its permanent nature - does not need to be rebuilt once it has been established. Conducting randomisation superimposed on an existing registry was demonstrated to result in an important reduction in costs .
(D) Regarding inclusion criteria, many trials only include a small proportion of all eligible patients, when reported. Extensive use of exclusion criteria creates trial results applicable only for selected cases. Trials need to produce results which can be generalized to clinical practice by adopting wide inclusion criteria, and limited exclusion criteria . Included patients need to represent the large majority of eligible patients. The multiplex trial design adopts wide inclusion criteria and as few exclusion criteria as possible. Within this framework, subgroup analyses may eventually reveal hypotheses for more or less favourable effects in specific patient groups.
(E) Concerning outcome, less important measures such as continuous outcomes and surrogate outcomes are frequently used, something mainly based on doctors’ or hospital’s interests (e.g. costs or hospital stay). GRADE emphasizes that outcome measures need to be ranked from to the perspective of the patient . The multiplex trial design was conceived according to this principle: simple and robust outcomes such as mortality and (severe) adverse events that are most relevant to patients.
(F) Unfortunately, many trial sizes are too small to detect relevant statistical differences. Unwarranted optimism concerning intervention effects or the use of inappropriate surrogate outcomes are sometimes employed to justify small sample sizes. This may lead to false positive or false negative conclusions. There is considerable evidence that the majority of trials are underpowered, so definitive conclusions cannot be drawn for many clinical questions . Usually far more randomised patients are needed before clinical questions can reliably be answered, and even more so when truly equivalent interventions are compared since differences will be smaller. Multiplex trial design therefore must entail large(r) sample sizes .
The combination of a continuous and factorial trial with clinical equipoise between all interventions, requires that each subtrial should be designed with low risks of bias and sufficiently large sample sizes based on realistic intervention effects focusing on outcome measures according to GRADE [2, 4, 15, 17].
Key elements of the multiplex design interact: both equipoise and choosing relevant outcomes inevitably lead to larger sample sizes as hypothesized differences in intervention effects will be smaller. This effect, however, will be offset by higher efficiency due to simultaneous randomisation of patients in multiple subtrials. A critical multiplex advantage is that only factorial studies can detect interactions [7, 18]. Since equipoise and quality are central principles of the proposed multiplex design, we believe that patient’s confidence and consent will increase.
Organisational issues as well as the willingness of investigators to cooperate must be addressed if multiplex is to succeed. Informed consent for multiple subtrials must be condensed into a single transparent informed consent procedure. Attitudes toward intellectual and material ownership of trials need to change fundamentally. Funding of multiplex trial units may originate from sponsors such as health service providers, drug and device industries, as well as clinical investigators. Although sponsors will have to relinquish part of their control of trials , in return the required resources would be borne by multiple sponsors. Ownership of trials as well as which subtrials are prioritized should be reconsidered as well as who will manage a multiplex institute. We believe that many registries (e.g. for cardiology or critical care) that currently record outcome on a nation-wide basis might provide part of the infrastructure for conducting multiplex trials. Modern information technology and web-based applications may offer solutions for data registration as well as transparency towards patients. Large sample sizes inevitably demand a multi-centre approach and probably the organisational structure will expand beyond national boundaries, creating additional legal challenges. Although these and other yet unthought-of issues must all be addressed before we can embark upon such a complex enterprise, we firmly believe that the multiplex trial design is a natural direction trial design must evolve into.
We believe that the multiplex design is compatible with basic ethical principles and that it is a natural methodological direction that trial design should evolve into. Obviously, considerable psychological, organizational and regulatory hurdles have to be overcome before multiplex trial design becomes reality.
We wish to thank Christian Gluud, Karim Mahmoud, Wim Sluiter and Felix Zijlstra for their comments.
- Freedman B: Equipoise and the ethics of clinical research. N Engl J Med. 1987, 317: 141-145.PubMedView ArticleGoogle Scholar
- Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck Ytter Y, Schünemann HJ, GRADE Working Group: What is "quality of evidence" and why is it important to clinicians?. BMJ. 2008, 336: 995-998.PubMedPubMed CentralView ArticleGoogle Scholar
- Halpern SD, Karlawish JHT, Berlin JA: The continuing unethical conduct of underpowered clinical trials. JAMA. 2002, 288: 358-362.PubMedView ArticleGoogle Scholar
- Savović J, Jones H, Altman D, Harris R, Jüni P, Pildal J, Als-Nielsen B, Balk EM, Gluud C, Gluud LL, Ioannidis JP, Schulz KF, Beynon R, Welton NJ, Wood L, Moher D, Deeks JJ, Sterne JA: Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med. 2012, 157: 429-438.PubMedView ArticleGoogle Scholar
- Wikipedia – Multiplexing. [http://en.wikipedia.org/wiki/Multiplexing]
- Montgomery AA, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Methodol. 2003, 3: 26-PubMedPubMed CentralView ArticleGoogle Scholar
- Green S, Liu PY, O’Sullivan J: Factorial design considerations. J Clin Oncol. 2002, 20: 3424-3430.PubMedView ArticleGoogle Scholar
- Fries JF, Krishnan E: Equipoise, design bias, and randomized controlled trials: the elusive ethics of new drug development. Arthritis Res Ther. 2004, 6: R250-R255.PubMedPubMed CentralView ArticleGoogle Scholar
- Felson DT, Glantz L: A surplus of positive trials: weighing biases and reconsidering equipoise. Arthritis Res Ther. 2004, 6: 117-119.PubMedPubMed CentralView ArticleGoogle Scholar
- Veatch RM: The irrelevance of equipoise. J Med Philos. 2007, 32: 167-183.PubMedView ArticleGoogle Scholar
- Causevic-Ramosevac A, Semiz S: Drug interactions with statins. Acta Pharm. 2013, 63: 277-293.PubMedView ArticleGoogle Scholar
- Stone GW, Maehara A, Witzenbichler B, Godlewski J, Parise H, Dambrink JH, Ochala A, Carlton TW, Cristea E, Wolff SD, Brener SJ, Chowdhary S, El-Omar M, Neunteufl T, Metzger DC, Karwoski T, Dizon JM, Mehran R, Gibson CM, INFUSE-AMI Investigators: Intracoronary abciximab and aspiration thrombectomy in patients with large anterior myocardial infarction: the INFUSE-AMI randomized trial. JAMA. 2012, 307: 1817-1826.PubMedView ArticleGoogle Scholar
- Fröbert O, Lagerqvist B, Olivecrona GK, Omerovic E, Gudnason T, Maeng M, Aasa M, Angerås O, Calais F, Danielewicz M, Erlinge D, Hellsten L, Jensen U, Johansson AC, Kåregren A, Nilsson J, Robertson L, Sandhall L, Sjögren I, Ostlund O, Harnek J, James SK, TASTE Trial: Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013, 369: 1587-1597.PubMedView ArticleGoogle Scholar
- Yusuf S, Held P, Teo KK, Toretsky ER: Selection of patients for randomized controlled trials: implications of wide or narrow eligibility criteria. Stat Med. 1990, 9: 73-83.PubMedView ArticleGoogle Scholar
- Thorlund K, Imberger G, Walsh M, Chu R, Gluud C, Wetterslev J, Guyatt G, Devereaux PJ, Thabane L: The number of patients and events required to limit the risk of overestimation of intervention effects in meta-analysis–a simulation study. PLoS One. 2011, 6: e25491-PubMedPubMed CentralView ArticleGoogle Scholar
- Yusuf S, Collins R, Peto R: Why do we need some large, simple randomized trials?. Stat Med. 1984, 3: 409-422.PubMedView ArticleGoogle Scholar
- Keus F, Wetterslev J, Gluud C, van Laarhoven CJ: Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010, 10: 90-PubMedPubMed CentralView ArticleGoogle Scholar
- McAlister FA, Straus SE, Sackett DL, Altman DG: Analysis and reporting of factorial trials: a systematic review. JAMA. 2003, 289: 2545-2553.PubMedView ArticleGoogle Scholar
- Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L: Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012, 12: MR000033-PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.