- Short Report
- Open Access
More ethical and more efficient clinical research: multiplex trial design
BMC Research Notes volume 7, Article number: 530 (2014)
Today’s clinical research faces challenges such as a lack of clinical equipoise between treatment arms, reluctance in randomizing for multiple treatments simultaneously, inability to address interactions and increasingly restricted resources. Furthermore, many trials are biased by extensive exclusion criteria, relatively small sample size and less appropriate outcome measures.
We propose a ‘Multiplex’ trial design that preserves clinical equipoise with a continuous and factorial trial design that will also result in more efficient use of resources. This multiplex design accommodates subtrials with appropriate choice of treatment arms within each subtrial. Clinical equipoise should increase consent rates while the factorial design is the best way to identify interactions.
The multiplex design may evolve naturally from today’s research limitations and challenges, while principal objections seem absent. However this new design poses important infrastructural, organisational and psychological challenges that need in depth consideration.
Randomised clinical trials (RCT) should provide high-level evidence. However RCT’s often exhibit several important limitations: (A) Clinical equipoise is frequently not present for the interventions that are compared . (B) Patients are often not allowed to participate in multiple trials for mainly non-methodological reasons. (C) The costs to initiate, conduct and successfully conclude trials are high. (D) Trials may only include small proportions of the relevant patients leading to results with low external validity. (E) Frequently, trialists choose surrogate or intermediate outcomes [2, 3]. (F) And unrealistic, small sample sizes may be based on inappropriate optimism regarding the expected effect size . All these factors can increase bias and can thus lead to unreliable conclusions .
Multiplex trial design may offer benefits including a more ethical and more efficient clinical research methodology.
We hypothesize that a novel design, called multiplex, will allow a more ethical and more efficient framework for conducting clinical studies. The principle of multiplexing  is widely used in many technical areas. Briefly, it denotes the combination of multiple signals into a single combined continuous signal that later can be decomposed into its individual signals (Figure 1). Clinical trial design could evolve into a similar approach (Figure 2).
The proposed multiplex trial has several key design elements, including a combination of the continuous and factorial approaches (Table 1). Patients are enrolled within a permanent trial structure and at any time point several subtrials will be conducted to address different hypotheses. The multiplex principle includes a factorial design to simultaneously run various subtrials for the same patient category [6, 7]. The number of clinical comparisons that are studied will vary over time, depending on the subtrials that are running at any time point. For all subtrials a relevant outcome according to Grading of Recommendations Assessment Development and Evaluation (GRADE)  is used. For example in critical care many interventions could be assessed for the agreed-upon outcome, i.e. hospital mortality. Enforcing clinical equipoise between the interventions within each subtrial, and their various combinations justifies that patients are simultaneously included in multiple subtrials. Such a design will result in increased efficiency as patients are randomised for multiple subtrials simultaneously and because of the continuous nature. It may demonstrate robust detection of interactions, increased patient consent by respecting equipoise and increased generalisability of results by using fewer exclusion criteria (Table 1).
Key elements of multiplex design
(A) The condition of clinical equipoise is often not met by the interventions that are compared , for example because of an inappropriate control arm . Freedman  proposed that ‘clinical equipoise’ should be based on present or imminent controversy in the clinical community over which treatment would be the preferred treatment. Thus this requirement is satisfied if there is genuine uncertainty within the expert medical community - not necessarily on the part of the individual investigator - about the preferred treatment . For example, clinicians could be evenly divided whether epinephrine or norepinephrine would be optimal for a specific condition.
Despite strong debates, the universal nature of this ethical bedrock of trials cannot be ignored [8, 10]. Respecting clinical equipoise may well result in smaller expected differences in outcome. Consequently, the sample size estimation would be larger to adequately address the question of the subtrial.
(B) Patients do usually not participate in more than one trial. Competitive motives, more than scientific or patients’ interests, may explain this phenomenon. A patient who participates in several subtrials at the same time will contribute to several clinical questions in parallel and thus the costs per subtrial will decrease. In real life, patients who receive N different simultaneous treatments are thus subjected to a multitude, i.e. N · (N-1) of potential interactions. Interactions may remain undetected after approval and market launch [11, 12]. If possible, interactions ought to be identified during a trial, rather than many years after introduction of drugs or interventions into clinical practice. In case that a certain combination of treatments from different subtrials is known a priori to be undesired, such a particular combination could be excluded in the multiplex design.
(C) Currently the planning, initiation, conduct, conclusion and analysis of individual trials are associated with large costs. In contrast, the multiplex organisational and logistical structure - because of its permanent nature - does not need to be rebuilt once it has been established. Conducting randomisation superimposed on an existing registry was demonstrated to result in an important reduction in costs .
(D) Regarding inclusion criteria, many trials only include a small proportion of all eligible patients, when reported. Extensive use of exclusion criteria creates trial results applicable only for selected cases. Trials need to produce results which can be generalized to clinical practice by adopting wide inclusion criteria, and limited exclusion criteria . Included patients need to represent the large majority of eligible patients. The multiplex trial design adopts wide inclusion criteria and as few exclusion criteria as possible. Within this framework, subgroup analyses may eventually reveal hypotheses for more or less favourable effects in specific patient groups.
(E) Concerning outcome, less important measures such as continuous outcomes and surrogate outcomes are frequently used, something mainly based on doctors’ or hospital’s interests (e.g. costs or hospital stay). GRADE emphasizes that outcome measures need to be ranked from to the perspective of the patient . The multiplex trial design was conceived according to this principle: simple and robust outcomes such as mortality and (severe) adverse events that are most relevant to patients.
(F) Unfortunately, many trial sizes are too small to detect relevant statistical differences. Unwarranted optimism concerning intervention effects or the use of inappropriate surrogate outcomes are sometimes employed to justify small sample sizes. This may lead to false positive or false negative conclusions. There is considerable evidence that the majority of trials are underpowered, so definitive conclusions cannot be drawn for many clinical questions . Usually far more randomised patients are needed before clinical questions can reliably be answered, and even more so when truly equivalent interventions are compared since differences will be smaller. Multiplex trial design therefore must entail large(r) sample sizes .
The combination of a continuous and factorial trial with clinical equipoise between all interventions, requires that each subtrial should be designed with low risks of bias and sufficiently large sample sizes based on realistic intervention effects focusing on outcome measures according to GRADE [2, 4, 15, 17].
Key elements of the multiplex design interact: both equipoise and choosing relevant outcomes inevitably lead to larger sample sizes as hypothesized differences in intervention effects will be smaller. This effect, however, will be offset by higher efficiency due to simultaneous randomisation of patients in multiple subtrials. A critical multiplex advantage is that only factorial studies can detect interactions [7, 18]. Since equipoise and quality are central principles of the proposed multiplex design, we believe that patient’s confidence and consent will increase.
Organisational issues as well as the willingness of investigators to cooperate must be addressed if multiplex is to succeed. Informed consent for multiple subtrials must be condensed into a single transparent informed consent procedure. Attitudes toward intellectual and material ownership of trials need to change fundamentally. Funding of multiplex trial units may originate from sponsors such as health service providers, drug and device industries, as well as clinical investigators. Although sponsors will have to relinquish part of their control of trials , in return the required resources would be borne by multiple sponsors. Ownership of trials as well as which subtrials are prioritized should be reconsidered as well as who will manage a multiplex institute. We believe that many registries (e.g. for cardiology or critical care) that currently record outcome on a nation-wide basis might provide part of the infrastructure for conducting multiplex trials. Modern information technology and web-based applications may offer solutions for data registration as well as transparency towards patients. Large sample sizes inevitably demand a multi-centre approach and probably the organisational structure will expand beyond national boundaries, creating additional legal challenges. Although these and other yet unthought-of issues must all be addressed before we can embark upon such a complex enterprise, we firmly believe that the multiplex trial design is a natural direction trial design must evolve into.
We believe that the multiplex design is compatible with basic ethical principles and that it is a natural methodological direction that trial design should evolve into. Obviously, considerable psychological, organizational and regulatory hurdles have to be overcome before multiplex trial design becomes reality.
Freedman B: Equipoise and the ethics of clinical research. N Engl J Med. 1987, 317: 141-145.
Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck Ytter Y, Schünemann HJ, GRADE Working Group: What is "quality of evidence" and why is it important to clinicians?. BMJ. 2008, 336: 995-998.
Halpern SD, Karlawish JHT, Berlin JA: The continuing unethical conduct of underpowered clinical trials. JAMA. 2002, 288: 358-362.
Savović J, Jones H, Altman D, Harris R, Jüni P, Pildal J, Als-Nielsen B, Balk EM, Gluud C, Gluud LL, Ioannidis JP, Schulz KF, Beynon R, Welton NJ, Wood L, Moher D, Deeks JJ, Sterne JA: Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med. 2012, 157: 429-438.
Wikipedia – Multiplexing. [http://en.wikipedia.org/wiki/Multiplexing]
Montgomery AA, Peters TJ, Little P: Design, analysis and presentation of factorial randomised controlled trials. BMC Med Res Methodol. 2003, 3: 26-
Green S, Liu PY, O’Sullivan J: Factorial design considerations. J Clin Oncol. 2002, 20: 3424-3430.
Fries JF, Krishnan E: Equipoise, design bias, and randomized controlled trials: the elusive ethics of new drug development. Arthritis Res Ther. 2004, 6: R250-R255.
Felson DT, Glantz L: A surplus of positive trials: weighing biases and reconsidering equipoise. Arthritis Res Ther. 2004, 6: 117-119.
Veatch RM: The irrelevance of equipoise. J Med Philos. 2007, 32: 167-183.
Causevic-Ramosevac A, Semiz S: Drug interactions with statins. Acta Pharm. 2013, 63: 277-293.
Stone GW, Maehara A, Witzenbichler B, Godlewski J, Parise H, Dambrink JH, Ochala A, Carlton TW, Cristea E, Wolff SD, Brener SJ, Chowdhary S, El-Omar M, Neunteufl T, Metzger DC, Karwoski T, Dizon JM, Mehran R, Gibson CM, INFUSE-AMI Investigators: Intracoronary abciximab and aspiration thrombectomy in patients with large anterior myocardial infarction: the INFUSE-AMI randomized trial. JAMA. 2012, 307: 1817-1826.
Fröbert O, Lagerqvist B, Olivecrona GK, Omerovic E, Gudnason T, Maeng M, Aasa M, Angerås O, Calais F, Danielewicz M, Erlinge D, Hellsten L, Jensen U, Johansson AC, Kåregren A, Nilsson J, Robertson L, Sandhall L, Sjögren I, Ostlund O, Harnek J, James SK, TASTE Trial: Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013, 369: 1587-1597.
Yusuf S, Held P, Teo KK, Toretsky ER: Selection of patients for randomized controlled trials: implications of wide or narrow eligibility criteria. Stat Med. 1990, 9: 73-83.
Thorlund K, Imberger G, Walsh M, Chu R, Gluud C, Wetterslev J, Guyatt G, Devereaux PJ, Thabane L: The number of patients and events required to limit the risk of overestimation of intervention effects in meta-analysis–a simulation study. PLoS One. 2011, 6: e25491-
Yusuf S, Collins R, Peto R: Why do we need some large, simple randomized trials?. Stat Med. 1984, 3: 409-422.
Keus F, Wetterslev J, Gluud C, van Laarhoven CJ: Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010, 10: 90-
McAlister FA, Straus SE, Sackett DL, Altman DG: Analysis and reporting of factorial trials: a systematic review. JAMA. 2003, 289: 2545-2553.
Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L: Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012, 12: MR000033-
We wish to thank Christian Gluud, Karim Mahmoud, Wim Sluiter and Felix Zijlstra for their comments.
The authors declare that they have no competing interests.
All three authors contributed to this debate paper. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Keus, F., van der Horst, I.C. & Nijsten, M.W. More ethical and more efficient clinical research: multiplex trial design. BMC Res Notes 7, 530 (2014). https://doi.org/10.1186/1756-0500-7-530
- Trial design
- Clinical equipoise
- Factorial design
- Simultaneous randomization