Scenario drafting to anticipate future developments in technology assessment
© Retèl et al.; licensee BioMed Central Ltd. 2012
Received: 17 July 2012
Accepted: 9 August 2012
Published: 16 August 2012
Health Technology Assessment (HTA) information, and in particular cost-effectiveness data is needed to guide decisions, preferably already in early stages of technological development. However, at that moment there is usually a high degree of uncertainty, because evidence is limited and different development paths are still possible. We developed a multi-parameter framework to assess dynamic aspects of a technology -still in development-, by means of scenario drafting to determine the effects, costs and cost-effectiveness of possible future diffusion patterns. Secondly, we explored the value of this method on the case of the clinical implementation of the 70-gene signature for breast cancer, a gene expression profile for selecting patients who will benefit most from chemotherapy.
To incorporate process-uncertainty, ten possible scenarios regarding the introduction of the 70-gene signature were drafted with European experts. Out of 5 most likely scenarios, 3 drivers of diffusion (non-compliance, technical failure, and uptake) were quantitatively integrated in a decision-analytical model. For these scenarios, the cost-effectiveness of the 70-gene signature expressed in Incremental Cost-Effectiveness Ratios (ICERs) was compared to clinical guidelines, calculated from the past (2005) until the future (2020).
In 2005 the ICER was €1,9 million/quality-adjusted-life-year (QALY), meaning that the 70-gene signature was not yet cost-effective compared to the current clinical guideline. The ICER for the 70-gene signature improved over time with a range of €1,9 million to €26,145 in 2010 and €1,9 million to €11,123/QALY in 2020 depending on the separate scenario used. From 2010, the 70-gene signature should be cost-effective, based on the combined scenario. The uptake-scenario had strongest influence on the cost-effectiveness.
When optimal diffusion of a technology is sought, incorporating process-uncertainty by means of scenario drafting into a decision model may reveal unanticipated developments and can demonstrate a range of possible cost-effectiveness outcomes. The effect of scenarios give additional information on the speed with cost effectiveness might be reached and thus provide a more realistic picture for policy makers, opinion leaders and manufacturers.
KeywordsEarly technology assessment Scenario drafting Genomic profiling 70-gene signature Breast cancer
Especially in early stages of promising new technologies, Health Technology Assessment (HTA) information should be used to anticipate possible developments. Performing a HTA requires sufficient patient numbers and, as a consequence, broad clinical implementation of new technologies may be premature in the absence of firm prospective data on the actual benefits . However, if we wait to perform a HTA, it might very well be that worthwhile technology is withheld from the public . This paradox has become known as Buxton’s law: “It is always too early, until suddenly, it is too late…”. We feel that there is a need to integrate methods in TA for dealing with the various possible developments in early stages of technology development, both to support information for policy makers, opinion leaders and manufacturers, and to anticipate developments encountered during the early introduction in clinical practice. Combining structured scenario drafting and decision modelling could be helpful to integrate these dynamics when calculating expected effects and costs.
The question is whether HTA –in the broad sense of the term- can be conducted in advance of widespread adoption of a technology? This question has also been featured by a rich body of publications in the recent years [4–7], however, none of these articles focused on incorporation of qualitative scenarios from the perspective of various stakeholders into a cost-effectiveness model.
An example of a promising technique in its early stages of development is the 70-gene prognosis signature (MammaPrintTM) for breast cancer patients . Using the 70-gene signature, the selection of patients that will benefit most from chemotherapy could be more accurate compared to currently used clinical guidelines, and thereby reducing over-treatment. The promising results of three retrospective validation studies [9–11] led to the performance of a prospective feasibility study (RASTER: MicroarRA y PrognoST ics in Breast CancER) from 2004 until 2006 , followed by a prospective, randomized clinical trial (MINDACT: Microarray In Node-negative Disease may Avoid ChemoTherapy), from 2007 until 2011 .
It would take at least 8–10 years to bring the signature into routine clinical practice via the usual path of prospective trials . It was therefore decided that the controlled introduction of this technology, starting in 2004, should be supported by an early and dynamic form of HTA; Constructive Technology Assessment (CTA).
CTA is based on the idea that during the course of technology development, choices are constantly being made about the form, the function, and the use of that technology [15, 16], and attempts to influence the development and diffusion of a new technology in a beneficial way .
For the introduction of the 70-gene signature, the CTA-part focused on quality aspects that were most likely to change during the introduction, such as: efficiency, logistics, ethical/legal aspects, patient centeredness and cost-effectiveness [18–20]. From the cost-effectiveness analysis was learned that the 70-gene had the highest probability of being cost-effective compared to the currently used clinical guidelines St. Gallen guidelines  and the Adjuvant! Online software  for a willingness to pay more than €4,614/QALY .
Simultaneous with the early introduction, scenarios were drafted to monitor and anticipate these changing aspects, in other words: the dynamics of the 70-gene signature diffusion. The scenarios were written in two steps; firstly, two overall scenarios were developed and secondly, a scenario workshop with more detailed scenarios was organized.
The technology-related developments and the diffusion pathway of the 70-gene signature are likely to have impact on the cost, effects and cost-effectiveness in the future. In cost-effectiveness analyses (CEAs), it is common to use different quantitative scenarios in sensitivity analyses to reflect the uncertainty of input-parameters . There are only a few examples in the literature where more comprehensive, qualitative scenarios were processed into a CEA [24, 25].
Our research objectives were: first, to develop a multi-parameter framework to assess dynamic aspects to determine the effects, costs and cost-effectiveness of possible future diffusion patterns of technologies at an early stage of development. Second, to illustrate this method for the 70-gene signature versus the current Adjuvant! Online (AO) treatment strategy for breast cancer patients.
The following steps in the multi-parameter framework can be distinguished: (I) determination of the phase of diffusion; (II) scenario construction; (III) grouping of scenarios; (IV) integration of the factors as parameters in the decision model; (V) input model parameters; (VI) model analysis.
Determination of the phase of diffusion
In the case of the 70-gene signature, the diffusion pathway is described following the curve as in Figure 1: innovation phase (2003–2005), the prognosis signature technique was developed and the first organisations (innovators) adopted the technology in their daily practice. The early adoption phase (2005–2007) describes the implementation in 10–15 hospitals: the logistics were established and physicians increasingly based their adjuvant treatment decision on the signature result. The early majority phase (2007–2012 and beyond) describes the implementation in a gradually increasingly number of hospitals participating in the prospective randomised controlled MINDACT-trial .
The method we used to construct the scenarios was based on the Shell (Royal Dutch Oil multinational) approach, using a most likely course of development with ‘There Is No Alternative’ (TINA) elements and the dynamic nature introduced by ‘what if’-deviations . The Shell method consists of background research, drafting one or two scenarios, structured feedback by experts and revision of these drafts [29, 30]. In fact, the scenario planning concerns planning based on the systematic examination of the future by picturing plausible and consistent images thereof. A specific element in this method is the introduction of “what if” deviations; especially in early stages the degree of uncertainty may render it helpful to consider alternatives. The Delphi method, in turn, attempts to develop systematically expert opinion consensus concerning specific aspects of future developments and events. It is a judgmental decision and/or forecasting procedure in form of an anonymous, written, multi-stage survey process, where feedback of group opinion is provided after each round. Generally speaking, the output of the different phases of the Delphi method can be used as input for the scenario method. More background details will be found at the Shell website  and a former publication concerning this subject .
Scenario results and likelihoods derived from the workshop with experts
Hesitant adopters (100% likely)
Professionals, who are not using the 70-gene signature until the results of the MINDACT are released, will delay the diffusion (spreading of the signature) process. This will be expressed in the proportion of non-compliance towards the signature result.
User-friendliness (90% likely)
There is a mix of new functions possible on the (read-out) microarray; such as ER/PgR/Her2 status, singles genes, with new possibilities for e.g. targeted therapies. Furthermore, by using needle biopsies the application becomes more user-friendly. This will be expressed in a decrease of failures of the signature.
Progressive techniques (90% likely)
There is positive proof for the value of RNA-preservation instead of formalin-based tissue for future research, which causes an increased use of the 70-gene signature. This will be expressed in a decrease of failures of the signature.
Progressive uptake (90% likely)
The 70-gene signature has developed further and can be used safely for all node negative and 1–3 positive patients. The uptake is 100% in your county and is embedded in the national guidelines. This will be expressed in an increasing number of patients receiving signature.
Financial access (75% likely)
The insurance companies in the Netherlands don’t reimburse the use of the 70-gene signature yet (2008). If the insurers were to reimburse the 70-gene signature, the rate of reimbursement agreements would be rather more progressive throughout Europe. This will be expressed in a –slightly slow- increase of patients receiving the signature.
Other paraffin/test (60% likely)
Another PRC-based, user-friendly test appears on the market, and the market share of the 70-gene signature decreases.
Competitive test (60% likely)
The Oncotype DX ‘wins’ the competition; the market share of the 70-gene signature decreases.
Era after: CTC? (40% likely)
A totally new (nano) technology has been developed (using fresh frozen tumour samples) which has more value than the 70-gene signature and - due to this test - the market share of the 70-gene signature decreases.
Provision on free market (18% likely)
Besides being used in the MINDACT trial, 70-gene signature is also available on the free market, to prevent unethical situations due to patient selection.
Regulation/legislation barrier (5% likely)
There is a probability of legal regulation by way of FDA clearance. Because the 70-gene signature has FDA and IVDMIA (In Vitro Diagnostic Multivariate Index Assay) approval, the market share of the Oncotype DX decreases.
Grouping of scenarios
Barrier or facilitator?
Drivers of diffusion (Parameter in decision model)
Mean parameter value in decision model
2 & 3
User friendliness & Progressive techniques
4 & 5
Progressive uptake & Financial access
Integration of the driving factors as parameters in the decision model
To reflect the dynamics in the diffusion, values of the parameters were changed over time. Cost-effectiveness was assessed for three points in time: 2005 (early adoption, data available), 2010 (early majority phase, data based on scenarios), 2020 (late majority, data based on scenarios). All scenarios starting in 2005 were based on data from the RASTER study , as well as the uncertainty, which was assumed to stay constant over time. The initial value of the technical failure parameter was 27%, as this occurred in the total available samples in the RASTER-study. Based on the workshop results, we assumed that the 27% failure rate would be reduced to 20% in 2010 and to 14% in 2020. Non-compliance was modelled in case of a clinical high/genomic low risk (15% in the RASTER-study) and in case of a clinical low/genomic high risk (20%); thus in total 35% non-compliance. Based on the scenarios, the total non-compliance was likely to reduce to 26% in 2010 and to 8% in 2020, assuming a positive result of the MINDACT-trial. The “uptake” parameter was calculated with the numbers of patients who annually received a 70-gene signature divided by the incidence of the targeted group in the Netherlands. We used the numbers of signatures performed in the RASTER-study (n = 427) to feed the data of 2005 . This specific parameter could be negatively influenced by the “financial access” scenario, where the uptake of the 70-gene signature is delayed by insurance companies who do not reimburse the signature; or a competitor test could enter the market with serious effects on the likely sales, which we modelled with an uptake probability of up to 50% in 2010. The uptake parameter could subsequently be positively influenced by the “progressive uptake” scenario, where the 70-gene signature would be adopted optimally in Europe and embedded in guidelines in up to 92% of cases in 2020.
An ICER lower than the threshold implies that the 70-gene signature is cost-effective compared to the AO, and an ICER higher than the threshold implies that the 70-gene signature is not cost-effective. The threshold reflects the maximum willingness to pay of the society, whether a strategy is deemed efficient depends on how much society is willing to pay for a gain in effect, which is referred to as the ceiling ratio . As a threshold for a positive decision on coverage, we used €30,000 per QALY, which reflects the £20,000-30,000 per QALY applied by the National Institute for Health and Clinical Excellence (NICE) . Parameter values were drawn at random from the assigned distributions, using Monte Carlo simulation with 1000 iterations. Uncertainty in the input parameters was handled probabilistically, by assigning distributions to parameters. To show decision uncertainty, cost-effectiveness acceptability curves (CEACs) frontiers are presented .
Mean results, incremental effects, costs, cost-effectiveness ratio and Incremental Cost-Effectiveness Ratio (ICER)
Mean value parameter
€ 1,9 mill
€ 1,9 mill
€ 1,9 mill
€ 1,7 mill
€ 1,5 mill
€ 1,9 mill
In the case of the 70-gene signature, the results of the scenarios incorporated in the dynamic CEA showed a wide range of possible ICERs over time. The effect of uptake, failure and non-compliance give additional information on the speed with cost effectiveness might be reached and thus provide a more realistic picture for policy makers. In our view it might more often be the case that real world variations are not accounted for in cost-effectiveness analyses, as these often rely on information from randomized controlled trials . Besides for policy makers, this information can also be valuable to guide implementation efforts and/or product improvements.
This article shows that, in the absence of sufficient data, scenarios can help to anticipate the future diffusion patterns and use of technology by providing insight into future developments. When integrated in a decision model, these scenarios can also improve the ability to make an informed policy decision. An advantage is that scenario-discussion and -analysis reveals factors that can be anticipated and may warrant intervention in the implementation process, in order to stimulate “appropriate use” and optimal cost-effectiveness at a population level.
In the case of the 70-gene signature, the influence of the uptake scenario seemed to generate the highest impact on the cost-effectiveness results. As the uptake of the 70-gene signature increases, the net benefit will obviously increase and the 70-gene becomes cost-effective. Informing doctors and patients and generating additional evidence, for instance through “coverage with evidence development” program, are possible means to enhance uptake. When comparing the improved compliance results with the reduction of failure results, failure seemed to generate larger impact on cost-effectiveness, mainly due to remaining costs for tests which failed throughout the process. Compliance improvement was observed actually in the pilot study of the MINDACT with a total of 5 % non-compliance in the discordant cases . This was, however, measured in a trial design, which may not be representative for use of the 70-gene signature. Hesitant adopters will have the confidence after prospective data is been released and ease of use could be established by using the 70-gene signature in decision making integrated into the Adjuvant! Online software as a hazard rate.
There are some remaining issues with regard to the scenario method used. First, to keep the analysis stable, we modelled the uncertainty constant over time. It is true expecting that the uncertainty will decrease in the future, but for the ease of comprehension, we left this stable. We expect uncertainty will decrease over time, for example when the results of the MINDACT trial will become available. This is likely to make the results of our analysis more favourable for the 70-gene signature. By using value of information analysis (VOI) one can characterise, and possibly deal, with uncertainty. We are currently exploring these approaches [36, 37]. Second, the uptake scenario turned out to be most influential, however, we could only use the numbers of the studies conducted in 2005 and 2010, in real there could be a lot more signatures used, and thereby effect the cost-effectiveness of the 70-gene in a positive way. Furthermore, the reimbursement decision in this case is based on knowledge and ideas regarding the accuracy of the 70-gene signature. This will indeed either accelerate or slow down the uptake of the signature. In the scenarios, we took into account a (delayed) uptake of 50% in 2010, which is in fact the threshold for cost-effectiveness of the 70-gene signature. Thus in case the uptake will stay below the 50%, the 70-gene signature will not be considered cost-effective. Thirdly, in the scenario workshop, most of the participants were already (short or long) working with the 70-gene signature in clinical practice. In our opinion, the experts who participated in the workshop had a clear view of the potential barriers and facilitators, because of their large experience and because they originated from different EU countries. However, more participants in the late majority or laggard phases could possibly have changed the scenario likelihoods. As a result, the scenarios might be more of a decelerating character, which would lead to higher costs and less effect for the 70-gene signature. In addition, alternative methods are available to elicit likelihoods of different scenarios, such as a Delphi-like approach. Finally, it is possible that costs of drugs used in adjuvant chemotherapy regimens may be underestimated because the costs of Taxanes, used in adjuvant chemotherapy regimen, are expected to increase in the coming years .
The discussed method made it possible to integrate qualitative scenarios into quantitative parameters and derive scores from experts in order to obtain an impression on the most likely future developments. A next phase could be to derive more quantitative scenarios, by preparing the choices for the experts in a more quantitative way, as has been described by some authors , and by evaluating the different options against each other. Another point of further research could be the exact timing of performing a CTA using scenarios and (retrospective) confirmation in other studies that dynamic CTA is possible.
With respect to the 70-gene signature, there is likely to be more than one “truth” regarding cost-effectiveness, especially in early stages of development. If we consider expected costs and outcomes, we cannot be certain about future developments. Technology Assessments in uncertain diffusion phases may be occurring more often; especially early stage cancer where researchers have to wait up to 10–20 years for relevant outcome data. Current advances in understanding cancer biology have provided leads to develop new, effective targeted therapies. However, progress is slowed by suboptimal/outdated clinical trial design paradigms and by regulatory complexity and rigidity. Ongoing studies like the Investigation of Serial studies to Predict Your Therapeutic Response with Imaging And MoLecular analysis (the ISPY-trial) are recent examples that using a new endpoint in the analyses (pathological complete response (PCR)) can be considered to evaluate study results at an earlier stage .
It is important to support those studies with a CTA in order to monitor developments and anticipate them at an early stage. Structured scenario drafting can be used as a tool in this process, and seems especially suited to integrate in decision-analytical models. This ultimately provides the decision maker, opinion leader and/or manufacturer with early, more detailed information of possible developments and of a likely range of cost-effectiveness results of a clinical technology, and the aspects that can be relevant, to improve the product or guide further diffusion.
Source of funding
This study was funded by the Dutch Health Care Insurance Board (DHCIB), the Netherlands. (M03ARR): “mRNA expression patterns as an aid in adjuvant systemic therapy decision making in lymph node negative breast cancer patients.” (RASTER-trial) The DHCIB had no role in the study design or in data collection, analysis and interpretation, and it was not involved in the decision to publish.
Health Technology Assessment
MicroarRAy PrognoSTics in Breast CancER
Microarray In Node-negative Disease may Avoid ChemoTherapy
Constructive Technology Assessment
Adjuvant Online software
TRANS-Breast International Group
National Institute for Health and Clinical Excellence
Quality Adjusted Life Years
Incremental Cost Effectiveness Ratio
Cost-effectiveness acceptability curves
Investigation of Serial studies to Predict Your Therapeutic Response with Imaging And MoLecular analysis
Pathological Complete Response
We acknowledge the European Organisation for Research and Treatment of Cancer (EORTC) for approval of this study and the participation of the Breast Cancer Group (TRANSBIG) during the scenario workshop in Bordeaux October 2008. We thank Dr. R de Jong and F. Stewart for editing the paper and Dr. M. Knauer for support via the consensus workshop.
- Claxton KP, Sculpher MJ, Drummond MF: A Rational Framework for Decision Making by the National Institute for Clinical Excellence (NICE). The Lancet. 2002, 360 (9334): 711-715. 10.1016/S0140-6736(02)09832-X.View ArticleGoogle Scholar
- Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL: Methods for the Economic Evaluation of Health Care Programmes. 2006, Oxford University Press, Oxford, third editionGoogle Scholar
- Fenwick E, Claxton KP, Sculpher MJ, Briggs A: Improving the Efficiency and Relevance of Health Technology Assessment: the Role of Iterative Decision Analytic Modelling. Technical Report 179. 2000, Centre for Health Economics, University of York, UKGoogle Scholar
- Spiegelhalter DJ, Abrams KR, Myles JP: Bayesian Approaches to Clinical Trials and Health-Care Evaluation. 2004, Statistics in Practice. John Wiley & Sons Ltd, ChichesterGoogle Scholar
- Griffin SC, Claxton KP, Palmer SJ, Sculpher MJ: Dangerous Omissions: The Consequences of Ignoring Decision Uncertainty. Health Econ. 2011, 20 (2): 212-24. 10.1002/hec.1586.PubMedView ArticleGoogle Scholar
- Ioannidis JP: Is molecular profiling ready for use in clinical decision making?. The Oncologist. 2007, 12: 301-311. 10.1634/theoncologist.12-3-301.PubMedView ArticleGoogle Scholar
- Buxton MJ: Problems in the economic appraisal of new health technology: The evaluation of heart transplants in the UK. Economic appraisal of health technology in the European Community. Edited by: Drummond MF. 1987, Oxford Medical Publications, Oxford, 103-118.Google Scholar
- Van 't Veer LJ, Dai H, Van de Vijver MJ, et al: Gene expression profiling predicts clinical outcome of breast cancer. Nature. 2002, 415: 530-536. 10.1038/415530a.PubMedView ArticleGoogle Scholar
- Van de Vijver MJ, He YD, van 't Veer LJ, et al: A Gene-Expression Signature as a Predictor of Survival in Breast Cancer. N Engl J Med. 2002, 347: 1999-2009. 10.1056/NEJMoa021967.PubMedView ArticleGoogle Scholar
- Buyse M, Loi S, van't Veer L, et al: Validation and Clinical Utility of a 70-Gene Prognostic Signature for Women With Node-Negative Breast Cancer. J Natl Cancer Inst. 2006, 98: 1183-1192. 10.1093/jnci/djj329.PubMedView ArticleGoogle Scholar
- Bueno-de-Mesquita JM, Linn SC, Keijzer R, et al: Validation of 70-gene prognosis signature in node-negative breast cancer. Breast Cancer Res Treat. 2009, 117: 483-495. 10.1007/s10549-008-0191-2.PubMedView ArticleGoogle Scholar
- Bueno-de-Mesquita JM, van Harten W, Retèl V, et al: Use of 70-gene signature to predict prognosis of patients with node-negative breast cancer: a prospective community-based feasibility study (RASTER). Lancet Oncol. 2007, 8: 1079-1087. 10.1016/S1470-2045(07)70346-7.PubMedView ArticleGoogle Scholar
- Cardoso F, Van't Veer L, Rutgers E, et al: Clinical application of the 70-gene profile: the MINDACT trial. J Clin Oncol. 2008, 26: 729-735. 10.1200/JCO.2007.14.3222.PubMedView ArticleGoogle Scholar
- Ramsey SD, Veenstra D, Tunis SR, et al: How comparative effectiveness research can help advance 'personalized medicine' in cancer treatment. Health Aff (Millwood). 2011, 30 (12): 2259-68. 10.1377/hlthaff.2010.0637.PubMed CentralView ArticleGoogle Scholar
- Douma KF, Karsenberg K, Hummel MJ, et al: Methodology of constructive technology assessment in health care. Int J Technol Assess Health Care. 2007, 23: 162-168.PubMedView ArticleGoogle Scholar
- Schot JW: Constructive Technology assessment and Technology Dynamics: The Case of Clean Technologies. Science, Technology & Human Values. 1992, 17: 36-56. 10.1177/016224399201700103.View ArticleGoogle Scholar
- Schot J, Rip A: The Past and Future of Constructive Technology Assessment. Technological Forecasting and Social Change. 1996, 54: 251-268.View ArticleGoogle Scholar
- Ploem MC, Retèl VP, Linn SC, et al: Tumour tissue: who is in control?. Lancet Oncol. 2010, 11: 9-11. 10.1016/S1470-2045(09)70318-3.PubMedView ArticleGoogle Scholar
- Retèl VP, Bueno-de-Mesquita JM, Hummel MJ, et al: Constructive Technology Assessment (CTA) as a tool in coverage with evidence development: the case of the 70-gene prognosis signature for breast cancer diagnostics. Int J Technol Assess Health Care. 2009, 25: 73-83. 10.1017/S0266462309090102.PubMedView ArticleGoogle Scholar
- Retèl VP, Joore MA, Knauer M, et al: Cost-effectiveness of the 70-gene signature versus St. Gallen guidelines and Adjuvant Online for early breast cancer. Eur J Cancer. 2010, 46: 1382-1391. 10.1016/j.ejca.2010.02.035.PubMedView ArticleGoogle Scholar
- Goldhirsch A, Wood WC, Gelber RD, et al: Progress and promise: highlights of the international expert consensus on the primary therapy of early breast cancer 2007. Ann Oncol. 2007, 18: 1133-1144. 10.1093/annonc/mdm271.PubMedView ArticleGoogle Scholar
- Ravdin PM, Siminoff LA, Davis GJ, et al: Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol. 2001, 19: 980-991.PubMedGoogle Scholar
- Kuntz KM, Tsevat J, Weinstein MC, et al: Expert panel vs decision-analysis recommendations for post discharge coronary angiography after myocardial infarction. JAMA. 1999, 282: 2246-2251. 10.1001/jama.282.23.2246.PubMedView ArticleGoogle Scholar
- Ramwadhdoebe S, Van Merode GG, Boere-Boonekamp MM, et al: Implementation by simulation; strategies for ultrasound screening for hip dysplasia in the Netherlands. BMC Health Serv Res. 2010, 10: 75-10.1186/1472-6963-10-75.PubMedPubMed CentralView ArticleGoogle Scholar
- Garrison LP, Veenstra DL: The Economic Value of Innovative Treatments over the Product Life Cycle: the case of Targeted Trastuzumab Therapy for Breast Cancer. Value Health. 2009, 12: 1118-1123. 10.1111/j.1524-4733.2009.00572.x.PubMedView ArticleGoogle Scholar
- Rogers EM: Diffusion of Innovations. 2003, Free Press, New YorkGoogle Scholar
- Rutgers E, Piccart-Gebhart MJ, Bogaerts J, et al: The EORTC 10041/BIG 03–04 MINDACT trial is feasible: results of the pilot phase. Eur J Cancer. 2011, 47 (18): 2742-9. 10.1016/j.ejca.2011.09.016.PubMedView ArticleGoogle Scholar
- Royal Dutch Shell Company: . 2010, 7: 6-20. Available at: http://www.shell.com/home/content/aboutshell/our_strategy/shell_global_scenarios/dir_global_scenarios_07112006.html
- Wack P: Scenarios: uncharted waters ahead. Harvard Business Review. 1985, 63 (5): 73-89.Google Scholar
- Wack P: Scenarios: shooting the rapids. Harvard Business Review. 1985, 63 (6): 139-150.Google Scholar
- Oostenbrink JB, Koopmanschap MA, Rutten FFH: Manual for cost analyses, methods and standard prices for economic evaluations in health care. 2006, Dutch Health Insurance Executive Board, Amstelveen (The Netherlands), in DutchGoogle Scholar
- Buxton MJ: Economic Evaluation and Decision Making in the UK. Pharmacoeconomics. 2006, 24 (11): 1133-42. 10.2165/00019053-200624110-00009.PubMedView ArticleGoogle Scholar
- Lothgren M, Zethraeus N: Definition, interpretation and calculation of cost-effectiveness acceptability curves. Health Econ. 2000, 9: 623-630. 10.1002/1099-1050(200010)9:7<623::AID-HEC539>3.0.CO;2-V.PubMedView ArticleGoogle Scholar
- Fenwick E, Claxton K, Sculpher M: Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001, 10: 779-787. 10.1002/hec.635.PubMedView ArticleGoogle Scholar
- Grutters JP, Seferina SC, Tjan-Heijnen VC, et al: Bridging trial and decision: a checklist to frame health technology assessments for resource allocation decisions. Value Health. 2011, 14 (5): 777-84. 10.1016/j.jval.2011.01.005.PubMedView ArticleGoogle Scholar
- Vallejo-Torres L, Steuten LM, Buxton MJ, et al: Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach. Int J Technol Assess Health Care. 2008, 24: 459-464.PubMedView ArticleGoogle Scholar
- Retèl VP, Grutters JPC, van Harten WH, Joore MA: Value of research and value of development in early stages of development of new medical technologies. , Dissertation, available at: http://doc.utwente.nl/78236/
- Goldhirsch A, Ingle JN, Gelber RD, et al: Threshold for therapies: highlights of the St Gallen international expert consensus on the primary therapy of early breast cancer 2009. Ann Oncol. 2009, 20: 1319-1329. 10.1093/annonc/mdp322.PubMedPubMed CentralView ArticleGoogle Scholar
- Bojke L, Claxton K, Bravo-Vergel Y, et al: Eliciting distributions to populate decision analytic models. Value Health. 2010, 13: 557-564. 10.1111/j.1524-4733.2010.00709.x.PubMedView ArticleGoogle Scholar
- Lin C, Buxton MB, Moore D, et al: Locally advanced breast cancers are more likely to present as Interval Cancers: results from the I-SPY 1 TRIAL (CALGB 150007/150012, ACRIN 6657, InterSPORE Trial). Breast Cancer Res Treat. 2012, 132 (3): 871-879. 10.1007/s10549-011-1670-4.PubMedPubMed CentralView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.