Using evidence-based guidelines to inform service provision: a structured mapping exercise within the National Health Service Diabetes Prevention Programme in England
BMC Research Notes volume 11, Article number: 510 (2018)
The National Health Service (NHS) in England planned a national diabetes prevention programme (NHS DPP) with phased implementation. Evidence-based guidelines and service specifications support efficient and effective translation of research into practice. We aimed to evaluate the use of a structured mapping exercise to appraise how evidence, service specification and early phase practice could inform recommendations to guide subsequent implementation of the NHS DPP.
The mapping exercise facilitated comparison and appraisal of key components from different documentary sources (evidence-based NICE guidelines, service specification, and provider documents). Key components were categorised into (A) pathways into programmes, (B) intervention content (C) inequalities and (D) quality assurance and staff training. We identified where key components were the same (accordance), where they varied (discrepancies) and where they were lacking (discontinuities), across the documentary sources. For example there was discrepancy in intervention duration and discontinuity in intervention enrolment procedures. This mapping exercise was useful to compare the fidelity in translation of evidence-based guidance into service specification and programme documents, thus identifying where future service implementation might be improved. This method may be applicable for use with other health conditions where research evidence requires translation into real world population programmes.
The NHS 5 year forward view in England emphasised the need for ‘a radical upgrade in prevention and public health’ and included a plan for a national diabetes prevention programme (NHS DPP) .
The NHS DPP in England, for individuals at high risk of developing type 2 diabetes (T2D), was planned to be rolled out in phases (i) demonstrator site phase (seven sites in England), (ii) wave 1 (four procured providers in 27 sites across England, permitting 20,000 referrals in 2016/17) and (iii) wave 2 (nationally to the whole country by 2020 with an expected 100,000 referrals available each year). The stated objectives were reduction in incidence of T2D, blood glucose parameters and weight .
The NHS DPP service specification  was developed by NHS England using research evidence reviews and reports [3, 4], input from an Expert Reference group, a User Involvement group and analysis of the Health Survey for England data. The demonstrator site phase relied mostly on applications from local health economies, where relevant services were already being delivered, and was intended to inform subsequent implementation of the NHS DPP.
National Institute for Health and Care Excellence (NICE) guidelines are created to improve outcomes for those using health services . However, evidence-based guidelines do not necessarily result in the anticipated change in practice. Where guidance is available there are often gaps between evidence-based principles, contractual agreements around intervention commissioning and actual provision of services and interventions .
Translation of research into practice involves making sure research findings about effective treatments reach populations that can benefit and are implemented as intended . Reflection on the guidelines available and how these are implemented in practice is necessary to make best use of the recommendations in an applied setting .
Summary of the process evaluation of the demonstrator and wave 1 phases of the NHS DPP are reported elsewhere .
We aimed to appraise how evidence informed practice to guide subsequent implementation of the NHS DPP through a structured mapping exercise .
To conduct the mapping exercise we reviewed and extracted data from all the relevant evidence/documentary sources. The documentary sources used within the mapping method were:
NICE guidelines—PH38 preventing T2D guidance for individuals at high risk .
The draft NHS DPP service specification (demonstrator site phase).
The final NHS DPP service specification  (wave 1 phase).
All of the seven demonstrator site applications and Memoranda of Understanding (MoU) submitted to become part of the NHS DPP demonstrator site phase. Any provided baseline documentation from the seven sites.
All of the four procurements and Memoranda of Understanding (MoU) submitted to become a provider for the NHS DPP wave 1 phase. Any provided baseline documentation from the four providers was reviewed.
Data was extracted from the above documentary sources in relation to Key components. Components related to the whole of the programme were extracted to enable the complete T2D prevention pathway to be reviewed and synthesised. These included:
Pathways into the programmes (identification, recruitment, referral, enrolment)
Inequalities using PROGRESS equality indicators (place of residence, race/ethnicity/language, occupation, gender/sex, religion, education, socioeconomic status, social capital) 
Quality assurance and staff training (fidelity measures, resources, staffing, training requirements)
Information was extracted on staff or health care professional involvement at each stage of the programme and also areas of responsibility, i.e. training of delivery staff.
Structured mapping was used to collate the evidence and enable comparison of the findings across the different documentary sources. Initially we used a spreadsheet to facilitate the mapping process and we used recommendations in NICE guidance (PH38) to identify key components . The extracted data were then organised into tables (Table 1).
The mapping exercise drew on Structured Mapping Theory, which describes the use of mapping and how evaluation of the analogy gives a measure of the quality of match between the base and a target . Critical appraisal identified whether key components across and between the documentary sources were in:
Accordance—components that were common and reported across all documentary sources, e.g. the format of the intervention (face-to-face group sessions).
Discrepancies—components that varied across documentary sources, e.g. duration or intensity of the intervention.
Discontinuities—components that did not appear across all documentary sources, e.g. intervention enrolment procedures.
We used the Accordance, Discrepancies, Discontinuities (ADD) ‘ADD-Fuse’ method outlined above, which was developed during the NHS DPP demonstrator and wave 1 phase evaluation projects, to facilitate critical appraisal. Critical appraisal identified where programmes or specifications consistently met the desired criteria or where differences or gaps were present and therefore where improvements could be recommended. Recommendations were formulated from the appraisal process and provided to the NHS DPP management team to inform subsequent phases (Additional file 1). Using this mapping exercise on two different phases of the NHS DPP showed how the programmes and service specifications progressed between these phases.
The mapping exercise was completed independently by two reviewers with expertise in behaviour change interventions and checked by a third reviewer in both phases, any disparities were resolved through discussion. However, we found that the clear specification of key components and the agreed classification as Accordance, Discrepancy and Discontinuity for each key component across each documentary source led to a high degree of consistency between reviewers. The data collection and methodology are summarised in a flow chart (Fig. 1).
Table 1 provides an example of how the mapping exercise was conducted.
Table 1 illustrates how the mapping exercise facilitated the identification of key components, actors and responsibilities within the NICE guidelines, NHS DPP service specification and NHS DPP provider documentation (the applied setting/context). Tables were then used to compare and contrast across the different documentary sources.
We described this method as identifying Accordance, Discrepancies and Discontinuities (the ADD-Fuse method), which was used to highlight the key commonalities, differences and gaps between the documentary sources (Table 2).
Table 2 illustrates how the identification of accordance, discrepancies and discontinuities (ADD-Fuse method) led to the formulation of recommendations for improvements in relation to the NHS DPP service specification, the planned implementation of the DPPs (provider documents) or both. Recommendations were provided to the NHS DPP Management team and responses to the recommendations were received from the Management team back to the research team (Additional file 1). This method identified key components in the service specification that impact on implementation.
In both the demonstrator and wave 1 phases, the format of the intervention was in accordance with the NHS DPP service specification (in person group sessions).
The reporting of the content of the face-to-face sessions, the level of detail on outcomes, mechanisms of action and techniques used varied greatly between providers. As outlined in Tables 1 and 2 discrepancies were identified in the duration and intensity of the intervention provided in both phases (demonstrator and wave 1). One wave 1 provider did not meet the required standard for duration and intensity, which varied across the four providers. This variation poses an issue for outcome evaluation across the provider interventions. Therefore monitoring of patient contacts is vital to ensure clarity in intervention provision and the impact of this on intervention outcomes.
A gap (discontinuity) in the draft NHS DPP service specification was identified at the demonstrator phase for the description of behaviour change techniques (BCTs) when compared with recommendation s in NICE guidelines (Table 1). However, by wave 1 more detailed BCT description was requested in the NHS DPP service specification, all providers incorporated the recommended BCTs, and most used additional evidence-based techniques for sustained behaviour change. Detail on additional contact with patients (i.e. telephone support, text messages or social media contact) outside of the standard in group sessions was an identified discontinuity in wave 1 provider documents. The remote contact and materials used, including digital components, should be described with the same level of detail as the other components, including reference to the specific behavioural outcomes, theoretical basis and techniques used. While this level of detail was recommended in the NHS DPP national service specification, the providers did not provide it in such detail.
Evidence-based documentary sources were used to examine incorporation of evidence in the planned context of the NHS DPP programme. Comparison identified accordance, discrepancies and discontinuities (ADD-Fuse method). Different components, actors and responsibilities that may impact the implementation and evaluability of the NHS DPP were revealed. This process identified recommendations (Additional file 1), informing subsequent phases of the NHS DPP, as to where further clarification and consideration was required to either improve the service specification and/or support the transition of evidence into practice.
Comparison with other studies
Evidence-based lifestyle interventions to prevent or treat diabetes have been shown to be effective and have the potential to reduce morbidity and mortality rates [17,18,19,20]. A difficulty in translating DPP’s into practice is the need to adapt to all patients, clinicians or setting needs. As all local services need to adapt for the diverse UK population it is vital to monitor intended variations as well as unintended variations that occur during implementation, highlighting the importance of process evaluations . A previous review identified translational strategies and cultural adaptations were frequency used to in order for DPP’s to reach diverse populations and those from disadvantaged socioeconomic backgrounds, e.g. adapting materials (including information on local foods or traditional physical activities), reducing the frequency of classes or using community health workers to deliver classes. This review stated how adaptations often go unreported and supports the use of a structured approach to documenting translation, as offered in this current manuscript, to facilitate identification of implementation and effectiveness .
Mapping two stages of the NHS DPP (demonstrator phase and wave 1) made it possible to trace the progression of a new service as the phases were rolled out in England and observe changes in the NHS DPP service specification over time. The mapping exercise evaluated the programme as a whole, informing on wider aspects of a health improvement programme that could be improved, which would not be assessed if focused solely on the intervention.
Variance in delivered programmes is likely to have an impact on the assessed outcomes. This structured mapping exercise has utility for implementation science and real-world programmes in explaining differences in outcomes based on specific components of the interventions and how each programme is implemented in relation to the service specification. This method could also enable the identification of key areas that require improvement. The mapping exercise examined the progression of a national programme rollout, identifying how the service specification developed from a draft to a final document (e.g. incorporating greater detail on the inclusion of BCTs and addressing inequalities). This mapping exercise could be utilised in further rollout of the NHS DPP. This process could be used for the development of future service specifications and in the reporting of behaviour change programmes. Fidelity measures need to be established in order to judge whether implementation of a programme meets the required standards.
A mapping exercise was applied in the context of the NHS DPP in England. Using NICE guidelines allowed the service specification and provider documents to be examined in relation to the evidence base. This enabled identification of whether the implementation of a new health care programme may experience problems owing to shortcomings in the service specification or whether problems lie within the transition from evidence into practice. We suggest the method may be applicable for use within other disease or health conditions where research evidence requires translation into real world population programmes.
The strength of the evidence base varies across different health conditions and therefore using a mapping exercise like this may not be applicable to programmes that do not have existing evidence-based guidelines and where the evidence is minimal or of poor quality.
The NHS DPP explicitly entered other sources of evidence into the specification development (users, experts, new evidence syntheses) and this has implications for how closely the programme tracks the research evidence. There are of course reasons for doing this, for example practicality and funding can impact greatly, but this brings risks that the key components that make an intervention effective become diluted.
Since the mapping exercise additional evidence has become available, in particular the 2017 update to the NICE PH38 guidelines . Data extraction relied on information provided from demonstrator site and wave 1 providers.
behaviour change techniques
diabetes prevention programme
National Health Service
- NHS DPP:
National Health Service Diabetes Prevention Programme
National Institute for Health and Care Excellence
type 2 diabetes
NHS England. Public health England, monitor, Health Education England, the care quality commission, NHS Trust Development Authority: NHS 5 year forward view. London: Public health England; 2014.
NHS England. NHS DPP national service specification, vol. 17. London: NHS England; 2015.
Public Health England. NHS diabetes prevention programme (NHS DPP) non-diabetic hyperglycemia. National cardiovascular intelligence network. London: PHE; 2015.
Public Health England. A systematic review and metaanalysis assessing the effectiveness of pragmatic lifestyle interventions for the prevention of type 2 diabetes mellitus in routine practice. 2015. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/456147/PHE_Evidence_Review_of_diabetes_prevention_programmes-_FINAL.pdf. Accessed 31 May 2016.
What we do [https://www.nice.org.uk/about/what-we-do]. Accessed 16 May 2016.
Michie S, Johnston M. Changing clinical behaviour by making guidelines specific. BMJ. 2004;328(7435):343–5.
Woolf SH. The meaning of translational research and why it matters. JAMA. 2008;299(2):211–3.
Graham ID, Harrison MB. Evaluation and adaptation of clinical practice guidelines. Evi Based Nurs. 2005;8(3):68–72.
Penn L, Rodrigues A, Haste A, Marques MM, Budig K, Sainsbury K, Bell R, Araújo-Soares V, White M, Summerbell C, Goyder E, Brennan A, Adamson AJ, Sniehotta FF. NHS Diabetes Prevention Programme in England: formative evaluation of the programme in early phase implementation. BMJ Open. 2018;8(2):e019467. https://doi.org/10.1136/bmjopen-2017-019467.
Gentner D. Structure-mapping: a theoretical framework for analogy. Cogn Sci. 1983;7:155–70.
National Institute for Health and Clinical Excellence. PH 38 preventing type 2 diabetes—risk identification and interventions for individuals at high risk. London: National Institute for Health and Clinical Excellence; 2012.
Davidson K, Goldstein M, Kaplan R, Kaufmann P, Knatterud G, Orleans C, Spring B, Trudeau K, Whitlock E. Evidence-based behavioral medicine: what is it and how do we achieve it? Ann Behav Med. 2003;26(3):161–71.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.
O’Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, Evans T, Pardo Pardo J, Waters E, White H, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014;67(1):56–64.
NICE NIfHaCE. PH 38 preventing type 2 diabetes—risk identification and interventions for individuals at high risk. London: NICE NIfHaCE; 2012.
Ashra NB, Spong R, Carter P, Davies MJ, Dunkley A, Gillies C, Greaves C, Khunti K, Sutton S, Yates T, et al. A systematic review and meta-analysis assessing the effectiveness of pragmatic lifestyle interventions for the prevention of type 2 diabetes mellitus in routine practice. London: Public Health England; 2015.
Costa B, Barrio F, Cabré JJ, Piñol JL, Cos X, Solé C, Bolíbar B, Basora J, Castell C, Solà-Morales O, et al. Delaying progression to type 2 diabetes among high-risk Spanish individuals is feasible in real-life primary healthcare settings using intensive lifestyle intervention. Diabetologia. 2012;55:1–10.
Li G, Zhang P, Wang J, Gregg EW, Yang W, Gong Q. The long-term effect of lifestyle interventions to prevent diabetes in the China Da Qing diabetes prevention study: a 20-year follow-up study. Lancet. 2008;371(9626):1783–9.
Penn L, White M, Lindström J, den Boer AT, Blaak E, Eriksson JG, Feskens E, Ilanne-Parikka P, Keinänen-Kiukaanniemi SM, Walker M, et al. Importance of weight loss maintenance and risk prediction in the prevention of type 2 diabetes: analysis of European diabetes prevention study RCT. PLoS ONE. 2013;8(2):e57143.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.
Tabak RG, Sinclair KA, Baumann AA, Racette SB, Sebert Kuhlmann A, Johnson-Jennings MD, Brownson RC. A review of diabetes prevention program translations: use of cultural adaptation and implementation research. Transl Behav Med. 2015;5(4):401–14.
National Institute for Health and Clinical Excellence. PH38 update: type 2 diabetes: prevention in people at high risk. London: National Institute for Health and Clinical Excellence; 2017.
AH, LP, AMR, MMM, and KB conducted the data collection, extraction and analysis. AJA, FFS, MW, CS, RB and LP designed the study and accessed funding. All authors read and provided feedback on previous versions. All authors read and approved the final manuscript.
We thank the NHS Diabetes Prevention Programme (NHS DPP) demonstrator sites, wave 1 providers and the NHS Diabetes Prevention Programme Management Group for access to documentation supplied by the various organisations through the NHS DPP demonstrator site and wave 1 application procedures. In particular, we thank the NHS DPP demonstrator and wave 1 site key contact personnel, providers and members of the NHS DPP Management Group for their help and co-operation with our research.
This is a paper of independent research funded by the NIHR SPHR. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Consent for publication
Ethics approval and consent to participate
This formative evaluation of the NHS Diabetes Prevention Programme demonstrator site phase is funded via the National Institute for Health Research School for Public Health Research.
The National Institute for Health Research School for Public Health Research (NIHR SPHR) is a partnership between the Universities of Sheffield, Bristol, Cambridge, UCL; The London School for Hygiene and Tropical Medicine; The Peninsula College of Medicine and Dentistry; the LiLaC collaboration between the Universities of Liverpool and Lancaster and Fuse; The Centre for Translational Research in Public Health, a collaboration between Newcastle, Durham, Northumbria, Sunderland and Teesside Universities.
AH, LP, AR, CS, AJA and FFS are members of Fuse, the Centre for Translational Research in Public Health (http://www.fuse.ac.uk). Fuse is a UK Clinical Research Collaboration (UKCRC) Public Health Research Centre of Excellence. Funding for Fuse from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, under the auspices of the UKCRC, is gratefully acknowledged. (Fuse Grant Reference Number is: MR/K02325X/1).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Haste, A., Penn, L., Rodrigues, A.M. et al. Using evidence-based guidelines to inform service provision: a structured mapping exercise within the National Health Service Diabetes Prevention Programme in England. BMC Res Notes 11, 510 (2018). https://doi.org/10.1186/s13104-018-3546-8