- Research article
- Open Access
Healthy ageing in Europe: prioritizing interventions to improve health literacy
BMC Research Notes volume 9, Article number: 270 (2016)
Health literacy (HL) is low for 40–50 % of the population in developed nations, and is strongly linked to many undesirable health outcomes. Older adults are particularly at risk. The intervention research on health literacy in ageing populations project systematically created a large inventory of HL interventions targeting adults age 50+ , to support practical production of policy and practice guidelines for promoting health literacy in European populations.
We comprehensively surveyed international scientific literature, grey literature and other sources (published 2003+) for implemented HL interventions that involved older adults. Studies were screened for eligibility criteria and further selected for aspects important in European public health policy, including priority diseases, risk factors and vulnerable target groups. Interventions were prioritised using a multiple criteria tool to select final interventions that also featured strong evidence of efficacy and a broad range of strategies.
From nearly 7000 written summaries, 1097 met inclusion criteria, of which 233 were chosen for scoring and ranking. Of these, seven had the highest multi-criteria scores. Eight more articles were selected based on rounded criteria including a high multi-criteria score as well as elements of innovation. Final selections were 18 articles describing 15 programmes, which feature strong evidence of efficacy among important diseases or risk factors and vulnerable groups, or that had success with elements of innovation were identified. Most programmes tried to increase skills in communication, self-management and understanding healthcare or lifestyle choices.
These programmes have multiple positive attributes which could be used as guidance for developing innovative intervention programmes to trial on European older adults. They provide evidence of efficacy in addressing high priority diseases and risk factors.
Health literacy (HL) may be defined as “the degree to which people are able to access, understand, appraise, and communicate information to engage with the demands of different health contexts to promote and maintain health across the life-course” . Other definitions of HL and practical intervention models have been presented [2–6], but the largest body of research follows Nutbeam , who proposed three sequential levels: functional HL (meaning the most basic literacy and numeracy skills applied to health matters), interactive HL (emphasis on communication skills with and use of information sources), and critical health literacy (which includes evaluation of risks and benefits).
Health literacy is considered relatively low for a high percentage (40–50 %) of the population in developed nations [8–10]. There are strong links between poor health literacy and undesirable impacts on a wide-range of health indicators and outcomes . Low HL may impose additional costs of 3–5 % onto total national health care budgets . In recent years European public health bodies have repeatedly called for coordinated approaches to addressing health literacy issues in the European Union (EU) [13, 14], and several EU-wide surveys have been commissioned to gauge HL deficits [5, 15]. Older adults tend to have especially low health literacy , and people over 65 may be considered in their entirety as a vulnerable group.
The Intervention Research on Health Literacy in Ageing populations (Irohla) project was funded for 3 years by the European Union (EU) as part of the seventh framework programme. Many (thousands of) peer-reviewed articles have described health literacy interventions that include older adults. Irohla’s ultimate aim was to identify, test and recommend from this large group of studies a maximum of twenty interventions for improving health literacy in older adults (age 50+), as part of larger EU-wide initiatives to promote healthy ageing. Conducting a systematic search and creating a comprehensive inventory was an important methodological task in Irohla, from which a shortlist of promising interventions could later be recommended for adaptation, piloting and implementation within European countries. Interventions were searched for in health care settings or delivered by health care professionals, as reported in scientific or grey literature or in other sources, and which included older adults (age 50+). We developed and applied a multi-criteria selection tool to identify fifteen interventions with the best balance of priority targeting, good quality design, efficacy and innovation (i.e., novel strategies or approaches for enhancing HL), and recommended these programmes for subsequent development and practical implementation in EU countries.
The phrase and concept of “health literacy” is most established among English- and Spanish-speaking professionals. Irohla  conceptualised how the HL concept might be articulated in other languages and cultures, and also identified relatively unusual and hence innovative strategies in previous HL research. Furthermore, the Irohla intervention model of health literacy (IIMHL; [17, 18]) strove to balance the situated nature of the individual older person (and family) in their broader social, economic and cultural context with those of the health professional within the health system. Thus, our search was not merely for studies that used the words “health literacy” but rather for health promotion efforts that had any element of the IIMHL, including patient education about health, informed decision making, skills acquisition, strengthening relevant social networks, removing barriers or efforts to increase patient empowerment at the system level.
The IIMHL itself is underpinned by a detailed taxonomy of health literacy that includes seven objectives classified as modifiable determinants applicable at the individual or system level such as: enablement through information, education and skills development; behavioural, social and contextual support; professional development; and, environmental change or enhancement (see Additional file 1: Table S1 and . The systematic survey reported here is the application of the Irohla model to identify relevant intervention reports, followed by mixed selection methods to identify the very best interventions to form the most promising basis for creating future health literacy promotion programmes in the diverse nations of the European continent.
Data sources and search methods
The search involved keyword searches (Table 1) within these scientific databases: OVID (part of the Medline group of literature archives), CINAHL and Scopus. The search of scientific databases took place in September 2013. Supplemental searches of specific scientific databases, expert suggestions and grey literature on the Internet were undertaken from September 2013 until 31 Jan 2014. Specific databases for clinical trials, health promotion programmes and previous evidence-based reviews were searched (see list Additional file 1: Box S2). Stakeholders and expert contacts were asked for details about active intervention programmes with a custom-designed online form. Grey literature was searched using the Google advanced search engine (Additional file 1: Box S3). The Internet/grey literature search was duplicated in Dutch, Greek, Italian, Polish, Swedish, Finnish, Spanish and French and German. Results from the first three pages of each Google search return were screened for relevant interventions. There was also a specific English-language search for health literacy interventions among disadvantaged European ethnic minorities within OVID, Google open search (screened first three pages of results only) and Google Scholar using the phrase:
(“Ethnic minority” OR Asian OR Moroccan OR Turkish OR Roma OR Gypsies) AND (European OR Europe OR European-country name) AND (health promotion).
Both scientific and supplemental searches found many review and policy documents that cited evidence from multiple interventions. Most of the review or policy documents, especially if they had specific keywords such as “older adults” (see full list of keywords in Additional file 1: Box S4), were also hand-searched for further relevant intervention studies (a process known as “snowballing”). Items were included after duplicate screening of title and abstract (or other summary information) if they seemed to feature health literacy strategies and objectives as defined by Irohla Consortium , and these inclusion criteria:
Any European language, but abstract or summary available in English;
publication year = 2003+;
target group must not exclude people age 50+;
target group must reside in a developed and predominantly western-culture country (North American, antipodean or European continent outside of Russian Federation and Turkey);
In addition, an implemented, evaluated and complete intervention programme that must report outcomes, thus precluding papers that merely identified associations, barriers, needs or ideas about variations in usual practice. Examples of typical outcomes were medication adherence, increase in physical activity, self-monitoring activities (such as blood glucose levels for diabetics), and increases in disease knowledge.
Screening and further selection
Entries were screened independently by two reviewers (JB and AM, BG or MS) on title and abstract for inclusion criteria, with disagreements resolved upon referral to a third screener (TK) or by discussion. Most review or policy documents which had specific relevant keywords were also hand searched for additional intervention studies that met the inclusion criteria.
The research objective was to choose a relatively small number (<20) of the most promising (and relevant to European priorities) HL intervention programmes to form the basis for practical adaptation and trialling in European populations. Key relevant European public health priorities are many, including: to develop innovative interventions to promote adoption of healthy lifestyles [20, 21], to redress health inequalities between social groups [22, 23], to recommend practical policies and programmes with best evidence of efficacy [21, 24], and to increase lifespans and promote healthy ageing, particularly by addressing the needs of people living with chronic disease .
Hence, from our initial inventory of all HL interventions, we identified (from screening title and abstracts) those articles that addressed the most important (in terms of causes of premature death or disability in Europe) diseases or risk factors , and that targeted or reported positive changes for vulnerable sub-groups (see item Additional file 1: S5). Next, interventions were assessed by reading the full text of each article and using an 8-point multi-criteria scoring form (MCSF; validity of MCSF methodology is documented in ) devised by the authors to further distinguish the most promising and effective interventions that addressed as many aspects of these European public health priorities as possible. Our MCSF questions with instructions are in supplemental files (item Additional file 1: S5). The MCSF questions allowed for a balance of European public health priorities, including: Innovation (see question 1); evidence of testing among vulnerable groups (questions 2 and 3); evidence of improvements in knowledge, behaviour or patient well-being (questions 4, 5 and 6); duration of impacts (question 7); and, quality of study design and evidence (question 8). Each individual question was given a score of 1 (yes) or 0 (no). Total scores were given to each article by at least two independent readers who had read the full article. The scorers were the authors and Irohla partners (see acknowledgements). A final total MCSF score was determined for each article by resolving disagreements via discussion or with reference to a third scorer. Interventions with final scores above five were further evaluated for breadth of strategies they adopted to improve HL, including use of relatively innovative or new methods, as identified by the Irohla model of health literacy [17, 19]. Hence, in addition to the articles which had the highest multi-criteria scores, final selections were made because of included breadth of strategies employed or rarity of that strategy (hence possible innovation), or those items that best targeted health professionals who are important but relatively rare targets for health literacy interventions.
No ethics approval was required for this systematic survey. Statements regarding ethics approval were clearly stated in most if not all of our selected articles.
In total, 6989 intervention descriptions were found from combined sources (with a small number of duplicates between different types of sources). Most articles (5561 unique reports) came from the scientific literature search. Snowballing revealed a further 421 items in review and policy documents, 371 items came from the English-language Internet search. An additional 53 items were found from the specific searches for articles about disadvantaged European ethnic minorities. Over 500 articles were found and screened from all other sources. Figure 1 shows the selection procedure in (PRISMA style ) flow chart format with 1097 items meeting initial inclusion criteria; a PRISMA checklist is available in Additional file 1: Table S6. The main reasons for exclusion were lack of testing on older adults, targets in an ineligible country or, not relevant to health literacy. A total of 233 items were shortlisted for multi-criteria scoring on full text because they featured priority risk factors or diseases, and targeted vulnerable subgroups. The distribution of multi-criteria scores is shown in Additional file 1: Figure S7. Ultimately, the threshold point for choosing the highest scoring programmes was decided based on the distribution of actual scores achieved and the project goal to select only a small number of the most balanced interventions for future testing. More than thirty articles had scores of 6 or above on the multi-criteria scoring form. Seven articles, describing six different programmes, scored 7 or higher. These highest scoring articles were prioritised and supplemented with other interventions to produce a final list of promising interventions that met the comprehensive range of objectives detailed in the IIMHL.
It was desirable that the final chosen programmes offer diverse strategies and address a broad range of diseases and risk factors to ensure study findings have relevance across individual EU countries and communities. After multi-criteria scoring, 15 intervention programmes described in 18 articles were selected as having the best balance of desirable traits, because they demonstrated efficacy among vulnerable target sub-groups, innovative approach to improving HL, greater duration or significance of impacts. These interventions either had the highest scores (multi-criteria score = 7 or greater, n = 7) or at least one of the following traits: a high breadth of intervention strategies (n = 5), especially uncommon strategies (n = 9), possessed the highest multi-criteria scores of those articles concerned with communication with professionals (n = 2) and/or focused on prevention of disease (n = 7). Table 2 summarises the frequency of which strategies were adopted and some target information, while Table 3 lists the final selected interventions.
Characteristics of selected studies
Most of the intervention participants were in urban communities of the United States. Other interventions took place in Canada , the United Kingdom [30, 31] and Austria . The selected interventions address a range of diseases and risk factors, but particularly type 2 diabetes, living with chronic illness, hypertension or cardiovascular disease, and healthy lifestyle changes. Five projects (in six reports) were randomised controlled trials [30, 33–37]. The rest were cohort studies. Most articles tested for statistically significant differences between intervention arms or improvements before and after intervention, and most had modest but statistically significant improvements in aspects of health literacy, such as health knowledge, skills, self-efficacy, quality of communication with health professionals or quality of life outcomes. Six articles [30, 34, 35, 38–40] did not report statistically significant intervention improvements in health-literacy or patient wellbeing outcomes, but were able to cite other benefits such as increased patient satisfaction. Most interventions involved multiple incidences of delivery (i.e., two or more contact sessions with health professionals), but two interventions were single occasion delivery only [35, 39]. Follow-up measurements were taken between 20 min and 24 months post-intervention. The most common intervention format (five programmes in six papers: [29, 34, 36, 37, 41–43]) was an intensive and individualised support programme. These interventions were especially telephone-based (telemedicine), to help people with limited literacy better manage chronic disease or risk factors such as obesity, poor nutrition or lack of physical activity. The chronic disease self-management programme also features twice, in both the United States and the United Kingdom [30, 44]; this is a short series of group sessions to help people manage chronic illness, led by qualified peer support lay health leaders.
Two papers [31, 32] describe community outreach programmes to promote overall active ageing, particularly among vulnerable cultural minorities. Sudore et al.  and Pruthi et al.  describe low literacy approaches to aid decision-making, and reduce decision conflict, about breast cancer screening and end of life care. Cooper et al.  and Lu et al.  present action plans to foster better self-assertiveness skills among patients when communicating with health professionals, about either cancer screening or general health questions. Medical staff received individualised feedback and guidance about improving their consultations skills via the mechanisms of video-monitoring and consultations with standardised patients in three projects described in four articles [33, 40, 45, 46]. Pruthi et al.  describes community action initiatives to increase awareness and action (to increase mammography screening rates). Together, these 15 programmes described in 18 articles offer a range of diverse strategies and approaches to improving health literacy in older adults.
From almost 7000 studies in many western-culture countries, 15 programmes were identified with promising attributes that could be used as guidance for developing innovative intervention programmes to trial on European older adults. The selected items have multiple positive elements. They provide evidence of efficacy in addressing high priority diseases and risk factors as well as the public health policy goal of disease prevention. They describe success in patient groups that are vulnerable or in health professionals trying to address a clinical risk factor. The selected interventions present a wide breadth of health promotion strategies and address diverse health problems. The interventions collected through this comprehensive and systematic survey are supported by multi-cultural theoretical and practical health promotion frameworks [47–49].
Virtually all interventions which scored highly in the multi-criteria scoring exercise aimed to educate, improve patient skills and motivate. Cultural adaptations and actions to change the physical environment (such as paying for travel expenses) were also common. Although target groups in the final interventions are both older adults and professionals, health professionals are much less often the targets of health literacy studies in well-evaluated and documented research, although health literacy often features in professional training . Only six of the final interventions featured the involvement of patients at a systems level (strategy No. 5 in Table 2); previous research showed this to be the rarest strategy in HL interventions . Yet, this particular strategy may be the most crucial to reducing the deleterious impacts that poor health literacy has upon population health outcomes. We lack space to fully explore the relevant debates, but it is worth noting that health literacy is not always seen as an individual responsibility. Salter et al. (2014) explored the heavy health literacy burden that modern health care systems impose particularly on older adults with chronic illness. Hence, an emphasis in public health programmes on individual health literacy may occur at the expense of ignoring the social determinants of health  and poor HL may be seen as a result of poor health care delivery . It has even been argued that health literacy interventions would be better viewed as treatment rather than education . There is also evidence to suggest that at least some interventions, even those in randomised controlled trial format, have negligible impacts and relevance due to poor planning before and insufficient process evaluation after implementation [54, 55].
For now, building on the search and grading work described here, the Irohla project intends to recommend interventions that are most likely to be successful for older adults in Europe. Recommendations will combine the replication of some interventions previously shown as successful, but with further evidence for suitable social and cultural adaptations .
Strengths and limitations
We do not know of a similar inventory to the one which we created, or of a similar effort to assess suitability from so many intervention programmes to identify a small number that are best for trial in the European context. Our approach was necessarily driven by the practical needs and objectives of the funders to promote healthy ageing. The diversity of selected interventions, in terms of implementation plans, delivery modes and frequency, as well as duration of measured impacts, is valuable. To be readily adaptable for culturally diverse European populations with increasingly complex health needs and risk factors due to ageing demographics [56, 57], health literacy interventions recommended by Irohla need to be flexible and multi-faceted.
Inevitably, the selection process was adapted to the data available and to the demands of the development process needed to inform future practical EU guidance. Search terms were necessarily limited and meant, for instance, that relatively few studies were found about some widely used communication methods such as Teach Back [58, 59]. We lacked resources to hand search all review documents and had to prioritise those with relevant key words about target groups or conditions. The search was reliant on indexing conventions in scientific databases as well as the content of abstracts and titles; as a result inadequate reporting in some abstracts  means that some promising interventions may have been missed. However, we attempted to overcome this by seeking expert opinion, checking reference lists of other papers, searching for national guidelines etc.
Response from the expert survey (to obtain information on tested but unpublished interventions) was low. Non English-language Internet results were generally less useful than those available in the English language. Importantly, the phrase and concept health literacy has not been widely adopted by European public health agencies which led to some subjectivity when screening and applying eligibility criteria. Ethnic minorities specific to the United States (Hispanics and African Americans) were frequent participants in the selected interventions; one of the subsequent challenges for Irohla will be how to appropriately adapt the principles of these successful programmes for use among European ethnic and minority groups.
Our multi-criteria scoring was probably weighted in favour of studies with demonstrable improvements in outcomes rather than type of evidence, duration of interventions or innovation. This may be a strength or a limitation of our work (depending on what priorities are foremost in mind of the reader). We were also not able to rigorously evaluate innovative but untested intervention ideas.
From thousands of intervention studies, we identified 15 promising programmes that featured strong evidence of efficacy among important diseases or risk factors and vulnerable groups, or that had some evidence of success and important innovation in older populations. To narrow down such a large group of items to such a small selection was challenging and the choices may never be perfect, but they should suggest a broad range of evidence-based approaches for future intervention development and testing on the diverse European continent. HL interventions that work elsewhere may not be able to deliver similar results among European populations. The interventions that we have prioritized are those with (some) evidence of efficacy, targeted at vulnerable groups with health conditions important to the European older adult population.
Unfortunately, health literacy interventions tend to lack rigorous study design [61, 62] and therefore it is premature  to try to select the very best health literacy interventions Nevertheless, five of our final selected projects featured the highest standard of clinical evidence of possible success (i.e., from a randomised control trial, or RCT). More clearly-reported research in the RCT format would be welcome. The observed potential lack of compelling evidence presents an opportunity to test both established and innovative ideas under a robust study design.
cumulative index to nursing and allied health literature
Irohla intervention model of health literacy
intervention research on health literacy in ageing populations
multi-criteria scoring form
randomised controlled trial
Kwan B, Frankish J, Rootman I, Zumbo B, Kelly K, Begoray D, Kazanijan A, Mullet J, Hayes M. The development and validation of measures of “health literacy” in different populations. UBC Institute of Health Promotion Research and University of Victoria Community Health Promotion Research 2006.
Jochelson K. Health literacy review paper. London: National Social Marketing Centre; 2007.
Nutbeam D. The evolving concept of health literacy. Social Sci Med. 2008;67(12):2072–8.
Peerson A, Saunders M. Health literacy revisited: what do we mean and why does it matter? Health Promot Int. 2009;24(3):285–96.
Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, Brand H. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12(1):80.
Salter C, Brainard J, McDaid L, Loke Y. Challenges and opportunities: what can we learn from patients living with chronic musculoskeletal conditions, health professionals and carers about the concept of health literacy using qualitative methods of inquiry? PLoS One. 2014;9(11):e112041.
Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15(3):259–67.
ABS: experimental estimates and projections, aboriginal and Torres strait islander Australians, 1991–2021 vol. Cat. No. 3238.0: Australian Bureau of Stastistics; 2009.
HLS-EU Consortium: comparative report of health literacy in eight EU member states. The European Health Literacy Survey HLS-EU; 2012.
Paasche-Orlow MK, Parker RM, Gazmararian JA, Nielsen-Bohlman LT, Rudd RR. The prevalence of limited health literacy. J General Intern Med. 2005;20(2):175–84.
Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97–107.
Eichler K, Wieser S, Brügger U. The costs of limited health literacy: a systematic review. Int J Public Health. 2009;54(5):313–24.
EurActiv: resilient and innovative EU health systems: special report; 2013.
European patients forum: making health literacy a priority in EU policy. http://www.eu-patient.eu/globalassets/policy/healthliteracy/health-literacy-concept-paper_final.pdf. Accessed 12 Dec 2014.
European commission: European citizens’ digital health literacy. 2014: 221.
Bostock S, Steptoe A. Association between low functional health literacy and mortality in older adults: longitudinal cohort study. BMJ. 2012;344:e1602.
Irohla consortium: overview of activities and results of WP2 deliverable D2.2; 2013.
Irohla consortium: IROHLA project progress report, community research and development information service. http://cordis.europa.eu/docs/results/305/305831/periodic1-irohla-project-progress-report-public-summary.pdf. Accessed 15 Feb 2016.
IROHLA consortium: IROHLA project progress report: public report June 2014. vol 1; 2014.
Sørensen TIA. Report of the independent expert group on the future of European public health research: European commission; 2013.
European commission. On effective, accessible and resilient health systems. European commission: Brussels; 2014.
European commission: European platform against poverty and social exclusion. http://ec.europa.eu/social/main.jsp?catId=961&langId=en&moreDocuments=yes. Accessed 11 Feb 2015.
Marmot M, Allen J, Bell R, Bloomer E, Goldblatt P. WHO European review of social determinants of health and the health divide. Lancet. 2012;380(9846):1011–29.
Guest C, Ricciardi W, Kawachi I, Lang I. Oxford handbook of public health practice. Oxford: Oxford University Press; 2013.
EIP-AHA. European scaling-up strategy in active and healthy ageing; 2014.
World Health Organization. Global health risks: mortality and burden of disease attributable to selected major risks. World Health Organization; 2009.
Husereau D, Boucher M, Noorani H. Priority setting for health technology assessment at CADTH. Int J Technol Assess Health Care. 2010;26(3):341–7.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151(4):W-65–94.
Laforest S, Nour K, Parisien M, Poirier M-C, Gignac M, Lankoande H. “I’m Taking Charge of My Arthritis”: designing a targeted self-management program for frail seniors. Phys Occup Ther Geriatr. 2008;26(4):45–66.
Griffiths C, Motlib J, Azad A, Ramsay J, Eldridge S, Feder G, Khanam R, Munni R, Garrett M, Turner A. Randomised controlled trial of a lay-led self-management programme for Bangladeshi patients with chronic disease. Br J General Prac. 2005;55(520):831–7.
Mathews G, Alexander J, Rahemtulla T, Bhopal R. Impact of a cardiovascular risk control project for South Asians (Khush Dil) on motivation, behaviour, obesity, blood pressure and lipids. J Public Health. 2007;29(4):388–97.
Active ageing. Aktiv ins Alter! Investition in die Gesundheit älterer Menschen; 2008.
Cooper LA, Roter DL, Carson KA, Bone LR, Larson SM, Miller ER III, Barr MS, Levine DM. A randomized trial to improve patient-centered care and hypertension control in underserved primary care patients. J General Intern Med. 2011;26(11):1297–304.
DeWalt DA, Schillinger D, Ruo B, Bibbins-Domingo K, Baker DW, Holmes GM, Weinberger M, Macabasco-O’Connell A, Broucksou K, Hawk V. A multisite randomized trial of a single-versus multi-session literacy sensitive self-care intervention for patients with heart failure. Circulation 2012. doi:10.1161/CIRCULATIONAHA.111.081745.
Sudore RL, Landefeld CS, Barnes DE, Lindquist K, Williams BA, Brody R, Schillinger D. An advance directive redesigned to meet the literacy level of most adults: a randomized trial. Patient Educ Counsel. 2007;69(1):165–95.
Schillinger D, Hammer H, Wang F, Palacios J, McLean I, Tang A, Youmans S, Handley M. Seeing in 3-D: examining the reach of diabetes self-management support strategies in a public health care system. Health Educ Behav. 2008;35(5):664–82.
Schillinger D, Handley M, Wang F, Hammer H. Effects of self-management support on structure, process, and outcomes among vulnerable patients with diabetes a three-arm practical clinical trial. Diabetes Care. 2009;32(4):559–66.
Pruthi S, Shmidt E, Sherman MM, Neal L, Wahner-Roedler D. Promoting a breast cancer screening clinic for underserved women: a community collaboration. Ethn Dis. 2010;20(4):463.
Lu W-H, Deen D, Rothstein D, Santana L, Gold MR. Activating community health center patients in developing question-formulation skills: a qualitative study. Health Educ Behav. 2011: 1090198110393337.
Price-Haywood EG, Roth KG, Shelby K, Cooper LA. Cancer risk communication with low health literacy patients: a continuing medical education program. J General Intern Med. 2010;25(2):126–9.
Carter EL, Nunlee-Bland G, Callender C. A patient-centric, provider-assisted diabetes tele health self-management intervention for urban minorities. Perspectives in health information management/AHIMA, American health information management association 2011, 8(Winter).
Robare JF, Bayles CM, Newman AB, Williams K, Milas C, Boudreau R, McTigue K, Albert SM, Taylor C, Kuller LH. The “10 Keys” to healthy aging: 24-month follow-up results from an innovative community-based prevention program. Health Educ Behav. 2011;38(4):379–388. doi: 10.1177/1090198110379575.
Brennan T, Spettell C, Villagra V, Ofili E, McMahill-Walraven C, Lowy EJ, Daniels P, Quarshie A, Mayberry R. Disease management to promote blood pressure control among African Americans. Population Health Manag. 2010;13(2):65–72.
Lorig K, Ritter PL, Pifer C, Werner P. Effectiveness of the chronic disease self-management program for persons with a serious mental illness: a translation study. Commun Mental Health J. 2014;50(1):96–103.
Coleman EA, Coon S, Mohrmann C, Hardin S, Stewart B, Gibson RS, Cantrell M, Lord J, Heard J. Developing and testing lay literature about breast cancer screening for African American women. Clin J Oncol Nurs. 2003;7(1):66–71.
Coleman EA, Lord J, Heard J, Coon S, Cantrell M, Mohrmann C, O’Sullivan P. The Delta project: increasing breast cancer screening among rural minority and older women by targeting rural healthcare providers. In: Oncology nursing forum 2003. Onc Nurs Soc. 2003.
Dadaczynski K, Paulus P, de Vries N, de Ruiter S, Buijs G. HEPS inventory tool: an Inventory tool including quality assessment of school interventions on healthy eating and physical activity. Online Submission 2010.
National collaborating centre for methods and tools tool for grading public health interventions (NICE Tool): Hamilton: McMaster University; 2009.
BZgA/UKE Med. Psych: an evidence-based quality assessment tool for prevention and health promotion activities. vol 2003–2010. BZgA; 2011.
Irohla consortium. Overview of activities and results of WP4 deliverable D4.4; 2014.
Volandes AE, Paasche-Orlow MK. Health literacy, health inequality and a just healthcare system. Am J Bioethic. 2007;7(11):5–10.
Raynor DK. Health Literacy. BMJ. 2012;344:e2188.
McCallum A. Director of public health and public policy, NHS lothian. 2014. Personal communication to Brainard J. Nov 22.
Bornhöft G, Maxion-Bergemann S, Wolf U, Kienle GS, Michalsen A, Vollmar HC, Gilbertson S, Matthiessen PF. Checklist for the qualitative evaluation of clinical studies with particular focus on external validity and model validity. BMC Med Res Methodol. 2006;6(1):56.
Murdoch J, Varley A, Lattimer V, Campbell J, Salter C. Designing process evaluations for cluster randomised controlled trials: definitions of context and implications for data collection. In: North American primary care group annual meeting: 21–25 November 2014; New York.
Börsch-Supan A, Hank K, Jürges H. A new comprehensive and international view on ageing: introducing the ‘survey of health, ageing and retirement in Europe’. Eur J Age. 2005;2(4):245–53.
Christensen K, Doblhammer G, Rau R, Vaupel JW. Ageing populations: the challenges ahead. Lancet. 2009;374(9696):1196–208.
Dinh HTT, Clark R, Bonner A, Hines S. The effectiveness of health education using the teach-back method on adherence and self-management in chronic disease: a systematic review protocol. JBI Database Syst Rev Implemen Rep. 2013;11(10):30–41.
White M, Garbez R, Carroll M, Brinker E, Howie-Esquivel J. Is “Teach-Back” associated with knowledge retention and hospital readmission in hospitalized heart failure patients? J Cardiovasc Nurs. 2013;28(2):137–46.
Brainard J, Loke Y, Salter C. International variations in targeting of vulnerable groups: health literacy interventions. In: European public health association meeting: Nov 22 2014; Glasgow.
Brainard J, Howard-Wilsher S, Loke Y, Salter C. Quality and efficacy of health literacy randomised controlled trials. (Under review).
Heijmans M, Uiters E, Rose T, Hofstede J, Devillé W, van der Heide I, Boshuisen H, Rademakers J. Study on sound evidence for better understanding of health literacy in the European Union. Brussels: Directorate General for Health and Food Safety; 2015.
JB and YL designed and undertook the search of scientific databases. All authors screened scientific studies for inclusion. The grey literature search was undertaken by JB and irohla partner PK with inclusions confirmed by JB, BG, AM, TK and MS. JB screened health literacy articles and links for innovative features or vulnerable targets. The multi-criteria scoring sheet was designed by YL, JB and CS. JB, YL, AM, BG and irohla partners undertook multi-criteria scoring. CS and JB summarised aspects of the final selected studies. JB wrote the first draft and incorporated comments and revisions. All authors commented upon drafts of the manuscript. All authors read and approved the final manuscript.
We are grateful for small contributions from Irohla partners, including Jorien Bakx, Bas Geboers, Cinzia Giammarchi, John Hoeks, Stephanie Howard-Wilsher, Jan Jansen, Pania Karnaki, Ruth Koops van’t Jagt, Jaap Koot, Kaisa Korpela, Jeanet Landsman-Dijkstra, Lynn van Leeuwen, Wolter Paans, Juliane Paech, Janine Vervoordeldonk, Andrea de Winter and Liesbeth de Wit.
The authors declare that they have no competing interests.
This work was supported by the European Union’s Seventh Framework Programme (FP7/2007-2013) under Grant agreement No. 305831, co-ordinated by the University Medical Center Groningen. The views expressed here are those of the authors and not the funders.