The effectiveness of M-health technologies for improving health and health services: a systematic review protocol
© Free et al; licensee BioMed Central Ltd. 2010
Received: 14 June 2010
Accepted: 6 October 2010
Published: 6 October 2010
The application of mobile computing and communication technology is rapidly expanding in the fields of health care and public health. This systematic review will summarise the evidence for the effectiveness of mobile technology interventions for improving health and health service outcomes (M-health) around the world.
To be included in the review interventions must aim to improve or promote health or health service use and quality, employing any mobile computing and communication technology. This includes: (1) interventions designed to improve diagnosis, investigation, treatment, monitoring and management of disease; (2) interventions to deliver treatment or disease management programmes to patients, health promotion interventions, and interventions designed to improve treatment compliance; and (3) interventions to improve health care processes e.g. appointment attendance, result notification, vaccination reminders.
A comprehensive, electronic search strategy will be used to identify controlled studies, published since 1990, and indexed in MEDLINE, EMBASE, PsycINFO, Global Health, Web of Science, the Cochrane Library, or the UK NHS Health Technology Assessment database. The search strategy will include terms (and synonyms) for the following mobile electronic devices (MEDs) and a range of compatible media: mobile phone; personal digital assistant (PDA); handheld computer (e.g. tablet PC); PDA phone (e.g. BlackBerry, Palm Pilot); Smartphone; enterprise digital assistant; portable media player (i.e. MP3 or MP4 player); handheld video game console. No terms for health or health service outcomes will be included, to ensure that all applications of mobile technology in public health and health services are identified. Bibliographies of primary studies and review articles meeting the inclusion criteria will be searched manually to identify further eligible studies. Data on objective and self-reported outcomes and study quality will be independently extracted by two review authors. Where there are sufficient numbers of similar interventions, we will calculate and report pooled risk ratios or standardised mean differences using meta-analysis.
This systematic review will provide recommendations on the use of mobile computing and communication technology in health care and public health and will guide future work on intervention development and primary research in this field.
M-health, the use of mobile computing and communication technologies in health care and public health, is a rapidly expanding area of research and practice. M-health programmes and interventions use mobile electronic devices (MEDs), such as personal digital assistants (PDAs) and mobile phones, for a range of functions from clinical decision support systems and data collection tools for healthcare professionals[1, 2], to supporting health behaviour change and chronic disease management by patients in the community.
Current documented M-health interventions and programmes include: mobile phone text messaging to support management of diabetes, hypertension, asthma, eating disorders and HIV treatment[3–7]; mobile phone text messaging and PDAs as aids to smoking cessation, body weight loss, reducing alcohol consumption, sexually transmitted infection prevention and testing[3, 5–7]; PDAs for data collection in healthcare and health research[1, 8–10] and to support medical education and clinical practice[2, 11–13]. Whilst the majority of M-health interventions are reported from high income countries, there is an emerging literature on the application of mobile technologies in low income countries[1, 7, 14–16].
Mobile communication technology is the fastest growing sector of the communications industry in low income countries[17, 18]. In the last two decades, the global digital divide has narrowed most for mobile phone use, with many low income countries "leap-frogging" over fixed-line communications technologies, straight to expansion of wireless cellular communication networks[18–20]. Whilst wireless communication network coverage and mobile phone ownership are not universal, or equally distributed, in low income countries, and the technology accessible to most of the population lags far behind that available in high income countries[19, 21], there is still huge potential for M-health interventions and programmes to have positive effects on health outcomes in resource-poor settings.
Mobile technologies have a number of key features that give them an advantage over other information and communication technologies in particular activities within health care and public health. Firstly, many MEDs have wireless cellular communication capability, providing the potential for continuous, interactive communication from any location e.g. telephone calls, text and multimedia messaging and also internet access via Wireless Application Protocol (WAP) or mobile broadband internet. Secondly, the devices are portable because of their small size, low weight and rechargeable, long-life battery power. Finally, many MEDs have sufficient computing power to support multimedia software applications. The combination of these features varies between specific devices and their relative importance will change with the health activity in which they are used. However, with advances in technology development, single devices increasingly possess many or all of these functions.
Existing systematic reviews of M-health interventions, and recently published protocols[22–26], focus on the application of specific devices (e.g. mobile phones[6, 9, 10, 13, 27]) or specific functions (e.g. text messaging[3, 4, 28]) to individual diseases or healthcare fields (e.g. diabetes care or chronic disease management[5, 10, 28]). In this systematic review, we propose to look all types of mobile technologies and all health outcomes, to provide a broad overview of the M-health sector at this relatively early point in its development. This will allow us to describe the use of different mobile technology functions across a range of healthcare and public health fields, from health behaviour to clinical outcomes such as medication compliance and service use, both to highlight similarities in mechanisms of action for a particular device or function and to suggest where they may be usefully transferred to new areas. Finally, we will identify studies of newer technologies such as Smartphones and portable media players, which are unlikely to be captured in technology-specific reviews.
The objectives of this review are to: (1) describe the uses of mobile computing and communication technologies by patients, healthcare professionals and the general public in the context of health service and public health interventions that have been evaluated in controlled studies; (2) assess the effectiveness of mobile technologies for improving health and health service outcomes in high, middle and low income countries; and (3) describe the acceptability of mobile technologies to patients, healthcare professionals and the general public, in the context of health service and health promotion interventions.
Methods and Design
Review Inclusion Criteria
Types of technology
Functions of mobile electronic devices included in the review
Mode of communication
Wireless cellular broadband
Custom/additional software support
Basic model 1
(e.g. Nokia 1280)1
(e.g. Nokia 6303i)1
Enterprise digital assistant
Portable media player
Handheld video games console
Types of intervention
Any intervention delivered using an MED owned or directly used by a patient or lay person;
Any clinical or practice aid delivered using an MED owned or directly used by a healthcare professional;
Any data collection or storage for the purposes of healthcare or health research using an MED.
Types of studies
Interventions delivered via a single MED to the treatment group (N.B. this could therefore include an intervention where a number of behaviour change techniques are used, e.g. prompts, reminders and patient-initiated support, but all delivered through a single MED, e.g. SMS to and from a mobile phone), where the control group receives no MED intervention;
Multi-MED interventions where the treatment group receives one or more interventions delivered through multiple MED, but no interventions through other (non-MED) modes and the control group receives no MED interventions;
Mixed MED and non-MED interventions where the treatment and control group both receive all non-MED components of the intervention and the MED intervention is delivered only to the treatment group, e.g. SMS plus group counselling for smoking cessation in the treatment group and the control group receives group counselling only;
Interventions delivered by different MED e.g. iphone vs. regular mobile phone;
The features and components of interventions delivered on a particular MED, such as the intensity, personalisation, content, duration and timing of an intervention, and the degree of software or other component customisation.
Mixed MED and non-MED interventions where the treatment and control group both receive the MED component;
Interventions where there are other treatment differences between the treatment and control groups besides the delivery of the MED component(s).
Types of participants
There will be no limits on study participants in terms of age, gender, ethnicity, morbidities (for patients and the general population) or staff role and occupation (for healthcare professionals e.g. nurse, surgeon, or physiotherapist). There will be no limits on study setting and we will include studies at all levels of healthcare setting (i.e. primary, secondary and tertiary healthcare) and those conducted in the community.
Types of outcome measures
All outcome measures reported in studies meeting the inclusion criteria will be extracted, both objective and self-reported measures. User-acceptability will be assessed as a self-reported outcome for all intervention types. We will also seek data on unintended adverse consequences of the interventions and process outcomes (e.g. repetitive strain injury or involvement in road traffic accidents).
Example outcome measures for anticipated MED-based interventions shown in Figure 1
Example outcome measures
Clinical decision support systems - diagnosis
• Adherence to clinical protocol • Diagnosis of disease or disease risk (primary prevention)• Treatment e.g. medication prescribed
• Use of clinical protocol • Ease of clinical protocol use/comprehensibility
Clinical decision support systems - disease management
• Successful disease management e.g. diabetes control measured by HbA1C, peak flow • Medication prescribed• Investigations arranged • Health outcomes e.g, cardiac events, mortality, diarrhoea, breast feeding
• Use of clinical protocol • Ease of clinical protocol use/comprehensibility
•Changes in clinical knowledge/skills
• Ease of use
• Data collected• Disease control e.g. HbA1c, peak flow• Timeliness of data collection
• Ease of data collection
Data collection tools
• Data completeness• Timeliness of data collection
• Ease of data collection• Ease of diagnosis
Test result notification
• Time to result notification• Time to treatment initiation
• Patient satisfaction with clinic service• Clinician preference for mode of notification
• Percent of appointments missed• Percentage of appointments cancelled in advance
• Patient intention to attend appointment
• Treatment outcomes e.g. change in depression score
• Patient satisfaction with treatment• Perceived level of support• Perceived changes in health status/disease condition
Chronic disease management
• Disease management e.g. diabetes control measured by HbA1C or asthma management expiration peak flow rate• Percent of medication doses taken on time
• Self-efficacy to manage condition/medication
Health behaviour change
• Health outcome e.g. body mass index (weight loss) or blood cotinine levels (smoking cessation)
• Self-efficacy to increase exercise/control dietary intake• Self reported behaviour
Acute disease management (first aid/emergency care)
• Cardiopulmonary resuscitation chest compression rate/depth/accuracy/hand position
• Perceived clarity of instructions
Untargeted mass health promotion campaigns
• Coverage• Uptake of services or treatment
We will use a three-part search strategy to identify studies meeting the inclusion criteria above that have been published since 1990: (1) we will search electronic bibliographic databases for published work, using a comprehensive search strategy for mobile technology interventions; (2) we will search trial registers for ongoing and recently completed trials; (3) we will search the reference lists of primary studies included in the review and the reference lists of relevant, previously published reviews.
Electronic bibliographic databases
The following electronic bibliographic databases will be searched: MEDLINE, EMBASE, PsycINFO, Global Health, The Cochrane Library (Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Methodology Register), NHS Health Technology Assessment Database, and Web of Science (science and social science citation index). The search strategy will include only terms relating to or describing mobile technologies because we will include all types of intervention and health or health service outcomes meeting the inclusion criteria described above. The search strategy for MEDLINE is shown in Additional File 1. All of these terms will be combined with the Cochrane Library MEDLINE filter for controlled trials of interventions. The mobile technology search terms will be adapted for use with other bibliographic databases in combination with database-specific filters for controlled trials, where these are available. There will be no language restrictions. The searches will be re-run immediately prior to analysis and further studies retrieved for inclusion, to ensure that the most current information is presented in the review.
We will include data from dissertations that meet the inclusion criteria, where these are indexed in the above databases and retrieved in our search. We will not be retrieving or including any unpublished data.
Ongoing, recently completed and unpublished clinical trials meeting the inclusion criteria described above will be identified from the following research registers: National Institutes of Health clinical trials registry (US); National Institute for Health Research Clinical Research Network Portfolio Database (UK); National Research Register Projects Database Archive (UK); and Current Controlled Trials (includes the International Standard Randomised Controlled Trial Number Register).
Study screening and selection
Titles and abstracts of studies retrieved using the search strategy and those from additional sources will be screened independently by two review authors to identify studies that potentially meet the inclusion criteria outlined above. The full text of these potentially eligible studies will be retrieved and independently assessed for eligibility by two review authors. Any disagreement between the two review authors over the eligibility of particular studies will be resolved through discussion with a third review author.
A standardised, pre-piloted form will be used to extract data from the included studies for assessment of study quality and evidence synthesis. Extracted information will include: study setting (including country); study population and participant demographics and baseline characteristics; MED used; details of the intervention and control conditions; study methodology; recruitment and study completion rates; outcomes and times of measurement; indicators of acceptability to users; suggested mechanisms of intervention action; information for assessment of the risk of bias (see below). Two review authors will independently extract data, discrepancies will be identified and resolved through discussion (with a third author where necessary). Missing data will be requested from study authors via email.
Assessing risk of bias
Randomisation sequence generation: was the allocation sequence (used to assign participants to the treatment and control groups) adequately generated? (This criterion only applies to randomised controlled trials.)
Treatment allocation concealment: was the allocated treatment adequately concealed from study participants and clinicians and other healthcare or research staff at the enrolment stage?
Blinding: were the personnel assessing outcomes and analysing data sufficiently blinded to the intervention allocation throughout the trial?
Completeness of outcome data: were participant exclusions, attrition and incomplete outcome data adequately addressed in the published report?
Selective outcome reporting: is there evidence of selective outcome reporting and might this have affected the study results?
Other sources of bias: was the trial apparently free of any other problems that could produce a high risk of bias?
Disagreements between the review authors over the risk of bias in particular studies will be resolved by discussion, with involvement of a third review author where necessary. The level of risk of bias in each of these domains will be presented separately for each study in tables in the final review publication.
The type of intervention e.g. individual behaviour change, chronic disease self-management, clinic appointment reminders or clinical diagnostic aid (as outlined in Figure 1);
The type of MED used;
The target population characteristics e.g. age, gender, ethnicity, socioeconomic status and/or education level, low/middle/high income country setting (classified according to the World Bank List of Economies);
The type of outcome e.g. smoking cessation or weight loss;
Intervention content - features of the MED employed (e.g. SMS, video), intervention components such as reminders, feedback or peer support, intensity, duration, personalisation and theoretical basis (if stated).
We will provide summaries of intervention effects for each study by calculating risk ratios (for dichotomous outcomes) or standardised mean differences (for continuous outcomes) from the data presented in the published studies or obtained from study authors.
We anticipate that there will be limited scope for meta-analysis because of the range of different outcomes measured across the reasonably small number of existing mobile technology intervention trials. However, where studies have used the same type of intervention and MED, with the same outcome measure, we will use Stata v11.0  to pool the results of randomised controlled trials using a random-effects meta-analysis, with standardised mean differences for continuous outcomes and risk ratios for binary outcomes, and calculate 95% confidence intervals and two sided P values for each outcome. In studies where the effects of clustering have not been taken into account, we will adjust the standard deviations for the design effect, using intra-class coefficients, if they are provided in the study reports, or alternatively using external estimates obtained from similar studies. Heterogeneity between the studies in effect measures will be assessed using both the χ2 test and the I2 statistic. We will consider an I2 value greater than 50% indicative of substantial heterogeneity. We will conduct sensitivity analyses based on study quality (risk of bias; level of participant drop-out) in order to investigate possible sources of heterogeneity). We will use stratified meta-analyses to explore heterogeneity in effect estimates according to: study quality (allocation concealment and blinding in RCTs); study populations (primary versus secondary prevention for health behaviour change interventions and high versus low and middle income country settings); the logistics of intervention provision (fully automated intervention content versus content generated by healthcare professionals or other qualified personnel); and intervention content (information only versus explicit use of behaviour change theories and techniques for behaviour change interventions). We will assess evidence of publication bias using Egger's weighted regression method for continuous outcomes and Begg's rank correlation test for dichotomous outcomes.
This systematic review of M-health interventions will provide a detailed summary of the evidence for the effectiveness of mobile computing and communication technologies to improve a broad range of health and health service outcomes.
This work is funded by the Department of Heath for England. VP is supported by a Wellcome Trust Senior Research Fellowship.
- Blaya JA, Fraser HS, Holt B: E-health technologies show promise in developing countries. Health Aff (Millwood). 2010, 29: 244-251. 10.1377/hlthaff.2009.0894.View Article
- Lindquist AM, Johansson PE, Petersson GI, Saveman B-I, Nilsson GC: The use of the Personal Digital Assistant (PDA) among personnel and students in health care: a review. Journal of Medical Internet Research. 2008, 10: e31-10.2196/jmir.1038.PubMed CentralPubMedView Article
- Cole-Lewis H, Kershaw T: Text Messaging as a Tool for Behavior Change in Disease Prevention and Management. Epidemiol Rev. 2010
- Fjeldsoe BS, Marshall AL, Miller YD: Behavior change interventions delivered by mobile telephone short-message service. American Journal of Preventive Medicine. 2009, 165-173. 10.1016/j.amepre.2008.09.040.
- Heron KE, Smyth JM: Ecological momentary interventions: Incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. 2010, 15: 1-39. 10.1348/135910709X466063.PubMed CentralPubMedView Article
- Krishna S, Boren SA, Balas EA: Healthcare via cell phones: a systematic review. Telemedicine Journal & E-Health. 2009, 15: 231-240.View Article
- Leach-Lemens C: Using mobile phones in HIV care and prevention. HIV & AIDS Treatment in Practice. 2009, 137: 7-
- Burton C, Weller D, Sharpe M: Are electronic diaries useful for symptoms research? A systematic review. Journal of Psychosomatic Research. 2007, 62: 553-561. 10.1016/j.jpsychores.2006.12.022.PubMedView Article
- Dale O, Hagen KB: Despite technical problems personal digital assistants outperform pen and paper when collecting patient diary data. Journal of Clinical Epidemiology. 2007, 60: 8-17. 10.1016/j.jclinepi.2006.04.005.PubMedView Article
- Lane SJ, Heddle NM, Arnold E, Walker I: A review of randomized controlled trials comparing the effectiveness of hand held computers with paper methods for data collection. BMC Medical Informatics & Decision Making. 2006, 6: 23-View Article
- Berlin A, Sorani M, Sim I: A taxonomic description of computer-based clinical decision support systems. Journal of Biomedical Informatics. 2006, 39: 656-667. 10.1016/j.jbi.2005.12.003.PubMedView Article
- Holubar S, Harvey-Banchik L: A review of the use of handheld computers in medical nutrition. Nutr Clin Pract. 2007, 22: 428-435. 10.1177/0115426507022004428.PubMedView Article
- Kho A, Henderson LE, Dressler DD, Kripalani S: Use of handheld computers in medical education. A systematic review. Journal of General Internal Medicine. 2006, 21: 531-537. 10.1111/j.1525-1497.2006.00444.x.PubMed CentralPubMedView Article
- Curioso WH, Mechael PN: Enhancing 'M-health' with south-to-south collaborations. Health Aff (Millwood). 2010, 29: 264-267. 10.1377/hlthaff.2009.1057.View Article
- Consulting VW: mHealth for Development: The Opportunity of Mobile Technology for Healthcare in the Developing World. 2009, Washington D.C. and Berkshire, UK
- Mechael PN, Batavia H, Kaonga N, Searle S, Kwan A, Fu L, Ossman J: Barriers and Gaps Affecting mHealth in Low and Middle Income Countries: Policy White Paper. 2010, Center for Global Health and Economic Development, Earth Institute, Columbia University
- ITU: Mobile overtakes fixed: Implications for policy and regulation. 2003, ITU International Telecommunications Union
- Orbicom-ITU: From the digital divide to digital opportunities: measuring infostates for development. 2005, Canada
- Banks K, Burge R: Mobile Phones: An Appropriate Tool for Conservation and Development?. 2004, Cambridge, UK
- Hamilton J: Are main lines and mobile phones substitutes or complements? Evidence from Africa. Telecommunications Policy. 2003, 27: 109-133. 10.1016/S0308-5961(02)00089-7.View Article
- Donner J: Research Approaches to Mobile Use in the Developing World: A Review of the Literature. Information Society. 2008, 24: 140-159. 10.1080/01972240802019970.View Article
- Car J, Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R: Mobile phone messaging reminders for attendance at scheduled healthcare appointments. Cochrane Database of Systematic Reviews. 2008
- de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, Car J, Atun R: Mobile phone messaging telemedicine for facilitating self management of long-term illnesses. Cochrane Database of Systematic Reviews. 2008
- Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Car J, Atun R: Mobile phone messaging for communicating results of medical investigations. Cochrane Database of Systematic Reviews. 2008
- Upadhyay N, Kokalj Kokot M, Kokalj Kokot M, Car J, Svab I: Mobile phone messaging - a telemedicine for people with diabetes mellitus. Cochrane Database of Systematic Reviews. 2007
- Vodopivec-Jamsek V, de Jongh T, Gurol-Urganci I, Atun R, Car J: Mobile phone messaging for preventive health care. Cochrane Database of Systematic Reviews. 2008
- Whittaker R, Borland R, Bullen C, Lin Ruey B, McRobbie H, Rodgers A: Mobile phone-based interventions for smoking cessation. Cochrane Database of Systematic Reviews. 2009
- Lim MS, Hocking JS, Hellard ME, Aitken CK: SMS STI: a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS. 2008, 19: 287-290. 10.1258/ijsa.2007.007264.PubMedView Article
- Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0. 2008, The Cochrane CollaborationView Article
- World Bank Country and Lending Groups. [http://data.worldbank.org/about/country-classifications/country-and-lending-groups]
- Stata Statistical Software: Release 11. 2009, StataCorp LP, College Station, TX
- Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG: Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999, 3: iii-92.PubMed
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.