- Research note
- Open access
- Published:
Analysis of reasons for loss to follow up in a prospective study in Chandigarh, India and impact from telecom changes
BMC Research Notes volume 14, Article number: 419 (2021)
Abstract
Objective
Mobile phones are used in research studies, to enroll and follow-up participants, collect data, and implement mHealth initiatives. We conducted a longitudinal study in a birth cohort, where infants were required to make four scheduled visits by 12 months of age. Families of those failing to attend scheduled follow-up visits, were contacted telephonically to ascertain the reasons, which were categorized as: not interested to continue participating, migrated, phone disconnected due to telecom change, or other reason.
Results
A total of 413 mother-infant dyads were enrolled. The overall attrition was 56%, with majority occurring at the first follow-up visit. This temporally coincided with a telecom service provider announcing strong incentives to switch providers. Attrition monotonically decreased at subsequent visits. The reasons were: moved away (13%), no longer interested (8%), phone disconnected (7%), and multiple other reasons (28%), the majority of whom had unreachable phones. Those who remained in the study and those lost to follow-up were similar on most demographic variables. Among common reasons for attrition in cohort studies, we experienced a new dimension introduced by telecom changes. These findings underscore the need to consider unexpected reasons for attrition in longitudinal studies, and design more robust methods to follow-up participants.
Introduction
Longitudinal epidemiological studies have been used for decades, making key contributions to understanding the risk factors [1] and etiology of various diseases [2, 3]. The evidence base in nutrition [4], cardiovascular disease [5], and host responses to infection [6] and many other health conditions, depends upon longitudinal studies [7, 8].
Currently, there is increasing interest in the impact of mHealth (mobile health) initiatives on various health outcomes [9, 10], particularly in low- and middle-income countries (LMICs) where there has been unprecedented growth of mobile phone networks [11]. Mobile phones are being used in longitudinal studies for contact with study participants, data collection, and various mHealth interventions. Such use of mobile phones is even a focus of funding agencies like the US National Institutes of Health [12] and the Gates Foundation [13].
However, the inherent need to repeatedly contact participants during a longitudinal study is challenged by attrition (i.e., loss to follow-up). Differential loss to follow-up can bias study results and also impact the ability to generalize the findings, if there are substantial differences between those lost to follow-up and those retained in the study. Prospective studies relying on mobile phones encounter problems if participant(s) or telecom provider(s) disconnect phones or alter coverage plans, during the course of the study. Problems resulting from multiple phones, disconnected phones, or switching telecom providers are likely exacerbated in LMICs where there may be limitations in reliable additional mechanisms for contact [14].
In a prospective birth cohort study in India, investigating the decay of maternal antibodies to measles among infants, we collected data at infants’ birth and at three, six, nine, and twelve months of age. During the study period, a telecom provider offered strong incentives for individuals to switch their mobile phone provider [15, 16], due to which phone numbers recorded for the study were no longer working. In this study, we examined the reasons for participant attrition, and also compared demographic characteristics between those lost to follow-up and those remaining in the study.
Main text
Methods
Study population
We randomly selected mother-infant dyads at birth, from 30 Anganwadi served communities, representative of the population residing in rural, urban, and resettlement colonies of Chandigarh, India. Data collection occurred during January 2017–October 2018.
Study staff first identified potential participants i.e., pregnant women, from Anganwadi records. For inclusion into the study, they had to be residing in Chandigarh, India at the time of delivery, and intending to reside in Chandigarh for at least a year after delivery. Study staff contacted each individual up to four times prior to the delivery date to invite their participation. If potential participants declined to participate or Study staff were not able to reach them, the next eligible individual from the enrollment log was contacted to participate in the study.
Enrolment of pregnant women was done at delivery in the hospital labour room. The following were excluded from enrolment: those with an acute febrile illness, those with known hemophilia or other blood dyscrasias characterized by potential for excessive bleeding, or those with a health condition necessitating immune-suppression medication. Infants born from participants were enrolled immediately after delivery.
Each enrolled infant underwent four scheduled follow-up visits at the ages of 3, 6, 9, and 12 months. Visits were scheduled during routine working hours, and mentioned on the Study records provided to the family. In addition, Study staff contacted the family telephonically at least 48 h prior to the scheduled visit, to remind them about the follow-up visit.
Derived variables
The main outcome in this study was being ‘lost to follow-up’. If caregivers of infants declined to follow-up during telephonic reminders, or failed to follow-up despite reminders, or could not be contacted prior to, or after the scheduled visit date elapsed, the Study staff recorded the reasons for loss to follow-up. The major categories were: (1) no longer interested to participate in the research study, (2) moved away from Chandigarh, (3) phone was disconnected (i.e., the number was no longer operational), or (4) other reasons.
The predominant independent variables were infant’s sex, mother’s age (trichotomized as 18–24 years, 25–29 years, and 30–42 years), caste [scheduled casted/scheduled tribe, other backward caste (OBC), or other], religion (dichotomized as Hindu or not), and monthly income (< 10,000 INR, 10,000–24,999 INR, 25,000–49,999 INR and ≥ 50,000 INR, which correspond to < $133, $133–$333, $334–$666 and > $666, respectively per current exchange rates). We also considered when the drop-out occurred, as the study check points were at birth, and age of three, six, nine and twelve months.
Statistical analysis
We summarized the number of individuals lost to follow-up, by reason. We ran two Rao-Scott chi-square tests to compare demographic information for those who were lost to follow-up versus those who were not. Reasons for loss to follow-up were also depicted graphically across study check points. The chi-square tests accounted for the survey design (clustering at Anganwadi centers). A p value < 0.05 was considered significant. Analyses were processed in SAS version 9.4 (SAS Institute, Cary, NC).
Ethical approval
This study was approved by the University of Michigan Health Sciences and Behavioral Sciences Institutional Review Board (HUM00104905), the Institutional Ethics Committee of the Postgraduate Institute of Medical Education and Research, Chandigarh, and the Health Ministry Screening Committee of the Government of India. Enrolled mothers provided written, informed consent to participate. Either parent provided written, informed consent for enrolment of their infants.
Results
Overall, 1810 mothers were screened and 413 mother-infant dyads were enrolled. A little over half (230, 56%) were lost to follow-up during the 12-month follow-up period. Most attrition (159 of 230, 69%), occurred at the first 3-month study visit, with decreasing amounts subsequently; 48 (21%) after three months of age, 14 (6%) after six months of age, and (4%) after nine months of age (Fig. 1). Of those who were lost to follow-up, the majority (114 of 230, 28%) were lost due to “other reason” which comprised 107 individuals who could not be contacted at all (i.e., phone was persistently unreachable), two infants who had died, and five who were out of town on the follow-up date (Table 1). Approximately 13% did not continue in the study because they moved from Chandigarh, and 8% were not interested in continuing. Those who were lost to follow-up due to a disconnected phone constituted 7%.
Infants retained in the study and those who were lost to follow-up, did not differ significantly on most demographic variables (infant’s sex, mother’s age, religion, and monthly income). Caste was associated (p = 0.015) with loss to follow-up; attrition occurred among 60% of participants categorized as “Other”, 46% among scheduled caste/scheduled tribe and 48% among OBC, respectively. Both mother’s age and monthly income had an inverse relationship with the percentage of participants retained in the study, although neither was statistically significant.
Discussion
This study showed that among various reasons for participant attrition in prospective community-based cohort studies, ‘telecom changes’ introduced a new dimension that made it difficult (or impossible) to track participants. Since this can impact other similar studies, we suggest practical ways to manage the problem, within limited resources.
Overall, we experienced significant attrition with the majority occurring during the first follow-up visit. Although < 10% attrition was definitely attributable to telecom changes, (identified through automated messages that the service was unavailable), this is likely a conservative estimate. A significant proportion of those who could not be contacted at all, were also likely due to telecom changes, since most were unreachable on multiple attempts (with automated recordings persistently stating that the subscriber was not reachable).
Telecom-related issues are important given the increasing use of mobile phones for mHealth initiatives. India has the second largest telecommunications network with over 1 billion users [17], and the industry faces high customer churn and switching of telecom providers [18]. One study found that call rates were the most important factor in switching mobile service providers and almost half the respondents were likely to switch to another service provider [19] often preferring to opt for a new phone number rather than porting existing number to the new provider.
Other factors, including gender norms and socio-economic status, also intersect to influence mobile phone use [20]. Previous research identified an association between lower socioeconomic status and increased loss to follow-up [21]. We found the opposite relationship; those of higher socioeconomic status being more likely to be lost to follow-up. It is possible that certain groups (with more disposable income, or of a certain caste) might be attuned to changes in telecom services.
Loss to follow-up has significant implications for longitudinal studies and can lead to biased estimates [22] and limited generalizability. For studies relying on phones to contact participants or deliver mHealth interventions, it may be of value to provide study participants with a mobile device, or to provide funds to cover mobile plan costs. Study staff could also collect multiple phone numbers at the time of enrollment; one for the primary study participant and another of a family member. Such strategies, if appropriate in the cultural context, could potentially reduce the loss to follow-up due to telecom related issues. Researchers could also assess the feasibility of using social media platforms including apps like Whatsapp (that are very popular in India).
We did not use (automated or other) text messaging to contact participants. First, we did not have the infrastructure to send out automated text message reminders. Second, many service providers provide pre-paid usage plans that provide unlimited (outgoing and incoming) calling but only a limited number of free-of-charge text messages. Third, telecom service providers regularly send advertising text messages to users, resulting in them being ignored. Fourth, older non smartphone handsets have limited inbox capacities, and fail to receive text messages unless the inbox is periodically emptied.
Previous studies have shown that increasing funds for study staff to track down individuals can decrease attrition [23]. In addition, loss to follow up can also be reduced by implementing a comprehensive protocol including an electronic database, training in cultural/linguistic competency, reinforcing study importance, and home assessment visits [24]. Reinforcing study importance could be particularly important in a study like this one if, for example, individuals do not believe vaccination to be important or measles disease to be serious.
The findings of this study can serve to inform the design of longitudinal studies in LMICs. The use of mHealth modalities are likely to increase as mobile phone access increases. Therefore addressing this issue will become even more important over time. This is especially true as major funders of global research, like the Gates Foundation, often reward proposals using technology and technology-driven programs to conduct studies and carry out interventions. The challenges may compound with time as more carriers and therefore more options for customers become available particularly in LMICs where many of these studies are conducted.
Conclusions
This study showed that, among multiple causes for participant attrition in prospective community-based cohort studies, a new dimension was introduced by ‘telecom changes’ that made it difficult (or impossible) to track participants. Practical ways to manage this problem without intensive investments in human and material resources, could be by recording multiple contact details for each participant, exploring the use of instant messaging platforms (or social media), and maintaining more regular contact with participants.
Limitations
The study has several limitations. First is the possible misclassification of the outcome. Despite thorough training, Study staff may have recorded the primary reason for loss to follow-up in a varying manner. Second, we could not ascertain whether those who were persistently “not reachable” to study calls, had disconnected phone-service due to telecom changes. Those with automated recorded messages stating that “the subscriber does not exist” or “this number does not exist” were easier to classify, compared to those without automated recordings. Third, the study was conducted in a single Indian city in a region that is culturally, socially, and geographically diverse, limiting its overall ability to be generalized. Last, we had a relatively small sample size, limiting confidence to detect significant effects or identify specific groups that are overall more likely to be lost to follow-up.
Availability of data and materials
Data and material used in this study are available with the authors on request. Researchers requiring additional data are invited to contact the Authors.
Abbreviations
- LMIC:
-
Low- or middle- income country
- mHealth:
-
Mobile health
- OBC:
-
Other backwards caste
References
Chen Z, Emberson J, Collins R. Strategic need for large prospective studies in different populations. JAMA. 2020;323(4):309–10.
Knobloch H, Pasamanick B. Prospective studies on the epidemiology of reproductive casualty: Methods, findings, and some implications. Merrill Palmer Q Behav Dev. 1966;12(1):27–43.
Weir JM, Dunn JE Jr. Smoking and mortality: a prospective study. Cancer. 1970;25(1):105–12.
Larsson SC, Wolk A. Meat consumption and risk of colorectal cancer: a meta-analysis of prospective studies. Int J Cancer. 2006;119(11):2657–64.
Ford ES, Caspersen CJ. Sedentary behaviour and cardiovascular disease: a review of prospective studies. Int J Epidemiol. 2012;41(5):1338–53.
Rockx B, De Wit M, Vennema H, et al. Natural history of human calicivirus infection: a prospective cohort study. Clin Infect Dis. 2002;35(3):246–53.
Shiferaw S, Spigt M, Tekie M, Abdullah M, Fantahun M, Dinant G-J. The effects of a locally developed mHealth intervention on delivery and postnatal care utilization; a prospective controlled evaluation among health centres in Ethiopia. PloS ONE. 2016;11(7):e0158600.
Knobloch H, Pasamanick B. Prospective studies on the epidemiology of reproductive casualty: methods, findings, and some implications. Merill Palmer Q Behav Dev. 1966;12:27–43.
Cataldi JR, O’Leary ST, Markowitz LE, Allison MA, Crane LA, Hurley LP, et al. Changes in strength of recommendation and perceived barriers to human papillomavirus vaccination: longitudinal analysis of primary care physicians, 2008–2018. J Pediatr. 2021;234:149-157.e3. https://doi.org/10.1016/j.jpeds.2021.03.002.
Pfammatter A, Spring B, Saligram N, et al. mHealth intervention to improve diabetes risk behaviors in India: a prospective, parallel group cohort study. J Med Internet Res. 2016;18(8):e207.
Lee SH, Nurmatov UB, Nwaru BI, Mukherjee M, Grant L, Pagliari C. Effectiveness of mHealth interventions for maternal, newborn and child health in low–and middle–income countries: systematic review and meta–analysis. J Glob Health. 2016. https://doi.org/10.7189/jogh.06.010401.
NIH Fogarty International Center. Mobile health: technology and outcomes in low and middle income countries (R21). 2020. https://www.fic.nih.gov/Programs/Pages/mhealth.aspx. Accessed 22 Aug 2020.
Bill & Melinda Gates Foundation. Innovations for improving the impact of health campaigns (Round 25)|Grand Challenges. 2019. https://gcgh.grandchallenges.org/challenge/innovations-improving-impact-health-campaigns-round-24. Accessed 22 Aug 2020.
van Olmen J, Erwin E, García-Ulloa AC, et al. Implementation barriers for mHealth for non-communicable diseases management in low and middle income countries: a scoping review and field-based views from implementers. Wellcome Open Res. 2020. https://doi.org/10.12688/wellcomeopenres.15581.2.
Safi M. Reliance Jio launches cheap 4G services in India. https://www.theguardian.com/world/2016/sep/05/reliance-jio-launches-cheap-4g-services-in-india. Accessed 23 July 2021.
Sathe G. Reliance Jio SIM available to everyone from September 5, free to use till December 31. https://gadgets.ndtv.com/telecom/news/reliance-jio-sim-available-to-everyone-from-september-5-free-to-use-till-december-31-1453084. Accessed 23 July 2021.
Telecom Regulatory Authority of India (TRAI) Highlights of Telecom Subscription Data as on 31st December, 2019. Available from: https://www.trai.gov.in/sites/default/files/PR_No.17of2020_0.pdf. Accessed 31 Mar 2021.
Chadha SK, Bhandari N. Determinants of customer switching towards mobile number portability. Paradigm. 2014;18(2):199–219.
Sathish M, Kumar KS, Naveen K, Jeevanantham V. A study on consumer switching behaviour in cellular service provider: a study with reference to Chennai. Far East J Psychol Bus. 2011;2(2):71–81.
Barboni G, Field E, Pande R, Rigol N, Schaner S, Moore CT. A tough call: understanding barriers to and impacts of women’s mobile phone adoption in India. Harvard: Harvard Kennedy School-Evidence for Policy Design; 2018.
Panditrao M, Darak S, Kulkarni V, Kulkarni S, Parchure R. Socio-demographic factors associated with loss to follow-up of HIV-infected women attending a private sector PMTCT program in Maharashtra, India. AIDS Care. 2011;23(5):593–600.
Howe CJ, Cole SR, Lau B, Napravnik S, Eron JJ Jr. Selection bias due to loss to follow up in cohort studies. Epidemiology. 2016;27(1):91.
Flores G, Portillo A, Lin H, Walker C, Fierro M, Henry M, Massey K. A successful approach to minimizing attrition in racial/ethnic minority, low-income populations. Contemp Clin Trials Commun. 2017;5:168–74.
Sprague S, Leece P, Bhandari M, Tornetta P 3rd, Schemitsch E, Swiontkowski MF, S.P.R.I.N.T. Investigators. Limiting loss to follow-up in a multicenter randomized trial in orthopedic surgery. Control Clin Trials. 2003;24(6):719–25.
Acknowledgements
Research reported in this publication was supported by the Trehan Foundation. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Trehan Foundation. We acknowledge the contributions of the Research staff who participated in various aspects of the study, and assisted with data collection.
Funding
Research reported in this publication was supported by the Trehan Foundation, USA. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Trehan Foundation, USA.
Author information
Authors and Affiliations
Contributions
JLM: conceived the study idea, contributed to analysis and interpretation of data, critically reviewed and edited the manuscript for content, gave final approval of published version and is a guarantor of the research. PP, AW, VS, BB and BC: contributed to the analysis and interpretation of data, drafted a portion of the article, gave final approval of the version to be published, and agreed to act as guarantor of the work. MB: secured the study funding, contributed to study design and acquisition of data, critically reviewed and edited the manuscript for content, gave final approval of published version and is a guarantor of the research. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the University of Michigan Health Sciences and Behavioral Sciences Institutional Review Board (HUM00104905), the Institutional Ethics Committee of the Postgraduate Institute of Medical Education and Research, Chandigarh, and the Health Ministry Screening Committee of the Government of India. Enrolled mothers provided written, informed consent to participate. Either parent provided written, informed consent for enrolment of their infants. This statement has also been included in the manuscript (“Methods” Section).
Consent for publication
Not applicable.
Competing interests
We declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Mathew, J.L., Patel, P.N., Wagner, A.L. et al. Analysis of reasons for loss to follow up in a prospective study in Chandigarh, India and impact from telecom changes. BMC Res Notes 14, 419 (2021). https://doi.org/10.1186/s13104-021-05837-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13104-021-05837-9