Lessons in participant retention in the course of a randomized controlled clinical trial
© Idoko et al.; licensee BioMed Central Ltd. 2014
Received: 25 January 2014
Accepted: 26 September 2014
Published: 9 October 2014
Clinical trials are increasingly being conducted as new products seek to enter the market. Deployment of such interventions is based on evidence obtained mainly from the gold standard of randomized controlled clinical trials (RCCT). A crucial factor in the ability of RCCTs to provide credible and generalisable data is sample size and retention of the required number of subjects at completion of the follow-up period. However, recruitment and retention in clinical trials are hindered by prevalent peculiar challenges in Africa that need to be circumvented. This article shares experiences from a phase II trial that recorded a high retention rate at 14 months follow-up at a new clinical trial site.
Mothers bringing children less than two months of age to the health facility were given information and invited to have their child enrolled if the inclusion criteria were fulfilled. Participants were enrolled over 8 months. Trial procedures, duration and risks/benefits were painstakingly and sequentially explained to the communities, parents and relevant relatives before and during the trial period. The proportions of participants that completed or did not complete the trial were analyzed including the reasons for failure to complete all trial procedures.
1044 individuals received information regarding the trial of which 371 returned for screening. 300 (81%) of them who fulfilled the inclusion criteria and did not meet any exclusion criteria were enrolled and 94% of these completed the trial. Consent withdrawal was the main reason for not completing the trial largely (75%) due to the father not being involved at the point of consenting or parents no longer being comfortable with blood sampling.
Participant retention in clinical trials remains a crucial factor in ensuring generalisability of trial data. Appropriate measures to enhance retention should include continuous community involvement in the process, adequate explanation of trial procedures and risks/benefits; and innovative tracing of participants adapted for the setting.
Clinical trials are increasingly being conducted across the world as new drugs, vaccines and other products seek to enter the market. Evidence for the safety and efficacy of interventions are mainly based on the gold standard of randomized controlled clinical trials (RCCT) to generate credible and generalisable data, and thus retaining the required number of subjects has become a key issue [1, 2]. Conducting such trials in sub-Saharan Africa is however still relatively new and encumbered with challenges.
Challenges within the region which may impact on subject retention are numerous. As the region boasts of a rich cultural heritage passed down from generation to generation, myths and traditions abound which may also have effects on new interventions and procedures. For instance, in certain parts of West Africa blood is considered sacred and children are thought to be made ill by blood sampling . In parts of East Africa, hair is considered sacred and should not be knowingly removed. (Personal communication) Thus clinical trials which involve blood or hair sampling for analysis would likely be met with resistance in these areas. Such factors imply that the factors affecting subject retention may vary region to region. Other factors considered to negatively influence participant retention in clinical trials include erratic health care utilization , low literacy levels , male gender , older age of trial participants  and psychological distress . Apart from these participant related factors, there are also investigator related barriers, which could be logistic or personnel factors. A common one is the failure to integrate the role as a caregiver and investigator, and failure to anticipate the required work load . Other barriers include the lack of time and resources, and poor motivation of investigators. Protocol related barriers may include, lengthy trial periods, and over burdensome visit schedule requiring a significant degree of change in the participants’ routine activities [10–12]. Barriers may also include the influence of media [13, 14] or community groups. In addition, there are few established clinical trial sites in the region with limited human resources trained in running such trials. The few trial sites available are often overwhelmed leading to products in queue awaiting clinical trial and thus delayed availability of products to end users. This has led to a need to build capacity and establish new trial sites.
Studies in adults have reported attrition rates of 24% at 12 months and 44% at 24 months duration in longitudinal studies . In paediatric developmental studies attrition rates of 10 to 15% are generally expected each year . Such high rates of attrition of trial participants may reduce the statistical power or lead to skewed representation of data.
The Medical research Council Unit (MRC) Unit The Gambia has been conducting RCCTs, and had to establish a new site at Faji Kunda Health Centre to run another trial due to the burden on the existing site. Lessons learned from previous sites and trials were utilized in setting up this new site and interestingly the trial recorded a high participant retention rate of 94% at 14 month follow up. The culture and belief system especially related to the collection of blood samples in children, and low literacy levels were considered major factors which could likely impact participant retention at this new site. This paper highlights the operational lessons learnt in subject retention during the course of this trial with the hope that other sites may learn from these and adapt where feasible.
Diagrams and landmarks were used in documenting home addresses and where feasible, field assistants visited the homes prior to enrolment to ensure that the participant could be traced. The field staff also used this opportunity to discuss details of the trial with the other parent or other family members deemed important in the decision making process. A potential participant tracking database was then set up such that each participant sensitized for subsequent enrolment had basic details including contact mobile phone numbers entered (Figure 1). From this database potential trial participants were identified as they became eligible for enrolment through a list generated for subject follow up with an indication of the allowable time window. These potential participants’ parents were now approached and invited to a formal consent procedure at which the information contained on the participant information sheets was discussed and questions answered. Those interested in participating in the trial then had an assessment of consent information understanding using a structured open ended questionnaire. This questionnaire included an assessment of the potential participants’ parents understanding that they could withdraw from the trial at any time without adverse impact. Inability to pass this ‘test’ (failing to answer two or more questions correctly at a maximum of two attempts) implied a lack of understanding of the consent information and such a potential participant did not proceed further . Those who passed this ‘test’ went on to sign the consent document and proceeded to screening for eligibility to participate in the trial. Literate impartial witnesses independent of the trial sat in on the consent process for each illiterate potential participant to attest that all required information was given, the potential participants’ parent had an opportunity to ask questions and apparently understood the discussion. This witness then filled in the portions of the form to be filled by the parent, while the parent thumb printed the form and the witness signed.
In addition each participant received an appointment card specifying the preferred date to meet with the trial team. This was backed up with manual tracking forms and lists of participants due visits which could be used should the electronic database fail. Each field assistant/nurse was equipped with a mobile phone and top-up funds were provided weekly depending on anticipated follow ups, to ensure that participants could be reached at any time as required.
Each participant was questioned regarding their availability during the follow-up period, including known short-term travel plans, and travels related to religious festivals or family events. The likelihood of moving to live with in-laws, parents or other family members was also explored as this is a common practice after child birth within the area. Where possible, visits and post vaccination follow-up visits were planned around these events and where these would interfere with follow-up or care this was explained to the parent or legal guardian to enable appropriate adjustments. Potential participants unable or unwilling to comply were excluded at the point of recruitment.
Previous utilization of health services in particular immunization clinics was assessed from the infant welfare record of each child. Potential participants who had been erratic with the utilization of immunization services were considered unlikely to comply with the trial procedures and excluded from enrollment into the trial.
Salient information from the information sheets was reinforced at each clinic visit and participants given opportunities to ask questions and confirm willingness to continue in the trial. Illustrations using specimen tubes that contained colored fluid equal to the volume of blood samples to be collected and the fraction of this to the total blood volume in the child were also used as previously reported .
The trial team met with the community again in the middle of the trial when preliminary results were presented on the data obtained from the mapping of the trial area such as number of houses, households, adults, children under one year and pregnant women. Other results shared at these meetings included laboratory data from screening of participants at enrollment such as community averages for haemoglobin, liver function tests, and electrolytes concentrations. Individual results were discussed privately with parents when requested. The trial team seized the opportunity of these meetings to address misconceptions regarding the use of blood samples and get feedback from the community. In addition, the final outcome of the trial was also shared with the community, at the end of the trial.
1044 potential participants received information regarding the trial of which 371 returned for screening.A total of 300 participants were recruited over a period of 8 months, with a follow up period of approximately 14 months per participant. 283 (94.3%) participants completed the trial (Figure 2). Of the 17 participants who did not complete the trial (Figure 3), 13 (75%) withdrew consent, 9 were due to family disputes over continued participation where a relevant member of the family had not been informed of the participants’ enrolment in the trial, and 4 were due to fear of continued blood sampling. 6 (47%) of those that withdrew consent were after 3 or fewer visits while the remaining 7 (53%) withdrawals were after 4 or more visits. Of the remaining 4 that did not complete the trial, 3 migrated out of the trial area and one died.
This trial recorded high retention rate of 94%, in a trial that had 6–9 scheduled visits, and 5–6 blood samples collected, within the 14 months duration of participation per enrolled participant. This was a remarkable success story, particularly for a new trial site, likely due to measures put in place by the trial team.
The handful of participants that could not complete the trial withdrew consent mainly due to an objection to further participation raised by a member of the family that was not present at the time of consent, or fear of subsequent blood sampling. This first reason brings to light a significant peculiarity within the region; the communal nature of relationships which may affect the consent process. The legal age in the Gambia is 18 years, and parents at this age can give consent for themselves or their children when applicable. It is clear however that in this context, other family relationships still play a significant role. Thus while one parent; usually the mother signs the consent form, it is wise to have trial staff engage other family members with a significant say in the life of the child such as fathers, grandfathers or grandmother prior to participant enrolment.
The use of mobile phones which has recently gained prominence in field trials with use ranging from contact, to education and data transmittal [18, 19] is likely to have contributed to the success of this trial. In an era where almost every home no matter how remote can boast of a mobile phone [20–22] it has become a resource which the public health community, including this trial, cannot ignore. Use in this trial was limited to contacting the participants, but it is likely to have significantly reduced overall contact costs and helped to ensure participant retention as it created an avenue to keep in close contact with participants. Mobile phones also served to help participants contact the trial staff whenever they had concerns. This may have enhanced the confidence of the participants as their concerns could be addressed immediately without waiting for the next clinic appointment which could have also impacted retention positively. This coupled with the numbering of houses and availability of basic demographic data made it easy to track participants, to address issues, perform home visits and maintain confidence in the trial team. In a society where living is so communal addressing concerns early was key to ensuring that confidence in the team was maintained within the community.
Comparable numbers withdrew during the early and late parts in the follow up phase suggesting that duration of trial participation did not play a major role in the decision to complete the trial. The use of a participant tracking database also helped to ensure that despite a complicated visit schedule varying between 6 sub-groups, participant visits were not missed. This was particularly key considering the low literacy levels  within the region where very few participants would return on the basis of an appointment alone. This also helped the trial team to plan workload in terms of resources needed weekly within the field. Such planning minimized participant waiting time which may have also contributed to the high retention rates. The prior mapping of the community and use of diagrams to identify homes ensured that despite the lack of an address system in the locality the trial team was able to trace participants, thus minimizing drop-outs due to inability to trace participants.
Screening out participants with parents/guardians perceived to be unable to comply with the protocol could also have played a role. This included ensuring that criteria such as presence within the trial area throughout the trial duration, including planned short term/long term travel, and previous utilization of immunization services were fulfilled.
Blood sampling remains a major challenge in conducting clinical trials in West Africa, with more resistance often encountered when larger blood volumes are collected [3, 24]. This factor also came to bear in this trial being the only other reason for consent withdrawal, with some subjects who completed the trial declining blood sampling while accepting safety review. Constant education including the use of illustrations is likely to have minimized this effect. Important to note however is the spread of information within communities often fuelled by communal living. At some point in this trial, the trial team became aware that rumors were circulating in the community that blood samples from trials were sold in Europe for monetary gain. Community engagement through community meetings, sharing preliminary demographic and clinical laboratory results with the community as well as taking representatives of the community to witness the laboratory processing of the blood samples helped to dispel such rumors. This was likely further strengthened by the involvement of community leaders in the community engagement sessions. The involvement of these leaders was crucial to gaining community acceptance of the trial which is crucial in these settings. Key and opinion leaders have been documented to play a significant role in acceptance of public health interventions [25, 26]. Following trial completion, feedback on results has also been given to the community. These meetings were useful for both the trial team and the community in particular as that was the first time these parameters were known to them. This will likely also have a positive impact on future trials.
Participant retention in clinical trials remains a crucial factor in ensuring generalisabilty of trial data. This trial with retention of 94.3% in a trial in which a participant remained for 14 months, with rigorous scheduled visits and blood sampling is a huge success. This excellent retention can be ascribed mainly to continuous community involvement, adequate explanation of trial procedures, risks/benefits, and innovative tracing of participants adapted for the setting. It is hoped that these will guide others developing new trial sites or reviewing the operations at existing sites.
The authors acknowledge with gratitude the trial communities and participants and the ethusiastic team of field and health centre staff notably Lamin Marong, Abdou Gibba, Jereba Darboe, Karamo Manneh, Istaou Gibba, Kalifa Bayang, Amie Janha, Neneh Cham, and James Mendy. We are also grateful to GlaxoSmithKline Biologicals, Belgium who sponsored the original trial. These sponsors however did not play any role in the design, conduct, or reporting of this nested trial on subject retention.
- Davis LL, Broome ME, Cox RP: Maximizing retention in community-based clinical trials. J Nurs Scholarsh. 2002, 34: 47-53. 10.1111/j.1547-5069.2002.00047.x.PubMedView ArticleGoogle Scholar
- Mor M, Niv G, Niv Y: Patient retention in a clinical trial: a lesson from the rofecoxib (VIOXX) study. Dig Dis Sci. 2006, 51: 1175-1178. 10.1007/s10620-006-8028-5.PubMedView ArticleGoogle Scholar
- Ota MO, Idoko OT, Ogundare EO, Afolabi MO: Human immune responses to vaccines in the first year of life: biological, socio-economic and ethical issues - a viewpoint. Vaccine. 2013, 31: 2483-2488. 10.1016/j.vaccine.2012.06.018.PubMedView ArticleGoogle Scholar
- Morse EV, Simon PM, Besch CL, Walker J: Issues of recruitment, retention, and compliance in community-based clinical trials with traditionally underserved populations. Appl Nurs Res. 1995, 8: 8-14. 10.1016/S0897-1897(95)80240-1.PubMedView ArticleGoogle Scholar
- Hill PD, Humenick SS: Comparison of subjects who fully versus minimally participated in a breast-feeding study. West J Nurs Res. 1995, 17: 328-334. 10.1177/019394599501700308.PubMedView ArticleGoogle Scholar
- Senturia YD, McNiff Mortimer K, Baker D, Gergen P, Mitchell H, Joseph C, Wedner HJ: Successful techniques for retention of study participants in an inner-city population. Control Clin Trials. 1998, 19: 544-554. 10.1016/S0197-2456(98)00032-4.PubMedView ArticleGoogle Scholar
- Moorman PG, Newman B, Millikan RC, Tse CK, Sandler DP: Participation rates in a case–control study: the impact of age, race, and race of interviewer. Ann Epidemiol. 1999, 9: 188-195. 10.1016/S1047-2797(98)00057-X.PubMedView ArticleGoogle Scholar
- Moser DK, Dracup K, Doering LV: Factors differentiating dropouts from completers in a longitudinal, multicenter clinical trial. Nurs Res. 2000, 49: 109-116. 10.1097/00006199-200003000-00008.PubMedView ArticleGoogle Scholar
- Taylor KM, Kelner M: Interpreting physician participation in randomized clinical trials: the physician orientation profile. J Health Soc Behav. 1987, 28: 389-400. 10.2307/2136792.PubMedView ArticleGoogle Scholar
- Penn ZJ, Steer PJ: Reasons for declining participation in a prospective randomized trial to determine the optimum mode of delivery of the preterm breech. Control Clin Trials. 1990, 11: 226-231. 10.1016/0197-2456(90)90038-4.PubMedView ArticleGoogle Scholar
- Janson SL, Alioto ME, Boushey HA: Attrition and retention of ethnically diverse subjects in a multicenter randomized controlled research trial. Control Clin Trials. 2001, 22: 236S-243S. 10.1016/S0197-2456(01)00171-4.PubMedView ArticleGoogle Scholar
- Foley JF, Moertel CG: Improving accrual into cancer clinical trials. J Cancer Educ. 1991, 6: 165-173. 10.1080/08858199109528114.PubMedView ArticleGoogle Scholar
- Drennan KB: Patient recruitment: the costly and growing bottleneck in drug development. Drug Discov Today. 2002, 7: 167-170. 10.1016/S1359-6446(01)02137-7.PubMedView ArticleGoogle Scholar
- Baines CJ: Impediments to recruitment in the Canadian national breast screening study: response and resolution. Control Clin Trials. 1984, 5: 129-140. 10.1016/0197-2456(84)90119-3.PubMedView ArticleGoogle Scholar
- Blanton S, Morris DM, Prettyman MG, McCulloch K, Redmond S, Light KE, Wolf SL: Lessons learned in participant recruitment and retention: the EXCITE trial. Phys Ther. 2006, 86: 1520-1533. 10.2522/ptj.20060091.PubMedView ArticleGoogle Scholar
- Aylward GP, Hatcher RP, Stripp B, Gustafson NF, Leavitt LA: Who goes and who stays: subject loss in a multicenter, longitudinal follow-up study. J Dev Behav Pediatr. 1985, 6: 3-8.PubMedView ArticleGoogle Scholar
- Saidu YOA, Jafali J, Ogundare O, Worwui A, Sey G, Thomas V, Stanley-Batchilly E, Afolabi M, Idoko O, Owolabi O, Ota MOC: Contextualizing the informed consent process in vaccine trials in developing countries. J Clinical Res Bioethics. 2013, 4: 141-doi:10.4172/2155-9627.1000141Google Scholar
- Denkinger CM, Grenier J, Stratis AK, Akkihal A, Pant-Pai N, Pai M: Mobile health to improve tuberculosis care and control: a call worth making. Int J Tuberc Lung Dis. 2013, 17: 719-727. 10.5588/ijtld.12.0638.PubMedView ArticleGoogle Scholar
- van Heerden A, Norris S, Tollman S, Richter L, Rotheram-Borus MJ: Collecting maternal health information from HIV-positive pregnant women using mobile phone-assisted face-to-face interviews in Southern Africa. J Med Internet Res. 2013, 15: e116-10.2196/jmir.2207.PubMedPubMed CentralView ArticleGoogle Scholar
- Lori JR, Munro ML, Boyd CJ, Andreatta P: Cell phones to collect pregnancy data from remote areas in Liberia. J Nurs Scholarsh. 2012, 44: 294-301. 10.1111/j.1547-5069.2012.01451.x.PubMedPubMed CentralView ArticleGoogle Scholar
- Byass P, D’Ambruoso L: Cellular telephone networks in developing countries. Lancet. 2008, 371: 650-PubMedView ArticleGoogle Scholar
- Kharbanda EO, Stockwell MS, Fox HW, Rickert VI: Text4Health: a qualitative evaluation of parental readiness for text message immunization reminders. Am J Public Health. 2009, 99: 2176-2178. 10.2105/AJPH.2009.161364.PubMedPubMed CentralView ArticleGoogle Scholar
- Manafa O, Lindegger G, Ijsselmuiden C: Informed consent in an antiretroviral trial in Nigeria. Indian J Med Ethics. 2007, 4: 26-30.PubMedGoogle Scholar
- Howie SR: Blood sample volumes in child health research: review of safe limits. Bull World Health Organ. 2011, 89: 46-53. 10.2471/BLT.10.080010.PubMedPubMed CentralView ArticleGoogle Scholar
- Cohn LH: Contributions of Thomas Jefferson to American medicine. Am J Surg. 1979, 138: 286-292. 10.1016/0002-9610(79)90388-X.PubMedView ArticleGoogle Scholar
- Hennock EP: Vaccination policy against smallpox, 1835–1914: a comparison of England with Prussia and imperial Germany. Soc Hist Med. 1998, 11: 49-71. 10.1093/shm/11.1.49.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.