- Research article
Sex-differences in reasons for non-participation at recruitment: Geelong Osteoporosis Study
BMC Research Notesvolume 6, Article number: 104 (2013)
Understanding reasons for non-participation in health studies can help guide recruitment strategies and inform researchers about potential sources of bias in their study sample. Whilst there is a paucity of literature regarding this issue, it remains highly plausible that men and women may have varied reasons for declining an invitation to participate in research. We aimed to investigate sex-differences in the reasons for non-participation at baseline of the Geelong Osteoporosis Study (GOS).
The GOS, a prospective cohort study, randomly recruited men and women aged 20 years and over from a region in south-eastern Australia using Commonwealth electoral rolls (2001–06 and 1993–97, respectively). Reasons for non-participation (n=1,200) were documented during the two recruitment periods. We used the Pearson’s chi squared test to explore differences in the reasons for non-participation between men and women.
Non-participation in the male cohort was greater than in the female cohort (32.9% vs. 22.9%; p<0.001). Overall, there were sex-differences in the reasons provided for non-participation (p<0.001); apparent differences related to time constraints (men 26.3% vs. women 10.4%), frailty/inability to cope with or understand the study (men 18.7% vs. women 30.6%), and reluctance over medical testing (men 1.1% vs women 9.9%). No sex-differences were observed for non-participation related to personal reason/disinterest, and language- or travel-related reasons.
Improving participation rates in epidemiological studies may require different recruitment strategies for men and women in order to address sex-specific concerns about participating in research.
Non-participation at recruitment of epidemiological studies has important implications. It has the potential to introduce selection bias: systematic groups of people may be more inclined to decline participation than others in a way which may be correlated with the variables under investigation. While selection bias due to non-participation may have only a minor impact on the validity of findings from the longitudinal phase of cohort studies, there is potential for greater impact on interpretation of baseline data analysed cross-sectionally. Further, non-participation may stunt the sample size and hence reduce statistical power, which in turn means that clinically important effects may go undetected. Finally, there are associated pragmatic difficulties, for example non-participation may increase the cost and resources spent per subject to reach the necessary sample size.
The Geelong Osteoporosis Study (GOS) is a large population-based prospective cohort study, initiated in 1993 for women, and in 2001 for men, in order to study the prevalence of osteoporosis, describe age-related changes in bone mineral density and characterize the risks for osteoporosis and fracture. The male and female cohorts have been shown as representative of the broader Caucasian Australian population, however, understanding reasons for non-participation, and any associated sex-differences in those reasons, will further inform the strong recruitment process employed by the GOS.
Few studies have examined non-participation in epidemiological research. Existing evidence suggests that the main barriers to participation may include indifference to the subject matter of the study, and demanding lifestyles in a climate of high requests for study participation. In a systematic review of non-participation in randomized controlled trials, a general distrust of hospitals and the medical industry, and a fear of the unknown were also identified as barriers. However, neither of these studies examined potential sex-differences amongst reasons for non-participation. We aimed to investigate reasons for non-participation at the baseline recruitment stages of the GOS and whether they differed by sex. This will inform future recruitment strategies used by researchers undertaking population-based health studies.
We examined the baseline recruitment data for the male and female cohort of the GOS, where the recruitment process had randomly selected potential participants from defined age-strata from the Commonwealth electoral rolls encompassing the Barwon Statistical Division (BSD), a region in south-eastern Australia. As voting in Australia is compulsory for residents aged at least 18 years, the electoral roll provides a comprehensive listing of all adult residents and an ideal sampling frame for population-based epidemiological studies. The men were recruited 2001–06 and the women were recruited approximately a decade earlier, in 1993–97. Age-stratified samples were recruited using the same structure for both sexes: approximately 100 individuals were recruited for each 5-year age-group 20–24, 25–29, 30–34, 35–39, 40–44, 45–49, 50–54, 55–59, 60–64 and 65–69 years, and approximately 200 individuals for each of the age groups 70–79 years and 80 years and older. The inclusion criterion was that the individual was listed on the electoral roll for the BSD; if individuals were unable to provide written consent, they were excluded. There was no screening on the basis of exposure to medications or diseases (see for more detailed description).
Of the potential 1,938 women eligible to participate, 444 (22.9%) declined to participate. Of the potential 2,296 men who were eligible to participate, 756 (32.9%) declined. The total number of non-participants was n=1,200 (37% women), and were thus included in this analysis.
During baseline recruitment for the GOS, various phases were employed. Initially, letters of invitation were mailed to the aforementioned randomly selected group of individuals which provided information about the purpose of the study, requirements of participants (clinical tests, blood collection and completion of questionnaires), and advised of the potential time-investment associated with participation and the location of the study centre. Participants were contacted by or requested to contact the research centre by telephone to arrange an appointment for their baseline assessment. Follow-up letters were dispatched at one and two monthly intervals to those who had not yet responded. After attempts to make contact, non-participants were coded according to (i) the reason for non-participation (where known), and (ii) sex.
For this current analysis, reasons for non-participation were pooled on the basis of common underlying themes, and formed seven groups:
personal reason/disinterest (disinterested / can't be bothered /does not want to; personal reasons; no wish to uncover medical problem; invasion of privacy; interference from family; religious / philosophical reasons);
frailty/inability to cope with or understand the study (frailty/infirmity or too old; other illness; unable to cope with involvement due to old age; cancer; illness associated with fracture; unable to understand the study due to old age);
time constraints (too busy; work commitments; home commitments);
undeterminable reason (no reason given; repeated failure to keep appointment);
reluctance over medical testing (avoiding unnecessary tests; avoiding further exposure to x-rays; fear of hospitals; fear of needles (venipuncture));
travel-related issues (too far to travel).
The Pearson’s chi-square test without continuity was used to identify whether there was an overall difference between the sexes regarding reasons for non-participation. Our interpretation of the chi-squared test was based on each group’s contribution to the test statistic. Binary logistic regression analysis was also used to compare sex differences in reasons for non-participation. Statistical analyses were performed using Minitab (Version 15; Minitab, State College, PA). Provision of reason for an individual’s non-participation formed implied consent to utilize the response. The study protocol was approved by the Barwon Health, Human Research Ethics Committee.
The most frequent reason for non-participation, for both men (42.7%) and women (43.2%), was personal reason/disinterest The next most common reasons for non-participation (in descending order) were: time constraints and frailty/inability to cope with the study for men; and frailty/inability to cope with the study, time constraints, and reluctance over medical testing for women (Table 1 and Figure 1). Overall, there were sex-differences in the reasons provided for non-participation (p < 0.001); apparent differences related to time constraints (men 26.3% vs. women 10.4%), frailty/inability to cope with or understand the study (men 18.7% vs. women 30.6%), and reluctance over medical testing (men 1.1% vs women 9.9%). No sex-differences were observed for non-participation relating to personal reasons/disinterest and language- (men 2.4% vs women 1.6%) or travel-related issues (men 1.6% vs. women 2.0%). Furthermore, reasons for non-participation were undeterminable for a relatively small proportion of people (men 7.3% and women 2.3%).
Using the group who gave personal reasons or disinterest as the reference, men were more than twice as likely as women to be a non-participant because of limited time (Table 2). In contrast, men were considerably less likely than women to state they were too frail to participate (OR = 0.62, 95%CI 0.46-0.83) or they felt reluctant to have medical tests (OR = 0.11, 95%CI 0.05-0.23).
We observed that a greater proportion of men declined participation in the baseline GOS recruitment compared to women. For men, the most common reasons for non-participation, in descending order were: (i) personal reason/disinterest, (ii) time constraints and (iii) frailty/inability to cope with the study requirements. For women, the most common reasons for non-participation in descending order were: (i) personal reason/disinterest, (ii) frailty/inability to cope with the study, (iii) time constraints, and (iv) reluctance over medical testing. Men were more likely to decline participation due to time constraints than women. Women were more likely to decline due to reasons associated with frailty and due to reluctance over medical testing, compared to men.
Our observation that men had an increased propensity to decline participation compared to women, is consistent with other studies[6, 7]. Interestingly, we observed no sex-difference in the level of disinterest; furthermore, we can confirm that disinterest was not borne out of religious/philosophical objections, family interference, privacy concerns, or a fear of uncovering a medical problem (subgroups that were collapsed to form the personal reason/disinterest group). However, evidence exists to suggest that people who experience symptoms relevant to the health conditions under investigation are more likely to take part in studies than those who do not have those symptoms[1, 8]. Given that osteoporosis often remains undetected until after a fragility fracture occurs, it is plausible that non-participation related to disinterest may be due to a lack of awareness of the disease. Osteoporosis has also been identified as a condition with ‘low salience’ among the lay and medical communities – there exists a level of ambivalence and unconcern about osteoporosis in individual patients and the general population[10, 11]. Other factors that hampered interest may have been that certain attributes of the study were not salient or appealing enough to provide motivation to participate; people may not see a personal gain from participating or feel disillusioned with scientific research on the whole. Thus, highlighting personal relevance during the recruitment phase of a study may help combat antipathy towards research participation.
Women were more likely than men to decline participation due to frailty, or the inability to cope with requirements of the GOS study. The recruitment of elderly individuals to epidemiological studies has obvious difficulties[14, 15]. A number of published studies that examined frailty-related reasons for non-participation suggested that women may be impeded by personal illness more so than men.
Compared to men, we also observed women to be more likely to decline participation due to reluctance over medical testing. A 2007 study reported that women may have a stronger perception of risks and harms involved with epidemiological research compared to men. This suggestion offers a plausible explanation for our observations, especially given that participation in the GOS required a number of clinical examinations. Furthermore, reluctance was not due to an avoidance of confronting medical issues, but rather due to concerns about possible stress and adverse effects of the battery of clinical examinations proposed.
The final key reason for non-participation was related to time constraints, whereby men were more likely to report limited time compared to women. To minimise problems associated with availability due to work commitments, the GOS offered potential participants appointment times after hours and at weekends. Time constraints have consistently been reported by other studies as a barrier to participation[6, 18].
This study has some notable strengths. First, the GOS re-contacted non-responders, whereby those who did not respond to the initial invitation were followed-up. A problem that is common to studies where mail surveys are utilised is that often there is no attempt made to ascertain whether non-response was due to the letter not being received, or because individuals have consciously chosen not to participate[18, 19]. Second, the GOS did not employ ambiguous categories to define reasons for non-participation, but rather explored precise reasons to improve clarity. This study also has some limitations. We are unable to comment on age-related reasons for non-participation, due to these data being unavailable. Furthermore, the female and male cohorts of the GOS were recruited 10 years apart, so the observed sex-differences in reasons may reflect a period effect, whereby the consequences of influences may vary with time.
In conclusion, we observed sex-differences in reasons for non-participation in the GOS; frequencies for reasons relating to frailty, time constraints, and reluctance over medical testing were not the same for men and women. Our findings also suggest that the GOS recruitment process may have limited the potential for sex-bias with regards to disinterest, language and travel issues. This study highlights the importance of stimulating interest in the aims of the research project during recruitment, which may be achieved by the early establishment of rapport to promote participation. Furthermore, targeted attention to providing information about the safety and risks involved in clinical tests may aid people’s decisions about whether or not to participate. We suggest that this exploration of sex-differences in reasons for non-participation may help future researchers to enhance specific recruitment strategies and protocols, depending on their target population.
Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17: 643-653. 10.1016/j.annepidem.2007.03.013.
Sharp L, Cotton SC, Alexander L, Williams E, Gray NM, Reid JM: Reasons for participation and non-participation in a randomized controlled trial: postal questionnaire surveys of women eligible for TOMBOLA (Trial Of Management of Borderline and Other Low-grade Abnormal smears). Clin Trials. 2006, 3: 431-442. 10.1177/1740774506070812.
Pasco JA, Nicholson GC, Kotowicz MA: Cohort Profile: Geelong Osteoporosis Study. Int J Epidemiol. 2012, 41: 1565-1575. 10.1093/ije/dyr148.
Boyle T, Landrigan J, Bulsara C, Fritschi L, Heyworth J: Increasing study participation. Epidemiology. 2011, 22: 279-
Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R: Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999, 52: 1143-1156. 10.1016/S0895-4356(99)00141-9.
Knudsen AK, Hotopf M, Skogen JC, Øverland S, Mykletun A: The health status of nonparticipants in a population-based health study: the Hordaland Health Study. Am J Epidemiol. 2010, 172: 1306-1314. 10.1093/aje/kwq257.
Bergman P, Ahlberg G, Forsell Y, Lundberg I: Non-participation in the second wave of the PART study on mental disorder and its effects on risk estimates. Int J Soc Psychiatr. 2010, 56: 119-132. 10.1177/0020764008098838.
Dunn KM, Jordan K, Lacey RJ, Shapley M, Jinks C: Patterns of consent in epidemiologic research: evidence from over 25,000 responders. Am J Epidemiol. 2004, 159: 1087-1094. 10.1093/aje/kwh141.
Otmar R, Kotowicz MA, Nicholson GC, Pasco JA: Methodological reflections on using pilot data from fracture patients to develop a qualitative study. BMC Res Notes. 2011, 4: 508-10.1186/1756-0500-4-508.
Otmar R, Marrow M, Nicholson GC, Kotowicz MA, Pasco JA: A cultural models approach to osteoporosis prevention and treatment. Sage Open. 2012, 2: 2158244012464976-
Otmar R, Reventlow SD, Nicholson GC, Kotowicz MA, Pasco JA: General medical practitioners’ knowledge and beliefs about osteoporosis and its investigation and management. Arch Osteoporos. 2012, 7: 107-114. 10.1007/s11657-012-0088-x.
Groves RM, Peytcheva E: The impact of nonresponse rates on nonresponse bias. Publ Opin Q. 2008, 72: 167-189. 10.1093/poq/nfn011.
Sugarman J, McCrory DC, Hubal RC: Getting meaningful informed consent from older adults: a structured literature review of empirical research. J Am Geriatr Soc. 1998, 46: 517-524.
Chang BH, Hendricks AM, Slawsky MT, Locastro JS: Patient recruitment to a randomized clinical trial of behavioral therapy for chronic heart failure. BMC Med Res Method. 2004, 4: 8-10.1186/1471-2288-4-8.
Clarke RM, Allen G, McBay S, Heaney S: Improving the quality of community health surveys and community health promotion campaigns by feedback from the community: experience from the Wallsend Community and Health Project. Community Health Stud. 1990, 14: 27-34.
Livingston PM, Lee SE, McCarty CA, Taylor HR: A comparison of participants with non-participants in a population-based epidemiologic study: The Melbourne Visual Impairment Project. Ophthalmic Epidemiol. 1997, 4: 73-81. 10.3109/09286589709057099.
Ding EL, Powe NR, Manson JE, Sherber NS, Braunstein JB: Sex differences in perceived risks, distrust, and willingness to participate in clinical trials: a randomized study of cardiovascular prevention trials. Arch Intern Med. 2007, 167: 905-912. 10.1001/archinte.167.9.905.
Rönmark EP, Ekerljung L, Lötvall J, Torén K, Rönmark E, Lundbäck B: Large scale questionnaire survey on respiratory health in Sweden: Effects of late- and non-response. Respir Med. 2009, 103: 1807-1815. 10.1016/j.rmed.2009.07.014.
Chou P, Kuo HS, Chen CH, Lin HC: Characteristics of non-participants and reasons for non-participation in a population survey in Kin-Hu, Kinmen. Eur J Epidemiol. 1997, 13: 195-200. 10.1023/A:1007384525568.
The study was funded by the Victorian Health Promotion Foundation and the National Health and Medical Research Council (NHMRC), Australia.
The authors have no competing interests to declare.
SLB and JAP conceived of and designed the study. SM performed the statistical analysis and drafted the manuscript. JAP helped collect the data and takes responsibility for the integrity of the study. SLB, HG and JAP critically revised the manuscript. All authors read and approved the final manuscript.