- Research note
- Open access
- Published:
Study invitations with envelopes made from recycled paper do not increase likelihood of active responses or study participation in the German National Cohort
BMC Research Notes volume 12, Article number: 468 (2019)
Abstract
Objective
We conducted a trial embedded within the German National Cohort comparing the responses to study invitations sent in recycled envelopes of grey color vs. envelopes of white color. We analyzed paradata for reactions to the invitation letters by potential subjects, the duration between mailing date of the invitation and active responses, and study participation.
Results
Grey envelopes only slightly increased the chance of active responses (OR 1.16, 95% CI 0.83, 1.62) to the invitation letter. Potential study subjects with German nationality (OR 3.75, 95% CI 2.07, 7.66) and age groups above 50 years (50–59: OR 1.78, 95% CI 1.19, 2.69; 60–69: OR 2.25, 95% CI 1.48, 3.43) were more likely to actively respond to the invitation letter. The duration between mailing date of the invitation and active response was not associated with envelope color, sex, nationality, or age. Our trial replicates previous observations that the color of the envelope of a study invitation does not influence the likelihood of an active response or study participation.
Introduction
In recent years, the problem of decreasing response in population-based research has received considerable attention [1,2,3,4,5] and although its implications are still a matter of debate [6,7,8,9,10,11], there seems to be a consensus that a higher response is generally preferable [10, 12]. A systematic review by Edwards and colleagues [12] reported that already some low-level characteristics of the delivery (e.g., recorded or first-class delivery, hand-written addresses) can increase the response to a mailed survey. The color of envelope (brown vs. white) did not influence the response [12] but may do so in other cultural contexts. We compared the response to grey vs. white envelopes that we used for invitations to a large cohort study in Germany. Grey envelopes are commonly used by German official authorities and we assumed that a more official character might influence the recipient’s attitude towards the contents of the letter. The response might also be influenced the by fact that grey envelopes apparently are made from recycled paper, whereas the paper source is not obvious for white envelopes.
In this trial, embedded in the German National Cohort (GNC, German: NAKO Gesundheitsstudie [13]), we investigated whether the envelope color of the first invitation influenced the probability of a reply to the invitation, the delay between mailing date and replies, and, finally, the probability of study participation.
Main text
Methods
The GNC is a cohort study investigating the causes for the development of major chronic diseases. The baseline examinations are conducted from 2014 to 2019. In 18 regional study centers across Germany, a random sample of the general population including a total of 100,000 women and 100,000 men aged 20–69 years will be examined. Potential study participants are randomly drawn from the regional registries of residents and corresponding contact details are provided to the respective study center. The baseline assessments include an extensive interview and self-completion questionnaires, a wide range of medical examinations and the collection of various biomaterials. Detailed information can be found elsewhere [13].
The recruitment protocol of the GNC includes an invitation letter, followed by up to three reminder letters separated by waiting periods of 14 days. The invitation letter asks potential participants to either return a pre-stamped response letter, e-mail, or to call the study center using a toll-free telephone number. For potential study subjects with known phone numbers, the invitation letter is followed by phone calls, and afterwards up to three reminder letters. The recruitment is controlled by MODYS [14], a dedicated software that schedules recruitment tasks and electronically documents all paradata, that is, detailed data about the recruitment process (e.g., events, attempted and successful contacts with potential subjects).
This trial was conducted in the Bremen study center of the GNC which will recruit a total of 10,000 cohort participants. The trial was restricted to potential subjects without known phone numbers to prevent phone calls of the study center during the waiting period.
For this trial, we planned to send out invitation letters with 1925 white and 1925 grey envelopes during 8 consecutive weeks between February and April 2017. With this sample size and an assumed response of approximately 11%, a response change of ± 3 percentage points can be detected with a power of 0.80. In each week letters were sent out on 2 days (usually Monday and Tuesday, according to the normal mailing schedule of the study) with only white envelopes used on 1 day and only grey ones on the other. Colors were randomly assigned to weekdays prior to the trial. The number of letters sent out per day varied between 225 and 250. Due to human error white envelopes were sent out on a “grey day” once, resulting in a final sample size of 2174 white and 1595 grey letters. The remaining recruitment adhered to the general recruitment protocol outlined above. We analyzed paradata for reactions by potential subjects during the first waiting period of 14 days (responses by mail, phone, e-mail, or personal contact in the study center) and derived the outcome ‘active response’ (0: not responded vs. 1: responded). For subjects actively responding within the first waiting period, we calculated the duration in days between the mailing of the invitation letter and their response. Whether or not subjects eventually participated in the GNC baseline examination defined the second outcome ‘participation’ (0: not participated vs. 1: participated). In our analyses, we included the variables sex (female vs. male), nationality (German vs. non-German), and age (categories: 20–29, 30–39, 40–49, 50–59, and 60–69 years), as provided by the registry of residents. To adjust for potential differences between weekdays, data from the 4 months preceding the trial was used to calculate pre-trial baselines for the likelihood of active responses and study participation separately for each weekday letters were sent out. Likewise, pre-trial baselines were calculated for the mean duration to respond to the invitation letter.
Subjects were excluded from further analyses if invitation letters were returned as undeliverable (i.e., subject moved or address turned out to be incorrect; N = 103) or if the paradata included recruitment events before the trial started (e.g., previous invitations sent to wrong addresses; N = 143) or phone calls initiated by the study center (N = 4). Furthermore, one subject was excluded because of missing data on nationality. The resulting analysis group consisted of 3518 subjects to whom letters with 2022 white and 1496 grey envelopes were sent (Fig. 1).
To estimate associations with the outcomes active response and participation we used logistic regression models adjusted for pre-trial likelihood of active responses and study participation to calculate odds ratios (ORs) and 95% confidence intervals (CIs). For the study participation model, 71 cases were excluded from the analysis (22 cases did not complete recruitment and 49 were not eligible, not capable, or deceased), reducing the analysis group to 3447 cases. We assessed the association between type of envelope and duration (ORs and 95% confidence intervals) to respond to the invitation letter with a linear regression model adjusted for pre-trial duration to respond to the invitation letter.
Results
Only 171 subjects responded actively to the invitation letter while 373 eventually participated in the study. Grey envelopes only slightly increased the chance of active responses (OR 1.16, 95% CI 0.83, 1.62, Table 1). In contrast to non-Germans, potential study subjects with German nationality (OR 3.75, 95% CI 2.07, 7.66) and, compared to the age group 40–49, age groups above 50 years (50–59: OR 1.78, 95% CI 1.19, 2.69; 60–69: OR 2.25, 95% CI 1.48, 3.43) were more likely to actively respond to the invitation letter and also eventually to participate in the Bremen GNC study. Male and female subjects did not differ in their likelihood to actively respond (OR 0.73, 95% CI 0.53, 1.02) but males were less likely to eventually participate (OR 0.71, 95% CI 0.57, 0.90). For both outcomes, we checked whether envelope color interacted with age, sex, or nationality, but no meaningful interactions were found (results not shown).
The duration between mailing date of the invitation and active response was not associated with envelope color, sex, nationality, or age (mean duration white envelopes 7.5 days vs. grey envelopes 7.4 days, Table 2).
Discussion
Our trial replicates the observation by Edwards et al. [12] that the color of the envelope of a study invitation does not significantly influence the likelihood of an active response or study participation. An update of the two meta-analyses relevant to our study (Analyses 20.1. and 20.2. in [12]) resulted in only slightly decreased odds ratios and no changes to the authors’ original conclusions (Additional file 1: Figures S1, S2). Furthermore, our data confirm previous reports from the pretest of the GNC indicating that subjects with a foreign background are less likely to participate [15, 16]. It should be noted, that the execution of this trial was eased by the utilization of the MODYS software for recruitment, in which all measures of interest were routinely recorded. We would therefore advocate for the routine collection of paradata that would greatly facilitate the assessment of new trials or periodic replications of previous trials testing the effects of low-level or technical characteristics of recruitment schemes. In addition to dedicated software, however, collecting detailed paradata routinely of course also requires extra effort and diligence from the recruiting personnel, but once available, they offer opportunities for new insights on the recruitment process that would not be available without [14, 17].
Limitations
It is not clear, however, whether the low response observed here generalizes to GNC as a whole since this trial is based only on a small sample from only one study center. Additionally, the sample in this trial excluded subjects with known phone numbers and phone contacts are known to have a positive effect on the response [15, 18].
Availability of data and materials
The datasets analysed during the current study are not publicly available due to privacy concerns but are available from the corresponding author on reasonable request.
Abbreviations
- CI:
-
confidence interval
- GNC:
-
German National Cohort
- OR:
-
odds ratio
References
Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17:643–53.
Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Quart. 2006;70:646–75.
La Verda N, Teta MJ. Re: “reporting participation in epidemiologic studies: a survey of practice”. Am J Epidemiol. 2006;164:292–292.
Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163:197–203.
Stang A. Nonresponse research—an underdeveloped field in epidemiology. Eur J Epidemiol. 2003;18:929–31.
Jöckel KH, Stang A. Cohort studies with low baseline response may not be generalisable to populations with different exposure distributions. Eur J Epidemiol. 2013;28:223–7.
Rothman KJ, Gallacher JE, Hatch EE. Why representativeness should be avoided. Int J Epidemiol. 2013;42:1012–4.
Stang A, Jöckel KH. Studies with low response proportions may be less biased than studies with high response proportions. Am J Epidemiol. 2004;159:204–10.
Groves RM, Couper MP, Presser S, Singer E, Tourangeau R, Acosta GP, Nelson L. Experiments in producing nonresponse bias. Public Opin Quart. 2006;70:720–36.
Lacey JV Jr, Savage KE. 50% response rates: half-empty, or half-full? Cancer Causes Control. 2016;27:805–8.
Nohr EA, Frydenberg M, Henriksen TB, Olsen J. Does low participation in cohort studies induce bias? Epidemiology. 2006;17:413–8.
Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009. https://doi.org/10.1002/14651858.MR000008.pub4.
German National Cohort C. The German National Cohort: aims, study design and organization. Eur J Epidemiol. 2014;29:371–82.
Reineke A, Pigeot I, Ahrens W, Rach S. MODYS—a modular control and documentation system for epidemiological studies. In: Bammann K, Lissner L, Pigeot I, editors. Instruments for health surveys in children and adolescents. Ahrens W: Springer Nature; 2018. p. 25–45.
Winkler V, Leitzmann M, Obi N, Ahrens W, Edinger T, Giani G, Linseisen J, Loffler M, Michels K, Nothlings U, et al. Response in individuals with and without foreign background and application to the National Cohort in Germany: which factors have an effect? Int J Public Health. 2014;59:555–63.
Reiss K, Dragano N, Ellert U, Fricke J, Greiser KH, Keil T, Krist L, Moebus S, Pundt N, Schlaud M, et al. Comparing sampling strategies to recruit migrants for an epidemiological study. Results from a German feasibility study. Eur J Public Health. 2014;24:721–6.
Langeheine M, Pohlabeln H, Ahrens W, Rach S. Consequences of an extended recruitment on participation in the follow-up of a child study: results from the German IDEFICS Cohort. Paediatr Perinat Epidemiol. 2017;31:76–86.
Stang A, Moebus S, Dragano N, Beck EM, Mohlenkamp S, Schmermund A, Siegrist J, Erbel R, Jockel KH, Heinz Nixdorf Recall Study Investigation G. Baseline recruitment and analyses of nonresponse of the Heinz Nixdorf Recall Study: identifiability of phone numbers as the major determinant of response. Eur J Epidemiol. 2005;20:489–96.
Acknowledgements
This project was conducted with data from the German National Cohort (GNC) (http://www.nako.de). We thank all participants who took part in the GNC study and the staff in this research program.
Funding
This project was conducted with data from the German National Cohort (GNC) (http://www.nako.de). The GNC is funded by the Federal Ministry of Education and Research (BMBF, project funding reference numbers: 01ER1301A/B/C and 01ER1511D), federal states and the Helmholtz Association with additional financial support by the participating universities and the institutes of the Leibniz Association. The funding bodies had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript. The publication of this article was partly funded by the Open Access Fund of the Leibniz Association.
Author information
Authors and Affiliations
Contributions
ML, KG, and SR designed the trial; ML and SR analyzed the data; ML and SR wrote the manuscript; ML, HP, WA, KG, and SR discussed the results, edited the manuscript and were responsible for quality assurance and control. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was approved by the Ethics committee of the local chamber of physicians in Bremen (Bremen Medical Association, reference number RE/HR-388). Written informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file
Additional file 1.
Results of the update of the meta-analysis conducted by Edwards and colleagues (2009) on the comparison of non-white vs. white envelope color on first response and final response.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Langeheine, M., Pohlabeln, H., Ahrens, W. et al. Study invitations with envelopes made from recycled paper do not increase likelihood of active responses or study participation in the German National Cohort. BMC Res Notes 12, 468 (2019). https://doi.org/10.1186/s13104-019-4510-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13104-019-4510-y