- Research note
- Open Access
Design and validation of a food frequency questionnaire to assess the dietary intake for adults in pastoral settings in Northern Tanzania
BMC Research Notes volume 14, Article number: 274 (2021)
Food frequency questionnaires are widely used as a dietary assessment tool in nutritional epidemiology to determine the relationship between diet and diseases. In Tanzania, there are several cultural variations in food intake which makes it necessary to design and validate a culture-specific food frequency questionnaire (CFFQ). Therefore, we designed a 27-items CFFQ and examine its validity in pastoral communities. Validity of CFFQ was assessed by comparing nutrient intake estimated from the CFFQ against the average from two 24-h diet recall (2R24). Spearman’s correlation coefficients, cross classification and Bland–Altman’s methods were used to assess the validity of CFFQ.
A total of 130 adults aged 18 years and above completed both CFFQ and 2R24. Correlation coefficients between CFFQ and 2R24 ranged from low (r = − 0.07) to moderate (r = 0.37). The correlation coefficients were moderately significant for kilocalories (r = 0.31, p < 0.001), carbohydrate (r = 0.33, p < 0.001), magnesium (r = 0.37, p < 0.001), and iron (r = 0.34, p < 0.001). On average, about 69% of participants were correctly classified into the same or adjacent quartile of energy and nutrient intake, while 9% were misclassified by the CFFQ. Bland–Altman’s plot demonstrated that the CFFQ had acceptable agreement with the 2R24.
The World Health Organization (WHO) estimated that approximately 1.7 million deaths worldwide are attributable to an unhealthy diet . Unhealthy diet is a cornerstone of several non-communicable diseases (NCDs) such as hypertension, type 2 diabetes and cancer [2,3,4]. Tanzania has made significant achievement in the reduction of diet-related NCDs despite the levels being high [5, 6]. Evaluating for dietary intake of the population is important because it help to determine the nutritional status and understand the association with diet-related diseases such as NCDs.
Literature suggests that the use of food frequency questionnaire (FFQ) is more appropriate for measuring habitual intake of foods and nutrients than alternative methods such as 24-h diet recall and food records [7, 8]. These questionnaires are relatively cheap to administer in population-based studies [7, 9, 10]. Because a FFQ does not necessarily estimate the actual amount of food intake, their validity needs to be evaluated. There is no ‘gold standard’ for validation of FFQ, but commonly the estimated intake from FFQ is compared against the intake from other dietary assessment methods .
To date, numerous studies have been devoted to assess the validity of FFQs before their application in Tanzania and elsewhere [12,13,14,15]. However, the applicability of these questionnaires for use in pastoral settings is limited. Pastoral livelihoods depend on animal production, and they have different dietary habits from that of urban populations. It is therefore important to design a FFQ that contains appropriate food items suitable for use in pastoral communities in order to correspond to the prevailing food culture . In this study, we explain the design of a culture-specific food frequency questionnaire (CFFQ) as part of a study that investigating the influence of dietary factors on NCDs in pastoral communities in Tanzania. This study aims to assess the relative validity of a CFFQ by comparing the dietary intake measured from CFFQ against the average of two 24-h diet recalls (2R24).
Materials and methods
This was a cross-sectional study involving adults aged 18 years or older who are permanent residents of Monduli district of Arusha Region (northern Tanzania). The majority of the population in the district identifies as traditional Maasai pastoralists (97%) and few agro-pastoralists who predominantly live in rural areas. We conducted the face to face interviews in a “boma” setting. A “boma” is a collection of households enclosed by a tree branches to protect animals from intruders and predators. A total of 15 “bomas” were selected from previously sampled villages . Households were randomly selected from each “boma” using a random start approach until the required number was reached. The number of participants was set at 150 after considering the recommended sample size of 100 for the validation study by Cade et al. , and after taking into account the loss to follow-up.
Development of the CFFQ
A culture-specific food frequency questionnaire (CFFQ) was designed from the food consumption data of one day 24-h dietary recall representative for the study population as described previously in detail . By using stepwise multiple regression analysis, food items in the model that explained 90% (R2 ≥ 90) of the between-person variability of total energy, carbohydrates, protein and fats were considered in the final CFFQ. About 42 foods and beverages were included in the initially developed CFFQ. We pilot tested these food items in a sub-sample (n = 31) in order to identify foods that were consumed rarely and on special occasions. None of these subjects were included in the final validation study. Finally, this resulted in a CFFQ of 27 food items (Additional file 1). In the CFFQ, all participants were required to indicate how many times they consumed each food item in the past month. The frequency of consumption was measured by selecting one of the following nine options: (1) never; (2) 1–3 per month (3) once per week; (4) 2–4 times per week; (5) 5–6 times per week; (6) once per day; (7) 2–3 times per day (8) 4–5 times per day (9) 6 + times per day . Portion sizes for food items and mixed dishes were defined based on the most commonly consumed portion sizes and mixed dishes. Pictures of utensils and photographs were also used during the interview to assist the participants.
Validation of the CFFQ
All participants were requested to complete two 24-h diet recalls for non-consecutive days (2R24) as reference method for validation . We administered the first 24-h diet recall with the CFFQ during the first visit. A second 24-h diet recall was repeated on the same participant after three to four weeks. All participants were asked to recall foods and beverages consumed on the previous day. This included quantitative response alternatives of the portion size consumed (bowl, plate, saucer, units, glasses or cups). As foods are often eaten as composite dishes, we asked them to estimate amounts of individual components eaten.
Estimation of energy and nutrient intake
Nutrient values were taken from the Tanzania Food Composition Table (TFCT) . The TFCT provides the amounts of each nutrient per 100 g for individual foods, beverages and for mixed dishes. For other local foods items that are absent in TFCT, similar foods were selected based on the nutritional composition of that food. For the CFFQ, the frequency responses were converted into number of servings per day (for-example, once per week = 0.143 servings per day) and multiplied by portion size . For every 100 g of food, we estimated the daily intake of energy and nutrients.
Median and interquartile ranges (IQR) for dietary energy and nutrient intake were compared using a Wilcoxon signed rank test . Macronutrients were separately adjusted for total energy intake using the nutrient density method as a percentage of energy. We used the Spearman’s correlation coefficients with 95% confidence intervals (CI), cross-classification and Bland–Altman’s methods to assess the validity of CFFQ. Weighted Kappa (k) values were calculated and interpreted as follows: > 0.80 indicates very good agreement, 0.61–0.80 good agreement, 0.41–0.60 moderate agreement, 0.21–0.40 fair agreement, and < 0.20 poor agreement . The Bland–Altman’s method was used to visualize the agreement between CFFQ and 2R24. The differences in nutrient intake from the two dietary methods (CFFQ −2R24) were plotted against the mean of nutrient intake from the two methods ((CFFQ + 2R24)/2) . Analysis was performed using Stata 16 (Texas, USA) and SPSS version 23 (Armonk, New York, USA).
A total of 130 participants completed both CFFQ and 2R24. Twenty participants (n = 20) were lost to follow-up. Participants had a mean (± SD) age of 35.3 (± 17.0) years, and 98 (75.3%) were females. Table 1 shows that there was a significant difference in median daily intake estimated by CFFQ and 2R24 (p < 0.05). Moreover, low (r = -0.07) to moderate (r = 0.37) Spearman’s rank correlation coefficients were found between the CFFQ and average of 2R24. Correlation coefficients were moderately significant for kilocalories (r = 0.31, p < 0.001) carbohydrate (r = 0.33, p < 0.001), magnesium (r = 0.37, p < 0.001), and iron (r = 0.34, p < 0.001).
The percentage of participants correctly classified into the same quartile ranged from 20% (sodium) to 37.7% (kilocalories). On average, about 69% of participants were correctly classified within one quartile which ranges from 53.8% (vitamin A) to 79.2% (iron and magnessium). The proportion of participants classified into opposite quartile was on average 9.6%. Most of the nutrients have shown a significant fair classification agreement with acceptable kappa statistic (k) in magnesium (k = 0.4, p < 0.001), kilocalories (k = 0.34, p < 0.001), carbohydrate (k = 0.34, p < 0.001), iron (k = 0.38, p < 0.001) and phosphorous (k = 0.3, p < 0.001) as shown in Table 2.
Moreover, Bland–Altman’s analysis shows that the CFFQ systematically overestimated kilocalories, carbohydrates, % protein and fats. There is, however, an acceptable level of agreement between both methods as most points were close to the mean and distributed within the 95% limit of agreement (LOAs), while very few (less than 10%) were outside the LOAs (Fig. 1).
In this study, we examined the relative validity of a CFFQ in pastoral communities in northern Tanzania. We found that the correlation coefficients between CFFQ and 2R24 range from low to moderate. Importantly, there was acceptable ranking of CFFQ in relation to 2R24. Therefore, our CFFQ has shown a low to moderate relative validity in measuring absolute nutrient intake, and found to be acceptable in classifying individuals according to dietary consumption in pastoral communities.
While the correlation coefficients reported here were small, this is consistent with the previous FFQ validation studies conducted in other parts of Tanzania [12, 18]. Moreover, our CFFQ tends to overestimate intake of energy and nutrients in relation to 2R24. Overestimation from CFFQ was expected because participants were asked to report the frequency of consumption of a finite list of food items over one month, while in 24-h diet recall participants reported the actual food intake for previous day . In comparison, overestimation from FFQ has been widely reported in many validation studies [21,22,23].
As previously suggested, when validating a FFQ—correlation coefficients should be at least 0.3 [7, 24]. This study indicating that the designed CFFQ may be capable of estimating absolute intake of kilocalories, carbohydrate, magnesium and iron. This may be due to the fact that these nutrients are available in most types of foods that form part of the daily meal in this community. We also found significant, however a small correlation for some micronutrients. The small correlation can be explained by little consumption of micronutrients rich foods such as fruits and vegetables in the study population. The small correlation of micronutrients in this study are somehow comparable with those reported in other validation studies in Tanzania , Botswana  and Bangladesh .
We found that agreement in ranking of participants was significant for most nutrients. This important finding demonstrates that the CFFQ is satisfactory in ranking of individuals, and this was the main purpose of developing this FFQ. The percentage of disagreement was on average 9.6%, which is acceptable level as shown by Masson et al. . Similar findings have been reported from validation studies elsewhere [27, 28]. Nevertheless, our CFFQ is relatively shorter than other previous developed FFQs in African countries such as South Africa  and Mali , but longer compared to that for adults in rural areas of Rwanda . To our knowledge, this is the first report on validation of a CFFQ in Tanzania.
This study has some strength. By collecting a repeated 24-h diet recalls it may ensure the accuracy of the dietary data. We are confident that the food list in the designed CFFQ covers more than 90% of the typical daily diet consumed in this community, since the development of the food list was based on pilot testing of CFFQ and that the diet of population is relatively homogeneous and simple.
In conclusion, the designed CFFQ can be useful in ranking participants based on their food consumption in pastoral communities. The CFFQ has a low to moderate relative validity for measurements of absolute nutrients intake due to overestimation. This however provides encouragement to the conducting of nutritional epidemiological studies using CFFQ in rural and hard to rich population like “Maasai” pastoralists.
There are some limitations in this study. Our CFFQ was not very exhaustive and consists of food items that are regularly consumed in the community. However, the main purpose was to develop a short and CFFQ that can be used to assess the dietary habits of adults in the community. In addition, CFFQ and 2R24 are both dependent on memory , therefore, we cannot rule out the possibility of over and under-estimation from participants. As opposed to conventional recommendations for FFQ validation studies , it was not possible to validate against 7-days food records as this may require high literacy.
Availability of data and materials
The data used to support the findings of this study are available from authors upon special request.
Two days 24-h diet recalls
Culture specific food frequency questionnaire
Food frequency questionnaire
WHO. Unhealthy diet. 2018. https://www.who.int/gho/ncd/risk_factors/unhealthy_diet_text/en/. Accessed 23 May 2019.
Schwingshackl L, Schwedhelm C, Hoffmann G, Knuppel S, Iqbal K. Food groups and risk of hypertension: a systematic review and dose-response meta-analysis of prospective studies. Adv Nutr. 2017. https://doi.org/10.3945/an.117.017178.
Zhao D, Qi Y, Zheng Z, Wang Y, Zhang X-Y, Li H-J, et al. Dietary factors associated with hypertension. Nat Rev Cardiol. 2011;8:456.
Ndanuko RN, Tapsell LC, Charlton KE, Neale EP, Batterham MJ. Dietary patterns and blood pressure in adults: a systematic review and meta-analysis of randomized controlled trials. Adv Nutr. 2016;7(1):76–89.
Mayige M, Kagaruki G, Ramaiya K, Swai A. Non communicable diseases in Tanzania: a call for urgent action, Tanzan. J Health Res. 2011;13(5 Suppl 1):378–86.
Narh-Bana S, Chirwa T, Mwanyangala M, Nathan R. Adult deaths and the future: a cause-specific analysis of adult deaths from a longitudinal study in rural Tanzania 2003–2007. Tropical Med Int Health. 2012;17(11):1396–404.
Cade J, Thompson R, Burley V, Warm D. Development, validation and utilisation of food-frequency questionnaires: a review. Public Health Nutr. 2002. https://doi.org/10.1079/PHN2001318.
FAO. Dietary Assessment: A resource guide to method selection and application in low resource settings. 2018. http://www.fao.org/documents/card/en/c/I9940EN/. Accessed 13 July 2021.
Naja F, Shatila H, Meho L, Alameddine M, Haber S, Nasreddine L, et al. Gaps and opportunities for nutrition research in relation to non-communicable diseases in Arab countries: call for an informed research agenda. Nutr Res. 2017;47:1–12.
Thompson FE, Subar AF. Dietary assessment methodology. In: Coulston AM, Rock CL, Monsen ER, editors. Nutrition in the prevention and treatment of disease. San Diego: Academic press; 2001.
Cade JV, Burley VJ, Warm DL, Thompson RL, Margetts BM. Food-frequency questionnaires: a review of their design, validation and utilisation. Nutr Res Rev. 2004. https://doi.org/10.1079/NRR200370.
Jordan I, Hebestreit A, Swai B, Krawinkel MB. Dietary patterns and breast cancer risk among women in northern Tanzania: a case–control study. Eur J Nutr. 2013;52(3):905–15.
Katalambula LK, Meyer DN, Ngoma T, Buza J, Mpolya E, Mtumwa AH, et al. Dietary pattern and other lifestyle factors as potential contributors to hypertension prevalence in Arusha City, Tanzania: a population-based descriptive study. BMC Public Health. 2017;17(1):659.
Doustmohammadian A, Amini M, Esmaillzadeh A, Omidvar N, Abtahi M, Dadkhah-Piraghaj M, et al. Validity and reliability of a dish-based semi-quantitative food frequency questionnaire for assessment of energy and nutrient intake among Iranian adults. BMC Res Notes. 2020;13(1):95.
Zack RM, Irema K, Kazonda P, Leyna GH, Liu E, Gilbert S, et al. Validity of an FFQ to measure nutrient and food intakes in Tanzania. Public Health Nutr. 2018;21(12):2211–20.
Khamis AG, Senkoro M, Mwanri AW, Kreppel K, Mfinanga SG, Bonfoh B, et al. Prevalence and determinants of hypertension among pastoralists in Monduli District, Arusha region in Tanzania: a cross-sectional study. Arch Public Health. 2020;78(1):99.
Lukmanji Z, Hertzmark E, Mlingi N, Assey V, Ndossi G, Fawzi W. Tanzania food composition Tables. MUHAS- TFNC, HSPH, Dar es Salaam Tanzania. 2008. https://cdn1.sph.harvard.edu/wp-content/uploads/sites/30/2012/10/tanzania-food-composition-tables.pdf. Accessed 13 July 2021.
Zack R, Irema K, Kazonda P, Leyna G, Liu E, Gilbert S, et al. Validity of an FFQ to measure nutrient and food intakes in Tanzania. Public Health Nutr. 2018. https://doi.org/10.1017/S1368980018000848.
Gibson RS. Principles of nutritional assessment. Oxford: Oxford University Press; 2005.
Huang M-C, Lin K-D, Chen H-J, Wu Y-J, Chang C-I, Shin S-J, et al. Validity of a short food frequency questionnaire assessing macronutrient and fiber intakes in patients of han chinese descent with type 2 diabetes. Int J Environ Res Public Health. 2018;15(6):1142.
Streppel MT, de Vries JH, Meijboom S, Beekman M, de Craen AJ, Slagboom PE, et al. Relative validity of the food frequency questionnaire used to assess dietary intake in the Leiden Longevity Study. Nutr J. 2013;12:75.
Steinemann N, Grize L, Ziesemer K, Kauf P, Probst-Hensch N, Brombach C. Relative validation of a food frequency questionnaire to estimate food intake in an adult population. Food Nutr Res. 2017;61(1):1305193.
Bowen L, Bharathi AV, Kinra S, Destavola B, Ness A, Ebrahim S. Development and evaluation of a semi-quantitative food frequency questionnaire for use in urban and rural India. Asia Pac J Clin Nutr. 2012;21(3):355–60.
Masson LF, McNeill G, Tomany JO, Simpson JA, Peace HS, Wei L, et al. Statistical approaches for assessing the relative validity of a food-frequency questionnaire: use of correlation coefficients and the kappa statistic. Public Health Nutr. 2007;6(3):313–21.
Jackson MD, Motswagole BS, Kwape LD, Kobue-Lekalake RI, Rakgantswana TB, Mongwaketse T, et al. Validation and reproducibility of an FFQ for use among adults in Botswana. Public Health Nutr. 2012;16(11):1995–2004.
Chen Y, Ahsan H, Parvez F, Howe GR. Validity of a food-frequency questionnaire for a large prospective cohort study in Bangladesh. Br J Nutr. 2004;92(5):851–9.
Mohammadifard N, Sajjadi F, Maghroun M, Alikhasi H, Nilforoushzadeh F, Sarrafzadegan N. Validation of a simplified food frequency questionnaire for the assessment of dietary habits in Iranian adults: Isfahan Healthy Heart Program, Iran. ARYA Atheroscler. 2015;11(2):139–46.
Beck KL, Houston ZL, McNaughton SA, Kruger R. Development and evaluation of a food frequency questionnaire to assess nutrient intakes of adult women in New Zealand. Nutr Diet. 2020. https://doi.org/10.1111/1747-0080.12472.
MacIntyre UE, Venter CS, Vorster HH. A culture-sensitive quantitative food frequency questionnaire used in an African population: 2. Relative validation by 7-day weighed records and biomarkers. Public Health Nutr. 2007;4(1):63–71.
Parr CL, Barikmo I, Torheim LE, Ouattara F, Kaloga A, Oshaug A. Validation of the second version of a quantitative food-frequency questionnaire for use in Western Mali. Public Health Nutr. 2002;5(6):769–81.
Yanagisawa A, Sudo N, Amitani Y, Caballero Y, Sekiyama M, Mukamugema C, et al. Development and validation of a data-based food frequency questionnaire for adults in Eastern Rural Area of Rwanda. Nutr Metab Insights. 2016;9:31–42.
We acknowledge our research staff, field workers and the study participants without whom the present study would have not been possible.
This study was conducted within the framework of the DELTAS Africa Initiative [Afrique One-ASPIRE /DEL-15–008]. Afrique One-ASPIRE is funded by a consortium of donor including the African Academy of Sciences (AAS) Alliance for Accelerating Excellence in Science in Africa (AESA), the New Partnership for Africa’s Development Planning and Coordinating (NEPAD) Agency, the Wellcome Trust [107753/A/15/Z] and the UK government.
Ethics approval and consent to participate
Ethical approval for the study was obtained from the Muhimbili University of Health and Allied Sciences (MUHAS) Institutional Review Board (IRB) number MUHAS-REC-9–2019-038. Permission to start the project was given by the Monduli district medical officer (DMO). Participants gave their written informed consent as approved by the IRB before the start of the data collection.
Consent for publication
The authors declare no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Khamis, A.G., Mwanri, A.W., Ntwenya, J.E. et al. Design and validation of a food frequency questionnaire to assess the dietary intake for adults in pastoral settings in Northern Tanzania. BMC Res Notes 14, 274 (2021). https://doi.org/10.1186/s13104-021-05692-8
- Relative validity
- Food frequency questionnaire
- Diet recall