Hand-held internet tablets for school-based data collection
© Denny et al; licensee BioMed Central Ltd. 2008
Received: 04 April 2008
Accepted: 26 July 2008
Published: 26 July 2008
In the last 20 years, researchers have been using computer self-administered questionnaires to gather data on a wide range of adolescent health related behaviours. More recently, researchers collecting data in schools have started to use smaller hand-held computers for their ease of use and portability. The aim of this study is to describe a new technology with wi-fi enabled hand-held internet tablets and to compare adolescent preferences of laptop computers or hand-held internet tablets in administering a youth health and well-being questionnaire in a school setting.
A total of 177 students took part in a pilot study of a national youth health and wellbeing survey. Students were randomly assigned to internet tablets or laptops at the start of the survey and were changed to the alternate mode of administration about half-way through the questionnaire. Students at the end of the questionnaire were asked which of the two modes of administration (1) they preferred, (2) was easier to use, (3) was more private and confidential, and (4) was easier to answer truthfully.
Many students expressed no preference between laptop computers or internet tablets. However, among the students who expressed a preference between laptop computers or internet tablets, the majority of students found the internet tablets more private and confidential (p < 0.001) and easier to answer questions truthfully (p < 0.001) compared to laptop computers.
This study demonstrates that using wi-fi enabled hand-held internet tablets is a feasible methodology for school-based surveys especially when asking about sensitive information.
In the last 20 years, researchers have been using computer self-administered questionnaires to gather data on a wide range of adolescent health related behaviours[1, 2]. A major advantage of computer-administered questionnaires is their potential to improve the quality of self-reported data collection. In comparison with pen and paper questionnaires, computer questionnaires generally increase the reporting of sensitive behaviours in young people. The effect of computer administration on reporting of sensitive behaviours appears to be context specific and related to the perceived privacy of the mode of administration. Computer administered questionnaires have been enhanced by the addition of an audio 'voice-over' and multimedia graphics. With an audio 'voice-over', participants hear questions through headphones while at the same time they appear on screen. The addition of audio has been shown to further increase reporting of sensitive behaviours[2, 5] and addresses issues of poor literacy, English as a second language, and visual impairment.
More recently, researchers have started using hand-held computers such as Personal Digital Assistants (PDAs) to collect survey information. Hand-held computers have the advantage of being smaller and having greater portability. This may also result in more accurate data as the smaller size may mean that students perceive their answers to be more private and may be less inclined to be influenced by others around them . Current limitations of hand-held computers in survey research include the small screen size and the lack of robust data handling software.
The aim of this study is to compare adolescent preferences of laptop computers or hand-held internet tablets in administering a youth health and well-being questionnaire, and to report on a new technology with wi-fi enabled hand-held internet tablets.
Three schools from both rural and urban environments were asked to participate in the pilot study of Youth'07, a national youth health and well-being survey during August and September 2006. Two hundred and twenty-two students aged 12 to 17 years were randomly selected from the school roll based on the size of the school and invited to participate. Students and their parents were informed as to the purposes of the survey, given opportunities to ask questions and understood that their participation was voluntary. Participating students gave their consent to participate on the laptops or hand-held internet tablet at the beginning of the survey. Ethical approval was received from the University of Auckland Human subject ethics committee.
This survey of general health and well-being, included questions about sensitive risk behaviours and emotional well-being. The questionnaire covered areas such as home and family, school, emotional health concerns, sexual health, and substance use. A branched questionnaire design was used to limit exposure to sensitive questions for participants with no direct experience in these behaviours.
Students were assigned in groups of about 30 students to one of the sessions on the survey days. The survey questions and responses were displayed on the screen of the computers and were read out over headphones. Responses were read out only when the corresponding text on the screen was selected. Answers were recorded by students using a mouse for the laptops and a touch sensitive screen for the internet tablets. The survey was available in both English and Mâori languages with students able to toggle between these two languages. (Please see our website for a demonstration of the questionnaire interface and ability to toggle between languages .)
To compare internet tablets to laptops, participating students were randomly assigned to internet tablets or laptops at the start of the survey and were changed to the alternate mode of administration about half-way through the questionnaire. Students at the end of the questionnaire were asked which of the two modes of administration (1) they preferred, (2) was easier to use, (3) was more private and confidential, and (4) was easier to answer truthfully. Response options included 'laptop', 'nokia' or 'no difference'. Chi-square goodness-of-fit tests are used to test for equal proportions of students preferring laptop and internet tables amongst those who expressed a preference.
Young people's preference to mode of administration of a youth health questionnaire. Laptop vs. Internet Tablet
Responses n (%)
Which method do you prefer?
Which method was easier to use?
Which method was more private and confidential?
Which method was easier to answer truthfully?
Overall the average time taken to complete the questionnaire was 69 minutes with a mean of 66 minutes. The range was from 9 minutes to 117 minutes. The average number of questions answered was 451 (40%) out of a total of 1131 due to branching nature of the questionnaire. This number represents all questions with question sets and cumulative questions counted individually. For example a cumulative question with 20 response options is counted as 20 individual questions.
In this study of students responding to a health and well-being survey, among students who expressed a preference between laptop computers or internet tablets, internet tablets were reported to be more private and confidential and easier to answer truthfully compared with laptop computers. The small size of the hand-held computers and the relative close proximity of the laptop computers in the classroom setting may have influenced student's perceptions of privacy and confidentiality and therefore their ability to answer truthfully. Students also found the hand-held computers as easy to use as laptops. These findings are consistent with recent research in school settings that have found high rates of acceptability of hand-held computers with few differences in the rates of reporting of sensitive behaviours compared to laptop computers. These findings add to current knowledge regarding the comparative attributes of interview modalities in youth surveys which have largely focussed on differences between pen and paper compared to computer administered questionnaires[7, 12].
Previous research on the use of hand-held computers in school settings have utilised personal digital assistants or palm pilots. The advantage of internet tablets over personal digital assistants is a larger screen size allowing for more text and graphics to be displayed, including multiple stem questions. Using wi-fi enabled devices also means that the questionnaire could be administered and stored on a laptop server. This allows for the inclusion of audio files without limitations on memory on the hand-held devices and increases security of data handling.
This study demonstrates that using wi-fi enabled hand-held internet tablets is a feasible methodology for school based surveys especially when asking about sensitive information. Further research needs to compare student's preferences and usability of internet-tablets with PDAs.
This research is funded by the Health Research Council of New Zealand (grant 05/216), the Department of Labour, Families Commission, Accident Compensation Corporation, Sport and Recreation New Zealand, the Alcohol Advisory Council of New Zealand and the Ministries of Youth Development, Justice and Health. We thank the participating students and schools for their contributions to this study.
- Millstein SG, Irwin CE: Acceptability of computer-acquired sexual histories in adolescent girls. J Pediatr. 1983, 103: 815-819. 10.1016/S0022-3476(83)80493-4.View ArticlePubMedGoogle Scholar
- Beebe TJ, Harrison PA, Mcrae JAJ, Anderson RE, Fulkerson JA: An evaluation of computer-assisted self-interviews in a school setting. Public Opin Q. 1998, 62 (4): 623-632. 10.1086/297863.View ArticleGoogle Scholar
- Webb PM, Zimet GD, Fortenberry JD, Blythe MJ: Comparability of a computer-assisted versus written method for collecting health behavior information from adolescent patients. J Adolesc Health. 1999, 24 (6): 383-388. 10.1016/S1054-139X(99)00005-1.View ArticlePubMedGoogle Scholar
- Watson PD, Denny SJ, Adair V, Ameratunga SN, Clark TC, Crengle SM, Dixon RS, Fa'asisila M, Merry SN, Robinson EM, Sporle AA: Adolescents' perceptions of a health survey using multimedia computer-assisted self-administered interview. Aust N Z J Public Health. 2001, 25 (6): 520-524. 10.1111/j.1467-842X.2001.tb00316.x.View ArticlePubMedGoogle Scholar
- Tourangeau R, Smith TW: Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly. 1996, 60 (2): 275-304. 10.1086/297751.View ArticleGoogle Scholar
- Trapl ES, Borawski EA, Stork PP, Lovegreen LD, Colabianchi N, Cole ML, Charvat JM: Use of audio-enhanced personal digital assistants for school-based data collection. J Adolesc Health. 2005, 37 (4): 296-305. 10.1016/j.jadohealth.2005.03.025.PubMed CentralView ArticlePubMedGoogle Scholar
- Couper MP, Singer E, Tourangeau R: Understanding the effects of audio-CASI on self-reports of sensitive behavior. Public Opin Q. 2003, 67 (3): 385-395. 10.1086/376948.View ArticleGoogle Scholar
- Nokia 770 Internet Tablet. [http://en.wikipedia.org/wiki/Nokia_770_Internet_Tablet]
- Demonstration of a multimedia youth health survey tool. [http://english.youthsurvey.ac.nz]
- Ford CA, Millstein SG, Halpern-Felsher BL, Irwin CEJ: Influence of physician confidentiality assurances on adolescents' willingness to disclose information and seek future health care: A randomized controlled trial. JAMA. 1997, 278 (12): 1029-1034. 10.1001/jama.278.12.1029.View ArticlePubMedGoogle Scholar
- van Griensven F, Naorat S, Kilmarx PH, Jeeyapant S, Manopaiboon C, Chaikummao S, Jenkins RA, Uthaivoravit W, Wasinrapee P, Mock PA, Tappero JW: Palmtop-assisted self-interviewing for the collection of sensitive behavioral data: randomized trial with drug use urine testing. Am J Epidemiol. 2006, 163 (3): 271-278. 10.1093/aje/kwj038.View ArticlePubMedGoogle Scholar
- Supple AJ, Aquilino WS, Wright DL: Collecting sensitive self-report data with laptop computers: Impact on the response tendencies of adolescents in a home interview. Journal of Research on Adolescence. 1999, 9 (4): 467-488. 10.1207/s15327795jra0904_5.View ArticleGoogle Scholar