Skip to main content

Training, executive, attention and motor skills (TEAMS) training versus standard treatment for preschool children with attention deficit hyperactivity disorder: a randomised clinical trial

Abstract

Objective

This study compared the effectiveness of manualised training, executive, attention, and motor skills (TEAMS) training versus standard treatment in preschool children with attention deficit hyperactivity disorder (ADHD). We conducted a randomised parallel group, single-blinded, superiority trial. The primary outcome was ADHD symptoms and the secondary outcome was functionality. Parents and primary school teachers assessed outcomes at pretreatment, posttreatment, and at one, three, and 6 months follow-up.

Results

In total, 67 children (aged 3–6 years) were randomised. In the TEAMS group, 32 out of 33 (97%) participants completed the total 8-week program, compared with only 7 out of 26 (27%) in the control group. The repeated-model analyses showed no significant change between the two interventions for ADHD symptoms and functionality levels over time. The mean difference in ADHD symptoms between TEAMS versus standard treatment at posttreatment was 2.18 points (95% confidence interval − 8.62 to 13.0; trial sequential analysis-adjusted confidence interval − 19.3 to 23.7).

Trial registration Clinical Trials identifier: NCT01918436 (Retrospectively registered). Registered on 7 August 2013.

Introduction

Attention deficit hyperactivity disorder (ADHD) is a prevalent and chronic neuropsychiatric disorder with three core symptoms: inattention, hyperactivity, and impulsivity [1]. Neuroimaging and neuropsychological data have indicated growth and functional anomalies throughout the neocortex, white matter pathology, and disrupted anatomical connectivity in the brains of children with ADHD [2]. ADHD also affects neurocognitive functions and behavioural processes, including working memory, planning, and inhibitory control [2, 3].

Early childhood is a particularly vital and responsive period in brain development [4, 5]. Interventions that target neural growth and development may enable more sustainable ADHD treatments [6]. However, the long-term benefits and adverse events of pharmacological and non-pharmacological treatments need to be thoroughly investigated [7,8,9]. The training, executive, attention, and motor skills (TEAMS) program is a non-pharmacological and neurocognitive training program that targets preschool children with ADHD [10, 11]. Preliminary data from Halperin and colleagues have been favourable [10, 11], but randomised clinical trials on TEAMS training are lacking. We aimed to assess whether TEAMS training could significantly improve ADHD symptoms and functionality levels in Danish preschool children with ADHD, compared with standard treatment.

Main text

Methods

Trial design

We conducted a randomised parallel group, single-blinded, superiority trial. A comprehensive description of the trial design and rationale has been published elsewhere [12]. The study protocol was registered on ClinicalTrials.gov with the ID number NCT01918436. The trial obtained approval from Region Zealand’s Committee on Health Research Ethics in Denmark, with the project number SJ-331 and the registration number 34758. Informed, written, and signed consent was obtained by the participating children’s legal guardians. All participants were free to leave the trial, and if a child psychiatrist or legal guardian determined that a child needed pharmacological treatment, this was endorsed and the child was excluded. Any adverse events were reported. The trial adhered to the CONSORT checklist.

Participants

The recruitment period lasted from January 1, 2012 to October 31, 2015. Eligible children were referred from four child and adolescent psychiatric clinics in Region Zealand, Denmark, to an ADHD outpatient clinic in Holbaek, Denmark, where randomisation and both interventions were carried out. The interventions lasted for 8 weeks, with follow-up assessments at 1-, 3-, and 6-months.

Participants were included if they: (a) had a formal diagnosis of ADHD according to the diagnostic and statistical manual of mental disorders [1]; (b) were 3–6 years of age at baseline; and (c) their parents were willing to participate in the trial and consented to the children’s participation. Children were excluded if they: (a) lived in a residential institution or in an unstable environment outside the home; (b) did not speak or understand Danish; (c) were taking ADHD medication; (d) had significant disabilities as a result of physical or psychiatric comorbidity; or (e) had parents who were not capable or willing to cooperate in implementing the program.

Randomisation, treatment allocation, and blinding

The randomisation was conducted with the web-based tool OPEN Randomize [13]. We used central randomisation with computer generated, permuted randomisation sequences in blocs of four, and an allocation ratio of 1:1, stratified for sex and age. Participants, parents, treating physicians, or health personnel were not blinded to treatment allocations. Outcome assessors and the statistician were blinded to allocations [12].

Measures

Parents and teachers rated the primary outcomes at baseline, at post-treatment, and at follow-ups. The ADHD rating scale-IV (ADHD-RS IV) (Danish child version, ages 5–10 years) is a norm-referenced checklist, and contains 26 items that measure ADHD symptomology, including hyperactivity/impulsivity, inattention, and conduct problems [14, 15].

The strengths and difficulties questionnaire—Denmark (SDQ-DAN) is a behavioural screening questionnaire for children between 2 and 17 years, and measures emotional, conduct, hyperactivity, and peer problems [16]. Please see the protocol for a description of their psychometric properties [12].

Treatment groups

The participants in the TEAMS intervention were divided into groups of two to five families, who had 8 weekly 45-min meetings with separate parent and child sessions. The parent groups mainly consisted of psychoeducation and collaborative problem solving [12]. The children groups consisted of problem solving, plus aerobic exercise, and relaxation techniques.

The control group was the conventional treatment regime for preschool ADHD patients, as outlined by the Danish national clinical guidelines [17]. It entailed a combination of psychoeducation, socialising, and cooperation activities. For a comprehensive description of both interventions, please see the protocol [12].

Data analysis

The sample size was calculated based on a type I error (α) of 5% and a type II error (β) of 20% (i.e. power of 80%), with an allocation ratio of 1:1 [12]. We used a standard deviation of five points. With an estimated withdrawal of approximately 30 patients, we planned to randomise a total of 120 participants [12]. The analyses were primarily conducted with and without adjustment for stratification variables. SPSS Statistics 22 was used to conduct the analysis.

The significance level was set at p < 0.05. Prior to each analysis all effect measures were inspected for normality (test of kurtosis and skewness, as well as a Shapiro Wilks test, plus inspection of histograms and distributions).

Descriptive statistics were generated. We used a stepwise procedure to test the effect of the intervention and the effect of time. The effect size was estimated by mean differences and confidence intervals (CI) at baseline, posttreatment, 1, 3, and 6 months using independent sample T tests. Subsequently, we performed adjusted analyses with an analysis of covariance model (ANCOVA) to incorporate covariates, pre-score (for ADHD-RS-IV and SDQ-DAN, respectively), and group as a fixed-factor. We compared the difference between baseline and 8 weeks after the TEAMS intervention program, as well as the difference between the two groups. The ANCOVA model allowed us to look for differences in adjusted means (i.e. adjusted for the covariates). Finally, we measured the effects of the TEAMS intervention at different time points and between groups by using a general linear repeated measure model (GLM). In advance, model fit was assessed for each regression model.

As we were unable to reach the planned sample size, we conducted a post hoc trial sequential analysis on the primary teacher-rated outcome ADHD-RS IV at posttreatment. Trial sequential analysis is a tool for quantifying the statistical reliability of data by adjusting significance levels for sparse data and repetitive testing for accumulating data [18,19,20,21,22,23]. The required sample size was calculated based on a minimal relevant difference of 3 points, a standard deviation of 5 points, an alpha of 3.33% (to take into consideration that we had two primary outcomes), and a beta of 10%.

Results

Only 72 participants were eligible during the trial inclusion phase from January 1, 2012 to October 31, 2015, and five declined to attend the trial. This left us with 67 eligible participants to be randomised (Fig. 1). 65 children were of Danish ethnicity, whereas one boy and one girl had non-Danish ethnicities. 34 children (32 boys, 2 girls) were randomised to the TEAMS experimental group, and 33 children (31 boys, 2 girls) to the control group. One participant dropped out in the TEAMS intervention prior to baseline assessment, and seven participants in the control intervention (Fig. 1).

Fig. 1
figure 1

Flow chart of group allocations

In the TEAMS group, 32 out of 33 (97%) participants completed the total 8-week program. 33 were assessed at 1-month follow-up, 32 at 3 month follow-up and 33 and 6 months follow-up. Seven participants (21%) from the control group completed the total 8-week program. In turn, 20 (77%) participants were lost at 1-month follow-up, 19 (73%) at 3 months follow-up, and 18 (69%) at 6 months follow-up. Because of the substantial attrition rates in the control group, the intention-to-treat principle and multiple imputations were not conducted. Age, sex, and baseline ADHD-RS-IV and SDQ-DAN scores were balanced between the groups (Additional file 1).

ADHD symptoms changed positively over time (Table 1). The ANCOVA model showed no significant difference between the two groups for both scores (ADHD-RS-IV and SDQ-DAN) when we adjusted for baseline values and group (Additional file 2). The repeated measures GLM procedure illustrates the effect over time and between groups: results showed that ADHD symptoms changed significantly over time (p = 0.020) and no significant change appeared in the SDQ scores (p = 0.166). Over time and between groups, results were insignificant for both outcomes (Table 2). Also, wide confidence intervals for the ADHD-RS-IV and SDQ-DAN scores indicated no significant differences between groups over time (Additional files 3, 4). No adverse events were reported by the participants.

Table 1 ADHD symptoms and functionality (SDQ-DAN) over time
Table 2 Repeated measures GLM procedure of the effect over time and between groups (p values)

We conducted a post hoc trial sequential analysis (TSA) on the primary outcome ADHD symptoms at 8 weeks [18,19,20,21,22,23] (Additional file 5). The required information size was 130 participants. The cumulated Z-curve (blue curve) did not cross the trial sequential monitoring boundaries for benefits or harms (red inner sloping lines) or the trial sequential monitoring boundaries for futility (red outward sloping lines), implying that there was a risk of random errors. In accordance, the trial sequential analysis-adjusted confidence interval is − 19.3 to 23.7.

Discussion

No significant improvements on ADHD symptoms or functionality were seen over time in the TEAMS intervention compared with the standard treatment. There was substantial dropout in the standard treatment group, with 19 out of 26 participants (73%) withdrawing during the intervention period. This was mainly because parents in the standard treatment group wanted their children to initiate pharmacological treatment. The parents in the TEAMS group seldom raised this request.

The Danish health authorities recommend non-pharmacological treatments for preschool children with ADHD [17]. We chose to exclude medicated children in the trial to accurately measure the effects of a non-pharmacological intervention only. Many parents held that medication would make for a smoother transition from kindergarten to primary school, and dampen future academic, social, familial, or personal conflicts. However, methylphenidate and other stimulant medication may only have little, if any, clinically important effects on ADHD symptoms [7]. Like other stimulants, methylphenidate is also connected with a number of adverse events [8].

This trial has some strengths. We published a protocol beforehand, the outcome assessors were blinded to treatment allocations at baseline assessment, and we only used two outcome measures, which may have protected for multiplicity issues due to random errors [24, 25]. Publication bias is a prominent problem in intervention research [26, 27], and it is important that null findings like these are reported in a transparent fashion. The families and their networks were also offered a high level of psychoeducation during treatment, which is considered a good treatment strategy for ADHD in Denmark [17]. Large-scale randomised clinical trials are needed to determine the true clinical utility of TEAMS training.

Limitations

The required sample size of 90 participants was not reached, because there were too few referrals in the target age group during the time of enrolment. Thus, the trial is underpowered to detect a true difference (i.e. at risk of type II errors). We also experienced dropouts during the initial baseline assessment on sociodemographic factors. The large and uneven attrition rates likely confounded the results as well [28]. We planned to conduct intention-to-treat analyses and multiple imputation for missing follow-up data (> 5%), but decided not to due to the substantial dropout rates. There is no easy fix to attrition rates greater than 20%, and it is unlikely that adjustment strategies would have been able to save the data [28, 29].

Abbreviations

AHHD:

attention deficit hyperactivity disorder

TEAMS:

the training, executive, attention, and motor skills program

ADHD-RS IV:

the ADHD rating scale-IV

SDQ-DAN:

the strengths and difficulties questionnaire—Denmark

GLM:

general linear model

ANCOVA:

analysis of covariance model

References

  1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington: American Psychiatric Association; 2013.

    Book  Google Scholar 

  2. Faraone SV, Asherson P, Banaschewski T, Biederman J, Buitelaar JK, Ramos-Quiroga JA, et al. Attention-deficit/hyperactivity disorder. Nat Rev Dis Primers. 2015;1:15020.

    Article  PubMed  Google Scholar 

  3. Sonuga-Barke EJ, Fairchild G. Neuroeconomics of attention-deficit/hyperactivity disorder: differential influences of medial, dorsal, and ventral prefrontal brain networks on suboptimal decision making? Biol Psychiatry. 2012;15(72):126–33.

    Article  Google Scholar 

  4. Anderson V, Spencer-Smith M, Wood A. Do children really recover better? Neurobehavioral plasticity after early brain insult. Brain. 2011;134(8):2197–221.

    Article  PubMed  Google Scholar 

  5. Sonuga-Barke EJ, Koerting J, Smith E, McCann DC, Thompson M. Early detection and intervention for attention-deficit/hyperactivity disorder. Expert Rev Neurother. 2011;11(4):557–63.

    Article  PubMed  Google Scholar 

  6. Halperin JM, Bédard ACV, Curchak-Linchtin JT. Preventive interventions for ADHD: a neurodevelopmental perspective. Neurotherapeutics. 2012;9(3):531–41.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Storebø OJ, Ramstad E, Krogh H, Nilausen TD, Skoog M, Rosendal S, et al. Methylphenidate for attention deficit hyperactivity disorder (ADHD) in children and adolescents. Cochrane Database Syst Rev. 2015;11:CD009885.

    Google Scholar 

  8. Storebø OJ, Pedersen N, Ramstad E, Kielsholm ML, Nielsen SS, Krogh HB, et al. Methylphenidate for attention deficit hyperactivity disorder (ADHD) in children and adolescents—assessment of adverse events in non-randomised studies. Cochrane Database Syst Rev. 2018;5:CD012069.

    PubMed  Google Scholar 

  9. Garattini S, Jakobsen JC, Wetterslev J, Bertelé V, Banzi R, Rath A, et al. Evidence-based clinical practice: overview of threats to the validity of evidence and how to minimise them. Eur J Intern Med. 2016;32:13–21.

    Article  PubMed  Google Scholar 

  10. Halperin JM, Marks DJ, Bedard ACV, Curchack JC, Yoon CA, Healy DM. Training executive, attention, and motor skills: a proof-of-concept study in preschool children with ADHD. J Atten Disord. 2013;17(8):711–21.

    Article  PubMed  Google Scholar 

  11. Halperin JM, Healy DM. The influences of environmental enrichment, cognitive enhancement, and physical exercise on brain development: can we alter the developmental trajectory and ADHD? Neurosci Biobehav Rev. 2011;35(3):621–34.

    Article  PubMed  Google Scholar 

  12. Vibholm HA, Pedersen J, Holm A, Krue S. A multicenter, randomized, controlled study of training executive, attention, and motor skills (TEAMS) in Danish preschool children with attention-deficit/hyperactivity disorder: rationale and description of the intervention and study protocol. SCJAPP. 2014; 2(1):2–10. https://tidsskrift.dk/sjcapp/article/view/15837. Accessed 03 Apr 2018.

  13. SDU. Open randomise. Odense, Denmark; 2017. https://www.sdu.dk/en/om_sdu/institutter_centre/klinisk_institut/forskning/forskningsenheder/open/opens_faciliteter/open+randomise. Accessed 03 Apr 2018.

  14. Szomlaiski N, Dyrborg J, Rasmussen H, Schumann T, Koch SV, Bilenberg N. Validity and clinical feasibility of the ADHD rating scale (ADHD-RS) A Danish nationwide multicenter study. Acta Paediatr. 2009;98(2):397–402.

    Article  PubMed  CAS  Google Scholar 

  15. DuPaul GJ, Power TJ, Anastopoulos AD, Ried R. ADHD rating scale IV: checklists, norms, and clinical interpretation. New York: Guilford; 1998.

    Google Scholar 

  16. Obel C, Dalsgaard S, Stax HP, Bilenberg N. Strengths and difficulties questionnaire (SDQ-Dan): a new instrument for psychopathological screening of children aged 4–16 years. Ugeskr Laeger. 2003;165(5):462–5.

    PubMed  Google Scholar 

  17. The Danish Health Authority. Quick guide: national clinical guideline for the assessment and treatment of ADHD in children and adolescents. 2016. https://www.sst.dk/da/udgivelser/2014/nkr-adhd-hos-boern-og-unge. Accessed 03 Apr 2018.

  18. Wetterslev J, Thorlund K, Brok J, Gluud C. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol. 2008;61(1):64–75.

    Article  PubMed  Google Scholar 

  19. Wetterslev J, Jakobsen JC, Gluud C. Trial sequential analysis in systematic reviews with meta-analysis. BMC Med Res Methodol. 2017;17:39.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Jakobsen JC, Gluud C, Kongerslev M, et al. Third-wave cognitive therapy versus mentalisation-based treatment for major depressive disorder: a randomised clinical trial. BMJ Open. 2014;4:e004903.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Thorlund K, Engstrøm J, Wetterslew J, Brok J, Imberger G, Gluud C. User manual for trial sequential analysis (TSA). Copenhagen: Copenhagen Trial Unit, Centre for Clinical Intervention Research; 2011. p. 1–115.

    Google Scholar 

  22. Brok J, Thorlund K, Gluud C, Wetterslev J. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008;61(8):763–9.

    Article  PubMed  Google Scholar 

  23. Brok J, Thorlund K, Wetterslev J, Gluud C. Apparently conclusive meta-analyses may be inconclusive—trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol. 2009;38(1):287–98.

    Article  PubMed  Google Scholar 

  24. Tyler KM, Normand ST, Horton NJ. The use and abuse of multiple outcomes in randomized controlled depression trials. Contemp Clin Trials. 2011;32(2):299–304.

    Article  PubMed  Google Scholar 

  25. Schulz KF, Grimes DA. Multiplicity in randomised trials I: endpoints and treatments. Lancet. 2005;365(9470):1591–5.

    Article  PubMed  Google Scholar 

  26. Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K. Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009. https://doi.org/10.1002/14651858.MR000006.pub3.

    Article  Google Scholar 

  27. Higgins JPT, Altman DG, Sterne JAC, editors. Chapter 8: assessing risk of bias in included studies. In: Higgins JPT, Churchill R, Chandler J, Cumpston MS, editors. Cochrane handbook for systematic reviews of interventions version 5.2.0 (updated June 2017). London: Cochrane; 2017. www.training.cochrane.org/handbook. Accessed 03 Apr 2018.

  28. Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials—practical guide with flowcharts. BMC Med Res Methodol. 2017;17(1):162.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Little RJ, D’Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367:1355–60.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

Download references

Authors’ contributions

HAV, JP and OJS oversaw and conducted the trial. HAV wrote the first draft. EF wrote the final draft. MHM conducted the statistical analyses. CG assisted with medical writing and reporting of data and analyses, including Trial Sequential Analysis. HAV, OJS, EF, MHM and CG commented on and revised the manuscript. All authors read and approved the final manuscript.

Acknowledgements

Odense Patient Data Explorative Network (OPEN) has supported this study by providing access to the OPEN Randomize and SurveyXact database facilities at Odense University. Dr. Jeffrey M. Halperin of the Department of Psychology at Queens College (New York, NY) and The Graduate Centre at the City University of New York (New York, NY), gave permission to cite his work and to conduct a randomised, clinical trial to further the ongoing development of the TEAMS program.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

The dataset used for the analyses in the current study are available in the Zenodo repository: https://zenodo.org/record/1250701#.WwPZ0dKLTmF.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The trial obtained approval from the Regional Ethics Committee of Zealand in Denmark, with the registration number SJ-331, and from the Danish Data Protection Agency. Informed, written, and signed consent was obtained by the participating children’s legal guardians. The trial was retrospectively registered (7 August 2013) on clinicaltrials.gov, with the identifier NCT01918436.

Funding

This trial was financially supported by Region Zealand Research Foundation. The funding bodies have no role in the design of this study; in the collection, analysis, and interpretation of data; or in the writing of this manuscript.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ole Jakob Storebø.

Additional files

Additional file 1.

Baseline characteristics (sociodemographic and clinical variables) for the TEAMS- and control group.

Additional file 2.

ANCOVA model of the effect after eight weeks and between-groupsa.

Additional file 3.

Box plot of differences between groups over time for ADHD scores. Group 1 = TEAMS and Group 0 = Control.

Additional file 4.

Box plot of differences between groups over time for SDQ scores. Group 1 = TEAMS and Group 0 = Control.

Additional file 5.

Trial Sequential Analysis on ADHD symptoms. MRDIF = Minimal relevant difference.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vibholm, H.A., Pedersen, J., Faltinsen, E. et al. Training, executive, attention and motor skills (TEAMS) training versus standard treatment for preschool children with attention deficit hyperactivity disorder: a randomised clinical trial. BMC Res Notes 11, 366 (2018). https://doi.org/10.1186/s13104-018-3478-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13104-018-3478-3

Keywords