Effects and feasibility of a preventive intervention in sub-threshold and mild panic disorder: Results of a pilot study
BMC Research Notes volume 2, Article number: 4 (2009)
Panic disorder (PD) is a serious DSM-IV axis I disorder affecting up to 3% of the adult population each year. It is associated with a large burden of disease and extensive economic costs. This study aims to examine the effects and feasibility of the 'Don't Panic' course, a preventive cognitive behavioural intervention in sub-threshold and mild PD. It also compares the effectiveness of two modifications of the course (8 vs. 12 sessions).
The method used was a quasi-experimental two-group pre-post design with a baseline measurement (T0) and two follow-up measurements. Follow-ups were at the end of the intervention (T1) and six months later (T2). Primary outcome measure was the Panic Disorder Severity Scale-Self Report. A total of 114 participants suffering from panic attacks (mean age 42 years; 78% female) entered the study.
The course participants showed a significant effect on the outcome measures at follow-up. Large effect sizes were found on panic symptoms, on symptoms of agoraphobia and on mental health-related quality of life at T1 and T2. Overall, the course leaders and the participants evaluated the course positively. There were no significant differences in outcome measures between the short and the long version of the course.
The study suggests that people with sub-threshold PD and mild PD could benefit from this preventive intervention and that the intervention might be feasible. Furthermore, the short version could be as effective as the long version.
Panic disorder (PD), affecting 2% to 3% of the adult population each year [1, 2], is associated with a large burden of disease, considerable medical consumption and extensive loss of productivity [3, 4]. The incidence of PD is high (about 35% of all cases each year of PD are new; ), indicating the importance of prevention and early intervention in PD.
A substantial proportion of the population suffers from sub-threshold PD [5, 6]. Sub-threshold PD can be defined as the presence of some symptoms of PD, not meeting the DSM-IV diagnostic criteria. These subjects may be at risk of developing full-blown PD .
Studies on prevention and early intervention in anxiety disorders indicate that prevention of anxiety disorders through cognitive-behavioural interventions can be successful [8, 9]. Only a few studies have been conducted on the prevention of panic disorder [10, 11]. The results of these studies suggest that prevention of panic disorder is a promising option.
As a pilot project we developed a preventive intervention for adults with panic symptoms, called the 'Don't Panic' course. The course is based on cognitive-behavioural principles and makes use of interventions that have appeared effective in the treatment of PD before [12, 13].
The aim of this study was to examine the effects and feasibility of the 'Don't Panic' course in a sample of self-referred people suffering from panic attacks in an uncontrolled pilot study. In addition, the effectiveness of two modifications of the course (8 vs. 12 sessions) was compared.
We used a quasi-experimental two-group pre-post design with a baseline measurement (T0), a post-test measurement at the end of the course (T1) and a follow-up measurement, 6 months after the course (T2). The study was designed to mimic the Dutch health care system as naturalistically as possible in terms of participant recruitment and the manner in which intake, offering the intervention, and monitoring outcomes are conducted. Because the study simulates the usual practice in the Netherlands, an ethical approval was not necessary.
Participants were recruited from the general population through advertisements in regional newspapers and information brochures at general practices. For screening, the standard procedures employed by the Community Mental Health Centres were used. Firstly, interested persons were given more information about the course and underwent initial screening by telephone to ascertain the presence of panic symptoms. Secondly, potential participants had a face-to-face clinical interview with a clinician (i.e., experienced psychologist) from a Community Mental Health Centre. The clinician used a list with inclusion and exclusion criteria. Depending on the impression formed by the clinicians, potential participants were included or excluded. Those included in the study were people with sub-threshold panic disorder or mild panic disorder with or without additional agoraphobic problems (i.e., low degree of symptom severity and little interference in work or social functioning). Exclusion criteria were severe PD (i.e., high degree of symptom severity and substantial interference in work or social functioning), other current psychiatric diagnoses or suicidality warranting treatment or likely to interfere with participation in the group course. People meeting one of the exclusion criteria were advised to seek regular treatment. If a participant used medication for anxiety or depression (e.g., anxiolytics or antidepressants), it was agreed not to change the medication while attending the course. The participants were receiving no other form of psychotherapy.
For the participants' flow through the study see Figure 1. To join the study, the participant had to sign a written informed consent. Fifty-four participants refused to take part in the research (32%; mainly because they didn't feel like it), but were allowed to attend the course.
A total of 114 participants were enrolled in the study and completed the baseline measurements. In Table 1, the characteristics of the course participants are presented.
A comparison of demographic and clinical status variables of the participants at baseline (T0) between the short (N = 36) and the long (N = 78) version of the course demonstrated no significant differences.
Primary outcome measure for panic and agoraphobic symptoms was the self-report version of the Panic Disorder Severity Scale . The Panic Disorder Severity Scale-Self Report (PDSS-SR) has good psychometric properties (Cronbach's alpha = 0.92; intraclass correlation coefficient = 0.81) . Secondary outcomes for panic symptoms consisted of the Body Sensation Questionnaire (BSQ1; ) and the subscale anxiety of the Symptom Check-List (SCL-90; ). For symptoms of agoraphobia the secondary outcomes were the Agoraphobic Cognitions Questionnaire (ACQ; ) and the Mobility Inventory (MI; ). In addition, the subscale phobic anxiety of the SCL-90  was used. For mental health-related quality of life, the outcome measure was the subscale mental health of the MOS Short-Form General Health Survey (MOS-SF-20 Mh; ). To measure general symptoms of depression, the subscale depression of the SCL-90  was used. Moreover, the Mastery-scale  was used to assess locus of control. All scales have good psychometric properties [16–20]. Only on the MOS-SF-20 MH and the Mastery-scale does a higher rating indicate a more favourable outcome.
Questionnaires to evaluate the course were used at post-test.
The 'Don't Panic' course includes a course manual , to be used by the clinician and prevention specialist offering the intervention, as well as a participant workbook . The course involves (a) psycho-education about the nature and physiology of anxiety and panic attacks, (b) changing life-style to enhance physical condition, (c) stress management to prevent constant stress by learning effective ways to cope with stressors, (d) relaxation training to reduce physiological arousal, (e) cognitive restructuring to challenge and correct faulty beliefs regarding panic and anxiety, (f) interoceptive exposure to reduce the fear of somatic sensations, and (g) 'in vivo' exposure to reduce avoidance of situations and use of safety behaviours. Furthermore, techniques aimed at relapse prevention are taught. The short course consists of 8 weekly, two-hour group sessions; the long version contains 12 weekly, two-hour group sessions of 6 to 12 participants. Both versions have the same elements. The long version has more sessions containing 'in vivo' exposure.
Clinicians and prevention specialists from 12 community mental health centres were trained in the selection procedure of participants (e.g., using the inclusion and exclusion criteria) and in using the course manual to conduct the course. Integrity of intervention delivery was maintained by utilizing a structured and manual-based course protocol.
The twelve-session course was run by 9 centres and the 8 session course by 6 centres (3 centres offered both versions of the course; one mental health centre offered the long version of the course four times. In these cases the time between two courses was about two months and a person participated in the course offered at the time the person entered the study. There was no selection of participants to the two versions of the course.). In total, the data contains the results of 18 courses.
Data collection was conducted by an independent research institute. Assessments consisted solely of self-report measures through postal questionnaires and were completed at home.
Analyses were conducted on an intention-to-treat basis. The effect of the intervention was analysed with a Repeated Measures ANOVA, Simple Contrast. Effect sizes (d) were obtained by subtracting post-test (T1) or follow-up (T2) means from baseline (T0) means and then dividing the difference by the pooled standard deviation. The categorization of Lipsey and Wilson  was used for clinical interpretations of the d's.
The difference between the short and the long version of the course on the severity of panic symptoms was analysed with a 2 Group (8 vs. 12 sessions) × 3 Time (baseline, post-test, 6 month follow-up) Repeated Measures ANOVA, with Group as the between-subject factor and Time as within-subject factor. Levels of severity of panic symptoms (PDSS-SR) constituted the dependent variable. Wilks' lambda (λ) was used as multivariate criterion for significance. The same analysis was performed on all the other outcome measurements.
The significance level was set at α = 0.05, two-sided.
Table 2 presents an overview of the results on the measurements. The course participants showed a significant effect on the primary outcome measure and secondary outcome measures at post-test and follow-up. Large effect sizes were found on panic symptoms and on symptoms of agoraphobia at T1 and T2. In addition, large effect sizes were found on mental health-related quality of life at T1 and T2 and on depression at T2. The increase of internal locus of control after the intervention showed medium effect sizes. Effects remained stable from post-test to follow-up.
The Repeated Measures ANOVAs on the outcome measures showed a significant effect of time, no significant group effect between the short and the long version of the course and no significant interaction effect for time × group (Table 3).
Medication use at baseline had no significant impact on the residualized change scores at T1 on the primary outcome measure (PDSS-SR; point-biserial correlation; r = 0.12, p = 0.249). For the other outcome measures at T1 (except for MOS-SF-20 Mh; point-biserial correlation; r = -0.20, p = 0.029) and for all outcome measures at T2, the results of the analyses were comparable.
Feasibility and acceptability
After each session the prevention specialists registered all the participants attending, and ascertained whether they had done their homework. On the basis of this information, the dropout rate (participants who indicated stopping the course, mainly because of work obligations or illness) was 13%; the mean number of attended sessions for the short version was 6.4 sessions (80%) and for the long version 9.0 sessions (75%). Of the participants attending a session, on average 91% had completed their homework. Therefore, compliance with the intervention was satisfactory.
The participants evaluated the course positively (organizational aspects, coaching, content, group sessions, and workbook). Asked whether the course had contributed to being more able to manage anxiety, 98% answered in the affirmative. Of the participants, 92% were "satisfied" or "very satisfied" with the course.
Overall, the course leaders also evaluated the course positively (content, time schedule, didactic elements). These findings suggest the intervention is feasible and acceptable.
In this study, the participants in the preventive course 'Don't Panic' showed a significant reduction in panic and agoraphobic symptoms after the course. Large effect sizes were achieved in reducing panic and agoraphobic symptoms. The improvement was maintained over 6 months after the intervention. The results suggest that the course is acceptable and feasible. These findings converge with the findings of earlier research on the prevention of panic disorder [10, 11].
Furthermore, symptoms of depression declined, as measured by the SCL-90. In addition, the internal locus of control and the quality of life increased significantly. These findings are important because people with panic symptoms may also have higher rates of other psychiatric symptoms .
We did not find any significant differences in outcome measures between the short and the long version of the course. A lack of power may play a role in this finding.
There are several limitations to the present study. Firstly, it lacked a structured psychiatric interview. Therefore, it is unclear how many participants might have been diagnosed with panic disorder or other psychiatric disorders at baseline, post-test and follow-up. Furthermore, the diagnosis of agoraphobia might have clarified whether it had an impact on the results.
Secondly, 56% of the participants used medication for anxiety or depression at baseline. Although medication use at baseline did not predict outcome, continued use of medication may have hampered the effect of the intervention. This is because medication may have been used as a safety behaviour. Likewise, discontinuation of medication after psychological treatment may also have reduced treatment efficacy because patients may attribute the symptom reduction achieved to the use of medication and may lack self-confidence in being able to control their panic attacks themselves. In the absence of data on medication use after baseline assessment, the possible interactions of medication use with psychological treatment remain unknown.
Thirdly, the present study did not include a control group. Thus, it is not certain whether the effects found in this study were due to the preventive course.
Fourthly, the study did not account for possible differences in outcome between the 12 community mental health centres which offered the course.
Fifthly, because the intervention is multi-component, it cannot be known which of the components may have been effective.
Finally, the results may be biased if people of the intended target population who did not participate in the course or participated in the course, but not in the study, differed from those who did.
People with sub-threshold PD and mild PD may benefit from a preventive group intervention. The short version is as effective as the long version, but is likely to be associated with fewer costs and greater acceptability. Future, randomized, controlled trials using diagnostic assessments are needed to confirm the present findings.
Bijl R, De Graaf R, Ravelli A, Smit F, Vollebergh W: Gender and age specific first incidence of DSM-III-R psychiatric disorders in the general population. Results from the Netherlands Mental Health Survey and Incidence Study (NEMESIS). Social psychiatry and Psychiatric Epidemiology. 2002, 37: 372-379. 10.1007/s00127-002-0566-3.
Kessler RC, Chiu WT, Jin R, Ruscio AM, Shear K, Walters EE: The Epidemiology of Panic Attacks, Panic Disorder, and Agoraphobia in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2006, 63: 415-424. 10.1001/archpsyc.63.4.415.
Marciniak M, Lage M, Landbloom R, Dunayevich E, Bowman L: Medical and Productivity Costs of Anxiety Disorders: Case Control Study. Depression and Anxiety. 2004, 19: 112-120. 10.1002/da.10131.
Smit F, Cuijpers P, Oostenbrink J, Batelaan N, De Graaf R, Beekman A: Costs of Nine Common Mental Disorders: Implications for Curative and Preventive Psychiatry. J Ment Health Policy Econ. 2006, 9 (4): 193-200.
Reed V, Wittchen HU: DSM IV panic attacks and panic disorder in a community sample of adolescents and young adults: how specific are panic attacks?. Journal of Psychiatric Research. 1998, 32: 335-345. 10.1016/S0022-3956(98)00014-4.
Batelaan N, De Graaf R, Van Balkom A, Vollebergh W, Beekman A: Thresholds for health and thresholds for illness: panic disorder versus subthreshold panic disorder. Psychological Medicine. 2007, 37: 247-256. 10.1017/S0033291706009007.
Katerndahl DA: Progression of limited symptom attacks. Depression and Anxiety. 1999, 9: 138-140. 10.1002/(SICI)1520-6394(1999)9:3<138::AID-DA7>3.0.CO;2-4.
Dadds MR, Spence SH, Holland DE, Barrett PM, Laurens KR: Prevention and early intervention for anxiety disorders: A controlled trial. Journal of Consulting and Clinical Psychology. 1997, 65: 627-635. 10.1037/0022-006X.65.4.627.
Schmidt NB, Eggleston AM, Woolaway-Bickel K, Fitzpatrick KK, Vasey MW, Richey JA: Anxiety Sensitivity Amelioration Training (ASAT): A longitudinal primary prevention program targeting cognitive vulnerability. Journal of Anxiety Disorders. 2007, 21: 302-319. 10.1016/j.janxdis.2006.06.002.
Gardenswartz CA, Craske MG: Prevention of Panic Disorder. Behavior Therapy. 2001, 32: 725-737. 10.1016/S0005-7894(01)80017-4.
Swinson RP, Soulios C, Cox BJ, Kuch K: Brief treatment of emergency room patients with panic attacks. American Journal of Psychiatry. 1992, 149: 944-946.
Margraf J, Barlow DH, Clark DM, Telch MJ: Psychological treatment of panic: Work in progress on outcome, active ingredients, and follow-up. Behaviour Research and Therapy. 1993, 31: 1-8. 10.1016/0005-7967(93)90036-T.
Van Balkom AJLM, Bakker A, Spinhoven P, Blaauw BMJW, Smeenk S, Ruesink B: A meta-analysis of the treatment of panic disorder with or without agoraphobia: A comparison of psychopharmacological, cognitive-behavioral, and combination treatments. Journal of Nervous and Mental Disease. 1997, 185: 510-516. 10.1097/00005053-199708000-00006.
Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Van der Bilt J, Houck P, Wang T: Reliability and validity of the panic disorder severity scale: replication and extension. Journal of Psychiatric Research. 2001, 35: 293-296. 10.1016/S0022-3956(01)00028-0.
Houck PR, Spiegel DA, Shear MK, Rucci P: Reliability of the self-report version of the panic disorder severity scale. Depression and Anxiety. 2002, 15: 183-185. 10.1002/da.10049.
Chambless DL, Caputo GC, Bright P, Gallagher R: Assessments of fear of fear in agoraphobics: The Body Sensations Questionnaire and the Agoraphobic Cognitions Questionnaire. Journal of Consulting and Clinical Psychology. 1984, 52: 1090-1097. 10.1037/0022-006X.52.6.1090.
Derogatis LR, Lipman RS, Covi L: SCL-90: An outpatient psychiatric rating scale – Preliminary report. Psychopharmacology Bulletin. 1973, 9: 13-28.
Chambless DL, Caputo GC, Jasin SE, Gracely EJ, Williams C: The Mobility Inventory for Agoraphobia. Behaviour Research and Therapy. 1985, 23: 35-44. 10.1016/0005-7967(85)90140-8.
Stewart AL, Hays RD, Ware JE: The MOS Short-form General Health Survey: Reliability and validity in a patient population. Medical Care. 1988, 26: 724-735. 10.1097/00005650-198807000-00007.
Pearlin LI, Schooler C: The structure of coping. Journal of Health and Social Behavior. 1978, 19: 2-21. 10.2307/2136319.
Meulenbeek P, Herzmanatus J, Smit F, Willemse G, Van der Zanden R: Draaiboek: Geen Paniek, leren omgaan met paniekklachten. 2005, Utrecht: Trimbos-instituut/GGNet, [Manual: Don't Panic, learn to cope with panic complaints]
Meulenbeek P, Herzmanatus J, Smit F, Willemse G, Van der Zanden R: Cursusmap: Geen Paniek, leren omgaan met paniekklachten. 2005, Utrecht: Trimbos-instituut/GGNet, [Workbook: Don't Panic, learn to cope with panic complaints]
Lipsey MW, Wilson DB: The efficacy of psychological, educational and behavioral treatment. American Psychologist. 1993, 48: 1181-1209. 10.1037/0003-066X.48.12.1181.
Birchall H, Brandon S, Taub N: Panic in a general practice population: prevalence, psychiatric comorbidity and associated disability. Social Psychiatry and Psychiatric Epidemiology. 2000, 35: 235-241. 10.1007/s001270050233.
The study was financially supported by the Health Insurance Company NUTS/OHRA (Amsterdam; grant # SNO-T-04-30) awarded to the third author.
We are indebted to Jessica Herzmanatus (GGNet) and Rianne van der Zanden (Trimbos Institute) for their help with the design and development of the Don't Panic intervention. We also thank the trainers and trainees for their valuable help in making this study possible.
The authors declare that they have no competing interests.
PM participated in the design of the study, conducted the analysis and drafted the manuscript. GW participated in the design of the study, collected the data and participated in the analysis of the data. FS participated in the design of the study and in the analysis of the data. NS participated in the statistical analysis of the data. PC, AvB and PS acted as a Quality Assurance Committee for this trial. All authors were involved in the interpretation of the data and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Meulenbeek, P., Willemse, G., Smit, F. et al. Effects and feasibility of a preventive intervention in sub-threshold and mild panic disorder: Results of a pilot study. BMC Res Notes 2, 4 (2009). https://doi.org/10.1186/1756-0500-2-4
- Large Effect Size
- Panic Disorder
- Panic Disorder
- Panic Attack
- Community Mental Health Centre