The suicide assessment scale: Psychometric properties of a Norwegian language version
- Bjørn Odd Koldsland†1, 2,
- Lars Mehlum†2Email author,
- Liv Solrunn Mellesdal3,
- Fredrik A Walby2, 4 and
- Lien M Diep2, 5
© Koldsland et al.; licensee BioMed Central Ltd. 2012
Received: 15 December 2011
Accepted: 28 July 2012
Published: 7 August 2012
Rating scales are valuable tools in suicide research and can also be useful supplements to the clinical interview in suicide risk assessments. This study describes the psychometric properties of a Norwegian language version of the Suicide Assessment Scale Self-report version (SUAS-S).
Participants were fifty-two patients (mean age = 39.3 years, SD = 10.7) with major depression (53.8%), bipolar disorder (25.0%) and/or a personality disorder (63.5%) referred to a psychiatric outpatient clinic. The SUAS-S, the screening section of the Beck Scale for Suicidal Ideation (BSS-5), the Beck Depression Inventory (BDI), Beck’s Hopelessness Scale (BHS), the Symptom Check-List-90 R (SCL-90R) and the Clinical Global Impression for Severity of Suicidality (CGI-SS) were administered. One week later, the patients completed the SUAS-S a second time.
Cronbach’s alpha for SUAS-S was 0.88 and the test–retest reliability was 0.95 (95% CI: 0.93– 0.97). SUAS-S was positively correlated with the BSS-5 (r = 0.66; 95% CI: 0.47–0.85) for the study sample as a whole and for the suicidal (r = 0.52) and non-suicidal groups (r = 0.50) respectively. There was no difference between the SUAS-S and the BSS-5 in the ability to identify suicidality. This ability was more pronounced when the suicide risk was high. There was a substantial intercorrelation between the score on the SUAS-S and the BDI (0.81) and the BHS (0.76). The sensitivity and specificity of the SUAS-S was explored and an appropriate clinical cut-off value was assessed.
The study revealed good internal consistency, test–retest reliability and concurrent validity for the Suicide Assessment Scale Self-report version. The discriminatory ability for suicidality was comparable to that of the BSS-5.
Assessment of suicide risk is one of the most challenging tasks that clinicians working in mental health care face. The difficulty of the task derives from problems with the definition of suicidality , the fact that suicide risk may vary considerably with time and across contexts, and, above all, the low incidence of completed suicide . To date, the clinical interview has been regarded as the gold standard for suicide risk assessment , but even though it is very resource demanding it has relatively low sensitivity and specificity. In a clinical context adding a self-report questionnaire could provide information that would otherwise remain undetected or undisclosed during the clinical interview . Furthermore, self-report instruments could be a useful supplementary low-cost method to secure repeated measurements of suicide risk in contexts where this is regarded important. Several suicide risk assessment questionnaires have been developed for research and clinical purposes . These instruments are highly heterogeneous. The Suicide Assessment Scale (SUAS) was developed by Stanley and co-workers  as a clinician-administered rating scale, and was further developed by Nimeus et al. [7, 8] as a self-report instrument (SUAS-S) [7, 9]. The SUAS scale was designed to tap both explicit suicide risk factors and information on indirect dimensions relevant to suicidality, such as affective instability and poor impulse control. The aim of this study was to investigate the psychometric properties of a Norwegian language version of the SUAS-S (Additional file 1).
The SUAS-S is a 20-item self-report rating scale measuring the patient’s attitude towards suicide, suicide-related behaviour and suicidal ideation on the day of reporting and during the previous seven days. Each item is scored in the range of 0–4 on a Likert-type scale and resulting in a scale sum score with a range of 0–80. The scale is designed to measure levels of suicidality and to be sensitive to temporal changes in suicide-related symptoms . The SUAS-S items cover five thematic areas [6, 8]: “affect” (items 1, 2, 9, 12 and 13), “bodily states” (items 3, 8 and 10), “control and coping” (items 6, 7, 11 and 15), “emotional reactivity” (items 4, 5 and 14) and “suicidal thoughts and behaviour” (items 16–20). The original SUAS-S scale has been found to possess good concurrent validity compared with the interview version .
Fifty-five patients consecutively referred to a psychiatric outpatient clinic from January 2008 until January 2009, were asked to participate in the project. Fifty-three (96%) of the patients provided informed consent and were included in the study. Of these, one patient dropped out before all scales were completed and was not included in the further analysis. Patients with an on-going substance abuse and/or psychotic disorder were not eligible to participate in the study. Patients were recruited from a non-emergency setting.
Deliberate self-harm (DSH) was defined as “an act with non-fatal outcome in which an individual deliberately initiated behaviour with the intention to cause self-harm, for example, self-cutting or jumping from a height, by ingestion of an illicit drug, a non-ingestible substance or an excess of a prescribed substance”[10, 11]. Suicide attempt (SA) was defined as “a potentially self-injurious behaviour with a nonfatal outcome, for which there is evidence that the person intended, at some level, to kill himself/herself”. The Clinical Global Impression of Severity of Suicidality Scale (CGI-SS)  was used in the baseline assessment to provide an overall clinician rated measure of the clinical risk of suicidality in each participant. The CGI-SS has five levels of severity of suicidality; 1 = not at all suicidal, 2 = mildly suicidal, 3 = moderately suicidal, 4 = severely suicidal, and 5 = attempted suicide. Interviews yielding these scores were made independent of and blind to the participants' SUAS-S scores. Study subjects were categorically classified as “non-suicidal” if they received scores 1 or “suicidal” if they were scored 2–5 on the CGI-SS. The baseline assessment also included measuring depressive symptoms with the Beck Depression Inventory (BDI) , feelings of hopelessness with Beck’s Hopelessness Scale (BHS) , general psychiatric symptoms with the Symptom Check List-90 R (SCL-90 R) , suicidal ideation with the five items screening section of Beck’s Scale for Suicidal Ideation (BSS-5)  and general functioning level with the Global Assessment of Functioning (GAF) . The SUAS-S was administered a second time one week after the first administration. Psychiatric diagnoses were made at baseline using the Mini International Neuropsychiatric Interview (M.I.N.I.)  for DSM-IV axis I disorders and the Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II)  for axis II disorders. Interviews and diagnoses were all made by the first author, an experienced psychiatrist. In cases where it was unclear whether criteria for a specific diagnosis were met, the case was discussed with the second author (a professor of psychiatry) and settled by consensus. In cases where the patients had more than one DSM IV axis I or axis II diagnosis, only the main diagnosis on each axis was considered in the analyses. Diagnostic data were collected to provide a good description of this clinical sample. The study was, however, not designed to study the SUAS-S properties in diagnostic subgroups.
Means and standard deviations, or medians and quartiles, were given for sum scores. The chi-squared test was used to assess differences in distribution between the groups for categorical variables. Differences in sum scores of two independent groups were tested by two-sample t-test or Mann–Whitney U test. Internal consistency was computed as the Cronbach’s alpha coefficient, and test–retest reliability was measured with Intra Class Correlation (ICC) with 95% Confidence Intervals (CIs). Associations between the sum scores on the SUAS-S and BSS-5, and their precision, were estimated by Pearson’s or Spearman’s correlation coefficient and bootstrapped 95% CI with 10,000 replications. Discriminatory ability of suicidality for the SUAS-S and BSS-5 sum scores was examined and compared through the use of nonparametric receiver operating characteristic (ROC) curve analyses. The tests were two-sided, and the significance level was set at 0.05. The analyses were performed with STATA 11  and the graphs were made in R 2.11.1 .
The study was approved by the Regional Committee for Medical Research Ethics, South-East Norway. All patients gave written informed consent.
The sample consisted of 33 (63.5%) females and 19 males (36.5%) with a mean age of 39.3 years (SD = 10.7, range = 21–62). Thirty-four patients (65.4%) had been in psychiatric treatment in total for more than five years, and 11 (21.2%) for less than a year. The mean GAF score was 48.6 (SD = 4.6); there were no gender differences. The mean SCL-90-R score was 1.5 (SD = 0.7), with no significant gender differences. Twenty-two (42.3%) of the patients, 16 females and six males, reported a history of DSH. In 15 (68.2%) of these cases, the criteria for a SA were met. Five patients reported having had a DSH episode during the last six months. The median number of DSH episodes per patient was one, with a range of 0–30.
All but one patient fulfilled the criteria for at least one axis I disorder. Major Depressive Disorder (MDD) was diagnosed in 28 patients (53.8%), Bipolar Disorder type II in 13 cases (25.0%) and Dysthymia in 4 cases (7.5%). These diagnostic groups were merged into one group, “Affective Disorders” (AD) (n = 45). The residual group (n = 7) was labelled “Other Axis I Disorders”. Thirty-three patients (63.5%) had an axis II diagnosis, of whom five (9.6%) had a Cluster A disorder, 11 (21.2%) a Cluster B disorder, 15 (28.8%) a Cluster C disorder, and two patients had Personality Disorder Not Otherwise Specified (PF-NOS).
The mean SUAS-S score was 31.0 (SD = 9.3) in females and 28.1 (SD = 12.7) in males. No significant correlation was found between age and the SUAS-S score. Patients with AD had a significantly higher median SUAS-S score (median = 31.0, quartiles = 24.5–39.0) than patients with other axis I disorders (median = 19, Q1-Q3 quartiles = 15–31), (p = 0.018).
Psychometric properties of the SUAS-S
Intercorrelations with 95% CIs between scores on the SUAS-S, BSS-5, BDI and BHS
Overall (n = 52)
Test score means with standard deviations and medians with quartiles and effect size in suicidal and non-suicidal patients
Suicidal (n = 25)
Non-suicidal (n = 27)
Mean ± SD
Mean ± SD
33.7 ± 9.7
25.6 ± 9.3
23.0 ± 11.0
14.2 ± 8.8
Sensitivity, specificity and predictive probability of SUAS-S and BSS-5 cut-off points for detecting suicidality
A cut-off value of 29 on the SUAS-S scale yielded a sensitivity of 80% and specificity of 56%. The negative and positive predictive probabilities of this chosen cut-off point were 75% and 63%, respectively.
Identification of suicidality, depression and hopelessness
Mean scores with standard deviations, medians with quartiles and effect size for the five SUAS-S thematic areas
Suicidal (n = 25)
Non-suicidal (n = 27)
Mean ± SD
Mean ± SD
10.2 ± 2.6
8.7 ± 2.4
5.0 ± 2.0
4.4 ± 2.1
6.1 ± 2.0
5.2 ± 2.1
5.0 ± 2.3
4.6 ± 2.3
8.0 (5.0 - 11.0)
1.0 (0.0 - 4.0)
Intercorrelations with 95% CIs between the five areas of SUAS-S, BSS-5, BDI and BHS sum scores
Correlation analyses showed that the SUAS-S areas of “affect” and “suicidal thoughts and behaviour” and “emotional reactivity” were strongly and significantly associated with depression and hopelessness (r ≥ 0.6, p < 0.001). The “bodily states” area was significantly correlated with depression (expressed by the BDI sum score) but not with hopelessness (expressed by the BHS sum score). The association was strongest between the sum scores of the area “suicidal thoughts and behaviour” and BSS-5 (r ≥ 0.8, p < 0.001). The results of correlation analyses are shown in Table 5.
The psychometric properties of the Norwegian language version of the SUAS-S in a non-emergency psychiatric outpatient setting were found to be good, with internal consistency and test–retest reliability properties comparable to the original version. Likewise, the construct validity was found to be favourable. Of the five areas in the SUAS-S, the “suicidal thoughts and behaviour” subscale was significantly and strongly associated with the clinician’s global assessment of suicidality. The findings of a strong correlation between the SUAS-S and BSS-5 (0.66), and no significant difference between the ROCs for these two scales (Figure 2), suggests that the SUAS-S is able to identify suicidality equally well as the BSS-5. By indicating a cut-off-value of 29, a sensitivity of 80% and a specificity of 56% were attained (Table 3). In the context of clinical suicide assessment, these specificity and sensitivity levels may be regarded as adequate. That the SUAS-S scores were highly correlated with the BDI-scores in the overall sample and the subgroups, indicate that SUAS-S may have the benefit of tapping depression in addition to suicidality. It is important to note that whereas the BSS-5 is a short screening instrument, the SUAS-S taps several additional clinically important dimensions relevant to assessment and management of suicidal patients in a clinical context. The SUAS-S seems also, as evident from Figure 1, to be sensitive to lower symptom levels which may well be of value when monitoring the clinical course with repeated measurements to evaluate treatment response and detect signs of relapse.
The limited number of patients excluded the possibility to study the SUAS-S properties in more narrow diagnostic subgroups. The selection criteria applied in this study with exclusion of on-going substance abuse and psychotic disorders limits the external validity of findings to non-psychotic and non-abusing patients in non-emergency psychiatric evaluation settings.
The Norwegian language version of the SUAS-S was found to possess psychometric properties equal to the original version and seems to be a valid and reliable instrument in the assessment of suicide risk and depression among patients in the mental health care system. The SUAS-S also has the advantage of open access with no copyright costs.
B.O.Koldsland MD is a senior psychiatrist at Vestre Viken Health Trust, Ringerike Hospital psychiatric outpatient clinic, and affiliated with the National Centre for Suicide Research and Prevention, University of Oslo. L. Mehlum MD PhD is a professor and head of the National Centre for Suicide Research and Prevention, Institute of Clinical Medicine, University of Oslo. L.S. Mellesdal RN MSc is a research fellow in the Psychiatric Division of Haukeland University Hospital, Bergen. F. A. Walby MA is a researcher at the National Centre for Suicide Research and Prevention, Institute of Clinical Medicine, University of Oslo and chief psychologist in the Department of Psychiatry, Diakonhjemmet Hospital, Oslo. L.M. Diep MSc is a statistician at Oslo University Hospital, the National Centre for Suicidal Research and Prevention at University of Oslo, and the Institute for Community Medicine at University of Oslo, Norway.
We would like to acknowledge the substantial efforts of Egil Haga, who established the database for research data, and Ellen Bjerkan and Camilla Sivesind Mehlum, who performed the data entry for this study. We are also grateful to the Ringerike Hospital Psychiatric Outpatients Clinic, for kindly allowing us to recruit patients for the study, and the Ringerike Hospital Research Department, for funding this research.
- O´Carrol P, Berman AL, Maris R, Moscicki E, Tanney B, Silverman M: Beyond the Tower of Babel: A nomenclature for suicidology. Suicide and Life-Threatening Behaviour J. 1996, 26: 237-252.Google Scholar
- Robert Goldney D: The prediction of suicide and attempted suicide. The International handbook of Suicide and Attempted Suicide. Edited by: Hawton K, Heeringen K. 2000, Chichester: John Wiley and SonsGoogle Scholar
- Brown Gregory K: A Review of Suicide Assessment Measures for Intervention Research with Adults and Older Adults. 2000, Pennsylvania: University of PennsylvaniaGoogle Scholar
- Beck AT, Steer RA, Ranieri WF: Scale for Suicide Ideation: psychometric properties of a self-report version. J Clin Psychol. 1988, 44: 499-505. 10.1002/1097-4679(198807)44:4<499::AID-JCLP2270440404>3.0.CO;2-6.PubMedView ArticleGoogle Scholar
- Range LM, Knott EC: Twenty suicide assessment instruments: Evaluation and recommendations. Death Stud. 1997, 21: 25-58. 10.1080/074811897202128.PubMedView ArticleGoogle Scholar
- Stanley B, Traskman-Bendz L, Stanley M: The suicide assessment scale: a scale evaluating change in suicidal behavior. Psychopharmacol Bull. 1986, 22: 200-205.PubMedGoogle Scholar
- Holmstrand C, Nimeus A, Traskman-Bendz L: Risk factors of future suicide in suicide attempters-a comparison between suicides and matched survivors. Nord J Psychiatry. 2006, 60: 162-167. 10.1080/08039480600583597.PubMedView ArticleGoogle Scholar
- Nimeus A, Alsen M, Traskman-Bendz L: The suicide assessment scale: an instrument assessing suicide risk of suicide attempters. European Psychiatry: the Journal of the Association of European Psychiatrists. 2000, 15: 416-423. 10.1016/S0924-9338(00)00512-5.View ArticleGoogle Scholar
- Nimeus A, Hjalmarsson SF, Sunnqvist C, Stanley B, Traskman-Bendz L: Evaluation of a modified interview version and of a self-rating version of the Suicide Assessment Scale. European Psychiatry: the Journal of the Association of European Psychiatrists. 2006, 21: 471-477. 10.1016/j.eurpsy.2006.01.011.View ArticleGoogle Scholar
- Madge N, Hewitt A, Hawton K, Wilde EJ, Corcoran P, Fekete S, et al: Deliberate self-harm within an international community sample of young people: comparative findings from the Child & Adolescent Self-harm in Europe (CASE) Study. Journal of Child Psychology and Psychiatry. 2008, 49: 667-677. 10.1111/j.1469-7610.2008.01879.x.PubMedView ArticleGoogle Scholar
- Ystgaard M, Reinholdt NP, Husby J, Mehlum L: Deliberate self harm in adolescents. [Norwegian]. Tidsskrift for Den Norske Laegeforening. 2003, 123: 2241-2245.PubMedGoogle Scholar
- Lindenmayer JP, Czobor P, Alphs L, Nathan AM, Anand R, Islam Z, et al: The InterSePT scale for suicidal thinking reliability and validity. Schizophr Res. 2003, 63 (1–2): 161-170. 1-9PubMedView ArticleGoogle Scholar
- Beck AT, Beamesderfer A: Assessment of depression: the depression inventory. Mod Probl Pharmacopsychiatry. 1974, 7: 151-169.PubMedView ArticleGoogle Scholar
- Beck AT, Weissman A, Lester D, Trexler L: The measurement of pessimism: the hopelessness scale. J Consult Clin Psychol. 1974, 42: 861-865.PubMedView ArticleGoogle Scholar
- Derogatis LR, Lipman RS, Covi L: SCL-90: An outpatient psychiatric rating scale-preliminary report. Psychopharmacol Bull. 1973, 9: 13-28.PubMedGoogle Scholar
- Beck AT, Kovacs M, Weissman A: Assessment of suicidal intention: the scale for suicide ideation. J Consult Clin Psychol. 1979, 47: 343-352.PubMedView ArticleGoogle Scholar
- Hall RC: Global assessment of functioning. A modified scale. Psychosomatics. 1995, 36: 267-275. 10.1016/S0033-3182(95)71666-8.PubMedView ArticleGoogle Scholar
- Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. [Review] [25 refs]. J Clin Psychiatry. 1994, 59: Suppl-33-Google Scholar
- First MB: Structured Clinical Interview for DSM-IV Personality Disorders, (SCID-II). Edited by: Spitzer RL, Gibbon M, Williams JBW. 1997, Washington DC: American Psychiatric Press, IncGoogle Scholar
- StataCorp LP: STATA/SE version 9.2 for Windows. 2010, X 77845 USA: 4905 Lakeway Drive, College StationGoogle Scholar
- R Development Core Team: R: A language and environment for statistical computing. 2009, Vienna: R Foundation for Statistical ComputingGoogle Scholar