Evaluating context and interest in training in evidence-based mental health care: a qualitative investigation among healthcare providers in Kyiv, Ukraine
BMC Research Notes volume 14, Article number: 373 (2021)
Increasing access to quality, evidence-based mental health treatments, including psychotherapy, is a global priority. Knowledge of factors associated with delivery settings is critical to ensure that new practices are appropriate and effectively adapted for novel settings. Understanding perceived needs for training and interest in ongoing education is one key factor. This qualitative study aimed to identify perspectives on contemporary evidence-based psychotherapies, perceived needs for mental health training, and existing barriers and facilitators to provision of mental health services in community clinics in Ukraine. Purposive and snowball sampling was used to recruit 18 physicians and psychologists employed in community clinics in Kyiv. A combination of free-listing and semi-structured interviews was used to collect data, which were thematically coded using emergent coding.
Findings from this study indicated that participants recognize a need for improved mental health knowledge and training, as well as suggested interest and openness to learning short-term, structured psychological interventions. Additional barriers and existing strengths described by participants provide insight into possible factors that may impact future trainings in and implementation of modern mental health approaches.
More than 80% of mental health disorders occur among individuals living in low-and middle-income countries (LMICs), thus reflecting a disproportionally high burden of disease in often under-resourced settings [1, 2]. Despite evidence supporting the use of adapted evidence-based psychological interventions in commonly accessed health care settings, implementation of these practices into routine care has remained slow , which significantly contributes to the large gap in the availability of quality mental health services in LMICs [4, 5].
Few studies have evaluated mental health care provision in routine clinical settings in Eastern Europe . In Ukraine (a LMIC  in Eastern Europe), it is estimated that 33% of the population experiences mental illness in their lifetime , though only 4.9% of such individuals receive treatment . Accessing quality services (particularly psychosocial care) is also a challenge, partly due to psychologists commonly lacking formalized clinical skills training, including training in evidence-based interventions . As part of significant mental healthcare reform, the Ukrainian Cabinet of Ministers passed the Mental Health Concept Note in 2017 endorsing improved access to evidence-based mental health care as a key priority . While there are minimal investigations associated with evidence-based psychological therapies in Ukraine, an exception is a recent trial evaluating the adaptation and use of the Common Elements Treatment Approach (CETA), an evidence-based transdiagnostic psychological treatment intervention that targets mood, anxiety, and trauma symptoms . As outcomes demonstrated that CETA effectively improved symptoms of depression, anxiety, and posttraumatic stress (d = 0.60–1.06),  there is current governmental and community stakeholder interest in scaling up and implementing CETA in routinely accessed clinical settings.
To gain preliminary knowledge about the delivery setting and gauge interest in future training efforts, this study aimed to identify perspectives on modern evidence-based psychotherapies, including CETA, and perceived needs for mental health training among current healthcare providers. We also evaluated existing barriers and facilitators in community clinics that affect mental health care provision and may have implications for future intervention adaptations.
Setting and participants
We conducted a qualitative study with psychologists and physicians providing care in community clinics in Kyiv, Ukraine. We initially identified participants via shared institutional affiliations and by searching online listings of providers; we subsequently used snowball sampling to recruit additional respondents. Additional eligibility criteria included being 18 years of age or older and ability to complete the study in Ukrainian or Russian.
Data collection procedures
We followed data collection and analytic procedures outlined in the Design, Implementation, Monitoring, and Evaluation (DIME) manual, an approach specifically developed for rapid assessment in low resource environments . This study was aligned with Module 1 of DIME, which offers guidelines for collection and analysis of qualitative data that will inform subsequent intervention adaptation and implementation. DIME methodology has been used worldwide, including previously in Ukraine [11, 14,15,16].
Data were collected from February 2020 through June 2020. Masters-level students and professors from the National University of Kyiv-Mohyla Academy conducted interviews, which occurred in-person or by telephone, were transcribed by hand, and were analyzed in the language of the interview. Interviews were conducted in Ukrainian or Russian by native, bilingual interviewers and followed an interview guide developed by the study team (see Table 1). We used a combination of free-listing  and semi-structured interviews, which allowed us to gather targeted data and also offered participants opportunities to elaborate on relevant topics.
This study was given an exempt IRB determination from our respective IRBs. Accordingly, we provided an informed consent template to all participants and obtained verbal consent prior to data collection.
Data analytic procedures
Following DIME’s approach , masters-level students participated in a day-long didactic and participatory training that built upon their prior research training. In order to ensure consistency and rigor in qualitative data collection and analysis, doctoral-level supervisors provided ongoing supervision. Pairs of interviewers met with each participant, and each interviewer recorded direct statements by hand (i.e., comments were not paraphrased or translated), thus resulting in two complete records of participant statements. Immediately after each interview was completed, the interviewing pair met together to review and reconcile their notes. For each completed interview, the interviewing pair conducted initial analysis by listing the different responses to each question and associating the interviewee identification number next to each response. When multiple interviewees provided similar responses, all interviewee identification numbers were listed next to that response . In consultation with the rest of the analytic team, these responses were thematically coded using emergent coding. Final themes were agreed upon in consultation with fellow authors. Data were examined in ongoing discussions to allow for further understanding and to make connections between research questions and raw data.
Eighteen participants, each from a different clinic, were enrolled (see Table 2 for demographic characteristics), including ten physicians and eight psychologists. Below, we present main themes (see Table 3 for an overview of themes and descriptive quotes).
Physicians: perspectives on training, identifying barriers, identifying facilitators
Overall, participants reported feeling positively about the possibility of increasing their knowledge of mental health care. Respondents indicated that they were not previously aware that targeted, time-limited psychological treatments exist and would be interested in learning more about these approaches.
However, physicians noted barriers that may challenge learning and implementing new mental health practices in routine care. First, difficulties associated with the referral process were commonly expressed; participants discussed general distrust of mental health care or negative beliefs about the qualifications and experience of psychologists. Accordingly, physicians reported less willingness to refer patients for mental health care. Further, several respondents noted encountering resistance from patients who are referred to mental health services, often due to patients’ limited understanding about the function of mental health treatment. Finally, participants described possible logistical challenges associated with implementing new psychological interventions, most frequently related to questions of financing and need for support from clinic administration. Other variables, such as lack of office space or lack of advertising regarding the availability of psychological services, were also noted.
In contrast, physicians identified a number of possible facilitators. Some participants endorsed the critical role of mental health care and discussed the utility of working with professionals from different specialty areas. Participants felt that both physicians and clinic administration would respond favorably to additional training in psychological treatments, particularly if positive results (either clinical or financial) came from their investment.
Psychologists: perspectives on training, identifying barriers, identifying facilitators
Participants broadly described existing needs for training in evidence-based practices, particularly due to knowledge gaps regarding modern psychotherapies. Psychologists consistently stated that their current methods are outdated and that the formal education they received did not adequately prepare them for clinical practice. However, participants endorsed general interest in training in a short-term psychotherapy and reported existing awareness of CETA. Respondents described interest in targeting and treating specific mental health concerns, as well as openness to using structured treatments. Participants stated that having existing documentation of CETA’s effectiveness, and understanding its limitations, would be useful in generating interest and uptake.
Psychologists reflected on challenges in their current work and possible barriers to integrating modern approaches. Several participants discussed difficulties with engaging patients in psychological care, often as patients either do not want or do not understand why they are recommended to start treatment. Stigma and distrust associated with mental health care are common patient barriers. Further, multiple participants noted that medical staff do not appear to understand the function of mental health care and the role that psychologists may play on multidisciplinary teams. In turn, many respondents reported feeling that medical professionals and clinic administration do not value mental health care and mental health staff. Stemming from these negative perceptions, many participants specifically referenced the lack of career opportunities and professional advancement in their clinical settings. Outside of these general barriers, some psychologists discussed concerns specific to learning and utilizing CETA (i.e., worries that a short-term treatment would only amount to symptom reduction in the short-term). Other logistical challenges, such as interruptions to clinical work and lack of office space, may affect psychotherapy treatment delivery. Finally, psychologists noted that clinic administration may be ambivalent about implementing a new treatment initiative (due to paperwork and other administrative hurdles) or may not allow psychologists to complete additional training during work hours.
Participants identified a number of facilitators that suggest openness and interest in learning and utilizing new methods. Importantly, many psychologists reported strong interest in learning a new approach, particularly if there is evidence that it will meaningfully impact patients. Psychologists also noted existing areas of professional support in their work settings, particularly among certain treatment teams that recognize the importance of mental health care. Participants felt that ensuring adequate supervision and support throughout implementation of new approaches would be mechanisms of increasing interest in training. Lastly, participants generally anticipated some level of support from clinic administration and noted that resistance from clinical staff would likely be minimal.
Across participants, interest in improving ability to address mental health symptoms, as well as a lack of training in mental health care, was almost uniformly acknowledged, which has implications both for the quality of care that is currently provided and for future professional development needs. Encouragingly, both psychologists and physicians expressed interest in learning more about mental health interventions, which may facilitate implementing a new approach into routine care. Specifically supporting the use of CETA, both groups of respondents predominantly expressed interest in learning about short-term, evidence-based psychotherapies. Nevertheless, both psychologists and physicians acknowledged a lack of knowledge and training about evidence-based psychotherapies, and to some extent, a lack of knowledge about mental illness. While Ukraine differs from other LMICs in that it has a large number of mental health providers [18, 19], respondents readily acknowledged that they are under-trained and thus may benefit from some of the same approaches used elsewhere (e.g., training in basic counseling skills) to bolster service delivery.
Participants identified a number of barriers that currently challenge mental health care provision. First, both physicians and psychologists overwhelmingly reported a lack of coordination and communication between mental health and medical providers, which negatively impacts multidisciplinary efforts and limits the number of referrals to psychologists. Future trainings may improve this concern by providing education to physicians about the role and training of mental health providers and by incorporating strategies that improve professional inter-group contact and communication patterns [20,21,22]. Some physicians also reported less inclination to work alongside or provide referrals to psychologists due to negative perceptions about their qualifications. Correspondingly, psychologists reported feeling disrespected or undervalued by both physicians and clinic administration. Implementation of psychotherapy training in community clinics may be a means through which to improve mental health training, increase visibility about provision of evidence-based psychotherapy, and improve working relationships between physicians and psychologists.
Finally, physicians and psychologists identified a number of challenges associated with mental health referrals. In part, lack of mental health knowledge appears to limit physicians’ ability to knowledgably discuss mental health care with patients. Other literature notes that patients may notice and internalize negative beliefs that physicians have about mental health referrals, which in turn limit patient engagement in mental health care; however, psychologists may aid this process by offering insights into how to more effectively communicate about mental health treatment . Improving the quality of mental health services provided may also improve patient engagement. Lastly, participants noted that patients often lack understanding about mental health treatment and described significant levels of stigma associated with mental heath care [24, 25], which suggest that efforts to reducing stigma and increase mental health literacy among all stakeholders will be critical [26, 27].
This preliminary study highlights the current gaps in the provision of evidence-based psychosocial care in community clinics in Ukraine, as well as indicates interest and openness to ongoing training in contemporary approaches among healthcare providers. Future work should continue to focus on opportunities to build capacity and strengthen care provision in order to improve the accessibility and quality of mental health care services in low-resourced environments.
Several limitations should be noted regarding the implications of this research. First, we used a combination of purposive and snowball sampling to recruit participants, which may have biased our study results and been non-representative of the views of other healthcare providers (e.g., providers who chose to participate may have had stronger reactions or specific exposure to mental health care, as compared to other providers who may have had more neutral opinions). Similarly, our sampling strategy may have resulted in missing essential factors associated with implementation determinants. Follow-up individual interviews are needed to expand upon the initial ideas provided by the participants, and involving other stakeholders, including clinic administration and patients, would add nuance to the ideas presented in this paper. Further, while participants self-selected into our study, it is possible that power hierarchies between researchers and respondents may have impacted the viewpoints shared by providers. Finally, while participants offered ideas about anticipated barriers and facilitators, ideas presented in this paper are hypothetical and may differ in actuality.
Availability of data and materials
The dataset used and/or analyzed during the current study is available from the corresponding author on reasonable request.
Common Elements Treatment Approach
Design, Implementation, Monitoring, and Evaluation
Low- and middle-income countries
Rathod S, Pinninti N, Irfan M, et al. Mental health service provision in low- and middle-income countries. Health Serv Insights. 2017;10:1178632917694350.
World Health Organization. Depression and Other Common Mental Disorders Global Health Estimates. https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf?sequence=1. Published 2017. Accessed 1 Dec 2020.
Wang PS, Aguilar-Gaxiola S, Alonso J, et al. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. 2007;370(9590):841–50. https://doi.org/10.1016/S0140-6736(07)61414-7.
Kruk ME, Gage AD, Arsenault C, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Glob Health. 2018;6(11):e1196–252.
Wainberg ML, Scorza P, Shultz JM, et al. Challenges and opportunities in global mental health: a research-to-practice perspective. Curr Psychiatry Rep. 2017;19(5):28. https://doi.org/10.1007/s11920-017-0780-z.
Wagenaar BH, Hammett WH, Jackson C, Atkins DL, Belus JM, Kemp CG. Implementation outcomes and strategies for depression interventions in low- and middle-income countries: a systematic review. Glob Ment Health. 2020;7: e7. https://doi.org/10.1017/gmh.2020.1.
The World Bank. World Bank Country and Lending Groups. https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups. Accessed 1 Dec 2020.
World Bank Group. Mental Health in Transition: Assessment and Guidance for Strengthening Integration of Mental Health into Primary Health Care and Community-Based Service Platforms in Ukraine. http://documents1.worldbank.org/curated/en/310711509516280173/pdf/120767-WP-Revised-WBGUkraineMentalHealthFINALwebvpdfnov.pdf. Published 2017. Accessed June 1, 2020.
Demyttenaere K, Bruffaerts R, Posada-Villa J, et al. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA. 2004;291(21):2581–90. https://doi.org/10.1001/jama.291.21.2581.
Cabinet of Minsters of Ukraine. Mental health care development concept note in Ukraine for the period of up to 2030. https://zakon.rada.gov.ua/laws/show/1018–2017-%D1%80#Text Accessed 10 Aug 2021.
Murray LK, Haroz EE, Doty SB, et al. Testing the effectiveness and implementation of a brief version of the Common Elements Treatment Approach (CETA) in Ukraine: a study protocol for a randomized controlled trial. Trials. 2018;19(1):418. https://doi.org/10.1186/s13063-018-2752-y.
Bogdanov S, Augustinavicius J, Bass JK, et al. A randomized-controlled trial of community-based transdiagnostic psychotherapy for veterans and internally displaced persons in Ukraine. Glob Ment Health. 2021;8:e32. https://doi.org/10.1017/gmh.2021.27
Applied Mental Health Research Group. Design, Implementation, Monitoring and Evaluation of Cross-Cultural Trauma-Related Mental Health and Psychosocial Assistance Programs: A User's Manual for Researchers and Program Implementers. https://www.jhsph.edu/research/centers-and-institutes/global-mental-health/resource-materials/design-implementation-monitoring-and-evaluation-dime/. Published 2013. Accessed 1 Dec 2020.
Murray L, Haworth A, Semrau K, et al. Violence and abuse among HIV-infected women and their children in Zambia. J Nerv Ment Dis. 2006;194(8):610–5. https://doi.org/10.1097/01.nmd.0000230662.01953.bc.
Murray LK, Dorsey S, Skavenski S, et al. Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: the use of TF-CBT in Zambia. Int J Ment Health Syst. 2013;7(1):24. https://doi.org/10.1186/1752-4458-7-24.
Bolton P, Lee C, Haroz EE, et al. A transdiagnostic community-based mental health treatment for comorbid disorders: development and outcomes of a randomized controlled trial among Burmese refugees in Thailand. PLoS Med. 2014;11(11): e1001757. https://doi.org/10.1371/journal.pmed.1001757.
Quinlan, MB. The freelisting method. In: Liamputtong P, ed. Handbook of research methods in health social sciences. Singapore: Springer; 2017.
Mughal AY, Devadas J, Ardman E, Levis B, Go VF, Gaynes BN. A systematic review of validated screening tools for anxiety disorders and PTSD in low to middle income countries. BMC Psychiatry. 2020;20(1):338.
Bruckner TA, Scheffler RM, Shen G, et al. The mental health workforce gap in low- and middle-income countries: a needs-based approach. Bull World Health Organ. 2011;89(3):184–94.
Beacham AO, Herbst A, Streitwieser T, Scheu E, Sieber WJ. Primary care medical provider attitudes regarding mental health and behavioral medicine in integrated and non-integrated primary care practice settings. J Clin Psychol Med Settings. 2012;19(4):364–75. https://doi.org/10.1007/s10880-011-9283-y.
Greene CA, Ford JD, Ward-Zimmerman B, Honigfeld L, Pidano AE. Strengthening the coordination of pediatric mental health and medical care: piloting a collaborative model for freestanding practices. Child Youth Care Forum. 2016;45(5):729–44. https://doi.org/10.1007/s10566-016-9354-1.
Kearney LK, Zeiss AM, McCabe MA, et al. Global approaches to integrated care: best practices and ongoing innovation. Am Psychol. 2020;75(5):668–82. https://doi.org/10.1037/amp0000490.
Kainz K. Barriers and enhancements to physician-psychologist collaboration. Prof Psychol Res Pr. 2002;33(2):169–75. https://doi.org/10.1037/0735-7028.33.2.169.
Ougrin D, Gluzman S, Dratcu L. Psychiatry in post-communist Ukraine: dismantling the past, paving the way for the future. Psychiatr Bull. 2006;30(12):456–9. https://doi.org/10.1192/pb.30.12.456.
Yankovskyy S. Political and economic transformations in Ukraine: the view from psychiatry. Transcult Psychiatry. 2016;53(5):612–29. https://doi.org/10.1177/1363461516660900.
Egbe CO, Brooke-Sumner C, Kathree T, Selohilwe O, Thornicroft G, Petersen I. Psychiatric stigma and discrimination in South Africa: perspectives from key stakeholders. BMC Psychiatry. 2014;14:191. Doi: https://doi.org/10.1186/1471-244X-14-191
Heim E, Kohrt BA, Koschorke M, Milenova M, Thornicroft G. Reducing mental health-related stigma in primary health care settings in low- and middle-income countries: a systematic review. Epidemiol Psychiatr Sci. 2018;29: e3. https://doi.org/10.1017/S2045796018000458.
We gratefully thank our participants for their time and thoughtful responses.
KH is supported by the National Institute of Mental Health (NIMH) T32MH116140. SB is supported by VOT USAID funded project “Enhancement of mental health services among torture survivors in Ukraine.” The sponsors had no role in study design; in the collection, analysis and interpretation of data; in the writing of the articles; and in the decision to submit it for publication.
Ethics approval and consent to participate
This study was approved by Boston University Medical Center IRB (#H-39735) and the Committee on Ethics in Research at National University of Kyiv-Mohyla Academy (Protocol No. 1 2020.01.27). All research methods were carried out in accordance with relevant guidelines and regulatory approval. As this study was given an exempt determination and thus did not require written consent, we instead provided an informed consent template translated in Ukrainian to all participants, reviewed procedures for maintaining confidentiality and opportunities to opt-out of the interview at any point, and obtain verbal consent from all participants before conducting qualitative interviews.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Hook, K., Kozishkurt, J., Kovalchuk, O. et al. Evaluating context and interest in training in evidence-based mental health care: a qualitative investigation among healthcare providers in Kyiv, Ukraine. BMC Res Notes 14, 373 (2021). https://doi.org/10.1186/s13104-021-05786-3
- Global mental health
- Implementation science
- Low- and middle-income countries