- Research note
Adaptation and validation of the Cyprus version of the Practice Environment Scale of the Nursing Work Index: a methodological study
BMC Research Notesvolume 11, Article number: 791 (2018)
The purpose of this study was to adapt and validate the Revised Practice Environment Scale of the Nursing Work Index, to be utilized among the Cyprus nurses’ population. Validated research scales are valuable tools in the hands of researchers in their attempt to recommend alterations within health care systems, especially during reform periods.
Internal consistency reliability of the scale was satisfactory (alpha = 0.94). Exploratory factor analysis produced a five-factor structure solution. Experts in the field provided further guidance. The findings demonstrated that the Cyprus version of the Revised Practice Environment Scale of the Nursing Work Index is a reliable and valid research instrument, however differences with previous studies on the factor structure were observed, mainly due to cultural reasons. As a valid and reliable scale, it can capture the views of nurses concerning their work environment. The Cyprus version of the Revised Practice Environment Scale of the Nursing Work Index can be used by nurse managers and policy makers to introduce changes that may improve the quality of nursing care provided and enhance the patients’ satisfaction from the health system as a whole.
Changes in health care systems result in the necessity to focus on forecasting models for nursing workforce reforms. Evidence indicates that current health workforce planning methods have poor results and do not enable health care managers to predict needs regarding the nursing profession. They also fail to allow policy interventions to be implemented satisfactorily to avoid staffing shortages [1,2,3]. The European Registered Nurse Forecasting (RN4CAST) research project was launched in 2009 aiming to investigate the nursing working environment, the nursing staff competency, workload, burnout and job satisfaction as well as the associations of those nursing variables towards patients’ outcomes. The present Cyprus RN4CAST survey was a replication of the initial protocol. Data collection regarding nurses’ perceptions on their working environment was accomplished by using the 32-item, 5-factor structure Revised Practice Environment Scale of the Nursing Work Index (PES-NWI-R). The PES-NWI-R appears cross-culturally applicable, it enables the measurement of differences between hospital organizations and it has a clear association with health care outcomes [4,5,6,7]. The multi-lingual use of the PES-NWI-R among nurses of different cultural settings led to several methodological studies [5, 8].
Despite the wide use of PES-NWI-R, there is a scarcity of publications reporting modifications of the instrument necessary for use in different settings and countries [5, 9]. Acknowledging that the establishment of cross-culturally relevant, valid, reliable and rigorously adapted instruments for international research is crucial for the quality of research findings, the aim of this study was to adapt and validate the PES-NWI-R for use among Cypriot nurses.
This is a methodological study, conducted to adapt and validate the PES-NWI-R [3, 4, 6, 10], specifically the Greek version. Although the Greek language is spoken in Cyprus, differences exist on the use of medical and nursing terminology. Therefore, adaptation of the Greek version was necessary.
Face and content validity
The Greek version of the PES-NWI-R was examined. Words that could confuse Cypriot nurses due to the use of different terminology in daily practice, were replaced (Table 1). Every effort was made to achieve semantic and conceptual equivalence to the Greek version. This first draft was evaluated by six clinical nurses; some suggestions for modifications were adopted.
Content Validity Index (CVI) was implemented for assessment of the scale’s content validity. Ten experts who were nurses with postgraduate qualifications, evaluated the preliminary Cypriot version in terms of item importance and relevance, using a 4-point Likert scale: 1 = not relevant, 2 = somewhat relevant, 3 = quite relevant, 4 = highly relevant. CVI was satisfactory (CVI = 0.97).
The instrument was piloted among a convenience sample of 95 clinical nurses. Only minor changes were required at this stage. Internal consistency for the whole scale was alpha = 0.93 and for subscales was alpha = 0.71–0.88.
To further test the instrument, it was distributed to 950 nurses working on medical and surgical wards; distribution took place during March and May 2015. Eligibility criteria were: willingness to participate as well as at least 1 year of professional experience. Research associates distributed the questionnaires and provided information on the scope of the study. Response rate was 65% (N = 507). The Statistical Package for the Social Sciences (SPSS) version 20 was used for analysis. Cronbach’s alpha was used to test the scale’s internal consistency and exploratory factor analysis (EFA) with Varimax rotation was used to break the list of 32 statements into groups of related variables and test the scale’s construct validity. The Kaiser–Meyer–Olkin (KMO) Measure of Sampling Adequacy was 0.949, while Bartlett’s test of Sphericity had a p-value < 0.001, indicating that the data were appropriate for a factor analysis.
The protocol of the study was reviewed by the Cyprus National Bioethics Committee (EEBK EΠ 2014.01.3); the Ministry of Health authorized the distribution of the questionnaires in all public hospitals. Nurses participated voluntarily, maintained the right to withdraw and verbally acknowledged that completion of a questionnaire would be considered as informed consent. Anonymity and confidentiality were preserved. Data were kept safely. Permission to replicate the study was obtained by Professor Sermeus (personal contact).
Most of the participants were young (64% between the ages of 25–34), female (67%), trained in Cyprus (93%) and holding a University Degree in Nursing (98%). Most were working on a full-time basis (98%) with a mean work experience of 11.4 years (SD 10.1).
Internal consistency and EFA
Internal consistency was satisfactory (alpha = 0.94). The EFA extracted five factors (all eigenvalues > 1), explaining a total of 56% of the variation. All item loadings in their respective factor were over 0.3 (Table 2). Every item was relevant to the other items included in the corresponding factor, therefore—for the benefit of the study—all items were retained.
Factors were named according to the items included within each factor (Table 3). Further testing by two experienced registered nurses, validated the above item distribution.
The five-factor structure Cyprus version of PES-NWI-R has acceptable CVI and internal consistency (alpha = 0.94). All items of the original version have been retained. Although factorial structure is similar to the original 5 factor-structure of the PES-NWI-R [10, 11], the items within the factors are different. Similar differences in item structure level have been observed in previous studies . Such differences can be attributed to cultural differences among countries, as well as to varying health care and management systems. This is an important consideration, as Cyprus has been, during the current study, in a transitional period concerning its health care system . This might have influenced the nurses’ responses because many changes and political decisions as well as conflicts between unions and government have taken place. Nurse researchers are challenged to further investigate in a more global perspective the concept of nursing working environment, since, once again, it has been shown that is considered differently among cultures. Current situations and local condition seem to play a vital role on how the nursing environment is described, a fact that policy makers need to be aware of, if they want to achieve an acceptable nursing working environment.
In this study, factor one consists of six items, relevant to Staffing and Resources Adequacy. This is in line with Lake’s study , Klopper et al.  and Parker et al.  studies except item named Working with nurses who are clinically competent which, in the present study, was loaded within a different factor, namely Nursing Competency. The move of this item to another factor can be attributed to the current situation in Cyprus; almost all nurses are holders of at least Bachelor’s in nursing. Competency is seen by nurses in this study as having to do high level of standards or being able to have equal power with other top-level hospital executives, which is explained by the position of high academic qualifications.
Factor two of the present study includes seven items, dealing on nurse–doctor relationship. It includes items on how doctors and nurses cooperate but also on what doctors believe—from the nurses’ perspective—about nurses. This factor is the only one that corresponds in its entity with the findings by Klopper et al.  and the same items (but not all) are included in the study by Parker et al. , Lake  and Van Bogaert et al. , whereas in Chiang and Lin  study, all items were scattered in various factors, probably due to cultural differences and perceptions in the Chinese population of nurses. The relationship between nurses and doctors can, probably, be affected by historical reasons and how both professions developed (together, in parallel etc.) but also on how the society in general perceives the roles and relationship between the two professions . In some cultures, the doctor’s opinion is decisive and under this status, little opportunity is given to nurses to work as autonomous health professionals [17, 18]. In the Cyprus context, many nurses hold up to Ph.D. qualifications, allowing them to act more autonomously, influencing in this way their perceptions regarding their working environment.
Factor three in this study is named Nursing Policy as it includes items that do not correspond with previous labelling of the factors in other studies. For example, the items included in this factor were included in Lake’s study  into different factors (Nurse Participation in Hospital affairs and Nursing Foundations for quality of care). However, in this study, these items were grouped in one factor, implying that in the Cyprus environment they form a different idea. They look on how the nursing profession is ruled, what policies exist and how nurses are involved in internal governance within the hospital. Thus, this factor, was named Nursing Policy since it reflects the general policy in nursing that covers the profession. It should be noted that in 2009, a directorate of Nursing Services was set up and is working at Ministerial level. One of its missions, is to develop policies, protocols and clinical guidelines that assist nurses to perform their duties. The existence of the directorate, which is independent from other directorates, has facilitated the perception of nurses in Cyprus as autonomous health professionals, that develop their policy and regulate the profession.
Factor four of the present study includes items that deal with management and professional development. It was also labelled differently from previous studies since its content is different, as items from the present study were scattered in different factors in previous studies (e.g. in Parker’s et al. study  items a nurse manager who backs up the nursing staff in decision making, even if conflict is with a doctor and Active staff development or continuing education programme for nurses). Once again it is obvious that the effect the possession of high qualifications among nurses in Cyprus has on their perception regarding the importance of professional development of nurses. This has led to grouping of all relevant items regarding this topic under one factor.
Factor five includes four items, all relevant to nursing quality and what is expected from nurses to be competent/be considered competent e.g. working with nurses who are clinically competent. This is a totally new factor, since in previous studies these items were included in different factors. In Parkers et al. study , quality was also seen from the perspective of the existence of a nursing model on which nursing care is based on, whereas Klopper et al.  suggested that quality also included a clear philosophy of nursing and the existence of a preceptor programme for new nurses. These findings reflect the differences between health care systems with reference to what is expected to be included in quality nursing care and how this is delivered and presented. For example, in the perception of Cypriot nurses, being competent to practice nursing is not relevant to staffing and resources but is grouped with other concepts like high standards and equal authority with other professionals. This is an important consideration, especially in current worldwide trend of practicing nursing in other countries. Nurses originating from other parts of the world and different health care and educational systems might find challenging the effort to become part of a new system.
This study showed that the Cyprus version of PES-NWI-R has satisfactory psychometric properties. Reliability findings are adequate, and a new factor structure is proposed. This structure is solid, since all factors include more than three items, they have adequate loading to their respective factor and have semantic relationship. The Cyprus version can be used for further testing the nurses working environment in Cyprus in order to facilitate changes but also to persuade policy-makers about the importance of nurses as part of the health system. Future studies may also focus into an in more in-depth testing of the PES-NWI-R, by replicating our study, to confirm its factor structure.
To follow the RN4CAST protocol, this study was confined to nurses working in surgical-medical departments. Therefore, further research in other clinical settings is suggested. A convenience sample was used, limiting the generatability of findings.
Nurse Forecasting in Europe
Revised Practice Environment Scale of the Nursing Work Index
International Council of Nurses
Content Validity Index
Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout and job dissatisfaction. JAMA. 2002;288:1987–93.
Aiken L, Clarke S, Sloane D, Lake ET, Cheney T. Effects of hospital care environment on patient mortality and nurse outcomes. J Nurs Adm. 2008;38(5):223–9.
Sermeus W, Aiken LH, van den Heede K, et al. Nurse forecasting in Europe (RN4CAST): rationale, design and methodology. BMC Nurs. 2011;10:6.
Lake ET. The nursing practice environment: measurement and evidence. Med Care Res Rev. 2007;64:104–22.
Warshawsky ΝE, Havens DS. Global use of the practice environment scale of the nursing work index. Nurs Res. 2011;60(1):17–31.
Klopper CH, Coetzee S, Pretorius R, Bester P. Practice environment, job satisfaction and burnout of critical care nurses in South Africa. J Nurs Manag. 2012;20:685–95.
Orts-Cortés MI, Moreno-Casbas T, Squires A, et al. Content validity of the Spanish version of the Practice Environment Scale of the Nursing Work Index. Appl Nurs Res. 2013;26:e5–9.
Aiken LH, Sermeus W, Van den Heede K, et al. Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2012;344:e1717.
Numminen O, Ruoppa E, Leino-Kilpi H, Isoaho H, Hupli M, Meretoja R. Practice environment and its association with professional competence and work-related factors: perception of newly graduated nurses. J Nurs Manag. 2016;24(1):E1–11.
Lake ET. Development of the practice environment scale of the Nursing Work Index. Res Nurs Health. 2002;25(3):176–18811.
Squires A, Aiken LH, van den Heede K, Sermeus W, Bruyneel L, Lindqvist R, et al. A systematic survey instrument translation process for multi-country, comparative health workforce studies. Int J Nurs Stud. 2013;50(2):264–73.
Chiang HY, Lin SY. Psychometric testing of the Chinese version of nursing practice environment scale. J Clin Nurs. 2009;18(6):919–29.
Theodorou M, Charalambous C, Petrou C, Cylus J. Cyprus: health system review. Health Syst Transit. 2012;14(6):1–128.
Parker D, Tuckett A, Eley R, Hegney D. Construct validity and reliability of the Practice Environment Scale of the Nursing Work Index for Queensland nurses. J Clin Nurs. 2010;18(6):902–9.
Van Bogaert P, Clarke S, Vermeyen K, Meulemans H, Van de Heyning P. Practice environments and their associations with nurse-reported outcomes in Belgian hospitals: development and preliminary validation of a Dutch adaptation of the Revised Nursing Work Index. Int J Nurs Stud. 2009;46(1):54–64.
Brown SS, Lindell DF, Dolansky MA, Garber JS. Nurses’ professional values and attitudes toward collaboration with physicians. Nurs Ethics. 2015;22(2):205–16.
Patelarou E, Vardavas CI, Ntzilepi P, Sourtzi P. Nursing education and practice in a changing environment: the case of Greece. Nurse Educ Today. 2009;29(8):840–84.
Obembe TA, Olajide AT, Asuzu MC. Managerial dynamics influencing doctor-nurse conflicts in two Nigerian hospitals. J Fam Med Prime Care. 2018;7(4):684–92.
This study was planned and supervised by EP. EP, GE, CA and MD were responsible for data collection and analysis, data interpretation, manuscript drafting, and made critical revisions for important intellectual content. HT was responsible for statistical and data analysis, data interpretation and manuscript drafting. All authors have participated sufficiently in this work and approve the final version of the manuscript. All authors agree to be accountable for all aspects of this work. All authors read and approved the final manuscript.
This study was funded by the Cyprus Nurses and Midwives Association and supported by the Cyprus University of Technology and Nursing Services, Ministry of Health, Cyprus. In addition, Andreas Charitou, RN, Despo Konstantinou, RN, Stavros Vryonides, RN, Evdokia Athini, RN, Dr. Maria Prodromou, RN and Dr. Anastasios Merkouris, RN, are acknowledged for actively participating in this study. The authors would like to thank Ms. Maria Evangelou for the language editing and Prof. Walter Sermeus for giving the permission to replicate the RN4cast study in Cyprus.
The authors declare that they have no competing interests.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author upon a reasonable request.
Consent for publication
Ethics approval and consent to participate
All participants were fully informed about the study, participated voluntarily and had the right to withdraw at any time. Anonymity was maintained at all stages of the study. Verbal informed consent was obtained by the participants since this study did not involve any invasive procedures. The study’s protocol, which included the above ethical considerations, was reviewed and approved by the Cyprus National Bioethics Committee (Reference Number EEBK EΠ 2014.01.32).
This study received funding from the Cyprus Nurses and Midwives Association (CYNMA). Members of CYNMA actively participated in the preparation of the research protocol, data collection, data analysis and interpretation of results.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.