Creating a gold medal Olympic and Paralympics health care team: a satisfaction survey of the mobile medical unit/polyclinic team training for the Vancouver 2010 winter games
© Brown et al.; licensee BioMed Central Ltd. 2013
Received: 3 September 2013
Accepted: 8 November 2013
Published: 13 November 2013
The mobile medical unit/polyclinic (MMU/PC) was an essential part of the medical services to support ill or injured Olympic or Paralympics family during the 2010 Olympic and Paralympics winter games. The objective of this study was to survey the satisfaction of the clinical staff that completed the training programs prior to deployment to the MMU.
Medical personnel who participated in at least one of the four training programs, including (1) week-end sessions; (2) web-based modules; (3) just-in-time training; and (4) daily simulation exercises were invited to participate in a web-based survey and comment on their level of satisfaction with training program.
A total of 64 (out of 94 who were invited) physicians, nurses and respiratory therapists completed the survey. All participants reported favorably that the MMU/PC training positively impacted their knowledge, skills and team functions while deployed at the MMU/PC during the 2010 Olympic Games. However, components of the training program were valued differently depending on clinical job title, years of experience, and prior experience in large scale events. Respondents with little or no experience working in large scale events (45%) rated daily simulations as the most valuable component of the training program for strengthening competencies and knowledge in clinical skills for working in large scale events.
The multi-phase MMU/PC training was found to be beneficial for preparing the medical team for the 2010 Winter Games. In particular this survey demonstrates the effectiveness of simulation training programs on teamwork competencies in ad hoc groups.
Mobile medical units often serve as extensions of main health facilities to reach patients when they are at most risk. These high-tech units act as mini-hospitals to provide definitive life-saving emergency and/or post disaster response for many needs-based functions, including disaster response, large-scale recreational events, support in mass casualties, or replacing lost ambulatory or emergency room service capacity in case of emergency department closures [1–5].
During the 2010 Vancouver Winter Games, mobile surgical services and medical support for athletes and officials were provided on-site at the Whistler Athlete Village by the Mobile Medical Unit/Polyclinic (MMU/PC). The MMU/PC was designed to provide definitive life-saving care for persons in the event that injury severity, transportation, or weather disruption would prohibit immediate triage and transport to larger care facilities as well as to provide surge capacity in the event of a mass or multi-casualty situation.
As these are highly sophisticated and specialized units it is necessary to provide equally sophisticated and specialized training in order to make the users comfortable and familiar with the environment. It has been shown that simulation based trainings have demonstrated significant impact on teamwork competencies such as communication, role clarity, situation awareness and leadership as well as clinical knowledge and skills [6, 7]. An education framework was established early in the planning process to ensure all medical staff and contractors received hands-on training to prepare for efficient and effective patient care and flow while working in the MMU. This training program was coordinated by a joint education committee between Canadian Forces Trauma Training Centre (West) (CFTTC (W))a and the Vancouver Coastal Health (VCH) section of Learning and Development at Vancouver General Hospital (VGH) with close collaboration from the Public Health Agency of Canada (PHAC), National Office of Health Emergency Response Teams (NOHERT) and Vancouver Olympic Committee (VANOC).
Validation and participant satisfaction studies can help link field performance to training context [8, 9]. The feedback gained from these measures can be used to synchronize the training objectives with trainees’ area of expertise to make the training “more targeted” . The purpose of this study was to survey the satisfaction of the clinical staff that completed the MMU/PC training in attempt to assess the impact of the education and training program provided to health care providers who supported the MMU during the Games.
A total of 105 medical personnel volunteers and contractors were recruited from within the Province of British Columbia and from across Canada to provide the required medical expertise to staff and operate the MMU during the 2010 Winter Games. Recruitment advertisements specified qualifications/criteria for selection. Successful applicants were credentialed through VGH, VCH, and VANOC prior to enrollment. Experts recruited for participation included anesthesiologists, general and orthopaedic trauma surgeons, emergency, critical care, and operating room nurses, and respiratory therapists.
Participants were grouped into five 17-person teams. Each team comprised of two trauma/general surgeons, two anesthesiologists, two orthopedic trauma surgeons, four operating room nurses, four critical care nurses, two emergency nurses, and one respiratory therapist. Each team was deployed for a 10 to 14 day rotation to provide care and continued support for the Whistler Olympic Village Polyclinic.
Education and training model
MMU participants completed a four-phase education and training curriculum prior to deployment in effort to foster the performance of a high functioning interdisciplinary team. Instruction was provided in collaboration with VGH, CFTTC(W), the Centre for Excellence for Simulation Education and Innovation (CESEI) at VGH, and the VCH Learning & Development division. Training programs were delivered between October 2009 and March 2010. The training model included the following phases:
Phase 1: weekend training
In October 2009, medical personnel attended a 2.5 day workshop at VGH. The purpose of this training phase was to introduce team members to other participants and provide an opportunity to become accustomed to the MMU facility. During this time all participants were also orientated with the triage and delivery structure for how medical services were to be provided across all Olympic venues. As well they were provided with classroom learning and instruction to increase their content familiarity with the MMU in order to problem solve potential treatment challenges they may face.
Phase 2: web-based modules
Following the weekend training seminar, participants completed a series of “mandatory” and elective web-based learning modules. Learning modules were distributed through CESEI and VCH Learning and Development. Topics included Infection Control Basics (hand hygiene), Central Venous Catheter Care & Maintenance, Safe Blood Transfusion, Workplace Hazardous Materials Information System Basics, VANOC 2010 medical services, Introduction to the Mobile Medical Unit – History and Planning, Summary of Whistler Polyclinic and Mobile Medical Unit, Mobile Medical Unit Orientation to Physical Lay Out and Patient Flow, 2010 Olympic/Paralympic MMU Blood Education Overview, Transfusion Medicine Services, Introduction to METI Emergency Care Simulator (ECS) and Introduction to METI Human Patient Simulator (HPS). Mandatory learning modules included Blood Transfusion and Infection Control Basics (hand hygiene).
Phase 3: “just-in time” training
In the week prior to deployment, participants completed a series of simulation training exercises in a mock up MMU in CESEI over the span of 1.5 days. Training included simulations as well as small and large group sessions. CFTTC(W) provided leadership in each exercise. Simulation exercises escalated in complexity over time, beginning with: (1) an introduction of team dynamics and trauma protocols; (2) orientation session and familiarization with the mock trauma bay, OR, Emergency Care Simulator (ECS) and Human Patient Simulator (HPS); (3) scenario based trauma management sessions followed by debriefings; and (4) mass casualty and complex case-based scenarios followed by debriefings. Simulation exercises were modified based on scenarios learned from previous team experiences consistent with a rapid cycle change problem solving philosophy.
Phase 4: daily simulation training
Simulation and training were imbedded into the daily routines for the MMU and polyclinic team. Daily simulation exercises ranged in complexity, beginning with simple case scenarios and moving toward more complex situations such as Code Blue simulations in all areas of the Whistler Polyclinic (eg, Dentistry, Therapy, MRI), a series of outreach responses in the Whistler Athletes Village, and the complex Long-Line Helicopter Evacuation from the event scene to the MMU. Arrangements were made to run these simulations while still conducting the normal operations of the Polyclinic. All scenarios were executed in “real time” whenever possible with fully integrated communications with other participating agencies (eg, event security, ski patrol etc.). An important aspect of the training was the formative debriefings held after each simulation. The debriefings allowed learnings to be discussed that built further team confidence within the new environment.
Survey of clinical staff satisfaction of the training program
Clinical staff were recruited by e-mail using their contact information obtained from the MMU/PC management office database. Inclusion criteria for our study were as follows: (1) having completed a rotation of at least four days serving with the MMU/PC in Whistler during the Games, and (2) having completed at least one of the four phases of pre-deployment training. All persons who participated in the preparation or delivery of the MMU/PC training programs were excluded from the survey.
Participants received a letter of initial contact from the Principal Investigator outlining the purpose and procedures of the study. Attached to this email they received a link to a secure online survey hosted at FluidSurveys (Chide.it Inc., Ottawa, Ontario).
Training assessment survey
All assessment questions were constructed from focus group discussions with MMU/PC staff. Questions were based on the phases of training that were provided prior to deployment and pilot-tested with MMU/PC staff. The survey was divided into three sections: responses to individual training phases; responses on overall course satisfaction; and demographic and work-related experience profiles. The survey was designed to require approximately 15 minutes to complete and would allow participants to save their progress in the event that the could not complete the entire survey in one sitting.
Most of the questions were closed-ended, but participants were encouraged to provide additional content in the event they wished to provide more specific feedback. Close-ended questions followed a five-point Likert scale ranging from very valuable, somewhat valuable, neutral, minimally valuable, and not at all valuable. The survey also included open-ended questions in which participants were asked to respond in their own words regarding the quality and amount of simulation training that was provided, whether they have since implemented or incorporated any of the learning approaches into practice at their home hospital/agency, and whether they had any other comments or suggestions regarding the education and training that they received during the MMU/PC training period. The survey was posted on-line between May 20, 2011 and August 8, 2011. The study was approved by the Behavioral Research Ethics Board at the University of British Columbia.
Descriptive statistics and cross-tabulations were calculated for each survey item. Responses were stratified by clinical job title, years of experience, and prior experience working in large scale events. Differences between means of continuous variables were examined using a two-tailed t-test, and differences in proportions of categorical variables were examined using a chi square test. We examined all categorical variables where expected values were less than five using Fisher’s exact test. A significance level of 0.05 was used to assess all bivariate relationships. All statistical analyses were generated using SAS software, Version 9.2 for Windows .
Clinical profile of participants
Nurses and RT’s*
Critical care nurse
Operating room nurse
Clinical experience profile
Nurses and RT’s*
Overall work experience
< 5 years
> 5 years
Large scale work experience
Training phase 1: weekend training
Responses to the weekend training session among nursing and physician course participants
Average responses by clinical role
Nurses and RT’s§ n = 21 (SD)
Physicians n = 22 (SD)
Training valuable for experiences during the games
Training increased comfort and familiarity in work environment
Preparation for subsequent practice during the games
MMU ’walk through’ provided situational awareness
MMU ’walk through’ increase anxiety
Discussion seminar on medical liability
Discussion on care management of elite athletes
MMU ’walk through’: understanding role and procedures
MMU ’walk through’: movement of simulated patient
MMU ’walk through’: experience in physical layout
Discussion on uniforms, security, and accommodation
Discussion on daily routines, shifts, and schedules
Discussion on protocols, safety, and infection control
General Q & A discussion
Discussion on mass casualty and emergency planning
Discussion on pandemic planning and H1N1
Discussion on blood administration protocols
Discussion on patient transfer protocols
Training phase 2: web-based training
Responses to the web-based training seminar among nursing and physician course participants
Average responses by clinical role
Nurses and RT’s§ n = 21 (SD)
Physicians n = 22 (SD)
Infection control basics
Central venous catheters care & maintenance
Safe blood transfusion
VANOC medical services
Introduction to MMU: history and planning
Summary of Whistler polyclinic and MMU
MMU orientation to physical layout and patient flow
Olympics/paralympics MMU blood education overview
Transfusion medicine services
Introduction to METI Emergency Care Simulator (ECS)
Introduction to METI Human Patient Simulator (HPS)
Value in post-test assessments of learning modules
Training phase 3: just-in-time training
Responses to the just-in-time MMU training seminar among nursing and physician course participants
Average responses by clinical role
Nurses and RT’s§n = 21 (SD)
Physicians n = 22 (SD)
Effectiveness of the introductory session
Simulation training: competency & communication
Simulation training: knowledge
Simulation training: clinical skills
Value of simulation training for weekend training session
Value of simulation training for web-based training session
Value of blood bank training session†
Training phase 4: daily simulation training
Responses to the daily simulation training sessions among nursing and physician course
Average responses by clinical role
Nurses and RT’s§ n = 21 (SD)
Physicians n = 22 (SD)
Patient moving simulation exercises
Long line helicopter simulation exercises
Simulation debriefing sessions
On average, both groups responded favorably to the simulation training. Approximately 55% of physicians (n = 10) who elected to provided feedback felt that they received adequate simulation training prior to deployment, while 39% of physicians (n = 7) recommended that similar training schedules should be increased if the course were to be offered again. The most common rationale for providing more simulation training among physicians was to improve familiarity working in the MMU unit. Among nurses and RT’s who elected to comment on the quality and amount of simulation training, 44% (n = 7) felt that the quality and amount of training was sufficient while 47% (n = 9) suggested that more simulation training would have been beneficial. The most common rationale for providing more simulation training among nurses and RT’s was to improve familiarization and movement within the MMU.
Only 5 of the 34 nursing and RT staff participants elected to provide additional feedback regarding whether they had implemented or incorporated any of the learning approaches into practice at their home hospital/agency. Of those responses, each participant reported favorably that the training has positively impacted their daily routine, but did not elect to comment on a particular component of the training that they found to be beneficial. One individual reported that the MMU/PC simulation training has improved their team debriefing following regular simulator training sessions at their own hospital/agency. Two individuals reported that they now regularly incorporate simulation training with their students/staff as a result of the training provided at the MMU/PC.
To assess the applicability of medical training in the actual practice field, the impact of training should be questioned in several territories such as clinical skills, performing procedures, patient management, ethicolegal responsibilities, team performance and communication skills [12, 13]. Our multi-phase MMU/PC training, that covered a diverse array of areas, was found to be beneficial in the perspective of the participants for preparing personnel for the 2010 Winter Games. The uniqueness of this training program was a four-phase education and training curriculum designed to foster the performance of a high functioning interdisciplinary team.
Although our evaluation did not include a controlled clinical trial design, it provides valuable information on the perspective of clinical staff that completed the different training models developed for the curriculum. In particular this survey demonstrates strong support for incorporating simulation training when preparing ad hoc clinical training programs. These findings add additional support to the literature on the utility of simulation training programs on teamwork competencies . The study also provides new information on how to structure training programs for preparing clinicians to work within mobile medical environments.
We had a favorable response rate and good representation of among the clinical professionals who participated in this training program. Over 75% of the participants had more than 5 years work experience and 55% had experience working in large scale events, indicating that the Whistler Olympic Village recruitment strategy specifically targeted individuals with experience working in large-scale events and experience in trauma. The fact that the ‘more experienced’ groups rated the training favorably does provide an indication that the structure of the training program was useful and of benefit to the participants.
This feedback is important given the many potential situations where ad hoc clinical teams might form, from potential epidemic outbreaks, to terrorist threats, to natural disasters. Since the 2010 Games, daily simulation has become a standing operation procedure for current MMU deployments in effort to keep our new and constantly changing teams up to speed on working in these types of clinical environments. Subsequent deployments have ranged from staging at small stage events, including the BMX Supercross World Cup in Abbotsford, BC in 2012, to outreach programs across the province, to providing Emergency Department support over a 10-day period during the 2012 flooding of the Surrey Memorial Hospital. Many of the original teaching staff attached to the MMU during the 2010 Games subsequently became staff for the MMU as a provincial resource. We continue to build on the original ‘just in time’ training curriculum to help train and prepare the medical teams prior to deployment. These ongoing sessions are helping to re-shape the curriculum, taking lessons learned from previous deployments and immediately updating lesson plans and performance objectives.
At the time of the Games, we had little experience in the MMU. Knowing what we do now about the strengths and weaknesses of the unit and support trailer and from experience with the Games and other deployments we would recommend holding more simulation exercises of casualties for future training sessions. In addition, to optimize learning for all clinical staff we would have the MMU wired for video broadcast of simulations. We recently did this at an emergency medical conference, allowing hundreds of people to watch the small teams function in the unit. For education and training purposes, the benefit of the video stream would be the increased observation opportunities for clinical staff as they watched teams practice, thus affording another opportunity to gain experience for working within the MMU.
These results should be viewed within the context of some important limitations. Firstly, although the survey responses imply that the training program developed for the 2010 Games was effective, we do not present any clinical outcome data that can additionally confirm or deny the appropriateness of the training. Access to this data was not feasible due to ownership and privacy stipulations of the medical records for all persons treated in the MMU during the 2010 games. One approach for future training evaluation programs would be to hold pre and post training surveys, thereby linking the training and performance objectives to outcome measures such as patient satisfaction, complications, or functional outcomes. Similarly, future assessments could be derived using pre- and post-test knowledge and confidence tests and surveys followed by post-deployment validation surveys. For example, an external reviewer observing team performance for error rates with simulation patients and treatment algorithms.
One of the legacy goals of the MMU/PC is to maintain an annual clinical training program whereby portions of the training delivered during the 2010 Winter Games will be replicated. Within a Canadian context, British Columbia is the only province with this type of service facility. Thus, it offers an opportunity to improve the preparedness of Canadian clinical personnel who may later work in austere environments either in Canada or abroad. The level of satisfaction from participants of the training program is encouraging as it provides a foundation to structure future training clinical training programs for working in MMU environments.
aCFTTC(W) contribution with the permission of the Minister of National Defense.
- Bolster C: Mobile hospital provides care when disaster strikes. Healthc Financ Manage. 2006, 60: 114-116.PubMedGoogle Scholar
- Blackwell T, Bosse M: Use of an innovated design mobile hospital in the medical response to hurricane katrina. Ann Emerg Med. 2006, 49: 580-588.PubMedView ArticleGoogle Scholar
- King B, Jatoi I: The mobile army surgical hospital (MASH): a militaory and surgical legacy. J Natl Med Assoc. 2005, 97: 648-656.PubMedPubMed CentralGoogle Scholar
- Erich J: As good as advertised: mobile hospital shines in Katrina response. Emerg Med Serv. 2007, 36: 38-39.PubMedGoogle Scholar
- Hoffman H: Medical field hospital capability and trauma care. J Trauma. 2007, 62 (6 Suppl): S97-S98.PubMedView ArticleGoogle Scholar
- DeVita M, Schaefer J, Wang H, Dongilli T: Improving medical emergency team (MET) performance using a novel curriculum and a computerized human patient simulator. Qual Saf Health Care. 2005, 14: 326-331. 10.1136/qshc.2004.011148.PubMedPubMed CentralView ArticleGoogle Scholar
- Shapiro M, Morey J, Small S, Langford V, Kaylor C, Jaminas L, et al: Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum?. Qual Saf Health Care. 2004, 13: 417-421. 10.1136/qshc.2003.005447.PubMedPubMed CentralView ArticleGoogle Scholar
- Goldie J: AMEE education guide no. 29: evaluating educational programs. Med Teach. 2006, 28: 210-224. 10.1080/01421590500271282.PubMedView ArticleGoogle Scholar
- Canadian Forces Individual Training & Education System: CFITES Manual of Individual Training and Education.http://www.admfincs-smafinsm.forces.gc.ca/dao-doa/5000/5031-2-eng.asp,
- Salas E, Rosen M, Burke C, Nicholson D, Howse W: Markers for enhancing team cognition in complex environments: the power of team performance diagnosis. Aviat Space Environ Med. 2007, 78: B77-B85.PubMedGoogle Scholar
- SAS Institute Inc: SAS/STAT® version 9.2 of the SAS system for Windows. Cary, NC, USA: Copyright © 2008Google Scholar
- Buljac-Samardzic M, Dekker-van Doorn C, van Wijngaarden J, van Wijk K: Interventions to improve team effectiveness: a systematic review. Health Policy. 2010, 94: 183-195. 10.1016/j.healthpol.2009.09.015.PubMedView ArticleGoogle Scholar
- Mukhopadhyay S, Smith S: Outcome-based education: principles and practice. J Obstet Gynaecol. 2010, 30: 790-794. 10.3109/01443615.2010.505305.PubMedView ArticleGoogle Scholar
- Mencia S, Lopez-Herce J, Botran M, Solana M, Sanchez A, Rodriguez-Nunez A, Sanchez L: Evaluation of advanced medical simulation courses for training of paediatric residents in emergency situations. Anales de Pediatria. 2012, 78: 241-247.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.