Academic emergency medicine : official journal of the Society for Academic Emergency Medicine
-
Immersive learning environments that use virtual simulation (VS) technology are increasingly relevant as medical learners train in an environment of restricted clinical training hours and a heightened focus on patient safety. We conducted a consensus process with a breakout group of the 2017 Academic Emergency Medicine Consensus Conference "Catalyzing System Change Through Health Care Simulation: Systems, Competency, and Outcomes." This group examined the current uses of VS in training and assessment, including limitations and challenges in implementing VS into medical education curricula. ⋯ Finally, we offer recommended areas of focus for future research examining VS technology for assessment, including high-stakes assessment in medical education. Specifically, we discuss needs for determination of areas of focus for VS training and assessment, development and exploration of virtual platforms, automated feedback within such platforms, and evaluation of effectiveness and validity of VS education.
-
Observational Study
Simulation for Assessment of Milestones in Emergency Medicine Residents.
All residency programs in the United States are required to report their residents' progress on the milestones to the Accreditation Council for Graduate Medical Education (ACGME) biannually. Since the development and institution of this competency-based assessment framework, residency programs have been attempting to ascertain the best ways to assess resident performance on these metrics. Simulation was recommended by the ACGME as one method of assessment for many of the milestone subcompetencies. We developed three simulation scenarios with scenario-specific milestone-based assessment tools. We aimed to gather validity evidence for this tool. ⋯ Three simulation cases with scenario-specific assessment tools allowed evaluation of EM residents on proficiency L1 to L4 within eight of the EM milestone subcompetencies. Evidence of test content, internal structure, response process, and relations with other variables were found. Good to excellent IRR and the ability to discriminate between various PGY levels was found for both the sum of CL items and the GRSs. However, there was a lack of a positive relationship between advancing PGY level and the completion of higher-level milestone items (L3 and L4).
-
Multicenter Study Observational Study
A simulation-based approach to measuring team situational awareness in emergency medicine: A multicenter, observational study.
Team situational awareness (TSA) is critical for effective teamwork and supports dynamic decision making in unpredictable, time-pressured situations. Simulation provides a platform for developing and assessing TSA, but these efforts are limited by suboptimal measurement approaches. The objective of this study was to develop and evaluate a novel approach to TSA measurement in interprofessional emergency medicine (EM) teams. ⋯ Team situational awareness supports adaptive teams and is critical for high reliability organizations such as healthcare systems. Simulation can provide a platform for research aimed at understanding and measuring TSA. This study provides a feasible method for simulation-based assessment of TSA in interdisciplinary teams that addresses prior measure limitations and is appropriate for use in highly dynamic, uncertain situations commonly encountered in emergency department systems. Future research is needed to understand the development of and interactions between individual-, team-, and system (distributed)-level cognitive processes.
-
Value-based health care requires a balancing of medical outcomes with economic value. Administrators need to understand both the clinical and the economic effects of potentially expensive simulation programs to rationalize the costs. Given the often-disparate priorities of clinical educators relative to health care administrators, justifying the value of simulation requires the use of economic analyses few physicians have been trained to conduct. ⋯ At the 2017 Academic Emergency Medicine Consensus Conference "Catalyzing System Change through Health Care Simulation: Systems, Competency, and Outcomes," our breakout session critically evaluated the cost-benefit and return on investment of simulation. In this paper we provide an overview of some of the economic tools that a clinician may use to present the value of simulation training to financial officers and other administrators in the economic terms they understand. We also define three themes as a call to action for research related to cost-benefit analysis in simulation as well as four specific research questions that will help guide educators and hospital leadership to make decisions on the value of simulation for their system or program.
-
Randomized Controlled Trial Comparative Study
Training and Assessing Critical Airway, Breathing and Hemorrhage Control Procedures for Trauma Care: Live Tissue versus Synthetic Models.
Optimal teaching and assessment methods and models for emergency airway, breathing, and hemorrhage interventions are not currently known. The University of Minnesota Combat Casualty Training consortium (UMN CCTC) was formed to explore the strengths and weaknesses of synthetic training models (STMs) versus live tissue (LT) models. In this study, we compare the effectiveness of best in class STMs versus an anesthetized caprine (goat) model for training and assessing seven procedures: junctional hemorrhage control, tourniquet (TQ) placement, chest seal, needle thoracostomy (NCD), nasopharyngeal airway (NPA), tube thoracostomy, and cricothyrotomy (Cric). ⋯ Training on STM or LT did not demonstrate a difference in subsequent performance for five of seven procedures (junctional hemorrhage, TQ, chest seal, NPA, and NCD). Until STMs are developed with improved anthropomorphic and tissue fidelity, there may still be a role for LT for training tube thoracostomy and potentially Cric. For assessment, our STM appears more challenging for TQ and potentially for NCD than LT. For junctional hemorrhage, the increased "skips" with LT may be explained by the differences in anatomic fidelity. While these results begin to uncover the effects of training and assessing these procedures on various models, further study is needed to ascertain how well performance on an STM or LT model translates to the human model.