Journal of surgical education
-
Comparative Study
Ensuring Competency of Novice Laparoscopic Surgeons-Exploring Standard Setting Methods and their Consequences.
Simulation-based assessment tools have been developed to allow for proficiency-based simulator training in laparoscopy. However, few studies have examined the consequences of different standard setting methods or examined what level of proficiency is considered adequate for trainees. The objectives of the present study were to explore the consequences of different standard setting methods and to examine the proficiency level that surgical trainees are expected to reach, before performing supervised surgery on patients. ⋯ Required proficiency levels varies depending on the standard setting method used, which highlights the importance of using an established standard setting method to set the pass/fail level.
-
Comparative Study
Reliability and Validity of 3 Methods of Assessing Orthopedic Resident Skill in Shoulder Surgery.
Traditional measures for evaluating resident surgical technical skills (e.g., case logs) assess operative volume but not level of surgical proficiency. Our goal was to compare the reliability and validity of 3 tools for measuring surgical skill among orthopedic residents when performing 3 open surgical approaches to the shoulder. ⋯ OSATS checklists are a valid and reliable assessment of technical skills across 3 surgical shoulder approaches. However, checklist scores do not measure quality of technique. Documenting adverse events is necessary to assess quality of technique and ultimate pass/fail status. Multiple methods of assessing surgical skill should be considered when evaluating orthopedic resident surgical performance.
-
Surgical simulation is an important adjunct in surgical education. The majority of operative procedures can be simplified to core components. This study aimed to quantify a cadaver-based simulation course utility in improving exposure to fundamental maneuvers, resident and attending confidence in trainee capability, and if this led to earlier operative independence. ⋯ A cadaveric skills course focused on fundamental maneuvers with objective confirmation of success is a viable adjunct to clinical operative experience. Residents were formally exposed to fundamental surgical maneuvers earlier as a result of this course. This activity improved both resident and attending confidence in trainee operative skill, resulting in increased attending willingness to grant a higher level of autonomy in the operating room.
-
The Accreditation Council for Graduate Medical Education requires accredited general surgery residencies to implement competency-based developmental outcomes in resident evaluations. Overall, 16 milestones are evaluated by a clinical competency committee (CCC). The milestones span 8 domains of surgical practice and 6 Accreditation Council for Graduate Medical Education clinical competencies. The highest level suggests preparedness for independent practice. Our objective was to compare self-assessments and committee evaluations within the milestone framework. ⋯ Surgery residents within our program demonstrated adequate self-awareness, with most self-evaluations falling within a half level of the CCC report. This self-awareness was consistent across surgical domains and most clinical competencies. Residents perceived a lower level of medical knowledge than the CCC. Subgroup analysis revealed interesting trends in the effects of sex, postgraduate year level, and academic year timing, which will take additional study to fully delineate.
-
Comparative Study
The MacTRAUMA TTL Assessment Tool: Developing a Novel Tool for Assessing Performance of Trauma Trainees: Initial Reliability Testing.
To develop a novel assessment tool for trainees-led trauma resuscitation. Assess psychometric properties of the proposed tool. Evaluate feasibility and utility of the tool. ⋯ MacTrauma TTL assessment tool is a novel tool for formative feedback for trainees' performance during trauma resuscitation. Initial psychometric property testing is promising. Further reliability and validity testing of the modified tool is needed. The tool has been shown to be feasible and acceptable by both trainees and faculty as a formative assessment tool.