Journal of evaluation in clinical practice
-
Within competency-based medical education, self-regulated learning (SRL) requires residents to leverage self-assessment and faculty feedback. We sought to investigate the potential for competency-based assessments to foster SRL by quantifying the relationship between faculty feedback and entrustment ratings as well as the congruence between faculty assessment and resident self-assessment. ⋯ Minimal and inconsistent associations were found between narrative and numerical feedback. Performance monitoring accuracy and feedback should be included in assessment validation.
-
In 2015, Queen's University embarked on an institution-wide transition to a competency-based medical education (CBME) curriculum for all 29 postgraduate medical education programmes. On 1 July 2017, this goal was accomplished. With this mass transition came the requirement to assess the efficacy of implementation through a programme evaluation process, which included the use of outcome harvesting (Wilson-Grau). Outcome harvesting identified the intended and unintended outcomes of CBME implementation, which helped us understand how the intervention was achieved and how the relationship between behaviours and stakeholders contributed to the successful transition. ⋯ Using outcome harvesting to assess the efficacy of CBME implementation produced a robust set of themes and resultant outcomes that can be categorized as requirements for success of implementation of any curricular innovation. Emergent themes included collaboration, community of practice, and stakeholder commitment. More unique observations noted through the harvest process included new policy development, creation of learner ownership, and an increase in the output of scholarly activity involving CBME.
-
This paper explores the economic value of rehabilitation to South Africa, using a costed example of cerebrovascular accident (CVA) (stroke) rehabilitation. ⋯ The value of rehabilitation should not be considered in terms of cost-effectiveness alone, but also as an investment for the country. A staged, prioritized approach should be considered in future South African national health budget.
-
Individual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)-delivered via the internet-has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT. ⋯ This study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, "Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness."