Cochrane South Africa training – does it work to increase knowledge and skills in evidence-based healthcare?

Session Type
Capacity building in evidence synthesis
Durao S1, Ebrahim S1, Cooper S1, Mabetha D1, Kredo T2
1Cochrane South Africa, South African Medical Research Council, South Africa
2Healthy Systems Research Unit, South African Medical Research Council, South Africa

Background: A key function of Cochrane South Africa includes building capacity of stakeholders to conduct reviews, use review evidence to inform healthcare decisions, and raise awareness about the importance evidence-based healthcare. In 2021, we launched a project to formally evaluate our training.
Objectives: To evaluate training delivered by Cochrane SA across four levels: reaction; learning; behavior; and impact.
Methods: We followed the Kirkpatrick model for evaluating training effectiveness, using mixed-methods study design (Table 1). To assess reactions to the training, and changes in knowledge and behaviour, participants completed online questionnaires at different timepoints: immediately after every event for reaction to training; immediately before and after selected events for learning; and for behaviour change, participants completed an adapted version of the evidence-based practice questionnaire before and three months after selected events. To assess impact, or the use of knowledge in practice, we interviewed participants of selected events six and 12 months after the event. Quantitative data was analysed using descriptive statistics, and qualitative data using thematic analysis.
Results: We hosted 18 training events including 1027 participants from November 2021 to December 2022 including webinars, protocol development course, primer in systematic reviews (Tables 2 and 3). Regarding reaction to training, participants feedback was overall positive (Figures 1 and 2). Only 223/1027 participants completed evaluation forms; response rates for the monthly webinars was poorer compared to the smaller workshops. Changes in knowledge was assessed for two events, changes in behavior for one event, and impact for two events; the results for these will be presented at the Colloquium.
Conclusions: The Training Evaluation project is helping us refine and improve the planning, delivery, and impact of the training Cochrane SA delivers. Challenges include the poor response rate and the lack of dedicated resources for implementing the evaluation more efficiently. Knowing the impact of our training will help understand what the return on investment is, as planning and delivering training is resource intensive.
Patient, public and/or healthcare consumer involvement: Our training may contribute to more evidence-informed decision-making in Africa. This would be beneficial for patients and other stakeholders.

Cochrane SA training evaluation_supplementary material.pdf