Developing and piloting an adaptation of AMSTAR tool for systematic reviews of research priority setting exercises

Session Type
Priority setting
Nasser M1, Tan A2, Kumbargere S3, Sharma T4, Kuchenm├╝ller TK5
1University of Plymouth, UK
2UCL Public Policy, UK
3MAGIC group, Norway
4WHO Regional Office for Europe, Denmark
5WHO, Switzerland

Background: There is increased number of systematic reviews of research priority setting exercises published. These reviews can be critical in informing future priority setting exercises and reduce unnecessary duplication of studies. However, these reviews have a range of qualities and there is a need for appropriate tool to appraise these studies.
Objectives: to adapt the AMSTAR tool for appraisal of systematic reviews of research priority setting studies and pilot them for a a group of systematic reviews identified as part of a previous publication (Tan 2022).
Methods: from previous studies on evaluation of priority setting exercises (Nasser 2021), we identified key elements that might affect the AMSTAR tool and developed either adapted questions or adapted guidance to answer the questions. Afterwards, the tool was used to pilot the reviews of Tan 2022 review.
Results: While the original 16 items were maintained, the questions were adapted so that the research priority setting method, as opposed to the intervention, was the focus. 31 studies were identified in Tan 2022 review that were evaluated using the AMSTAR tool. Only two reviews were assessed as low quality and the remaining 29 reviews were assessed to be of critically low quality overall.
Conclusions: Our adapted AMSTAR tool can be used to appraise systematic reviews of research priority setting exercises and differentiate their quality.
Patient, public and/or healthcare consumer involvement: There was no direct involvement, however, the work builds on methodological research focusing on patient involvement in research amongst other research.

Abstract with references.pdf
Adapted AMSTAR tool.pdf