评估研究的影响:一个方法论框架

Evaluating impact from research: A methodological framework

RESEARCH POLICY · 2021
被引 299 · 同刊同年前 2%
人大 AFT50ABS 4*

中文导读

通过文献分析,定义了研究影响及其评估,提出了五种影响评估设计类型,并构建了一个方法论框架,帮助研究者、资助者等跨学科选择适合的评估设计和方法。

Abstract

Interest in impact evaluation has grown rapidly as research funders increasingly demand evidence that their investments lead to public benefits. This paper analyses literature to provide a new definition of research impact and impact evaluation, develops a typology of research impact evaluation designs, and proposes a methodological framework to guide evaluations of the significance and reach of impact that can be attributed to research. An adapted Grounded Theory Analysis of research impact evaluation frameworks drawn from cross-disciplinary peer-reviewed and grey literature. Recognizing the subjective nature of impacts as they are perceived by different groups in different times, places and cultures, we define research impact evaluation as the process of assessing the significance and reach of both positive and negative effects of research. Five types of impact evaluation design are identified encompassing a range of evaluation methods and approaches: i) experimental and statistical methods; ii) textual, oral and arts-based methods; iii) systems analysis methods; iv) indicator-based approaches; and v) evidence synthesis approaches. Our guidance enables impact evaluation design to be tailored to the aims and context of the evaluation, for example choosing a design to establish a body of research as a necessary (e.g. a significant contributing factor amongst many) or sufficient (e.g. sole, direct) cause of impact, and choosing the most appropriate evaluation design for the type of impact being evaluated. Using the proposed definitions, typology and methodological framework, researchers, funders and other stakeholders working across multiple disciplines can select a suitable evaluation design and methods to evidence the impact of research from any discipline.

研究评估影响评价方法论跨学科研究