Beyond internal validity: Towards a broader understanding of credibility in development policy research
基于转移项目的证据,指出方法设计只是决定政策制定者眼中可信度的一个因素,合作研究参与、信任建立和问题共创同样重要,倡导以研究问题为导向而非方法为导向的政策研究。
We provide evidence from the Transfer Project to show that methodological design is only one factor in determining credibility in the eyes of policymakers. Policymakers understand concerns around internal validity, but also value collaborative research engagement, which builds trust, allows co-creation of research questions, informs operations throughout the evaluation period and leverages national research expertise. Further, the mere act of engaging in a large-scale, transparent impact evaluation, across quasi- and experimental designs can change the culture of decision-making within an agency, leading to better policy choices in the long run. We advocate for a more inclusive approach to policy research that begins with identifying the most relevant research question and fitting the methods to the question rather than vice-versa. We challenge the field to engage more closely with policymakers to identify their evidence needs in order to prioritize the end objective of improving the lives of the poor—regardless of methodological design choices.