Building Programme Evaluation into the Design of Public Research-Support Programmes
指出公共研究项目效果难以衡量,提出通过部分随机化或公开评审排名来改进评估,以解决选择性偏差和额外性问题。
There is wide agreement that the high social rate of return to research and innovation justifies government support for research. There is, however, only limited evidence on the effectiveness of different public research programmes. Reliable measurement of programme effectiveness is hampered by the 'selectivity' problem (public funding goes to proposals judged in advance to be likely to succeed) and the question of 'additivity' (whether public funding increases total spending on research or merely displaces funding from other sources). The selectivity problem can be mitigated by building evaluation into programme design, either by partial randomization of the grant process, or by recording the rankings used in grant evaluation and making this information available to researchers. The additivity question reflects the more fundamental problem that the ultimate objective of these programmes is to have long-term effects that are inherently very difficult to measure and attribute to particular programmes. Copyright 2002, Oxford University Press.