Expert Decisions
研究发现,国家科研评估中90%的专家决策可从公开信息(如简历)推断,约一半受客观质量驱动,另一半受认知偏差影响。
ABSTRACT National Research Assessments are used by countries to improve their research quality. They rely on experts to evaluate research, and use their assessments to reward publications. It is widely assumed that experts bring to the process the kind of judgment and knowledge that transcends their observable characteristics. We show that, for the most part, they do not. Using a unique uncensored dataset of expert deliberations, we find that 90% of expert decisions can be inferred from publicly available information, notably experts’ CVs. We also find that about half of their decisions are driven by objective quality standards and the other half by cognitive biases.