用替代计量指标衡量研究的社会影响?常见问题与错误

MEASURING SOCIETAL IMPACTS OF RESEARCH WITH ALTMETRICS? COMMON PROBLEMS AND MISTAKES

Journal of Economic Surveys · 2020
被引 66
人大 AABS 2

中文导读

综述了替代计量指标在衡量研究社会影响时的常见问题与错误,包括指标选择、聚合方式、正式评估中的使用限制等,为研究者正确使用这些指标提供指导。

Abstract

Abstract The impact agenda in many countries has led to increased attempts to assess the societal impacts of research. Altmetrics, webometrics, and other alternative indicators have been proposed to support this task, and many journal articles have been written that exploit alternative indicators to investigate societal impacts. Nevertheless, methodological studies of many of these indicators have revealed that extreme care must be taken with gathering, aggregating, and interpreting them. This article gives an overview of current alternative indicators, summarizes empirical research, and reports a series of common problems and mistakes to avoid when using them. The main issues are: selecting indicators to match goals; aggregating them in a way sensitive to field and publication year differences; largely avoiding them in formal evaluations; understanding that they reflect a biased fraction of the activity of interest; and understanding the type of impact reflected rather than interpreting them at face value.

替代计量指标社会影响力评估指标选择偏差数据聚合方法