The effect of methodological variations on university rankings and associated decision-making and policy
研究了排名方法的选择如何影响全球高等教育机构排名，以及这些排名对决策和政策的影响，发现不同排名系统对非顶尖院校的排名一致性很低。
This paper explores the effect of methodological choice on global Higher Education Institutions’ (HEI) rankings, and the effect of choices regarding League Table and Ranking Systems (LTRSs) upon decision-making and policy. LTRSs are identified as heuristics to aid decision-making about HEIs. The paper examines the methodological choices commonly made within ‘rankology’. It describes the methodologies used in six popular LTRSs and the manner in which the ranking formulae were constructed. An analysis of the ranking of global HEIs by the six LTRSs for 2015 revealed that whilst there was a degree of agreement across these LTRSs regarding the ranking of two ‘elite’ institutions, the level of agreement across the LTRSs rapidly broke down as one progressed to consider institutions further down the ranking order. The study shows that the use of LTRSs to aid decisions is highly sensitive to one’s choice of LTRS.