“校准击败”:在预测者自己的游戏中击败他们

“Calibeating”: Beating forecasters at their own game

Theoretical Economics · 2023
被引 3
人大 AABS 4

中文导读

提出一种方法,可以在不损失预测专业性的前提下改善校准分数,称为“校准击败”,并提供了确定性在线程序和随机程序来实现。

Abstract

To identify expertise, forecasters should not be tested by their calibration score, which can always be made arbitrarily small, but rather by their Brier score. The Brier score is the sum of the calibration score and the refinement score; the latter measures how good the sorting into bins with the same forecast is, and thus attests to “expertise.” This raises the question of whether one can gain calibration without losing expertise, which we refer to as “calibeating.” We provide an easy way to calibeat any forecast, by a deterministic online procedure. We moreover show that calibeating can be achieved by a stochastic procedure that is itself calibrated, and then extend the results to simultaneously calibeating multiple procedures, and to deterministic procedures that are continuously calibrated.

CalibeatingBrier score校准分数精炼分数