Decision Threshold Setting in Binary Classification Problems—A Behavioral Lens
实验发现，决策者在设定二分类模型阈值时系统性地偏离最优成本效率点，且偏差在成本与类别不平衡时加剧，平均导致误分类成本增加53%。
ABSTRACT When binary classification models are wrong, managers face misclassification costs. Although false positive outcomes imply unnecessary mitigation efforts, false negative outcomes imply overlooking the class of interest. Humans calibrate these ai models supporting operational systems by adjusting the decision threshold that translates prediction probability into either class. Results of our controlled laboratory experiment show that, despite all relevant information being available, decision makers systematically deviate from the optimal cost‐efficient threshold. We observe a significant interaction effect of class and cost imbalance on this deviation, which increases in high‐stakes settings where more extreme thresholds are optimal. When unit costs are different, we find that participants anchor on the threshold where expected misclassification costs for false alarms and missed hits are equal, whereas mean anchoring cannot explain the pull‐to‐center behavior sufficiently. Surprisingly, we confirm that this impulse balance equilibrium also serves as attractive anchor in our setting, where decisions are made ex ante without loss aversion. To debias decision makers, simulated responses with behavior‐aware costs show that subjects are nudged to make choices closer to the optimum. Managers should be aware of this boundedly rational behavior and complementary debiasing techniques, as sub‐optimal threshold setting results in 53% higher misclassification costs, on average.