Longitudinal Impact of Preference Biases on Recommender Systems’ Performance
通过模拟方法研究用户偏好偏差如何随时间影响推荐系统性能,发现偏差会显著降低推荐效果和用户消费结果,且对冷门和内容不独特的物品影响更大,同时提出利用额外信息的新去偏方法。
Recommender systems are ubiquitous on various online platforms and provide significant value to the users in helping them find relevant content/items to consume. After item consumption, users can often provide feedback (i.e., their preference ratings for the item) to the system. Research studies have shown that recommender systems’ predictions, observed by users, can cause biases in users’ postconsumption preference ratings. Because these ratings are typically fed back to the system as training data for future predictions, this process is likely to influence the system’s performance over time. We use a simulation approach to investigate the longitudinal impact of preference biases on the dynamics of recommender systems’ performance. Our results reveal that preference biases significantly impair recommendation performance and users’ consumption outcomes, and larger biases cause disproportionately large negative effects. Additionally, less popular and less distinctive (in terms of their content) items are more susceptible to preference biases. Furthermore, considering the substantial impact of preference biases on recommendation performance, we examine the issue of debiasing user-submitted ratings. We find that relying solely on historical rating data is unlikely to be effective in debiasing; thus, we propose/evaluate new debiasing approaches that use additional relevant information that can be collected by recommendation platforms.