Counterfactual Q-learning via the linear Buckley–James method for longitudinal survival data
提出反事实Buckley-James Q学习框架，结合反事实推理与强化学习处理纵向生存数据中的删失问题，通过模拟和临床试验数据验证其能识别最优动态治疗方案以最大化预期生存时间。
Abstract Treatment strategies are critical in healthcare, particularly when outcomes are subject to censoring. This study introduces the Counterfactual Buckley–James Q-Learning framework, which integrates counterfactual reasoning with the Buckley–James method and reinforcement learning to address challenges arising from longitudinal survival data. The Buckley–James method imputes censored survival times via conditional expectations based on observed data, offering a robust mechanism for handling incomplete outcomes. By incorporating these imputed values into a counterfactual Q-learning framework, the proposed method enables the estimation and comparison of potential outcomes under different treatment strategies. This facilitates the identification of optimal dynamic treatment regimes that maximize expected survival time. Through extensive simulation studies, the method demonstrates robust performance across various sample sizes and censoring scenarios, including right censoring and missing at random. Application to real-world clinical trial data further highlights the utility of this approach in informing personalized treatment decisions, providing an interpretable and reliable tool for optimizing survival outcomes in complex clinical settings.