Novel Aggregate Deletion/Substitution/Addition Learning Algorithms for Recursive Partitioning
本文提出了bagged partDSA和boosted partDSA两种集成算法，通过聚合多个partDSA模型提高预测精度，并提供了四种变量排序方法，适用于复杂疾病中遗传与环境因素的交互作用分析。
Many complex diseases are caused by a variety of both genetic and environmental factors acting in conjunction. To help understand these relationships, nonparametric methods that use aggregate learning have been developed such as random forests and conditional forests. Molinaro et al. (2010 Molinaro, A. M., Lostritto, K., and van der Laan, M. (2010), “Partdsa: Deletion/Substitution/Addition Algorithm for Partitioning the Covariate Space in Prediction,” Bioinformatics, 26:1357–1363.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) described a powerful, single model approach called partDSA that has the advantage of producing interpretable models. We propose two extensions to the partDSA algorithm called bagged partDSA and boosted partDSA. These algorithms achieve higher prediction accuracies than individual partDSA objects through aggregating over a set of partDSA objects. Further, by using partDSA objects in the ensemble, each base learner creates decision rules using both “and” and “or” statements, which allows for natural logical constructs. We also provide four variable ranking techniques that aid in identifying the most important individual factors in the models. In the regression context, we compared bagged partDSA and boosted partDSA to random forests and conditional forests. Using simulated and real data, we found that bagged partDSA had lower prediction error than the other methods if the data were generated by a simple logic model, and that it performed similarly for other generating mechanisms. We also found that boosted partDSA was effective for a particularly complex case. Taken together these results suggest that the new methods are useful additions to the ensemble learning toolbox. We implement these algorithms as part of the partDSA R package. Supplementary materials for this article are available online.