基于Wasserstein距离的超高维混合数据特征筛选

Feature Screening for Ultrahigh Dimensional Mixed Data via Wasserstein Distance

International Statistical Review · 2025
被引 1
ABS 3

中文导读

提出一种基于Wasserstein距离的特征筛选方法Wasserstein-SIS,用于处理连续和离散混合的超高维数据,无需模型假设,理论证明其筛选性质,数值实验和实际数据验证其优于现有方法。

Abstract

Summary This article develops a novel feature screening procedure for ultrahigh dimensional mixed data based on Wasserstein distance, termed as Wasserstein‐SIS. To handle the mixture of continuous and discrete data, we use Wasserstein distance as a new marginal utility to measure the difference between the joint distribution and the product of marginal distributions. In theory, we establish the sure screening property under less restrictive assumptions on data types. The proposed procedure does not require model specification, gives a more effective geometric measure to compare the discrepancy between distributions and avoids introducing biases caused by the choice of slicing rules for continuous data. Numerical comparison indicates that the proposed Wasserstein‐SIS method performs better than existing methods in various models. A real data application also validates the better practicability of Wasserstein‐SIS.

高维统计特征筛选混合数据Wasserstein距离