🌙

Gromov–Wasserstein距离:熵正则化、对偶性与样本复杂度

Gromov–Wasserstein distances: Entropic regularization, duality and sample complexity

Annals of Statistics · 2024
被引 8
ABS 4*

中文导读

研究了不同维度欧氏空间上二次Gromov–Wasserstein距离的对偶形式,并推导出标准GW和熵正则化GW的经验收敛速率,为异质数据集对齐提供了统计理论基础。

Abstract

The Gromov–Wasserstein (GW) distance, rooted in optimal transport (OT) theory, quantifies dissimilarity between metric measure spaces and provides a framework for aligning heterogeneous datasets. While computational aspects of the GW problem have been widely studied, a duality theory and fundamental statistical questions concerning empirical convergence rates remained obscure. This work closes these gaps for the quadratic GW distance over Euclidean spaces of different dimensions dx and dy. We treat both the standard and the entropically regularized GW distance, and derive dual forms that represent them in terms of the well-understood OT and entropic OT (EOT) problems, respectively. This enables employing proof techniques from statistical OT based on regularity analysis of dual potentials and empirical process theory, using which we establish the first GW empirical convergence rates. The derived two-sample rates are n−2/max{min{dx,dy},4} (up to a log factor when min{dx,dy}=4) for standard GW and n−1/2 for entropic GW (EGW), which matches the corresponding rates for standard and entropic OT. The parametric rate for EGW is evidently optimal, while for standard GW we provide matching lower bounds, which establish sharpness of the derived rates. We also study stability of EGW in the entropic regularization parameter and prove approximation and continuity results for the cost and optimal couplings. Lastly, the duality is leveraged to shed new light on the open problem of the one-dimensional GW distance between uniform distributions on n points, illuminating why the identity and anti-identity permutations may not be optimal. Our results serve as a first step towards a comprehensive statistical theory as well as computational advancements for GW distances, based on the discovered dual formulations.

最优传输度量空间对齐统计学习理论熵正则化