一种用于非线性支持向量机的新型鲁棒优化模型

A novel robust optimization model for nonlinear Support Vector Machine

European Journal of Operational Research · 2024
被引 15
ABS 4

中文导读

提出一种新的支持向量机优化模型,通过核函数处理非线性分类,并利用鲁棒优化技术应对数据扰动,在真实数据集上表现优于多种现有方法。

Abstract

In this paper, we present new optimization models for Support Vector Machine (SVM), with the aim of separating data points in two or more classes. The classification task is handled by means of nonlinear classifiers induced by kernel functions and consists in two consecutive phases: first, a classical SVM model is solved, followed by a linear search procedure, aimed at minimizing the total number of misclassified data points. To address the problem of data perturbations and protect the model against uncertainty, we construct bounded-by-norm uncertainty sets around each training data and apply robust optimization techniques. We rigorously derive the robust counterpart extension of the deterministic SVM approach, providing computationally tractable reformulations. Closed-form expressions for the bounds of the uncertainty sets in the feature space have been formulated for typically used kernel functions. Finally, extensive numerical results on real-world datasets show the benefits of the proposed robust approach in comparison with various SVM alternatives in the machine learning literature.

机器学习支持向量机鲁棒优化分类算法