🌙

松弛Peaceman-Rachford分裂方法在单调包含问题上的收敛速度

Convergence Rates for the Relaxed Peaceman-Rachford Splitting Method on a Monotone Inclusion Problem

Journal of Optimization Theory and Applications · 2022
被引 1
ABS 3

中文导读

研究了松弛Peaceman-Rachford分裂方法求解单调包含问题的收敛行为,证明了在特定松弛参数区间内迭代的收敛性,并给出了点态和R-线性收敛速度结果,通过加权Lasso最小化问题验证了假设的有效性。

Abstract

Abstract We consider the convergence behavior using the relaxed Peaceman–Rachford splitting method to solve the monotone inclusion problem $$0 \in (A + B)(u)$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mn>0</mml:mn> <mml:mo>∈</mml:mo> <mml:mo>(</mml:mo> <mml:mi>A</mml:mi> <mml:mo>+</mml:mo> <mml:mi>B</mml:mi> <mml:mo>)</mml:mo> <mml:mo>(</mml:mo> <mml:mi>u</mml:mi> <mml:mo>)</mml:mo> </mml:mrow> </mml:math> , where $$A, B: \Re ^n \rightrightarrows \Re ^n$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>A</mml:mi> <mml:mo>,</mml:mo> <mml:mi>B</mml:mi> <mml:mo>:</mml:mo> <mml:msup> <mml:mi>ℜ</mml:mi> <mml:mi>n</mml:mi> </mml:msup> <mml:mo>⇉</mml:mo> <mml:msup> <mml:mi>ℜ</mml:mi> <mml:mi>n</mml:mi> </mml:msup> </mml:mrow> </mml:math> are maximal $$\beta $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mi>β</mml:mi> </mml:math> -strongly monotone operators, $$n \ge 1$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>n</mml:mi> <mml:mo>≥</mml:mo> <mml:mn>1</mml:mn> </mml:mrow> </mml:math> and $$\beta &gt; 0$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>β</mml:mi> <mml:mo>&gt;</mml:mo> <mml:mn>0</mml:mn> </mml:mrow> </mml:math> . Under a technical assumption, convergence of iterates using the method on the problem is proved when either A or B is single-valued, and the fixed relaxation parameter $$\theta $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mi>θ</mml:mi> </mml:math> lies in the interval $$(2 + \beta , 2 + \beta + \min \{ \beta , 1/\beta \})$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mo>(</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>+</mml:mo> <mml:mo>min</mml:mo> <mml:mo>{</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>1</mml:mn> <mml:mo>/</mml:mo> <mml:mi>β</mml:mi> <mml:mo>}</mml:mo> <mml:mo>)</mml:mo> </mml:mrow> </mml:math> . With this convergence result, we address an open problem that is not settled in Monteiro et al. (Computat Optim Appl 70:763–790, 2018) on the convergence of these iterates for $$\theta \in (2 + \beta , 2 + \beta + \min \{ \beta , 1/\beta \})$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>θ</mml:mi> <mml:mo>∈</mml:mo> <mml:mo>(</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>+</mml:mo> <mml:mo>min</mml:mo> <mml:mo>{</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>1</mml:mn> <mml:mo>/</mml:mo> <mml:mi>β</mml:mi> <mml:mo>}</mml:mo> <mml:mo>)</mml:mo> </mml:mrow> </mml:math> . Pointwise convergence rate results and R -linear convergence rate results when $$\theta $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mi>θ</mml:mi> </mml:math> lies in the interval $$[2 + \beta , 2 + \beta + \min \{\beta , 1/\beta \})$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mo>[</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>2</mml:mn> <mml:mo>+</mml:mo> <mml:mi>β</mml:mi> <mml:mo>+</mml:mo> <mml:mo>min</mml:mo> <mml:mo>{</mml:mo> <mml:mi>β</mml:mi> <mml:mo>,</mml:mo> <mml:mn>1</mml:mn> <mml:mo>/</mml:mo> <mml:mi>β</mml:mi> <mml:mo>}</mml:mo> <mml:mo>)</mml:mo> </mml:mrow> </mml:math> are also provided in the paper. Our analysis to achieve these results is atypical and hence novel. Numerical experiments on the weighted Lasso minimization problem are conducted to test the validity of the assumption.

算法计算机科学优化数值分析