A New Primal–Dual Algorithm for Minimizing the Sum of Three Functions with a Linear Operator

• Published in: Journal of scientific computing Vol. 76; no. 3; pp. 1698 - 1717
• Main Author: Yan, Ming
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.09.2018; Springer Nature B.V
• Subjects: Algorithms; Computational Mathematics and Numerical Analysis; Continuity (mathematics); Convergence; Convex analysis; Fines & penalties; Iterative methods; Linear operators; Mathematical and Computational Engineering; Mathematical and Computational Physics; Mathematics; Mathematics and Statistics; Operators (mathematics); Optimization; Sums; Theoretical; Chambolle–Pock; Nonexpansive operator; Fixed-point iteration; Primal–dual; Three-operator splitting
• ISSN: 0885-7474; 1573-7691
• DOI: 10.1007/s10915-018-0680-3

In this paper, we propose a new primal–dual algorithm for minimizing f ( x ) + g ( x ) + h ( A x ) , where f , g , and h are proper lower semi-continuous convex functions, f is differentiable with a Lipschitz continuous gradient, and A is a bounded linear operator. The proposed algorithm has some famous primal–dual algorithms for minimizing the sum of two functions as special cases. E.g., it reduces to the Chambolle–Pock algorithm when f = 0 and the proximal alternating predictor–corrector when g = 0 . For the general convex case, we prove the convergence of this new algorithm in terms of the distance to a fixed point by showing that the iteration is a nonexpansive operator. In addition, we prove the O (1 /  k ) ergodic convergence rate in the primal–dual gap. With additional assumptions, we derive the linear convergence rate in terms of the distance to the fixed point. Comparing to other primal–dual algorithms for solving the same problem, this algorithm extends the range of acceptable parameters to ensure its convergence and has a smaller per-iteration cost. The numerical experiments show the efficiency of this algorithm.