On the Douglas–Rachford Algorithm for Solving Possibly Inconsistent Optimization Problems

• Published in: Mathematics of operations research Vol. 49; no. 1; pp. 58 - 77
• Main Authors: Bauschke, Heinz H., Moursi, Walaa M.
• Format: Journal Article
• Language: English
• Published: Linthicum INFORMS 01.02.2024; Institute for Operations Research and the Management Sciences
• Subjects: 90C25; Algorithms; Convergence; Convex analysis; convex functions; convex optimization problem; Douglas–Rachford algorithm; inconsistent optimization problem; Mathematical problems; minimal displacement vector; normal problem; Optimization; Primary: 65K10; proximal mapping; resolvent; Secondary: 47H05; Splitting
• ISSN: 0364-765X; 1526-5471
• DOI: 10.1287/moor.2022.1347

More than 40 years ago, Lions and Mercier introduced in a seminal paper the Douglas–Rachford algorithm. Today, this method is well-recognized as a classic and highly successful splitting method to find minimizers of the sum of two (not necessarily smooth) convex functions. Whereas the underlying theory has matured, one case remains a mystery: the behavior of the shadow sequence when the given functions have disjoint domains. Building on previous work, we establish for the first time weak and value convergence of the shadow sequence generated by the Douglas–Rachford algorithm in a setting of unprecedented generality. The weak limit point is shown to solve the associated normal problem, which is a minimal perturbation of the original optimization problem. We also present new results on the geometry of the minimal displacement vector. Funding: The research of H. H. Bauschke and W. M. Moursi was partially supported by Discovery Grants of the Natural Sciences and Engineering Research Council of Canada [Grants RGPIN-2018-03703 and RGPIN-2019-04803], respectively.