Convergence properties of inexact projected gradient methods

• Published in: Optimization Vol. 55; no. 3; pp. 301 - 310
• Main Authors: Wang, Changyu, Liu, Qian
• Format: Journal Article
• Language: English
• Published: Philadelphia Taylor & Francis Group 01.06.2006; Taylor & Francis LLC
• Subjects: Convergence; Mathematical problems; Mathematical programming; Mathematics Subject Classifications 2000: 90C30; Nonmonotone linear search; Optimization; Projected gradient; Studies
• ISSN: 0233-1934; 1029-4945
• DOI: 10.1080/02331930600711448

In this article, we give a more comprehensive theoretical analysis of the inexact spectral projected gradient (ISPG) method introduced by Birgin et al. (Birgin, E.G., Martínez, J.M. and Raydan, M., 2003, Inexact spectral projected gradient methods on convex set. IMA Journal of Numerical Analysis, 23, 539-559) for the minimization of differentiable functions on closed convex sets. In doing so, we remove the boundedness of level sets of the objective function. Under weaker conditions, we establish the convergence theory. Moreover, we present a new inexact hybrid projection method based on the ISPG method. This new method has an encouraging convergence property which is that the whole sequence of iterates converges to a solution of the problem under no assumptions other than pseudoconvexity and continuous differentiability of f(·).