Analysis of Target Data-Dependent Greedy Kernel Algorithms: Convergence Rates for f-, f·P- and f/P-Greedy

• Published in: Constructive approximation Vol. 57; no. 1; pp. 45 - 74
• Main Authors: Wenzel, Tizian, Santin, Gabriele, Haasdonk, Bernard
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.02.2023; Springer Nature B.V
• Subjects: Algorithms; Analysis; Approximation; Codes; Convergence; Fourier transforms; Greedy algorithms; Hilbert space; Interpolation; Mathematics; Mathematics and Statistics; Numerical Analysis; Greedy algorithms; Kernel methods; 46E22; Convergence rates; Primary 65D15; 65D05; Target data-dependent algorithms; Secondary 41A58
• ISSN: 0176-4276; 1432-0940
• DOI: 10.1007/s00365-022-09592-3

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been presented. This situation is unsatisfactory, especially when compared to the case of the data-independent P -greedy algorithm, for which optimal convergence rates are available, despite its performances being usually inferior to the ones of target data-dependent algorithms. In this work, we fill this gap by first defining a new scale of greedy algorithms for interpolation that comprises all the existing ones in a unique analysis, where the degree of dependency of the selection criterion on the functional data is quantified by a real parameter. We then prove new convergence rates where this degree is taken into account, and we show that, possibly up to a logarithmic factor, target data-dependent selection strategies provide faster convergence. In particular, for the first time we obtain convergence rates for target data adaptive interpolation that are faster than the ones given by uniform points, without the need of any special assumption on the target function. These results are made possible by refining an earlier analysis of greedy algorithms in general Hilbert spaces. The rates are confirmed by a number of numerical examples.