On the steady state analysis of covariance matrix self-adaptation evolution strategies on the noisy ellipsoid model

This paper addresses the analysis of covariance matrix self-adaptive Evolution Strategies (CMSA-ES) on a subclass of quadratic functions subject to additive Gaussian noise: the noisy ellipsoid model. To this end, it is demonstrated that the dynamical systems approach from the context of isotropic mu...

Full description

Saved in:
Bibliographic Details
Published inTheoretical computer science Vol. 832; pp. 98 - 122
Main Authors Hellwig, Michael, Beyer, Hans-Georg
Format Journal Article
LanguageEnglish
Published Elsevier B.V 06.09.2020
Subjects
Online AccessGet full text
ISSN0304-3975
1879-2294
DOI10.1016/j.tcs.2018.05.016

Cover

More Information
Summary:This paper addresses the analysis of covariance matrix self-adaptive Evolution Strategies (CMSA-ES) on a subclass of quadratic functions subject to additive Gaussian noise: the noisy ellipsoid model. To this end, it is demonstrated that the dynamical systems approach from the context of isotropic mutations can be transferred to ES that also control the covariance matrix. Theoretical findings such as the component-wise quadratic progress rate or the self-adaptation response function can thus be reused for the CMSA-ES analysis. By deriving the steady state quantities approached on the noisy ellipsoid model for constant population size, a detailed description of the asymptotic CMSA-ES behavior is obtained. By providing self-adaptive ES with a population control mechanism, despite noise disturbances, the algorithm is able to realize continuing progress towards the optimum. Regarding the population control CMSA-ES (pcCMSA-ES), the analytical findings allow to specify its asymptotic long-term behavior and to identify influencing parameters. The finally obtained convergence rate matches the theoretical lower bound of all comparison-based direct search algorithms.
ISSN:0304-3975
1879-2294
DOI:10.1016/j.tcs.2018.05.016