Realtime gray-box algorithm configuration using cost-sensitive classification

• Published in: Annals of mathematics and artificial intelligence Vol. 93; no. 1; pp. 109 - 130
• Main Authors: Weiss, Dimitri, Tierney, Kevin
• Format: Journal Article
• Language: English
• Published: Dordrecht Springer Nature B.V 01.02.2025
• Subjects: Algorithms; Artificial intelligence; Automation; Black boxes; Business metrics; Configuration management; Machine learning; Mathematics; Optimization; Parameters; Real time; Solvers; Tournaments & championships
• ISSN: 1012-2443; 1573-7470; 1573-7470
• DOI: 10.1007/s10472-023-09890-x

A solver’s runtime and the quality of the solutions it generates are strongly influenced by its parameter settings. Finding good parameter configurations is a formidable challenge, even for fixed problem instance distributions. However, when the instance distribution can change over time, a once effective configuration may no longer provide adequate performance. Realtime algorithm configuration (RAC) offers assistance in finding high-quality configurations for such distributions by automatically adjusting the configurations it recommends based on instances seen so far. Existing RAC methods treat the solver as a black box, meaning the solver is given a configuration as input, and it outputs either a solution or runtime as an objective function for the configurator. However, analyzing intermediate output from the solver can enable configurators to avoid wasting time on poorly performing configurations. We propose a gray-box approach that utilizes intermediate output during evaluation and implement it within the RAC method Contextual Preselection with Plackett-Luce (CPPL blue). We apply cost-sensitive machine learning with pairwise comparisons to determine whether ongoing evaluations can be terminated to free resources. We compare our approach to a black-box equivalent on several experimental settings and show that our approach reduces the total solving time in several scenarios and improves solution quality in an additional scenario.