An empirical analysis of binary transformation strategies and base algorithms for multi-label learning

• Published in: Machine learning Vol. 109; no. 8; pp. 1509 - 1563
• Main Authors: Rivolli, Adriano, Read, Jesse, Soares, Carlos, Pfahringer, Bernhard, de Carvalho, André C. P. L. F.
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.08.2020; Springer Nature B.V; Springer Verlag
• Subjects: Algorithms; Artificial Intelligence; Binary data; Computer Science; Control; Datasets; Empirical analysis; Machine Learning; Mechatronics; Natural Language Processing (NLP); Performance prediction; Robotics; Simulation and Modeling; Transformations; Multi-label learning; Base algorithms; Binary transformation; Comparison of strategies; Empirical analysis
• ISSN: 0885-6125; 1573-0565; 1573-0565
• DOI: 10.1007/s10994-020-05879-3

Investigating strategies that are able to efficiently deal with multi-label classification tasks is a current research topic in machine learning. Many methods have been proposed, making the selection of the most suitable strategy a challenging issue. From this premise, this paper presents an extensive empirical analysis of the binary transformation strategies and base algorithms for multi-label learning. This subset of strategies uses the one-versus-all approach to transform the original data, generating one binary data set per label, upon which any binary base algorithm can be applied. Considering that the influence of the base algorithm on the predictive performance obtained by the strategies has not been considered in depth by many empirical studies, we investigated the influence of distinct base algorithms on the performance of several strategies. Thus, this study covers a family of multi-label strategies using a diversified range of base algorithms, exploring their relationship over different perspectives. This finding has significant implications concerning the methodology of evaluation adopted in multi-label experiments containing binary transformation strategies, given that multiple base algorithms should be considered. Despite these improvements in strategy and base algorithms, for many data sets, a large number of labels, mainly those less frequent, were either never predicted, or always misclassified. We conclude the experimental analysis by recommending strategies and base algorithms in accordance with different performance criteria.