Task Variance Regularized Multi-Task Learning

• Published in: IEEE transactions on knowledge and data engineering Vol. 35; no. 8; pp. 1 - 14
• Main Authors: Mao, Yuren, Wang, Zekai, Liu, Weiwei, Lin, Xuemin, Hu, Wenbin
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.08.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Adversarial multi-armed bandit; Algorithms; Computational modeling; Computer vision; Error analysis; Learning; Multi-armed bandit problems; multi-task learning; Multitasking; Natural language processing; Optimization; Regularization; Task analysis; task variance regularization; Toy manufacturing industry; Training
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2022.3207049

Multi-task Learning (MTL), which involves the simultaneous learning of multiple tasks, can achieve better performance than learning each task independently. It has achieved great success in various applications, ranging from Computer Vision (CV) to Natural Language Processing (NLP). In MTL, the losses of the including tasks are jointly optimized. However, it is common for these tasks to be competing. When the tasks are competing, minimizing the losses of some tasks increases the losses of others, which accordingly increases the task variance (variance between the task-specific loss); furthermore, it induces under-fitting in some tasks and over-fitting in others, which degenerates the generalization performance of an MTL model. To address this issue, it is necessary to control the task variance; thus, task variance regularization is a natural choice. While intuitive, task variance regularization remains unexplored in MTL. Accordingly, to fill this gap, we study the generalization error bound of MTL through the lens of task variance and propose the task variance matters the generalization performance of MTL. Furthermore, this paper investigates how the task variance might be effectively regularized, and consequently proposes a multi-task learning method based on adversarial multi-armed bandit. The proposed method, dubbed BanditMTL, regularizes the task variance by means of a mirror gradient ascent-descent algorithm. Adopting BanditMTL both in CV and NLP applications is found to achieve state-of-the-art performance. The results of extensive experiments back up our theoretical analysis and validate the superiority of our proposals.