Generative Learning from Semantically Confused Label Distribution via Auto-Encoding Variational Bayes

• Published in: Electronics (Basel) Vol. 14; no. 13; p. 2736
• Main Authors: Li, Xinhai, Meng, Chenxu, Zhou, Heng, Guo, Yi, Xue, Bowen, Yu, Tianzuo, Lu, Yunan
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 07.07.2025
• Subjects: Algorithms; Comparative analysis; Data mining; Design; Entropy; Labels; Learning; Low density lipoproteins; Machine learning; Semantics; Variational methods
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics14132736

Label Distribution Learning (LDL) has emerged as a powerful paradigm for addressing label ambiguity, offering a more nuanced quantification of the instance–label relationship compared to traditional single-label and multi-label learning approaches. This paper focuses on the challenge of noisy label distributions, which is ubiquitous in real-world applications due to the annotator subjectivity, algorithmic biases, and experimental errors. Existing related LDL algorithms often assume a linear combination of true and random label distributions when modeling the noisy label distributions, an oversimplification that fails to capture the practical generation processes of noisy label distributions. Therefore, this paper introduces an assumption that the noise in label distributions primarily arises from the semantic confusion between labels and proposes a novel generative label distribution learning algorithm to model the confusion-based generation process of both the feature data and the noisy label distribution data. The proposed model is inferred using variational methods and its effectiveness is demonstrated through extensive experiments across various real-world datasets, showcasing its superiority in handling noisy label distributions.