An Efficient Adaptive Multi-Kernel Learning With Safe Screening Rule for Outlier Detection

• Published in: IEEE transactions on knowledge and data engineering Vol. 36; no. 8; pp. 3656 - 3669
• Main Authors: Wang, Xinye, Duan, Lei, He, Chengxin, Chen, Yuanyuan, Wu, Xindong
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.08.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Anomaly detection; Computational efficiency; Data analysis; Data models; Feature extraction; Kernel; Learning; Linear programming; Multi-kernel learning; outlier detection; Outliers (statistics); safe screening rule (SSR); Screening; support vector data description (SVDD); Training
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2023.3330708

Recent advances in multi-kernel-based methods for outlier detection have positioned them as an attractive way to detect instances that are markedly different from the remaining data in a dataset. Currently, most outlier detection approaches based on multi-kernel learning are simply a convex combination of various kernels with handcrafted weights, meaning that these weights may not be suitable. Meanwhile, this combination of weights does not sufficiently consider the intrinsic correlations of instances when fusing different kernels. Thus, a key challenge is how to adaptively learn an appropriate combination of weights for capturing a new feature space in which outliers can be better detected than the original space. Simultaneously, it is still a burning issue to get the optimal combination of weights due to considerable computational cost and memory usage when the feature or instance size is large. In this paper, we propose a novel method for e fficient a daptive m ulti-kernel for o utlier d etection (EAMOD), which automatically learns the optimal weight for each training instance under different kernels using a non-negative function. In addition, we design a safe screening rule (SSR) for EAMOD to improve its training efficiency without any loss of accuracy. To the best of our knowledge, it is the first attempt to develop SSR for multi-kernel-based outlier detection methods. Extensive experiments show that EAMOD is effective and efficient.