Online-Learning-Based Bayesian Decision Rule for Fast Intra Mode and CU Partitioning Algorithm in HEVC Screen Content Coding

• Published in: IEEE transactions on image processing Vol. 29; pp. 170 - 185
• Main Authors: Kuang, Wei, Chan, Yui-Lam, Tsang, Sik-Ho, Siu, Wan-Chi
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Algorithms; Bayes methods; Bayesian analysis; Bayesian decision rule; Change detection; Coding; Computational complexity; Copper; Decision analysis; Encoding; fast CU size decision; fast mode decision; Feature extraction; High Efficiency Video Coding (HEVC); Image coding; Machine learning; Model accuracy; Partitioning algorithms; scene change detection; Screen content coding (SCC); Video compression
• ISSN: 1057-7149; 1941-0042; 1941-0042
• DOI: 10.1109/TIP.2019.2924810

Screen content coding (SCC) is an extension of high efficiency video coding by adopting new coding modes to improve the coding efficiency of SCC at the expense of increased complexity. This paper proposes an online-learning approach for fast mode decision and coding unit (CU) size decision in SCC. To make a fast mode decision, the corner point is first extracted as a unique feature in screen content, which is an essential pre-processing step to guide Bayesian decision modeling. Second, the distinct color number in a CU is derived as another unique feature in screen content to build the precise model using online-learning for skipping unnecessary modes. Third, the correlation of the modes among spatial neighboring CUs is analyzed to further eliminate unnecessary mode candidates. Finally, the Bayesian decision rule using online-learning is applied again to make a fast CU size decision. To ensure the accuracy of the Bayesian decision models, new scene change detection is designed to update the models. Results show that the proposed algorithm achieves 36.69% encoding time reduction with 1.08% Bjøntegaard delta bitrate (BDBR) increment under all intra configuration. By integrating into the existing fast SCC approach, the proposed algorithm reduces 48.83% encoding time with a 1.78% increase in BDBR.