Fast ISP coding mode optimization algorithm based on CU texture complexity for VVC

• Published in: EURASIP journal on image and video processing Vol. 2021; no. 1; pp. 1 - 14
• Main Authors: Liu, Zhi, Dong, Mengjun, Guan, Xiao Han, Zhang, Mengmeng, Wang, Ruoyu
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 02.07.2021; Springer Nature B.V; SpringerOpen
• Subjects: Algorithms; Biometrics; Coding; Coding standards; Coding unit (CU); Complexity; Cost analysis; Engineering; Frames (data processing); H.266; Image Processing and Computer Vision; Intra prediction; ISP; Optimization; Optimization algorithms; Pattern Recognition; Signal,Image and Speech Processing; Texture; Texture complexity; VVC; H.266; VVC; Texture complexity; Coding unit (CU); Intra prediction; ISP
• ISSN: 1687-5281; 1687-5176; 1687-5281
• DOI: 10.1186/s13640-021-00564-4

In lately published video coding standard Versatile Video Coding (VVC/ H.266), the intra sub-partitions (ISP) coding mode is proposed. It is efficient for frames with rich texture, but less efficient for frames that are very flat or constant. In this paper, by comparing and analyzing the rate distortion cost (RD-cost) of coding unit (CU) with different texture features for using and not using ISP(No-ISP) coding mode, it is observed that CUs with simple texture can skip ISP coding mode. Based on this observation, a fast ISP coding mode optimization algorithm based on CU texture complexity is proposed, which aims to determine whether a CU needs to use ISP coding mode in advance by calculating CU texture complexity, so as to reduce the computation complexity of ISP. The experimental results show that under All Intra (AI) configuration, the coding time can be reduced by 7%, while the BD rate only increase by 0.09%.