Blind Video Quality Assessment Using Fusion of Novel Structural Features and Deep Features

• Published in: Computer Vision and Image Processing Vol. 1568; pp. 219 - 229
• Main Authors: Vishwakarma, Anish Kumar, Bhurchandi, Kishor M.
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2022; Springer International Publishing
• Series: Communications in Computer and Information Science
• Subjects: Convolutional Neural Network; Structural features; Support vector regression
• ISBN: 9783031113482; 3031113489
• ISSN: 1865-0929; 1865-0937
• DOI: 10.1007/978-3-031-11349-9_19

We propose a robust and efficient blind video quality assessment model using fusion of novel structural features and deep semantic features. As the human visual system (HVS) is very sensitive to the structural contents in a visual scene, we come up with a novel structural feature extractor that uses a two-level encoding scheme. In addition, we employ a pre-trained Convolutional Neural Network (CNN) model Inception-v3 that extracts semantic features from the sampled video frames. Further, structural and deep semantic features are concatenated and applied to a support vector regression (SVR) that predicts the final visual quality scores of the videos. The performance of the proposed method is validated on three popular and widely used authentic distortions datasets, LIVE-VQC, KoNViD-1k, and LIVE Qualcomm. Results show excellent performance of the proposed model compared with other state-of-the-art methods with significantly reduced computational burden.