Image aesthetic quality evaluation using convolution neural network embedded learning

• Published in: Optoelectronics letters Vol. 13; no. 6; pp. 471 - 475
• Main Author: 李雨鑫;普园媛;徐丹;钱文华;王立鹏
• Format: Journal Article
• Language: English
• Published: Tianjin Tianjin University of Technology 01.11.2017; Springer Nature B.V
• Subjects: Classification; Convolution; Image classification; Image quality; Lasers; Neural networks; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; Quality; Quality assessment; Tuning; A
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-017-7203-6

A way of embedded learning convolution neural network（ELCNN） based on the image content is proposed to evaluate the image aesthetic quality in this paper. Our approach can not only solve the problem of small-scale data but also score the image aesthetic quality. First, we chose Alexnet and VGG_S to compare for confirming which is more suitable for this image aesthetic quality evaluation task. Second, to further boost the image aesthetic quality classification performance, we employ the image content to train aesthetic quality classification models. But the training samples become smaller and only using once fine-tuning cannot make full use of the small-scale data set. Third, to solve the problem in second step, a way of using twice fine-tuning continually based on the aesthetic quality label and content label respective is proposed, the classification probability of the trained CNN models is used to evaluate the image aesthetic quality. The experiments are carried on the small-scale data set of Photo Quality. The experiment results show that the classification accuracy rates of our approach are higher than the existing image aesthetic quality evaluation approaches.