3D Assisted Face Recognition: Dealing With Expression Variations

• Published in: IEEE transactions on information forensics and security Vol. 9; no. 5; pp. 826 - 838
• Main Authors: Erdogmus, Nesli, Dugelay, Jean-Luc
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.05.2014; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Applied sciences; Artificial intelligence; Biometrics; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Data processing. List processing. Character string processing; Discriminant analysis; Exact sciences and technology; Face; Face recognition; Lighting; Memory organisation. Data processing; Nose; Pattern recognition; Pattern recognition. Digital image processing. Computational geometry; Shape; Software; Solid modeling; Three dimensional; Three dimensional models; Three-dimensional displays; Face recognition; 3D facial animation; facial expressions; Computer vision; Discriminant analysis; Expressed emotion; Image processing; Image databank; Computer animation; Modeling; Texture; Authentication; Classification; Facies; Tridimensional image; Facial expression; Principal component analysis
• ISSN: 1556-6013; 1556-6021
• DOI: 10.1109/TIFS.2014.2309851

One of the most critical sources of variation in face recognition is facial expressions, especially in the frequent case where only a single sample per person is available for enrollment. Methods that improve the accuracy in the presence of such variations are still required for a reliable authentication system. In this paper, we address this problem with an analysis-by-synthesis-based scheme, in which a number of synthetic face images with different expressions are produced. For this purpose, an animatable 3D model is generated for each user based on 17 automatically located landmark points. The contribution of these additional images in terms of the recognition performance is evaluated with three different techniques (principal component analysis, linear discriminant analysis, and local binary patterns) on face recognition grand challenge and Bosphorus 3D face databases. Significant improvements are achieved in face recognition accuracies, for each database and algorithm.