Discriminant multi-label manifold embedding for facial Action Unit detection

• Published in: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) Vol. 6; pp. 1 - 6
• Main Authors: Yuce, Anil, Hua Gao, Thiran, Jean-Philippe
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2015
• Subjects: Correlation; Face; Feature extraction; Gold; Laplace equations; Training
• DOI: 10.1109/FG.2015.7284871

This article describes a system for participation in the Facial Expression Recognition and Analysis (FERA2015) sub-challenge for spontaneous action unit occurrence detection. The problem of AU detection is a multi-label classification problem by its nature, which is a fact overseen by most existing work. The correlation information between AUs has the potential of increasing the detection accuracy. We investigate the multi-label AU detection problem by embedding the data on low dimensional manifolds which preserve multi-label correlation. For this, we apply the multi-label Discriminant Laplacian Embedding (DLE) method as an extension to our base system. The system uses SIFT features around a set of facial landmarks that is enhanced with the use of additional non-salient points around transient facial features. Both the base system and the DLE extension show better performance than the challenge baseline results for the two databases in the challenge, and achieve close to 50% as F1-measure on the testing partition in average (9.9% higher than the baseline, in the best case). The DLE extension proves useful for certain AUs, but also shows the need for more analysis to assess the benefits in general.