Efficient and accurate face detection using heterogeneous feature descriptors and feature selection

• Published in: Computer vision and image understanding Vol. 117; no. 1; pp. 12 - 28
• Main Authors: Pan, Hong, Zhu, Yaping, Xia, Liangzheng
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier Inc 01.01.2013; Elsevier
• Subjects: Adaboost; Algorithmics. Computability. Computer arithmetics; Algorithms; Applied sciences; Artificial intelligence; Cascade classifier; Classifiers; Computer science; control theory; systems; Data processing. List processing. Character string processing; Detectors; Exact sciences and technology; Face detection; Feature selection; Learning; Memory organisation. Data processing; Optimization; Pattern recognition. Digital image processing. Computational geometry; PSO; Searching; Software; Support vector machines; Theoretical computing; Feature selection; Cascade classifier; Face detection; PSO; Adaboost; Automatic classification; Haar function; Binary code; Aggregate model; Efficiency; Facies; Vector support machine; Selection criterion; Swarm intelligence; Robustness; Learning algorithm; Hessian matrices; Computer vision; Data analysis; Face recognition; Hierarchical classification; Particle swarm optimization; Computational geometry; Supervised learning; Binary descriptor; Frontal; Hierarchical system; Artificial intelligence
• ISSN: 1077-3142; 1090-235X
• DOI: 10.1016/j.cviu.2012.09.003

► Represent face patterns with heterogeneous and complementary feature descriptors. ► Propose PSO-Adaboost algorithm for efficient discriminative feature selection. ► Develop fast and robust face detector with a three-stage cascade classifiers. ► Reduce training time up to 20 times using the proposed PSO-Adaboost and cascade structure. ► Achieves the best detection rate (96.50%) at 10 false positives on CMU+MIT dataset. The performance of an efficient and accurate face detection system depends on several issues: (1) distinctive representation for face patterns; (2) effective algorithm for feature selection and classifier learning; (3) suitable framework for rapid background removal. To address the first issue, we propose to represent face patterns with a set of heterogeneous and complementary feature descriptors including the Generalized Haar-like (GH) descriptor, Multi-Block Local Binary Patterns (MB-LBP) descriptor and Speeded-Up Robust Features (SURF) descriptor. To address the second issue, Particle Swarm Optimization (PSO) algorithm is incorporated into the Adaboost framework, replacing the exhaustive search used in original Adaboost for efficient feature selection. The utilization of heterogeneous feature descriptors enriches the diversity of feature types for Adaboost learning algorithm. As a result, classification performance of the boosted ensemble classifier also improves significantly. A three-stage hierarchical classifier structure is proposed to tackle the last issue. In particular, a new stage is added to detect candidate face regions more quickly by using a large size window with a large moving step. Nonlinear support vector machine (SVM) classifiers are used instead of decision stump classifiers in the last stage to remove those remaining complex non-face patterns that cannot be rejected in the previous two stages. Combining the abovementioned effective modules, we derive the proposed Hetero-PSO-Adaboost-SVM face detector that achieves superior detection accuracy while maintaining a low training and detection complexity. Extensive experiments demonstrate the robustness and efficiency of our system by comparing it with several popular state-of-the-art algorithms on our own test set as well as the widely used CMU+MIT frontal and CMU profile face dataset.