Face locating and tracking for human-computer interaction

• Published in: Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers Vol. 2; pp. 1277 - 1281 vol.2
• Main Authors: Hunke, M., Waibel, A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE Comput. Soc. Press 1994
• Subjects: Artificial neural networks; Cameras; Computer science; Face detection; Humans; Lenses; Object detection; Robustness; Shape; Speech synthesis
• ISBN: 0818664053; 9780818664052
• ISSN: 1058-6393
• DOI: 10.1109/ACSSC.1994.471664

Effective human-to-human communication involves both auditory and visual modalities, providing robustness and naturalness in realistic communication situations. Recent efforts at our lab are aimed at providing such multimodal capabilities for human-machine communication. Most of the visual modalities require a stable image of a speaker's face. We propose a connectionist face tracker that manipulates camera orientation and room, to keep a person's face located at all times. The system operates in real time and can adapt rapidly to different lighting conditions, cameras and faces, making it robust against environmental variability. Extensions and integration of the system with a multimodal interface are presented.< >