Development of Realistic and Real Time Virtual Mirror Application for Electronic Cosmetic System

• Published in: Journal of The Society of Photographic Science and Technology of Japan Vol. 71; no. 6; pp. 425 - 431
• Main Authors: TSUMURA, Norimichi, MIYAKE, Yoich, KINOSHITA, Hayato, NAKAGUCHI, Toshiya, MAKINO, Takao
• Format: Journal Article
• Language: Japanese
• Published: THE SOCIETY OF PHOTOGRAPHY AND IMAGING OF JAPAN 2008; 社団法人 日本写真学会
• Subjects: electronic cosmetic; face tracking; half mirror; particle filter; virtual mirror; ハーフミラー; バーチャルミラー; パーティクルフィルタ; 化粧シミュレータ; 顔追跡
• ISSN: 0369-5662; 1884-5932
• DOI: 10.11454/photogrst1964.71.425

We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is a system that can reproduce a mirror image of user's face onto the display by using a video camera and a half mirror. Unlike a normal mirror, virtual mirror can enlarge the facial image or change the facial color. Our goal is to create the electronic cosmetic system with the virtual mirror. To achieve our goal, we proposed the real-time face tracking method with one video camera. This method can track the facial movement and expression separately by using a multistep particle filtering and a facial database.