Development of Realistic and Real Time Virtual Mirror Application for Electronic Cosmetic System
We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is a system that can reproduce a mirror image of user's face onto the display by using a video camera and a half mirror. Unlike a nor...
Saved in:
| Published in | Journal of The Society of Photographic Science and Technology of Japan Vol. 71; no. 6; pp. 425 - 431 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | Japanese |
| Published |
THE SOCIETY OF PHOTOGRAPHY AND IMAGING OF JAPAN
2008
社団法人 日本写真学会 |
| Subjects | |
| Online Access | Get full text |
| ISSN | 0369-5662 1884-5932 |
| DOI | 10.11454/photogrst1964.71.425 |
Cover
| Abstract | We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is a system that can reproduce a mirror image of user's face onto the display by using a video camera and a half mirror. Unlike a normal mirror, virtual mirror can enlarge the facial image or change the facial color. Our goal is to create the electronic cosmetic system with the virtual mirror. To achieve our goal, we proposed the real-time face tracking method with one video camera. This method can track the facial movement and expression separately by using a multistep particle filtering and a facial database. |
|---|---|
| AbstractList | We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is a system that can reproduce a mirror image of user's face onto the display by using a video camera and a half mirror. Unlike a normal mirror, virtual mirror can enlarge the facial image or change the facial color. Our goal is to create the electronic cosmetic system with the virtual mirror. To achieve our goal, we proposed the real-time face tracking method with one video camera. This method can track the facial movement and expression separately by using a multistep particle filtering and a facial database. We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is a system that can reproduce a mirror image of user's face onto the display by using a video camera and a half mirror. Unlike a normal mirror, virtual mirror can enlarge the facial image or change the facial color. Our goal is to create the electronic cosmetic system with the virtual mirror. To achieve our goal, we proposed the real-time face tracking method with one video camera. This method can track the facial movement and expression separately by using a multistep particle filtering and a facial database. 我々は, 被写体の顔の位置, 向き, 口の動きを1台のカメラで実時間追跡することにより化粧シミュレーションを実現するバーチャルミラーシステムを構築した. バーチャルミラーとは, ハーフミラーとビデオカメラを用いることで, ディスプレイを被写体 (今回の場合は使用者の顔) への画像処理が可能な鏡として扱うシステムである. このシステムを顔追跡, 顔への付加処理と組み合わせることで, 簡便な化粧シミュレータを構築した. 顔追跡には, 顔の動きと表情を分離して確率的に推定する手法を提案した. また, 追跡に必要なデータは人体寸法のデータベースより取得した. これにより1台のカメラでも精度良く顔追跡を行うことが可能となった. |
| Author | MIYAKE, Yoich MAKINO, Takao KINOSHITA, Hayato TSUMURA, Norimichi NAKAGUCHI, Toshiya |
| Author_FL | 三宅 洋一 津村 徳道 木下 逸人 牧野 貴雄 中口 俊哉 |
| Author_FL_xml | – sequence: 1 fullname: 牧野 貴雄 – sequence: 2 fullname: 木下 逸人 – sequence: 3 fullname: 津村 徳道 – sequence: 4 fullname: 中口 俊哉 – sequence: 5 fullname: 三宅 洋一 |
| Author_xml | – sequence: 1 fullname: TSUMURA, Norimichi organization: Graduate School of Advanced Integrated Science, Chiba University – sequence: 1 fullname: MIYAKE, Yoich organization: Research Center for Frontier Medical Engineering, Chiba University – sequence: 1 fullname: KINOSHITA, Hayato organization: Graduate School of Advanced Integrated Science, Chiba University – sequence: 1 fullname: NAKAGUCHI, Toshiya organization: Graduate School of Advanced Integrated Science, Chiba University – sequence: 1 fullname: MAKINO, Takao organization: Graduate School of Science and Technology, Chiba University |
| BackLink | https://cir.nii.ac.jp/crid/1390001206570226304$$DView record in CiNii |
| BookMark | eNpNkFFLwzAUhYNMcM79BKEPvnYmaZKmj2NOHUwEnb7W2zTdMtqmJFHYvzdzIr7cywfnHu45l2jU214jdE3wjBDG2e2ws8FunQ-kEGyWkxmj_AyNiZQs5UVGR2iMM1GkXAh6gabemwpTzGRWYDlGH3f6S7d26HQfEtskLxpa44NRCfT1DyUb0-nk3bjwGeHJOGddMh-G1igIxvZJE3nZahWc7ePdwvpOHw1eDz7o7gqdN9B6Pf3dE_R2v9wsHtP188NqMV-ne8IpSymVuap1pRqoKZYEdA48BgLMoQapaslFBqBZpWStMsB5JXKouaxxIYoqzybo5uTbG1Mqc5wkRsSYUCx4jikVGWZRtjrJ9j7AVpeDMx24QwkuvtxG_t9mmZNSnEYs9U-jduBK3Wffxw917Q |
| ContentType | Journal Article |
| Copyright | The Society of Photographic Science and Technology of Japan |
| Copyright_xml | – notice: The Society of Photographic Science and Technology of Japan |
| DBID | RYH |
| DOI | 10.11454/photogrst1964.71.425 |
| DatabaseName | CiNii Complete |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Visual Arts |
| DocumentTitleAlternate | 実時間顔画像追跡を用いたバーチャルミラーの電子化粧シミュレータへの応用 |
| DocumentTitle_FL | 実時間顔画像追跡を用いたバーチャルミラーの電子化粧シミュレータへの応用 |
| EISSN | 1884-5932 |
| EndPage | 431 |
| ExternalDocumentID | 130004285062 article_photogrst1964_71_6_71_6_425_article_char_en |
| GroupedDBID | ABJNI ACGFS ALMA_UNASSIGNED_HOLDINGS HH5 JSF OK1 RJT ABDPE AFFNX RYH |
| ID | FETCH-LOGICAL-j1524-2287cdebcfad2081ae7a5964a05ada8cd8563aae4bc8dc3a07b67ad58d0969b73 |
| ISSN | 0369-5662 |
| IngestDate | Fri Jun 27 00:05:26 EDT 2025 Wed Sep 03 06:28:52 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | true |
| Issue | 6 |
| Language | Japanese |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-j1524-2287cdebcfad2081ae7a5964a05ada8cd8563aae4bc8dc3a07b67ad58d0969b73 |
| OpenAccessLink | https://www.jstage.jst.go.jp/article/photogrst1964/71/6/71_6_425/_article/-char/en |
| PageCount | 7 |
| ParticipantIDs | nii_cinii_1390001206570226304 jstage_primary_article_photogrst1964_71_6_71_6_425_article_char_en |
| PublicationCentury | 2000 |
| PublicationDate | 2008 |
| PublicationDateYYYYMMDD | 2008-01-01 |
| PublicationDate_xml | – year: 2008 text: 2008 |
| PublicationDecade | 2000 |
| PublicationTitle | Journal of The Society of Photographic Science and Technology of Japan |
| PublicationTitleAlternate | J.Soc.Photgr.Sci.Tech.Jpn |
| PublicationTitle_FL | 日写誌 日本写真学会誌 JSPSTJ J.Soc.Photgr.Sci.Tech.Jpn |
| PublicationYear | 2008 |
| Publisher | THE SOCIETY OF PHOTOGRAPHY AND IMAGING OF JAPAN 社団法人 日本写真学会 |
| Publisher_xml | – name: THE SOCIETY OF PHOTOGRAPHY AND IMAGING OF JAPAN – name: 社団法人 日本写真学会 |
| References | 2) T. Darrell, G. Gordon, J. Woodfill, M. Harville, “A Virtual Mirror Interface using Real-time Robust Face Tracking”, In Proceedings of the Third International Conference on Face and Gesture Recognition, 616 (1998). 6) K. Oka, Y. Sato, “Real-time modeling of face deformation for 3D head pose estimation”, Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2005), 308 (2005). 9) 西田佳史, 平山敏行, 柿倉正義, 堀俊夫, 末廣尚士, 平井成興, “3次元視覚を用いた洗面台型ディスプレイ”, 電気学会システム・制御研究会SC-01-5 (2001). 10) 小木哲朗, 山田俊郎, 栗田, 服部, 廣瀬通孝, “仮想空間共有のためのビデオアバタ技術とその利用法”, 日本バーチャルリアリティ学会論文集, 8, 47 (2003). 4) 湯浅真由美, 中島朗子, “高精度顔特徴点検出に基づくデジタルメイクシステム”, 第10回画像センシングシンポジウム講演論文集, 219 (2004). 5) 牧野貴雄, 中口俊哉, 津村徳道, 高瀬紘一, 岡口紗綾, 小島伸俊, 三宅洋一, “-Color Enhanced Emotion-実時間表情認識を用いた感情強調システムの開発”, 芸術科学会論文誌, 6, 53 (2007). 8) 河内まき子, 持丸正明, “AIST人体寸法データベース”, 産業技術総合研究所H 16 PRO287 (2005). 3) 古川貴雄, 坂口嘉之, 塚田章, “リアルタイムメークアップシミュレーダ”, 第19回センシングフォーラム資料, 53 (2002). 7) F. Dornaika, F. Davoine, “Head and facial animation tracking using appearance-adaptive models and particle filters”, Proc. Workshop on Real-Time Vision for Human-Computer Interaction, 153 (2004). 12) M. Isard, A. Blake, “Condensation-conditional density propagation for visual tracking”, Int. J. Computer Vision, 29, 5 (1998). 1) T. Makino, T. Nakaguchi, N. Tsumura, Y. Miyake, “Virtual mirror based on 3D shape reconstruction and real-time face tracking”, Internet Imaging VI. Edited by Santini, Simone; Schettini, Raimondo; Gevers, Theo. Proceedings of the SPIE, 5670, 252, (2004). 11) 舟橋琢磨, 藤原孝幸, 輿水大和, “瞳認識を利用したアイコンタクト顔映像生成”, 第13回画像センシングシンポジウム講演論文集 (2007). |
| References_xml | – reference: 9) 西田佳史, 平山敏行, 柿倉正義, 堀俊夫, 末廣尚士, 平井成興, “3次元視覚を用いた洗面台型ディスプレイ”, 電気学会システム・制御研究会SC-01-5 (2001). – reference: 10) 小木哲朗, 山田俊郎, 栗田, 服部, 廣瀬通孝, “仮想空間共有のためのビデオアバタ技術とその利用法”, 日本バーチャルリアリティ学会論文集, 8, 47 (2003). – reference: 6) K. Oka, Y. Sato, “Real-time modeling of face deformation for 3D head pose estimation”, Proc. IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2005), 308 (2005). – reference: 11) 舟橋琢磨, 藤原孝幸, 輿水大和, “瞳認識を利用したアイコンタクト顔映像生成”, 第13回画像センシングシンポジウム講演論文集 (2007). – reference: 4) 湯浅真由美, 中島朗子, “高精度顔特徴点検出に基づくデジタルメイクシステム”, 第10回画像センシングシンポジウム講演論文集, 219 (2004). – reference: 7) F. Dornaika, F. Davoine, “Head and facial animation tracking using appearance-adaptive models and particle filters”, Proc. Workshop on Real-Time Vision for Human-Computer Interaction, 153 (2004). – reference: 5) 牧野貴雄, 中口俊哉, 津村徳道, 高瀬紘一, 岡口紗綾, 小島伸俊, 三宅洋一, “-Color Enhanced Emotion-実時間表情認識を用いた感情強調システムの開発”, 芸術科学会論文誌, 6, 53 (2007). – reference: 2) T. Darrell, G. Gordon, J. Woodfill, M. Harville, “A Virtual Mirror Interface using Real-time Robust Face Tracking”, In Proceedings of the Third International Conference on Face and Gesture Recognition, 616 (1998). – reference: 8) 河内まき子, 持丸正明, “AIST人体寸法データベース”, 産業技術総合研究所H 16 PRO287 (2005). – reference: 1) T. Makino, T. Nakaguchi, N. Tsumura, Y. Miyake, “Virtual mirror based on 3D shape reconstruction and real-time face tracking”, Internet Imaging VI. Edited by Santini, Simone; Schettini, Raimondo; Gevers, Theo. Proceedings of the SPIE, 5670, 252, (2004). – reference: 3) 古川貴雄, 坂口嘉之, 塚田章, “リアルタイムメークアップシミュレーダ”, 第19回センシングフォーラム資料, 53 (2002). – reference: 12) M. Isard, A. Blake, “Condensation-conditional density propagation for visual tracking”, Int. J. Computer Vision, 29, 5 (1998). |
| SSID | ssib020483908 ssj0000491483 ssib001234146 |
| Score | 1.7422568 |
| Snippet | We present a virtual mirror system for tracking a 3D position and orientation of a user's head in real-time with a single video camera. The “virtual mirror” is... |
| SourceID | nii jstage |
| SourceType | Publisher |
| StartPage | 425 |
| SubjectTerms | electronic cosmetic face tracking half mirror particle filter virtual mirror ハーフミラー バーチャルミラー パーティクルフィルタ 化粧シミュレータ 顔追跡 |
| Title | Development of Realistic and Real Time Virtual Mirror Application for Electronic Cosmetic System |
| URI | https://www.jstage.jst.go.jp/article/photogrst1964/71/6/71_6_425/_article/-char/en https://cir.nii.ac.jp/crid/1390001206570226304 |
| Volume | 71 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| ispartofPNX | Journal of The Society of Photographic Science and Technology of Japan, 2008/12/25, Vol.71(6), pp.425-431 |
| journalDatabaseRights | – providerCode: PRVFSB databaseName: Free Full-Text Journals in Chemistry customDbUrl: eissn: 1884-5932 dateEnd: 20141231 omitProxy: true ssIdentifier: ssj0000491483 issn: 0369-5662 databaseCode: HH5 dateStart: 19640101 isFulltext: true titleUrlDefault: http://abc-chemistry.org/ providerName: ABC ChemistRy – providerCode: PRVAFT databaseName: Open Access Digital Library customDbUrl: eissn: 1884-5932 dateEnd: 99991231 omitProxy: true ssIdentifier: ssib020483908 issn: 0369-5662 databaseCode: KQ8 dateStart: 19640101 isFulltext: true titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html providerName: Colorado Alliance of Research Libraries |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lj9MwELbKcoED4ikWWOQDtyolTeLEOYaqNO2q27KbrnZPwU5cbYpoUJseln_JP2KmdtNULOJxsVonjhz7y3hmPPOZkHehUlLmSlqBzzAlpyvhm-vmFlfCtaUfzvNtVtr4zI9n3uiKXbVaPxpRS5tKdrLvd-aV_M-sQh3MK2bJ_sPM1g-FCvgN8wslzDCUfzXHjYgfTSqCbIY7Blb8Z2GGR_uyWG2zRMbFalWutOKZ7YMM-_uTcHrl-itmNRoi899orgitXbQnhtDdlJUmvsaGRlZgD_Zue7xtBMtyjcRxdDo8m7QT8UWUtcyHmot4mETtWNyKqq5PQPLPziPcYirQNVrUDuzoNBrMevGwnZTrm-JWHLgweA03jGq6mPSG_eQag5ym8SSZDM6jaXy9JdcajqMB-uzg0iiaGnbbXbJXaIEmqgW50rKbc89ioXsg3PX5LgbETUnt6Xxrs-h7ein6dT3xmIenIOuBXFdIX9YJup269QFVN24Nog3KbNQK7jvoIsI4gU-NjUkH1Ia9BY60yW5o6JUW2mADA1Uf6m1e0eSdYVfe39UR0J0WYEkgRcS9ZVE01KPkMXlk0EEjDdInpLUQT8nDy2K90bXrZ-RzA660nNMarhTAQmu4UgNXquFKG3ClAFe6hyvdwZVquD4ns4_9pBdb5oAPawFqo2c5YK5nICiyucgd0E2FCgSDFxM2E7ngWc6Z7wqhPJnxPHOFHUg_EDnjORjeoQzcF-RoWS7VS0L9zBFO6IC94SjPtwWfc2jNeBZ4ikk2PyYf9CCl3zSLS2q-2vRgSNOgm_q6gJGt78EMSBA4x-QEBjjNCizBdNq6cW0MHgMjxrW9V3-4_po80OFG6MF7Q46q1UadgE5bybdblPwEPxGdoA |
| linkProvider | Colorado Alliance of Research Libraries |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Development+of+Realistic+and+Real-Time+Virtual+Mirror+Application+for+Electronic+Cosmetic+System&rft.jtitle=Journal+of+The+Society+of+Photographic+Science+and+Technology+of+Japan&rft.au=MAKINO+Takao&rft.au=KINOSHITA+Hayato&rft.au=TSUMURA+Norimichi&rft.au=NAKAGUCHI+Toshiya&rft.date=2008&rft.pub=THE+SOCIETY+OF+PHOTOGRAPHY+AND+IMAGING+OF+JAPAN&rft.issn=0369-5662&rft.eissn=1884-5932&rft.volume=71&rft.issue=6&rft.spage=425&rft.epage=431&rft_id=info:doi/10.11454%2Fphotogrst1964.71.425&rft.externalDocID=130004285062 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0369-5662&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0369-5662&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0369-5662&client=summon |