Post-production facial performance relighting using reflectance transfer

• Published in: ACM transactions on graphics
• Main Authors: Peers, Pieter, Tamura, Naoki, Matusik, Wojciech, Debevec, Paul
• Format: Conference Proceeding
• Language: English
• Published: 05.08.2007
• ISSN: 0730-0301
• DOI: 10.1145/1275808.1276442

We propose a novel post-production facial performance relighting system for human actors. Our system uses just a dataset of view-dependent facial appearances with a neutral expression, captured for a static subject using a Light Stage apparatus. For the actual performance, however, a potentially different actor is captured under known, but static, illumination. During post-production, the reflectance field of the reference dataset actor is transferred onto the dynamic performance, enabling image-based relighting of the entire sequence. Our approach makes post-production relighting more practical and could easily be incorporated in a traditional production pipeline since it does not require additional hardware during principal photography. Additionally, we show that our system is suitable for real-time post-production illumination editing.