VCLab

 

RESEARCH AREAS   PEOPLE   PUBLICATIONS   COURSES   ABOUT US
Home / Publications

indicator

ACM SIGGRAPH Asia 2024 (Transactions on Graphics)

 
Polarimetric BSSRDF Acquisition of Dynamic Faces
 
                     
  Hyunho Ha   Inseung Hwang   Nestor Monzon   Jaemin Cho   Donggun Kim  
                     
  Seung-Hwan Baek   Adolfo Muñoz   Diego Gutierrez   Min H. Kim  
                     
  KAIST Universidad de Zaragoza - I3A   POSTECH  
                     
 
   
  Current polarimetric acquisition systems are limited to static, opaque objects. In this work, we present a novel appearance acquisition method that allows us to obtain biophysically-based polarimetric BSSRDF and surface geometry of dynamic faces. Our polarimetric appearance parameters include index of refraction, specular roughness, single scattering roughness, specular intensity, and single scattering intensity. We also introduce an end-to-end multispectral optimization with heterogeneous subsurface scattering, revealing biophysically-based skin parameters including inner- and outer-layer hemoglobin, eumelanin and pheomelanin. Our model is compatible with popular human skin models in graphics.  
     
   
  Supplemental video results  
     
   
  Abstract
   
 

Acquisition and modeling of polarized light reflection and scattering help reveal the shape, structure, and physical characteristics of an object, which is increasingly important in computer graphics. However, current polarimetric acquisition systems are limited to static and opaque objects. Human faces, on the other hand, present a particularly difficult challenge, given their complex structure and reflectance properties, the strong presence of spatially-varying subsurface scattering, and their dynamic nature. We present a new polarimetric acquisition method for dynamic human faces, which focuses on capturing spatially varying appearance and precise geometry, across a wide spectrum of skin tones and facial expressions. It includes both single and heterogeneous subsurface scattering, index of refraction, and specular roughness and intensity, among other parameters, while revealing biophysically-based components such as inner- and outer-layer hemoglobin, eumelanin and pheomelanin. Our method leverages such components' unique multispectral absorption profiles to quantify their concentrations, which in turn inform our model about the complex interactions occurring within the skin layers. To our knowledge, our work is the first to simultaneously acquire polarimetric and spectral reflectance information alongside biophysically-based skin parameters and geometry of dynamic human faces. Moreover, our polarimetric skin model integrates seamlessly into various rendering pipelines.

   
  BibTeX
 
@Article{polarface:SIGA:2024,
  author  = {Hyunho Ha and Inseung Hwang and Nestor Monzon and Jaemin Cho
             and Donggun Kim and Seung-Hwan Baek and Adolfo Muñoz and
             Diego Gutierrez and Min H. Kim},
  title   = {Polarimetric BSSRDF Acquisition of Dynamic Faces},
  journal = {ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2024)},
  year    = {2024},
  volume  = {43},
  number  = {6},
}  
   
   
   
icon
Preprint paper:
PDF (41.5MB)
icon
Supplemental
document:
PDF (1.3MB)
SIGGRAPH Asia 2024 slides (TBA)
www GitHub code &
dataset (TBA)
www ACM
Digital Library
 
 

Hosted by Visual Computing Laboratory, School of Computing, KAIST.

KAIST