Home / Publications


ACM SIGGRAPH Asia 2018 (Transactions on Graphics)

Simultaneous Acquisition of Polarimetric SVBRDF and Normals
  Seung-Hwan Baek Daniel S. Jeon Xin Tong* Min H. Kim  
  KAIST *Microsoft Research Asia  
  (a) We propose a complete polarimetric BRDF model that defines both specular and diffuse polarimetric reflection. The model enables us to capture spatially-varying polarimetric BRDF and high-frequency normals using a compact setup with a single projector and camera. Images (b) – (e) show environment rendering results of 3D objects captured from a novel light and view.  
  Capturing appearance often requires dense sampling in light-view space, which is often achieved in specialized, expensive hardware setups. With the aim of realizing a compact acquisition setup without multiple angu- lar samples of light and view, we sought to leverage an alternative optical property of light, polarization. To this end, we capture a set of polarimetric images with linear polarizers in front of a single projector and camera to obtain the appearance and normals of real-world objects. We encountered two technical challenges: First, no complete polarimetric BRDF model is available for modeling mixed polarization of both specular and diffuse reflec- tion. Second, existing polarization-based inverse rendering methods are not applicable to a single local illumination setup since they are formulated with the assumption of spherical illumination. To this end, we first present a com- plete polarimetric BRDF (pBRDF) model that can define mixed polarization of both specular and diffuse reflection. Second, by leveraging our pBRDF model, we propose a novel inverse-rendering method with joint optimization of pBRDF and normals to capture spatially-varying material appearance: per-material specular properties (including the refractive index, specular roughness and specular coefficient), per-pixel diffuse albedo and normals. Our method can solve the severely ill-posed inverse-rendering problem by carefully accounting for the physical relationship between polarimetric appearance and geometric properties. We demonstrate how our method overcomes limited sampling in light-view space for inverse rendering by means of polarization.
  author  = {Seung-Hwan Baek and Daniel S. Jeon and Xin Tong and Min H. Kim},
  title   = {Simultaneous Acquisition of Polarimetric SVBRDF and Normals},
  journal = {ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2018)},
  year    = {2018},
  volume  = {37},
  number  = {6},
  pages   = {268:1--15},
  doi     = "10.1145/3272127.3275018",
  url     = "",
Preprint paper:
PDF (35.5MB)
Supplemental document #1:
PDF (1.2MB)

document #2:
PDF (83.8MB)
SIGGRAPH Asia 2018 slides
www ACM
Digital Library

Hosted by Visual Computing Laboratory, School of Computing, KAIST.