Shading-based refinement on volumetric signed distance functions

Michael Zollhöfer, Angela Dai, Matthias Innmann, Chenglei Wu, Marc Stamminger, Christian Theobalt, Matthias Nießner

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

108 Scopus citations

Abstract

We present a novel method to obtain fine-scale detail in 3D reconstructions generated with low-budget RGB-D cameras or other commodity scanning devices. As the depth data of these sensors is noisy, truncated signed distance fields are typically used to regularize out the noise, which unfortunately leads to over-smoothed results. In our approach, we leverage RGB data to refine these reconstructions through shading cues, as color input is typically of much higher resolution than the depth data. As a result, we obtain reconstructions with high geometric detail, far beyond the depth resolution of the camera itself. Our core contribution is shading-based refinement directly on the implicit surface representation, which is generated from globally-aligned RGB-D images. We formulate the inverse shading problem on the volumetric distance field, and present a novel objective function which jointly optimizes for fine-scale surface geometry and spatially-varying surface reflectance. In order to enable the efficient reconstruction of sub-millimeter detail, we store and process our surface using a sparse voxel hashing scheme which we augment by introducing a grid hierarchy. A tailored GPU-based Gauss-Newton solver enables us to refine large shape models to previously unseen resolution within only a few seconds.

Original languageEnglish
Title of host publicationProceedings of ACM SIGGRAPH 2015
PublisherAssociation for Computing Machinery
Volume34
Edition4
ISBN (Electronic)9781450333313
DOIs
StatePublished - 27 Jul 2015
Externally publishedYes
EventACM Special Interest Group on Computer Graphics and Interactive Techniques Conference, SIGGRAPH 2015 - Los Angeles, United States
Duration: 9 Aug 201513 Aug 2015

Conference

ConferenceACM Special Interest Group on Computer Graphics and Interactive Techniques Conference, SIGGRAPH 2015
Country/TerritoryUnited States
CityLos Angeles
Period9/08/1513/08/15

Keywords

  • 3D reconstruction
  • Shading-based refinement

Fingerprint

Dive into the research topics of 'Shading-based refinement on volumetric signed distance functions'. Together they form a unique fingerprint.

Cite this