Image-based reconstruction of heterogeneous media in the presence of multiple light-scattering

Ludwic Leonard, Rüdiger Westermann

Research output: Contribution to journalArticlepeer-review

1 Scopus citations


Image-based reconstruction of a three-dimensional heterogeneous density field in the presence of multiple scattering of light is intrinsically under-constrained. This leads to reconstructions that look similar to the ground truth when rendered, but the recovered field is often far off the real one. We shed light on the sources of uncertainty in the reconstruction process which are responsible for this ambiguity, and propose the following approaches to improve the reconstruction quality: Firstly, we introduce a new path sampling strategy, which yields more accurate estimates of the gradients of the extinction field. Secondly, we build upon the observation that the variance in the loss computation is one source of bias in the optimization process. To reduce this variance in the primal estimator, we propose exploiting temporal coherence by reusing previously rendered images. All this is coupled with a constraint on spatial object occupancy, which restricts the problem to a reconstructed shape prior. In a number of examples we demonstrate that compared to existing approaches the proposed reconstruction pipeline leads to improved accuracy of the reconstructed density fields.

Original languageEnglish
Article number103877
JournalComputers and Graphics (Pergamon)
StatePublished - Apr 2024


  • Differentiable rendering
  • Inverse rendering
  • Volume reconstruction


Dive into the research topics of 'Image-based reconstruction of heterogeneous media in the presence of multiple light-scattering'. Together they form a unique fingerprint.

Cite this