Model for Multi-View Residual Covariances Based on Perspective Deformation

Alejandro Fontan, Laura Oliva, Javier Civera, Rudolph Triebel

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

In this work, we derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups. The core of our approach is the formulation of the residual covariances as a combination of geometric and photometric noise sources. And our key novel contribution is the derivation of a term modelling how local 2D patches suffer from perspective deformation when imaging 3D surfaces around a point. Together, these add up to an efficient and general formulation which not only improves the accuracy of both feature-based and direct methods, but can also be used to estimate more accurate measures of the state entropy and hence better founded point visibility thresholds. We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment, improving their accuracy with a negligible overhead.

Original languageEnglish
Pages (from-to)1960-1967
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume7
Issue number2
DOIs
StatePublished - 1 Apr 2022

Keywords

  • Cameras
  • Deformable models
  • Entropy
  • Simultaneous localization and mapping
  • Strain
  • Tensors
  • Visualization

Fingerprint

Dive into the research topics of 'Model for Multi-View Residual Covariances Based on Perspective Deformation'. Together they form a unique fingerprint.

Cite this