Real-time 3D surface tracking and its applications

Nicholas A. Ramey, Jason J. Corso, William W. Lau, Darius Burschka, Gregory D. Hager

Research output: Contribution to journalConference articlepeer-review

16 Scopus citations


We present a general technique for directly estimating and tracking surfaces from a stream of rectified stereo pairs in real-time. These techniques are based on the iterative updating of surface representations directly from image information and use no disparity search except during initialization. We perform the tracking through an iteratively re-weighted least squares minimization wherein a mask is incorporated to increase robustness to occlusion. The algorithms are formulated for a general family of linear in parameters surface models and discussed for the cases of planar surfaces and tensor product surfaces. These algorithms have been implemented on standard hardware and run at or near frame rate, with accuracy on the order of 1/20 of a pixel. We discuss applications of the technique including mobile robot localization, general deforming surface tracking, and biometry of biological surfaces.

Original languageEnglish
Article number1384825
JournalIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Issue numberJanuary
StatePublished - 2004
Externally publishedYes
Event2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2004 - Washington, United States
Duration: 27 Jun 20042 Jul 2004


Dive into the research topics of 'Real-time 3D surface tracking and its applications'. Together they form a unique fingerprint.

Cite this