[POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR

Hemal Naik; Federico Tombari; Christoph Resch; Peter Keitler; Nassir Navab

doi:10.1109/ISMAR.2015.34

[POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR

Hemal Naik
, Federico Tombari
, Christoph Resch
, Peter Keitler
, Nassir Navab

Informatics 16 - Chair of Computer Aided Medical Procedures

EXTEND3D GmbH
DIBINEM, Alma Mater Studiorum, University of Bologna
Technical University of Munich
Johns Hopkins University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

In Spatial Augmented Reality (SAR) applications, real world objects are augmented with virtual content by means of a calibrated camera-projector system. A computer generated model (CAD) of the real object is used to plan the positions where the virtual content is to be projected. It is often the case that the real object deviates from its CAD model, this resulting in misregistered augmentations. We propose a new method to dynamically correct the planned augmentation by accommodating for the unknown deviations in the object geometry. We use a closed loop approach where the projected features are detected in the camera image and deployed as feedback. As a result, the registration misalignment is identified and the augmentations are corrected in the areas affected by the deviation. Our work is especially focused on SAR applications related to the industrial domain, where this problem is omnipresent. We show that our method is effective and beneficial for multiple industrial applications.

Original language	English
Title of host publication	Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
Editors	Nobuchika Sakata, Richard Newcombe, Robert Lindeman, Christian Sandor, Walterio Mayol-Cuevas, Veronica Teichrieb
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	112-115
Number of pages	4
ISBN (Electronic)	9781467376600
DOIs	https://doi.org/10.1109/ISMAR.2015.34
State	Published - 11 Nov 2015
Event	14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 - Fukuoka, Japan Duration: 29 Sep 2015 → 3 Oct 2015

Publication series

Name	Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

Conference

Conference	14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
Country/Territory	Japan
City	Fukuoka
Period	29/09/15 → 3/10/15

Keywords

3D Verification
Closed loop AR
Industrial SAR
Registration Correction

Access to Document

10.1109/ISMAR.2015.34

Cite this

Naik, H., Tombari, F., Resch, C., Keitler, P., & Navab, N. (2015). [POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR. In N. Sakata, R. Newcombe, R. Lindeman, C. Sandor, W. Mayol-Cuevas, & V. Teichrieb (Eds.), Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 (pp. 112-115). Article 7328074 (Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2015.34

Naik, Hemal ; Tombari, Federico ; Resch, Christoph et al. / [POSTER] A step closer to reality : Closed loop dynamic registration correction in SAR. Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. editor / Nobuchika Sakata ; Richard Newcombe ; Robert Lindeman ; Christian Sandor ; Walterio Mayol-Cuevas ; Veronica Teichrieb. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 112-115 (Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015).

@inproceedings{2cade67a01424505ae15da59e1a1f91c,

title = "[POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR",

abstract = "In Spatial Augmented Reality (SAR) applications, real world objects are augmented with virtual content by means of a calibrated camera-projector system. A computer generated model (CAD) of the real object is used to plan the positions where the virtual content is to be projected. It is often the case that the real object deviates from its CAD model, this resulting in misregistered augmentations. We propose a new method to dynamically correct the planned augmentation by accommodating for the unknown deviations in the object geometry. We use a closed loop approach where the projected features are detected in the camera image and deployed as feedback. As a result, the registration misalignment is identified and the augmentations are corrected in the areas affected by the deviation. Our work is especially focused on SAR applications related to the industrial domain, where this problem is omnipresent. We show that our method is effective and beneficial for multiple industrial applications.",

keywords = "3D Verification, Closed loop AR, Industrial SAR, Registration Correction",

author = "Hemal Naik and Federico Tombari and Christoph Resch and Peter Keitler and Nassir Navab",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 ; Conference date: 29-09-2015 Through 03-10-2015",

year = "2015",

month = nov,

day = "11",

doi = "10.1109/ISMAR.2015.34",

language = "English",

series = "Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "112--115",

editor = "Nobuchika Sakata and Richard Newcombe and Robert Lindeman and Christian Sandor and Walterio Mayol-Cuevas and Veronica Teichrieb",

booktitle = "Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015",

}

Naik, H, Tombari, F, Resch, C, Keitler, P & Navab, N 2015, [POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR. in N Sakata, R Newcombe, R Lindeman, C Sandor, W Mayol-Cuevas & V Teichrieb (eds), Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015., 7328074, Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015, Institute of Electrical and Electronics Engineers Inc., pp. 112-115, 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015, Fukuoka, Japan, 29/09/15. https://doi.org/10.1109/ISMAR.2015.34

[POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR. / Naik, Hemal; Tombari, Federico; Resch, Christoph et al.
Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. ed. / Nobuchika Sakata; Richard Newcombe; Robert Lindeman; Christian Sandor; Walterio Mayol-Cuevas; Veronica Teichrieb. Institute of Electrical and Electronics Engineers Inc., 2015. p. 112-115 7328074 (Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - [POSTER] A step closer to reality

T2 - 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

AU - Naik, Hemal

AU - Tombari, Federico

AU - Resch, Christoph

AU - Keitler, Peter

AU - Navab, Nassir

PY - 2015/11/11

Y1 - 2015/11/11

N2 - In Spatial Augmented Reality (SAR) applications, real world objects are augmented with virtual content by means of a calibrated camera-projector system. A computer generated model (CAD) of the real object is used to plan the positions where the virtual content is to be projected. It is often the case that the real object deviates from its CAD model, this resulting in misregistered augmentations. We propose a new method to dynamically correct the planned augmentation by accommodating for the unknown deviations in the object geometry. We use a closed loop approach where the projected features are detected in the camera image and deployed as feedback. As a result, the registration misalignment is identified and the augmentations are corrected in the areas affected by the deviation. Our work is especially focused on SAR applications related to the industrial domain, where this problem is omnipresent. We show that our method is effective and beneficial for multiple industrial applications.

AB - In Spatial Augmented Reality (SAR) applications, real world objects are augmented with virtual content by means of a calibrated camera-projector system. A computer generated model (CAD) of the real object is used to plan the positions where the virtual content is to be projected. It is often the case that the real object deviates from its CAD model, this resulting in misregistered augmentations. We propose a new method to dynamically correct the planned augmentation by accommodating for the unknown deviations in the object geometry. We use a closed loop approach where the projected features are detected in the camera image and deployed as feedback. As a result, the registration misalignment is identified and the augmentations are corrected in the areas affected by the deviation. Our work is especially focused on SAR applications related to the industrial domain, where this problem is omnipresent. We show that our method is effective and beneficial for multiple industrial applications.

KW - 3D Verification

KW - Closed loop AR

KW - Industrial SAR

KW - Registration Correction

UR - https://www.scopus.com/pages/publications/84962254861

U2 - 10.1109/ISMAR.2015.34

DO - 10.1109/ISMAR.2015.34

M3 - Conference contribution

AN - SCOPUS:84962254861

T3 - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

SP - 112

EP - 115

BT - Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

A2 - Sakata, Nobuchika

A2 - Newcombe, Richard

A2 - Lindeman, Robert

A2 - Sandor, Christian

A2 - Mayol-Cuevas, Walterio

A2 - Teichrieb, Veronica

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 29 September 2015 through 3 October 2015

ER -

Naik H, Tombari F, Resch C, Keitler P, Navab N. [POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR. In Sakata N, Newcombe R, Lindeman R, Sandor C, Mayol-Cuevas W, Teichrieb V, editors, Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 112-115. 7328074. (Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015). doi: 10.1109/ISMAR.2015.34

[POSTER] A step closer to reality: Closed loop dynamic registration correction in SAR

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this