Context-Aware 3D Visualization of the Dynamic Environment

Sheikh Radiah Rivu, Darius Burschka

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We present a graphical interface that provides context-dependent information about possible interactions with a complex cluttered environment, which can be used as a video overlay system in Head Mounted Devices (HMDs) in Augmented Reality applications. The system identifies task relevant objects in a cluttered scene, learns the typical interaction patterns with them in a teaching phase, and supports the user with information about the object functionality and handling in the interaction phase. The underlying systen is capable of identification of objects in cluttered environment, providing information about possible task-dependent grasps, tracking object motion with high frame-rate and prediction of possible actions from a learned action graph that represents possible handling variants for a specific object. The system can be used to train a novice in an unknown environment providing expert knowledge. We present our implementation of the system in a service scenario of a kitchen environment, where the system supports the user while performing the actions.

Original languageEnglish
Title of host publicationProceedings - 2nd International Conference on Multimedia Information Processing and Retrieval, MIPR 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages42-47
Number of pages6
ISBN (Electronic)9781728111988
DOIs
StatePublished - 22 Apr 2019
Event2nd International Conference on Multimedia Information Processing and Retrieval, MIPR 2019 - San Jose, United States
Duration: 28 Mar 201930 Mar 2019

Publication series

NameProceedings - 2nd International Conference on Multimedia Information Processing and Retrieval, MIPR 2019

Conference

Conference2nd International Conference on Multimedia Information Processing and Retrieval, MIPR 2019
Country/TerritoryUnited States
CitySan Jose
Period28/03/1930/03/19

Keywords

  • 3D Modeling, Reconstruction, and Interactive Applications
  • Multimedia Telepresence and Virtual/Augmented/Mixed Reality
  • Multimedia/Multimodal Interaction Interfaces with humans

Fingerprint

Dive into the research topics of 'Context-Aware 3D Visualization of the Dynamic Environment'. Together they form a unique fingerprint.

Cite this