Edge Cloud-based Augmented Reality

Christoph Bachhuber, Alvaro Sanchez Martinez, Rastin Pries, Sebastian Eger, Eckehard Steinbach

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

A convincing augmented reality (AR) experience requires vast computational resources, in particular for three-dimensional mapping of the environment, pose estimation and high-quality rendering of virtual objects. Even today's most powerful mobile devices can not provide such computational resources and consequently limit the achievable quality of the augmentation. To tackle this issue, all computations necessary for AR can be offloaded to the Edge Cloud, such that the mobile device merely acts as a camera and display. This approach introduces additional processing steps, namely video communication, which we carefully evaluate with respect to their influence on the quality of experience and energy consumption. In the evaluation of our prototype, we show that with a Glass-to-Glass delay of about 85 ms, our implementation is competitive against state-of-the-art solutions which run completely locally on a mobile device. Most notably, the additional steps required for offloading contribute little delay, which is often overcompensated by the faster computations in the Edge Cloud. A further benefit is that compared to performing all AR processing locally, offloading reduces the energy consumption in smartphones on average by 50 %. Moreover, the computational resources available for the AR application increase by a factor 10 to 100 through offloading. Finally, offloading enables high-quality AR applications even in low-end mobile devices.

Original languageEnglish
Title of host publicationIEEE 21st International Workshop on Multimedia Signal Processing, MMSP 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728118178
DOIs
StatePublished - Sep 2019
Event21st IEEE International Workshop on Multimedia Signal Processing, MMSP 2019 - Kuala Lumpur, Malaysia
Duration: 27 Sep 201929 Sep 2019

Publication series

NameIEEE 21st International Workshop on Multimedia Signal Processing, MMSP 2019

Conference

Conference21st IEEE International Workshop on Multimedia Signal Processing, MMSP 2019
Country/TerritoryMalaysia
CityKuala Lumpur
Period27/09/1929/09/19

Keywords

  • augmented reality
  • edge cloud
  • energy consumption
  • glass-to-glass delay

Fingerprint

Dive into the research topics of 'Edge Cloud-based Augmented Reality'. Together they form a unique fingerprint.

Cite this