Audio Perception in Robotic Assistance for Human Space Exploration: A Feasibility Study

Marco Sewtz, Werner Friedl, Adrian Bauer, Anne Kopken, Florian Lay, Nicolai Bechtel, Peter Schmaus, Rudolph Triebel, Neal Y. Lii

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Future crewed missions beyond low earth orbit will greatly rely on the support of robotic assistance platforms to perform inspection and manipulation of critical assets. This includes crew habitats, landing sites or assets for life support and operation. Maintenance and manipulation of a crewed site in extra-terrestrial environments is a complex task and the system will have to face different challenges during operation. While most may be solved autonomously, in certain occasions human intervention will be required. The telerobotic demonstration mission, Surface Avatar, led by the German Aerospace Center (DLR), with partner European Space Agency (ESA), investigates different approaches offering astronauts on board the International Space Station (ISS) control of ground robots in representative scenarios, e.g. a Martian landing and exploration site. In this work we present a feasibility study on how to integrate auditory information into the mentioned application. We will discuss methods for obtaining audio information and localizing audio sources in the environment, as well as fusing auditory and visual information to perform state estimation based on the gathered data. We demonstrate our work in different experiments to show the effectiveness of utilizing audio information, the results of spectral analysis of our mission assets, and how this information could help future astronauts to argue about the current mission situation.

Original languageEnglish
Title of host publication2023 IEEE Aerospace Conference, AERO 2023
PublisherIEEE Computer Society
ISBN (Electronic)9781665490320
StatePublished - 2023
Externally publishedYes
Event2023 IEEE Aerospace Conference, AERO 2023 - Big Sky, United States
Duration: 4 Mar 202311 Mar 2023

Publication series

NameIEEE Aerospace Conference Proceedings
ISSN (Print)1095-323X


Conference2023 IEEE Aerospace Conference, AERO 2023
Country/TerritoryUnited States
CityBig Sky


Dive into the research topics of 'Audio Perception in Robotic Assistance for Human Space Exploration: A Feasibility Study'. Together they form a unique fingerprint.

Cite this