Safe Robot Navigation Using Constrained Hierarchical Reinforcement Learning

Felippe Schmoeller Roza, Hassan Rasheed, Karsten Roscher, Xiangyu Ning, Stephan Günnemann

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Safe navigation is one of the steps necessary for achieving autonomous control of robots. Among different algorithms that focus on robot navigation, Reinforcement Learning (and more specifically Deep Reinforcement Learning) has shown impressive results for controlling robots with complex and high-dimensional state representations. However, when integrating methods to comply with safety requirements by means of constraint satisfaction in flat Reinforcement Learning policies, the system performance can be affected. In this paper, we propose a constrained Hierarchical Reinforcement Learning framework with a safety layer used to modify the low-level policy to achieve a safer operation of the robot. Results obtained in simulation show that the proposed method is better at retaining performance while keeping the system in a safe region when compared to a constrained flat model.

Original languageEnglish
Title of host publicationProceedings - 21st IEEE International Conference on Machine Learning and Applications, ICMLA 2022
EditorsM. Arif Wani, Mehmed Kantardzic, Vasile Palade, Daniel Neagu, Longzhi Yang, Kit-Yan Chan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages737-742
Number of pages6
ISBN (Electronic)9781665462839
DOIs
StatePublished - 2022
Event21st IEEE International Conference on Machine Learning and Applications, ICMLA 2022 - Nassau, Bahamas
Duration: 12 Dec 202214 Dec 2022

Publication series

NameProceedings - 21st IEEE International Conference on Machine Learning and Applications, ICMLA 2022

Conference

Conference21st IEEE International Conference on Machine Learning and Applications, ICMLA 2022
Country/TerritoryBahamas
CityNassau
Period12/12/2214/12/22

Keywords

  • Constrained Reinforcement Learning
  • Hierarchical Reinforcement Learning
  • Robot Navigation
  • Safety

Fingerprint

Dive into the research topics of 'Safe Robot Navigation Using Constrained Hierarchical Reinforcement Learning'. Together they form a unique fingerprint.

Cite this