On Policy Learning Robust to Irreversible Events: An Application to Robotic In-Hand Manipulation

Pietro Falco, Abdallah Attawia, Matteo Saveriano, Dongheui Lee

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

In this letter, we present an approach for learning in-hand manipulation skills with a low-cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on visual perception with low-level reactive control based on tactile perception, which aims to avoid slipping. The objective of the reinforcement learning level consists not only in fulfilling the in-hand manipulation goal, but also in minimizing the intervention of the tactile reactive control. This way, the occurrence of object slipping during the learning procedure, which we consider an irreversible event, is significantly reduced. When an irreversible event occurs, the learning process is considered failed. We show the performance in two tasks, which consist in reorienting a cup and a bottle only using the fingers. The experimental results show that the proposed architecture allows reaching the goal in the Cartesian space and reduces significantly the occurrence of object slipping during the learning procedure. Moreover, without the proposed synergy between reactive control and reinforcement learning it was not possible to avoid irreversible events and, therefore, to learn the task.

Original languageEnglish
Pages (from-to)1482-1489
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume3
Issue number3
DOIs
StatePublished - Jul 2018
Externally publishedYes

Keywords

  • Dexterous manipulation
  • learning and adaptive systems
  • tactile reactive control

Fingerprint

Dive into the research topics of 'On Policy Learning Robust to Irreversible Events: An Application to Robotic In-Hand Manipulation'. Together they form a unique fingerprint.

Cite this