LieGrasPFormer: Point Transformer-Based 6-DOF Grasp Detection with Lie Algebra Grasp Representation

Jianjie Lin, Markus Rickert, Alois Knoll

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

With the significant advancements made in the 6-DOF Grasp learning network, grasp selection for unseen objects has garnered much attention. However, most existing approaches rely on complex sequence pipelines to generate potential Grasp, which can be challenging to implement. In this work, we propose an end-to-end grasp detection network that can create a diverse and accurate 6-DOF grasp posture based solely on pure point clouds. We utilize the hierarchical PointNet++ with a skip-connection point transformer encoder block to extract contextual local region point features, which we refer to as LieGrasPFormer. This network can efficiently generate a distribution of 6-DoF parallel-jaw grasps directly from a pure point cloud. Moreover, we introduce two different grasp detection loss functions, which give the neural network the ability to generalize to unseen objects, such as generators. These loss functions also enable a continuously differentiable property for the network. We trained our LieGrasPFormer using the synthesized grasp dataset ACRONYM, which contains 17 million parallel-jaw grasps, and found that it generalized well with an actual scanned YCB dataset consisting of 77 objects. Finally, we conducted experiments in the PyBullet simulator, which showed that our proposed grasp detection network can outperform most state-of-the-art approaches with respect to the grasp success rate.

Original languageEnglish
Title of host publication2023 IEEE 19th International Conference on Automation Science and Engineering, CASE 2023
PublisherIEEE Computer Society
ISBN (Electronic)9798350320695
DOIs
StatePublished - 2023
Event19th IEEE International Conference on Automation Science and Engineering, CASE 2023 - Auckland, New Zealand
Duration: 26 Aug 202330 Aug 2023

Publication series

NameIEEE International Conference on Automation Science and Engineering
Volume2023-August
ISSN (Print)2161-8070
ISSN (Electronic)2161-8089

Conference

Conference19th IEEE International Conference on Automation Science and Engineering, CASE 2023
Country/TerritoryNew Zealand
CityAuckland
Period26/08/2330/08/23

Fingerprint

Dive into the research topics of 'LieGrasPFormer: Point Transformer-Based 6-DOF Grasp Detection with Lie Algebra Grasp Representation'. Together they form a unique fingerprint.

Cite this