UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework

Tianhang Wang, Guang Chen, Kai Chen, Zhengfa Liu, Bo Zhang, Alois Knoll, Changjun Jiang

Publikation: Beitrag in Buch/Bericht/KonferenzbandKonferenzbeitragBegutachtung

3 Zitate (Scopus)

Abstract

Multi-agent collaborative perception (MCP) has recently attracted much attention. It includes three key processes: communication for sharing, collaboration for integration, and reconstruction for different downstream tasks. Existing methods pursue designing the collaboration process alone, ignoring their intrinsic interactions and resulting in suboptimal performance. In contrast, we aim to propose a Unified Collaborative perception framework named UMC, optimizing the communication, collaboration, and reconstruction processes with the Multi-resolution technique. The communication introduces a novel trainable multi-resolution and selective-region (MRSR) mechanism, achieving higher quality and lower bandwidth. Then, a graph-based collaboration is proposed, conducting on each resolution to adapt the MRSR. Finally, the reconstruction integrates the multi-resolution collaborative features for downstream tasks. Since the general metric can not reflect the performance enhancement brought by MCP systematically, we introduce a brand-new evaluation metric that evaluates the MCP from different perspectives. To verify our algorithm, we conducted experiments on the V2X-Sim and OPV2V datasets. Our quantitative and qualitative experiments prove that the proposed UMC outperforms the state-of-the-art collaborative perception approaches.

OriginalspracheEnglisch
TitelProceedings - 2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten8153-8162
Seitenumfang10
ISBN (elektronisch)9798350307184
DOIs
PublikationsstatusVeröffentlicht - 2023
Veranstaltung2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023 - Paris, Frankreich
Dauer: 2 Okt. 20236 Okt. 2023

Publikationsreihe

NameProceedings of the IEEE International Conference on Computer Vision
ISSN (Print)1550-5499

Konferenz

Konferenz2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023
Land/GebietFrankreich
OrtParis
Zeitraum2/10/236/10/23

Fingerprint

Untersuchen Sie die Forschungsthemen von „UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren