EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View

Torben Teepe, Philipp Wolters, Johannes Gilg, Fabian Herzog, Gerhard Rigoll

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multi-view aggregation promises to overcome the occlusion and missed detection challenge in multi-object detection and tracking. Recent approaches in multi-view detection and 3D object detection made a huge performance leap by projecting all views to the ground plane and performing the detection in the Bird's Eye View (BEV). In this paper, we investigate if tracking in the BEV can also bring the next performance breakthrough in Multi-Target Multi-Camera (MTMC) tracking. Most current approaches in multi-view tracking perform the detection and tracking task in each view and use graph-based approaches to perform the association of the pedestrian across each view. This spatial association is already solved by detecting each pedestrian once in the BEV, leaving only the problem of temporal association. For the temporal association, we show how to learn strong Re-Identification (re-ID) features for each detection. The results show that early-fusion in the BEV achieves high accuracy for both detection and tracking. EarlyBird outperforms the state-of-the-art methods and improves the current state-of-the-art on Wildtrack by +4.6 MOTA and +5.6 IDF1. https://github.com/tteepe/EarlyBird

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Winter Conference on Applications of Computer Vision Workshops, WACVW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages102-111
Number of pages10
ISBN (Electronic)9798350370287
DOIs
StatePublished - 2024
Event2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2024 - Waikoloa, United States
Duration: 4 Jan 20248 Jan 2024

Publication series

NameProceedings - 2024 IEEE Winter Conference on Applications of Computer Vision Workshops, WACVW 2024

Conference

Conference2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2024
Country/TerritoryUnited States
CityWaikoloa
Period4/01/248/01/24

Fingerprint

Dive into the research topics of 'EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye View'. Together they form a unique fingerprint.

Cite this