Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities

Fabian Herzog, Junpeng Chen, Torben Teepe, Johannes Gilg, Stefan Hormann, Gerhard Rigoll

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Scopus citations

Abstract

Smart City applications such as intelligent traffic routing, accident prevention or vehicle surveillance rely on computer vision methods for exact vehicle localization and tracking. Privacy issues make collecting real data difficult, and labeling data is a time-consuming and costly process. Due to the scarcity of accurately labeled data, detecting and tracking vehicles in 3D from multiple cameras proves challenging to explore. We present a massive synthetic dataset for multiple vehicle tracking and segmentation in multiple overlapping and non-overlapping camera views. Unlike existing datasets, which only provide tracking ground truth for 2D bounding boxes, our dataset additionally contains perfect labels for 3D bounding boxes in camera- and world coordinates, depth estimation, and instance, semantic and panoptic segmentation. The dataset consists of 17 hours of labeled video material, recorded from 340 cameras in 64 diverse day, rain, dawn, and night scenes, making it the most extensive dataset for multi-target multi-camera tracking so far. We provide baselines for detection, vehicle re-identification, and single- and multi-camera tracking. Code and data are publicly available. 11Code and data: https://github.com/fubel/synthehicle

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-11
Number of pages11
ISBN (Electronic)9798350320565
DOIs
StatePublished - 2023
Event2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023 - Waikoloa, United States
Duration: 3 Jan 20237 Jan 2023

Publication series

NameProceedings - 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023

Conference

Conference2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023
Country/TerritoryUnited States
CityWaikoloa
Period3/01/237/01/23

Fingerprint

Dive into the research topics of 'Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities'. Together they form a unique fingerprint.

Cite this