Real-Time Instance Segmentation of Pedestrians using Transfer Learning

Bare Luka Zagar, Tobias Preintner, Alois C. Knoll, Ekim Yurtsever

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

Real-time instance segmentation of pedestrians presents a critical core task within an automated driving pipeline. Recent research focuses on existing real-world datasets to train their instance segmentation networks. However, due to the limited size of real-world datasets, they tend to either overfit or lack accuracy. Therefore, these networks remain useless for real-world applications. Hence, we introduce a transfer learning strategy by combining a large-scale synthetic dataset and a real-world dataset for instance segmentation of pedestrians. We showcase our approach on three state-of-the-art real-time instance segmentation methods: (1) YOLACT++, (2) SipMask, and (3) BlendMask. Finally, we provide a quantitative and qualitative evaluation of our introduced approach on two publicly available urban street scenes datasets, i.e. the real-world Cityscapes dataset and the synthetic Synscapes dataset.

Original languageEnglish
Title of host publication2022 27th International Conference on Automation and Computing
Subtitle of host publicationSmart Systems and Manufacturing, ICAC 2022
EditorsChenguang Yang, Yuchun Xu
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665498074
DOIs
StatePublished - 2022
Event27th International Conference on Automation and Computing, ICAC 2022 - Bristol, United Kingdom
Duration: 1 Sep 20223 Sep 2022

Publication series

Name2022 27th International Conference on Automation and Computing: Smart Systems and Manufacturing, ICAC 2022

Conference

Conference27th International Conference on Automation and Computing, ICAC 2022
Country/TerritoryUnited Kingdom
CityBristol
Period1/09/223/09/22

Keywords

  • Automated Driving Systems
  • Real-Time Instance Segmentation
  • Synthetic Data
  • Transfer Learning

Fingerprint

Dive into the research topics of 'Real-Time Instance Segmentation of Pedestrians using Transfer Learning'. Together they form a unique fingerprint.

Cite this