End-to-end imaging system optimization for computer vision in driving automation

Korbinian Weikl, Damien Schroeder, Daniel Blau, Zhenyi Liu, Walter Stechele

Research output: Contribution to journalConference articlepeer-review

2 Scopus citations


Full driving automation imposes to date unmet performance requirements on camera and computer vision systems, in order to replace the visual system of a human driver in any conditions. So far, the individual components of an automotive camera have mostly been optimized independently, or without taking into account the effect on the computer vision applications. We propose an end-to-end optimization of the imaging system in software, from generation of radiometric input data over physically based camera component models to the output of a computer vision system. Specifically, we present an optimization framework which extends the ISETCam and ISET3d toolboxes to create synthetic spectral data of high dynamic range, and which models a state-of-the-art automotive camera in more detail. It includes a state-of-the-art object detection system as benchmark application. We highlight in which way the framework approximates the physical image formation process. As a result, we provide guidelines for optimization experiments involving modification of the model parameters, and show how these apply to a first experiment on high dynamic range imaging.

Original languageEnglish
Article number173
JournalIS and T International Symposium on Electronic Imaging Science and Technology
Issue number18
StatePublished - 2021
Event2021 3D Imaging and Applications, 3DIA 2021 - Virtual, Online, United States
Duration: 11 Jan 202128 Jan 2021


Dive into the research topics of 'End-to-end imaging system optimization for computer vision in driving automation'. Together they form a unique fingerprint.

Cite this