You must be logged in  to watch this session

Your personal data will be used to support your experience throughout this website, to manage access to your account, and for other purposes described in our privacy policy.

Sense Media, on behalf of AutoSens, needs the contact information you provide to us to update you with information about AutoSens and our products. You may unsubscribe from these communications at anytime. For information on how to unsubscribe, as well as our privacy practices and commitment to protecting your privacy, check out our privacy policy.

MTF as a performance indicator for AI algorithms?

Event: AutoSens Brussels
, 2022

Hear from:

"Alexander Braun smiling and looking off-camera"
"Alexander Braun smiling and looking off-camera"
Prof. Alexander Braun​
Professor of Physics,

University of Applied Sciences Dusseldorf

"Alexander Braun smiling and looking off-camera"
"Alexander Braun smiling and looking off-camera"
Prof. Alexander Braun​
Professor of Physics,

University of Applied Sciences Dusseldorf

The modulation-transfer function (MTF) is a well-established optical metric to quantify the ‚sharpness‘ of a camera system. We previously described a novel approach to use the MTF to quantify the quality of a simulation framework. Based on these results we now ask the question how well the MTF values correlate with the performance of evaluation algorithms, like traffic sign recognition or object detection. For this, we take a given database of automotive images (here: the Berkeley Deep Drive, BDD) and degrade these images with a parameterized optical model. We end up with several variations of the original database with different but realistic optical properties. Each simulated optical property is characterized using our MTF approach. Finally, a standard object-detection algorithm (car and person detection) is run on all database variations, showing the change in AI performance in dependence of the optical parameters. The results indicate that the MTF and the object-detection performance do not correlate well, as distinctly different MTF curves yield exactly the same precision-recall curves.

Passes0
There are no passes in your basket!
0