You must be logged in  to watch this session

Your personal data will be used to support your experience throughout this website, to manage access to your account, and for other purposes described in our privacy policy.

Sense Media, on behalf of AutoSens, needs the contact information you provide to us to update you with information about AutoSens and our products. You may unsubscribe from these communications at anytime. For information on how to unsubscribe, as well as our privacy practices and commitment to protecting your privacy, check out our privacy policy.

Effective Use of Long-wave Infrared Technology for the Development and Optimization of Deep Learning based Intelligent Thermal vision Systems for Smart Vehicular Applications

Event: AutoSens Brussels
, 2022

Hear from:

Waseem Sharriff
Waseem Sharriff
Waseem Shariff
R&D Associate Engineer,

DTS/Xperi

Waseem Sharriff
Waseem Sharriff
Waseem Shariff
R&D Associate Engineer,

DTS/Xperi

Deep learning and Computer Vision have shown immense strength in real-world applications. This presentation will focus on using thermal imaging technology for designing an intelligent forward sensing system that should be effective in all weather and environmental conditions. This work is carried out under Heliaus project funded by European Union’s Horizon 2020 research and innovation programme and France, Germany, Ireland, and Italy. The systems work by deploying the thermally tuned deep learning networks on GPU & single-board EDGE-GPU computing platforms for onboard automotive sensor suite testing. The state-of-the-art object detection models are trained and fine-tuned on a large-scale novel C3I thermal dataset comprising of more than 35K distinct thermal frames collected from 640×480 uncooled thermal cameras along with 4 different large-scale publicly available thermal datasets. The trained network variant of the YOLO object detector is further optimized using SoA neural inference accelerator (TensorRT) to explicitly boost the frames per second rate and cut the overall inference time. The optimized network engine increases the frames per second rate by 3.5 times when testing on low-power edge devices thus achieving 11 fps on Nvidia Jetson Nano and 60 fps on Nvidia Xavier NX GPU-Edge computing boards.

Passes0
There are no passes in your basket!
0