IWR1642BOOST: Camera Radar Fusion Demo Approach

Ryen Elith

Part Number: IWR1642BOOST

Hi,

I watched the camera radar fusion demo video from TI on youtube (https://www.youtube.com/watch?v=sPQGtIXaXqA) and am interested to find out more about the approach used in the presented system. Is there a white paper on this sensor fusion demo, explaining more about the fusion of vision (optical flow and neuralnetwork information) and radar (obstacle map)?

Regards,

Ryen

over 6 years ago

0 amin over 6 years ago

Expert 1985 points

Hello Ryen Elith,

It's not hard. One of the simplest ways to do this, is to use the following algorithm(based on camera):
Background Subtraction:
- The difference of consecutive frames
Mixture of Gaussian method
Optical Flow (basic method without using learning algorithm) or …
Optical Flow: en.wikipedia.org/.../Lucas–Kanade_method

This method is suitable for fixed cameras. Essentially, you can detect motion using these methods. But if you have a moving camera, you need more sophisticated methods. These links will help you:

sites.google.com/.../extension-to-moving-cameras
www.telecom.ulg.ac.be/.../

Regards,
Amin

0 Akash Gondalia over 6 years ago in reply to amin

TI__Guru 50240 points

Thank you for your response Amin!

Ryen, Let us know if you have more questions.

Cheers,
Akash

0 Ryen Elith over 6 years ago in reply to Akash Gondalia

Intellectual 300 points

Hi,

Thanks for your replies. I am specifically looking for information about the (high level) fusion process. Is there a whitepaper on this topic?

Regards,

Ryen

0 amin over 6 years ago in reply to Ryen Elith

Expert 1985 points

Hi Ryen,

About a video published by TI, TI experts must respond. But in the case of other sample tasks, there are many articles you can find. You can read these articles:

www.mrt.kit.edu/.../Liu_al2008iv.pdf

sensors-11-08992.pdf

Regards,

Amin

0 Ryen Elith over 6 years ago in reply to amin

Intellectual 300 points

Hi Amin,

Thank you for the links to the articles. That is very helpful!

Regards,
Ryen

0 amin over 6 years ago in reply to Ryen Elith

Expert 1985 points

Hi Ryen,

Glad that it helped.

Regards,
Amin

Sensors

Sensors forum

IWR1642BOOST: Camera Radar Fusion Demo Approach