TDA4VM: RGB & IR Sensor Design Guide with SK-EVM and Yocto SDK

Jack

Part Number: TDA4VM

Dear TDA4 and Sitara AM62Ax Champs !

Several security-related companies have attempted to connect RGB + IR sensors to MIPI-CSI2 ports using TDA4VM and AM62Ax.

AM62Ax product pages also introduced RGB IR Sensor support via AM62Ax.

Can you please support for RGB+IR Sensor bring up on top of TDA4VM or AM6xAx?

Q1. Can you please give us RGB & IR sensor applicaton guide along with AM6x or TDA4VM?'

Q2. Please recommend the RGB+IR sensor which is applicable to TDA4VM and AM6x?

Q3. Also let us know how to implement VISS manual updating (driver) software in case a sensor transmits RGB 20 frames and IR 20 frames respectively on same MIPI-CSI port.

However the sensor does not support virtual channel feature according to Sensor module supplier that customer contacted.

Q4. If the RGB & IR sensor is delivered through the single CSI port, the original thread mentioned to utilize the MIPI CSI virutal channel, could you introduce more detailed documents and examples in relation to this?

Regards,

Jack

over 1 year ago

0 Fabiana Jaimes over 1 year ago

TI__Mastermind 19680 points

Hi Jack,

I will be looping in the right engineers to help you. In the meantime, please see the following page:

Linux Camera Academy for AM62Ax: https://dev.ti.com/tirex/explore/node?node=A__ATmvgyzeqCfCvoHoyFGZGw__AM62A-ACADEMY__WeZ9SsL__LATEST

OV2312 RGB-IR sensor is listed in the page linked above.

Thank you,

Fabiana

0 Jianzhong Xu over 1 year ago in reply to Fabiana Jaimes

TI__Guru 58805 points

Hello Jack,

Jack said:
Q1. Can you please give us RGB & IR sensor applicaton guide along with AM6x or TDA4VM?'

We currently don't have any application guide on using RGB-IR sensor. Please take a look at the CSI2-Rx driver documentation which has an example of using OV2312 to stream RGB and IR data.

Jack said:
Q2. Please recommend the RGB+IR sensor which is applicable to TDA4VM and AM6x?

We support OV2312 in our current SDK. We've also tested OX05B1S as well. Depending on the resolution and frame rate requirement, you can choose one from these two sensors.

Jack said:
Q3. Also let us know how to implement VISS manual updating (driver) software in case a sensor transmits RGB 20 frames and IR 20 frames respectively on same MIPI-CSI port.

The GStreamer plugin for AM62A ISP handles configuring VISS for RGB and IR streams: github.com/.../gsttiovxisp.c. Please search for "TIVX_VPAC_VISS_IR_ENABLE".

Jack said:
However the sensor does not support virtual channel feature according to Sensor module supplier that customer contacted.

If the sensor supports changing datatype using a register, we can use that to implement virtual channel.

Jack said:
Q4. If the RGB & IR sensor is delivered through the single CSI port, the original thread mentioned to utilize the MIPI CSI virutal channel, could you introduce more detailed documents and examples in relation to this?

Please take a look at the OV2312 driver as a reference: https://git.ti.com/cgit/ti-linux-kernel/ti-linux-kernel/tree/drivers/media/i2c/ov2312.c?h=ti-linux-6.1.y.

I'll be working on an app note for RGB-IR soon and hopefully will address your questions. Before then, please look at the source code I provided above for examples.

Regards,

Jianzhong

Processors

Processors forum

TDA4VM: RGB & IR Sensor Design Guide with SK-EVM and Yocto SDK