TDA4VEN-Q1: RGBIR sensor integration

Because of the holidays, responses will be delayed from Dec. 25 through Jan. 2. Thank you for your patience.

Hi Ajay,

Ajay Jose said:

Do we need to enable PCID module for RGBIR working ?If yes what changes we need to do in single_cam application ?

Yes, for RGBIR sensors, IR must be removed from the R/G/B pixels.

PCID can only process up to 16-bit linear WDR images.

What is the WDR format of your AR0823 output?
As far as I know, AR0823 is up to 24-bit or 26-bit WDR.

Ajay Jose said:

Also how we can get the Bayer output and IR output as output from the ISP pipeline?

It varies with the use cases.
VISS-PCID H/W may output up to 12-bit IR images with interpolation.

Many customers would like to use the sensor raw output for IR frames without any PCID processing.

Gang Hua said:

What is the WDR format of your AR0823 output?

We are using 20-bit WDR data which is companded to 12-bit.

You said PCID can handle only up to 16 bits. But as per the architecture we are reducing the bit depth to 16-bit in RAWFE block before giving to PCID.

Even though we use any input bit depth (26 bit ,24 bit or 20 bit) finally the RAWFE block will convert it into 16 bits.

So, this bit depth issue won't matter right?

Gang Hua said:

VISS-PCID H/W may output up to 12-bit IR images with interpolation.

If i want Bayer outputwhat changes i need to do? Similarly, if i want only IR output what changes i need to do in single_cam application?

As per the TRM we can get either Bayer or IR using the switch block.

For CAC ,NSF4V and GLBCE we have obj->viss_params.bypass_nsf4 ,obj->viss_params.bypass_glbce   variables in the single cam.If there any specific variable in the SDK which will do this switching (means Bayer output or IR output) ?

Thanks.

Hi Ajay,

Happy New Year!

Ajay Jose said:

You said PCID can handle only up to 16 bits. But as per the architecture we are reducing the bit depth to 16-bit in RAWFE block before giving to PCID.

Even though we use any input bit depth (26 bit ,24 bit or 20 bit) finally the RAWFE block will convert it into 16 bits.

So, this bit depth issue won't matter right?

This is about the requirement for IR subtraction which must be done in linear domain.
PCID can only support 16-bit input which must be linear so that IR subtraction can be done correctly.

20-bit WDR cannot be handled by PCID.
You may have to either use a sensor that can output IR and Bayer pattern separately or use DSP to do that before VISS.

Ajay Jose said:

If i want Bayer outputwhat changes i need to do? Similarly, if i want only IR output what changes i need to do in single_cam application?

You would need to enable PCID in this case (set bypass_pcid = 0).

https://git.ti.com/cgit/processor-sdk/imaging/tree/kernels/hwa/vpac_viss/vx_vpac_viss_target.c?h=main#n608

Ajay Jose said:

As per the TRM we can get either Bayer or IR using the switch block.

From the H/W perspective, PCID IR output can go out to DDR directly.
That should be what the diagram shows.

I am not familiar with the S/W details, it looks like "enable_ir_op" must be set for IR output.

https://git.ti.com/cgit/processor-sdk/imaging/tree/kernels/hwa/vpac_viss/vx_vpac_viss_target.c?h=main#n1595

Some format change may also be needed in application.

https://git.ti.com/cgit/processor-sdk/imaging/tree/kernels/hwa/vpac_viss/vx_vpac_viss_target.c?h=main#n1952

Gang Hua said:

PCID can only support 16-bit input which must be linear so that IR subtraction can be done correctly.

Hi Gang,

Will the PCID will work with 12 -bit linear data also? or we need 16bit input?

Thanks