AM62A7: Issues related to image quality debugging

Hi Peng,

Do you use Processor SDK Linux or MCU+ SDK on AM62A7 device?

Hi Bin

We use MCU+SDK on Am62A7 device.

Sorry, we are using Processor SDK Linux ,not  MCU+ SDK.

Hi Peng,

I am routing your query to our CSI expert for comments.

Hello Peng Qiang,

The dark image was most likely caused by WDR not being enabled. Please try the following on the EVM:

1. open file /opt/edgeai-tiovx-modules/src/tiovx_sensor_module.c and change sensor_wdr_enabled to 1 as shown below:

vx_status tiovx_init_sensor(SensorObj *sensorObj, char *objName)
{
    vx_status status = VX_SUCCESS;
    sensorObj->sensor_dcc_enabled=1;
    sensorObj->sensor_exp_control_enabled=0;
    sensorObj->sensor_gain_control_enabled=0;
    sensorObj->sensor_wdr_enabled=1;    // change to 1 to enable WDR

2. run script /opt/edgeai-gst-apps/scripts/install_tiovx_modules.sh to build TIOVX modules. Please make sure your board is connected to a network to get the right time stamp needed by the script.

root@am62axx-evm:/opt/edgeai-gst-apps# ./scripts/install_tiovx_modules.sh

Then stream from the camera with the WDR binaries. Please let me know if this fixes the problem.

Regards,

Jianzhong

Hi Peng,

In case you are not aware, there is FAQ for generating default DCC profile.

https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1275034/faq-default-dcc-profile-generation-tool-for-tda4-am6xa-isp-vpac?tisearch=e2e-sitesearch&keymatch=%20user%3A35541

It can take care of WDR decomapnding.

Hi Gang

I generated the initial bin file as you said before.

And I generated it again according to your parameters setting.There are still question 1(Q1).

Let me provide a detailed description of my experiment.

1.Generate three XML files using the cfa+wdr module in DCC.

2.Generate generate.sh and XML files using TI tools

3.Replace the corresponding files generated by TI tools with XML files and .txt generated by DCC

4.Generate .bin file using generate.sh

question 1：As long as  cfa's the XML file is included, the screen will be very dark.

Hi Jianzhong

This doesn't work.

Let me provide a detailed description of my experiment.

1.Generate three XML files using the cfa+wdr module in DCC.

2.Generate generate.sh and XML files using TI tools

3.Replace the corresponding files generated by TI tools with XML files and .txt generated by DCC

4.Generate .bin file using generate.sh

question 1：As long as  cfa's the XML file is included, the screen will be very dark.

Hi Peng,

Did you make the change below and recompile?

    sensorObj->sensor_wdr_enabled=1;    // change to 1 to enable WDR

Hi Gang

Yes,I did.It It doesn't work.

 Setting the parameter (sensorObj->sensor_wdr_enabled ) to 0 or 1 has no effect on image quality.

Hi peng,

Do you have live tuning working on your side for capturing raw/yuv images?

Please share (1) your raw/yuv image captures, (2) configuration file for the python script, and (3) your gstreamer pipeline command for streaming.

Here are the steps for enabling live tuning on SDK 9.0 (I suppose you are on 9.0).

1. Navigate to /opt/edgeai-tiovx-modules/
2. In the CMakeLists.txt file, modify (ENABLE_DCC_TOOL  "Enable DCC Tuning Tool Support" OFF -> ON)
3. mkdir build
4. cd build
5. cmake ..
6. make -j2
7. make install

BTW, what kind of sensor are you working on?

Hi Gang

This is the file you need.

case文件.zip

There are two configuration files for the python script.

They have the same problem.

ox3C10  with wdr mode （24bit）.   60fps

PWl 24bit->12bit 

Hi peng,

It looks like GLBCE is still not enabled after changing sensor_wdr_enabled to 1.

There might be some problem with the gstreamer/tiovx implementation on AM62A.

Do you use the latest SDK 9.0?

No,We are using SDK8.6.

May I ask if SDK 9.0 does not have this problem?

if so, can provide us with a patch based on the difference between 8.6 and 9.0? There is a driver issue with replacing the 9.0 now.

Hi Gang

The cfa.xml files generated using VPAC1 and VPAC3L have different effects. 

The cfa.xml file generated using VPAC1 will darken the image.

The cfa.xml file generated using 1 will not take effect.

May I ask what is the difference between the two? Which should be used for AM62a7?

peng qiang said:

The cfa.xml files generated using VPAC1 and VPAC3L have different effects. 

Could you please share the files?

peng qiang said:

The cfa.xml file generated using VPAC1 will darken the image.

This should behave the same way on AM62A and TDA4.

In our AM62A testing, we used the same TDA4  settings for IMX390.

peng qiang said:

The cfa.xml file generated using 1 will not take effect.

I am not sure what you mean exactly.

peng qiang said:

May I ask what is the difference between the two? Which should be used for AM62a7?

Both should work for AM62A.

I am not sure if your issue is because of 8.6.

Gang Hua said:

Could you please share the files?

cfa.xml.zip

Gang Hua said:

I am not sure what you mean exactly

The file is not valid.In other words, this file will not have any impact on image quality.

Hi Gang

Is there any progress on cfa. xml?

Due to the lack of MIPI CSI drivers in SDK 9.0, it is currently not possible to use 9.0. Is there any other method to make GLBCE effective?

Gang Hua said:

We tested on SDK 9.0 with IMX390 and tone mapping works after changing sensor_wdr_enabled to 1.

I now suspect that the parameter modification did not take effect.

How can I verify the successful modification?

That's what I did.But the relevant content was not printed during streaming.

peng qiang said:

Due to the lack of MIPI CSI drivers in SDK 9.0, it is currently not possible to use 9.0.

Which drivers were you referring to, that were available in SDK 8.6 but not in 9.0?

peng qiang said:

Is there any progress on cfa. xml?

Hi peng,

Both xml files are valid (no error by itself).

There could be some bug in gstreamer or viss kernel on AM62A for the vpac3 version.
We will look into it further 

You may keep using the VPAC1 version for your application.
The additional things in VPAC3-CFA is for very special use cases.
I don't believe they are really useful for your application.

peng qiang said:

I now suspect that the parameter modification did not take effect.

On SDK 9.0, that is only change required.

Hi Chau Le, do you have any additional comment on this?

May I ask why the cfa.xml file causes the screen to turn black using the VPAC1?

The SDK 9.0 startup development board does not load any drivers.What could be the reason for this.

peng qiang said:

May I ask why the cfa.xml file causes the screen to turn black using the VPAC1?

That is not because of anything wrong in CFAI.
CFAI is simply reverting color back to relatively linear after tone mapping.

Because GLBCE is not working as expected, the output image is not locally tone mapped and therefore we are looking at the top 12-bit (linear) of the input image.

Hi Gang

At present, glbce has taken effect, but the remaining issue is that the cfa.xml generated by VPAC3L does not take effect.

Previously, glbce did not take effect due to a file error during the compilation process.

Hi Peng,

Thank you very much for the update!

peng qiang said:

At present, glbce has taken effect, but the remaining issue is that the cfa.xml generated by VPAC3L does not take effect.

Did you do this on SDK9.0 or SDK8.6?

For cfai xml format, you may use keep using the VPAC1 format.
We will check if there is any s/w issue.

Hi Peng,

peng qiang said:

The SDK 9.0 startup development board does not load any drivers.What could be the reason for this.

What were the errors? Please feel free to open another thread for this issue.

Regards,

jianzhong

Hi Gang

SDK8.6