TDA4VM: Some questions in app_multi_cam_codec (SDK:08.06.00.12 vision_apps)

qian yue

Part Number: TDA4VM

Hi，

May I ask if in "app_multi_cam_codec", if four cameras are set in the configuration file, all four cameras initially run normally, but later due to a malfunction in one camera, images cannot be captured? Where can I add a check in the code to determine if a camera image has been captured before continuing. Because I found that if one of the paths fails to capture a frame, it will block at the "vxGraphParameterDequeueDoneRef" position. As a result, the other three cameras are also unable to output images.

Regards,

Yueqian

over 1 year ago

0 qian yue over 1 year ago

Intellectual 981 points

Hi,

Can we use the function "app_send_error_frame" here? If so, how should we use this function correctly?

Since I saw that only raw format input is supported when initializing error_detection_frames, but we are using YUV format, is there a function interface that can convert RAW to YUV422?

Regards，

Yueqian

0 qian yue over 1 year ago in reply to qian yue

Intellectual 981 points

Is there a function interface that can read images in UYVY format locally? Similar to "read_error_image raw()".

0 Nikhil Dasan over 1 year ago in reply to qian yue

TI__Guru* 85126 points

Hi Yueqian,

If we use error frame, it wouldn't block the other 3 cameras from streaming and the error frames start streaming once the camera stops.

tivxCaptureRegisterErrorFrame(captureObj->node, (vx_reference)captureObj->error_frame_raw_image);

In the SDK, this API sends raw image (i.e. error_frame_raw_image), but internally, I see that this API also supports other formats.

i.e. output image type of the capture node should match this error image data type.

Regards,

Nikhil

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

OK, thank you! I solved this problem yesterday, so this thread can be closed.

Regards,

Yueqian

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

Hi,

There is currently an issue, can I determine from the code which frame the error frame is being pushed from?

Regards,

Yueqian

0 Nikhil Dasan over 1 year ago in reply to qian yue

TI__Guru* 85126 points

Hi Yueqian,

One way to track this is to check the activechannel mask present in the capture node. This would say which camera is not working / disconnected.

I have an FAQ below where I reconfigure a camera sensor based on this mask. Please check the below FAQ for the same

(+) [FAQ] TDA4VM: Reconfiguration of disconnected camera or camera that is powered off - Processors forum - Processors - TI E2E support forums

Regards,

Nikhil

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

Hi,

How should I check the activechannel mask present in the capture node in the code?

Can you provide some guidance methods?

Regards,

Yueqian

0 Nikhil Dasan over 1 year ago in reply to qian yue

TI__Guru* 85126 points

Hi Yuequan,

qian yue said:
How should I check the activechannel mask present in the capture node in the code?

This could be seen in the above FAQ provided.

Could you please refer the same?

Regards,

Nikhil

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

OK, Nikhil. Thank you very much. I saw the modifications to the patch.

Regards,

Yueqian

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

Hi Nikhil,

After adding the patch, how do I know which camera is being replaced by the incorrect frame and from which frame does the incorrect frame appear?

If there is no camera malfunction, pressing r will print

"active.channel=0xf
Ch_Mask=0x0",

if one camera fails, it will print

"active.channel=0x7"
Ch_Mask=0x8".

The number of cameras configured in our interactive mode is four.

Regards,

Yueqian

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

Hi,

At present, it is possible to reconfigure the camera, but is there any way from the code to know which camera and when the error frame was used?

Regards，

Yueqian

0 Nikhil Dasan over 1 year ago in reply to qian yue

TI__Guru* 85126 points

Hi,

qian yue said:
if one camera fails, it will print

"active.channel=0x7"
Ch_Mask=0x8".

In this case, I believe the camera that fails is the one that is connected to port 3 right?

active.channel for 4 cameras working would be 0x1111 where each bit from LSB to MSB represent port 0, 1, 2, 3 of the csi-rx instance 0.

So, if active.channel for 4 cameras is 0x0111, this means sensor connected to port 3 of csi-rx instance 0 is the camera that is replaced with error frames.

qian yue said:
from which frame does the incorrect frame appear?

May I know what parameter of the frame are you looking for here?
Do you have any parameter of the frame that would be tracked from the sensor?

Regards,

Nikhil

0 qian yue over 1 year ago in reply to Nikhil Dasan

Intellectual 981 points

OK, thank you very much. I want to know the "frame_id" for sending the error_frame_image. You have provided me with some validation ideas, and I will conduct some tests.

Regards，

Yueqian