SK-TDA4VM: How do I run edgeai-gst-apps once I have updated firmware for TIDL-TOOLS?

Charanjit Singh

Part Number: SK-TDA4VM

Tool/software:

Hi,

Is there a way to use the optiflow examples by calling

python3 optiflow/optiflow.py configs/object_detection.yaml

from edgeai-gst-apps after updating the target from edgeai-tidl-tools using the update_target.sh script?

When I try to run optiflow code after the update I get

root@tda4vm-sk:/opt/edgeai-gst-apps# python3 optiflow/optiflow.py configs/object_detection.yaml 
APP: Init ... !!!
  1463.382156 s: MEM: Init ... !!!
  1463.382196 s: MEM: Initialized DMA HEAP (fd=17) !!!
  1463.382324 s: MEM: Init ... Done !!!
  1463.382338 s: IPC: Init ... !!!
  1463.443016 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  1463.452600 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  1463.455651 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
  1463.455685 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
  1463.455696 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
  1463.461501 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-0 
  1463.461777 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-1 
  1463.461917 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-2 
  1463.462084 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-3 
  1463.462163 s:  VX_ZONE_INFO: [tivxInitLocal:202] Initialization Done !!!
  1463.462185 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
  1463.516900 s: IPC: Deinit ... !!!
  1463.517612 s: IPC: DeInit ... Done !!!
  1463.517779 s: MEM: Deinit ... !!!
  1463.517808 s: DDR_SHARED_MEM: Alloc's: 14 alloc's of 20643840 bytes 
  1463.517827 s: DDR_SHARED_MEM: Free's : 14 free's  of 20643840 bytes 
  1463.517843 s: DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes 
  1463.517865 s: MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!
APP: Init ... !!!
  1463.525691 s: MEM: Init ... !!!
  1463.525775 s: MEM: Initialized DMA HEAP (fd=8) !!!
  1463.525904 s: MEM: Init ... Done !!!
  1463.525932 s: IPC: Init ... !!!
  1463.585073 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  1463.591699 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  1463.591875 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
  1463.591894 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
  1463.591959 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
  1463.592231 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-0 
  1463.592401 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-1 
  1463.592526 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-2 
  1463.592641 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-3 
  1463.592712 s:  VX_ZONE_INFO: [tivxInitLocal:202] Initialization Done !!!
  1463.592764 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
libtidl_onnxrt_EP loaded 0x2f3d53b0 
Final number of subgraphs created are : 1, - Offloaded Nodes - 283, Total Nodes - 283 
  1464.592055 s:  VX_ZONE_ERROR: [ownContextSendCmd:1001] Command ack message returned failure cmd_status: -1
  1464.592088 s:  VX_ZONE_ERROR: [ownNodeKernelInit:704] Target kernel, TIVX_CMD_NODE_CREATE failed for node node_113
  1464.592100 s:  VX_ZONE_ERROR: [ownNodeKernelInit:705] Please be sure the target callbacks have been registered for this core
  1464.592110 s:  VX_ZONE_ERROR: [ownNodeKernelInit:706] If the target callbacks have been registered, please ensure no errors are occurring within the create callback of this kernel
  1464.592120 s:  VX_ZONE_ERROR: [ownGraphNodeKernelInit:793] kernel init for node 0, kernel com.ti.tidl:1:2 ... failed !!!
  1464.592128 s:  VX_ZONE_ERROR: [ TIDL subgraph dets ] Node kernel init failed
  1464.592134 s:  VX_ZONE_ERROR: [ TIDL subgraph dets ] Graph verify failed
terminate called after throwing an instance of 'Ort::Exception'
  what():  Create state function failed. Return value:-1
Aborted (core dumped)
root@tda4vm-sk:/opt/edgeai-gst-apps# exit
logout
Connection to tda4vm closed.

Regards,

Charanjit Singh

27 days ago

0 Chris Tsongas 26 days ago

TI__Genius 14520 points

Hi Charanjit,

Please isolate the problem and run your model first under TIDL only by running it from /opt/tidl_test. I am not an openvx expert and cannot advise or debug the extra layer of complexity.

1. Run your model artifacts from /opt/tidl_test with the standard EVM (no updates). If this works then run your update

2. After the update, again run your artifacts from /opt/tidl_test. If this works then is is an OpenVX problem.

3. If this does not work, then please send me your model, import and inference config and version information and I will try it locally.

Regards,

Chris

0 Charanjit Singh 26 days ago in reply to Chris Tsongas

Prodigy 120 points

Hi Chris,

There seems to be a misunderstanding in my question.

The issue is neither with the model nor with TIDL. Both of these are working fine.

I wanted to use optiflow just to confirm whether the kmssink and tidss (both gstreamer elements) are working correctly, as I need to use these in my code to show the output through the HDMI port, but got the above error.

So the question is

1. whether I have to update edgeai-gst-apps along with updating the target device?

2. How do I update to the latest firmware for TIDL and still be able to use optiflow apps.

Thanks and regards,

Charanjit

0 Sarabesh Srinivasan 25 days ago in reply to Charanjit Singh

TI__Genius 17050 points

Hi Charanjit,

Which SDK version are you using?

0 Charanjit Singh 25 days ago in reply to Sarabesh Srinivasan

Prodigy 120 points

Hi Sarabesh,

I am using 11.00.00.08 version of the SDK LINUX.

0 Sarabesh Srinivasan 24 days ago in reply to Charanjit Singh

TI__Genius 17050 points

Hi Charanjit,

I'll take a look at this ticket early next week. I am out of office today.

Thanks,
Sarabesh S.

0 Charanjit Singh 19 days ago in reply to Sarabesh Srinivasan

Prodigy 120 points

Hi Sarabesh,

Any updates in this matter?

0 Sarabesh Srinivasan 14 days ago in reply to Charanjit Singh

TI__Genius 17050 points

Hi Charanjit,

Charanjit Singh said:
1. whether I have to update edgeai-gst-apps along with updating the target device?

To avoid mismatches and maintain compatibility, yes you may need to update the edgeai-gst-apps.

If you're looking to verify kmssink, you can follow the SDK documentation (here).

Let me refer you to my colleague for your TIDL question.

Thanks,
Sarabesh S.

0 Charanjit Singh 11 days ago in reply to Sarabesh Srinivasan

Prodigy 120 points

Hi Sarabesh,

Thank you for your reply.

Sarabesh Srinivasan said:
To avoid mismatches and maintain compatibility, yes you may need to update the edgeai-gst-apps.

Q1. How do I update these? Do I have to rebuild, or is just a repo update enough?

Sarabesh Srinivasan said:
If you're looking to verify kmssink, you can follow the SDK documentation (here).

This only shows whether any output is connected, but does not verify whether we can see any output on it.

A workaround I used is to run a simple gst pipeline to check if the output works.

gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-raw, width=1920, height=1080, format=NV12 ! kmssink driver-name=tidss sync=false

Thanks,

Charanjit

+1 Wen Li 10 days ago in reply to Charanjit Singh

TI__Expert 7171 points

Hello;

I would built a new RTOS-SDK to make sure you have the latest firmware first. After that, if you want to update the TIDL-C7x firmware, you have to go through the patching process. Basically, remove the original bin file and create a symbolic link to your new firmware bin file. Then the optiflow apps will be on top of the latest firmware. I hope I understand your question correctly.

Best regards

Wen Li

0 Charanjit Singh 7 days ago in reply to Wen Li

Prodigy 120 points

Hi,

Thank you Wen Li.

Wen Li said:
I hope I understand your question correctly.

Yes. That what I was trying to confirm.

I will get back to you if I have any specific problem in the process, maybe even in a new post.

Regards,

Charanjit

0 Wen Li 6 days ago in reply to Charanjit Singh

TI__Expert 7171 points

Thank you for the feedback! Please feel free to submit a new one, if you have problems in the future.

Best regards

Wen Li

Processors

Processors forum

SK-TDA4VM: How do I run edgeai-gst-apps once I have updated firmware for TIDL-TOOLS?