Questions about Model Deployment on TDA4VM EVM

KONG XIANGXU

Expert 2046 points

Part Number: TDA4VM

Hi Team,

We have some questions about the model deployment on TDA4VM EVM,

1. Could you provide a list of ONNX operators that TIDL-RT currently supports? The Docs only roughly mention there are almost 40 operators supported.

Operators Coverage

2. Is there any tools that can inspect or analyze the usage of hardware device while running a model on the EVM, so that we can have a intuitive understanding about the computation capacity of the hard-device?

3. Is there any docs in terms of the Operator Customization for TIDL-RT unsupported operators?

Look forward to your reply!

Regards,

Kong

over 3 years ago

0 Fredy Zhang over 3 years ago

TI__Expert 5410 points

Hi,Kong,

1. please refer here to get more details: https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/08_02_00_05/exports/docs/tidl_j721e_08_02_00_11/ti_dl/docs/user_guide_html/md_tidl_layers_info.html

2. When you running the tidl demo ,you can press 'p' to get more details.

3. If you need any details, please check this first: https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/08_02_00_05/exports/docs/tidl_j721e_08_02_00_11/ti_dl/docs/user_guide_html/index.html

Regards,

Fredy Zhang

0 KONG XIANGXU over 3 years ago in reply to Fredy Zhang

Expert 2046 points

Hi, Fredy,

Thank you for your reply.

1. There are around 20 ONNX Ops from the website you provided. I list them in the code block. But the docs say TIDL-RT supports around 40 Ops. Do you have a list of all the supported ONNX Ops?

Surpported ONNX Ops
1. Conv
2. BatchNormalization
3. MaxPool
4. AveragePool
5. GlobalAveragePool
6. Add
7. Mul
8. Gemm
9. Softmax
10. ConvTranspose
11. Concat
12. Split
13. Flatten
14. ArgMax
15. Reshape
16. UpSample
17. DepthToSpace
18. Sigmoid/Logistic 
19. Pad
20. ScatterND
21. RELU
22. Prelu

2. Great! That really helps!

3. I have get through this doc, but I didn't find contents related to the custom operators.

Regards,

Kong

0 Fredy Zhang over 3 years ago in reply to KONG XIANGXU

TI__Expert 5410 points

Hi, Xiangxu,

1. Newest layer support ,please check our newest guide : https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/08_05_00_11/exports/docs/tidl_j721e_08_05_00_16/ti_dl/docs/user_guide_html/md_tidl_layers_info.html

2. You can develop your operators, the TI provided operators is not enough. Thanks.

Regards,

Fredy Zhang

Processors

Processors forum

Questions about Model Deployment on TDA4VM EVM