TDA4VM: [edgeai-tidl-tools] How to configure numBatches in edgeai-tidl-tools

Henry2333

Intellectual 490 points

Part Number: TDA4VM
Other Parts Discussed in Thread: AM69A

Hi, friends.

In SDK0804, Number of batches to be processed together by setting numBatches option.

So,how to configure this option in edgeai-tidl-tools?

Best Regards

Henry

over 1 year ago

0 Pratik Kedar over 1 year ago

TI__Mastermind 24041 points

Hi,

Please refer the edgeai tidl tools documents :

https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/examples/osrt_python/README.md#options-for-devices-with-multiple-dsp-cores

To enable parallel batch processing, set the options as follows:
advanced_options:inference_mode = 1
advanced_options:num_cores = Number of batches in the model

0 Henry2333 over 1 year ago in reply to Pratik Kedar

Intellectual 490 points

Hi,Pratik

Thank you for the reply.

I want to use this feature on SDK 08_06_00_12 TDA4VM.So I used edgeai-tidl-tools tag 08_06_00_03 according to https://github.com/TexasInstruments/docs/version_compatibility_table.md.

We do not see the options[inference_mode/num_cores ] in this version of common_utils.py.

And i notice the options are applicable only for "AM69A"

Can you tell me how to deploy this feature on SDK 08_06_00_12 TDA4VM.

Best Regards

Henry

0 Pratik Kedar over 1 year ago in reply to Henry2333

TI__Mastermind 24041 points

Hi,

Parallel Batch Processing is only supported for multi core devices like AM69A only.

Secondly this support is only available post 9.0 SDK release.

We recommend to use appropriate SDK and Target SoC as mentioned above to enable this feature.

0 Henry2333 over 1 year ago in reply to Pratik Kedar

Intellectual 490 points

Hi,Pratik

If i want to develop in SDK9.0, which tag of edgeai-tidl-tools should i use?

https://github.com/TexasInstruments/docs/version_compatibility_table.md this page is not found now.

Best Regards

Henry

0 Pratik Kedar over 1 year ago in reply to Henry2333

TI__Mastermind 24041 points

Click on the tag section of the repo there you will find all the tags.

09_00_00_06

Processors

Processors forum

TDA4VM: [edgeai-tidl-tools] How to configure numBatches in edgeai-tidl-tools