TDA4VM: Using Tensorflow Lite delegate

Isharaka Gunasinghe

Part Number: TDA4VM

https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/examples/osrt_cpp/README.md

I am trying to use above CPP examples with tensorflow lite delegate on Jacinto development board. I followed the instruction in the above link. However I notice that that the delegate downloaded as part of https://github.com/TexasInstruments/edgeai-tidl-tools/releases/download/08_01_00_09-rc1/tidl_tools.tar.gz via the setup.sh script is only build for x86-64.

root@j7-evm:~/edgeai-tidl-tools/tidl_tools# file libtidl_tfl_delegate.so
libtidl_tfl_delegate.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), statically linked, BuildID[sha1]=e2f3e97758f967b8611dcd34fd926d4818aad955, not stripped

How can I use a TI tensorflow lite delegate to use C7X DSP ?

over 4 years ago

0 Isharaka Gunasinghe over 4 years ago

Prodigy 35 points

Is it possible for us to build the delegate for C7X DSP from source, if pre-built one is not available ?

0 Manu Mathew over 4 years ago in reply to Isharaka Gunasinghe

TI__Genius 11546 points

Hi Isharaka,

Here are some links:

Hardware (EdgeAI StarterKit):

https://www.ti.com/tool/SK-TDA4VM

Software (EdgeAI StarterKit SDK)

https://www.ti.com/tool/download/PROCESSOR-SDK-LINUX-SK-TDA4VM

The SDK has the software components that you are looking for.

As you noted, the TIDL Tools that you listed is for PC and it is used for model compilation.

The link for TIDL Tools (PC) that you listed is for 8.1 release - however the StarterKit SDK is not yet released for 8. 1 (It will be released in a few days). Currently you can use 8.0 version: https://github.com/TexasInstruments/edgeai-tidl-tools/releases/download/08.00.01.10/tidl_tools.tar.gz

And PC tools for 8.0 version:

https://github.com/TexasInstruments/edgeai-benchmark/blob/master/setup.sh#L66

See the list of PC tools for 8.1 version:

https://github.com/TexasInstruments/edgeai-benchmark/blob/master/setup.sh#L60

Regards,

Manu

0 Isharaka Gunasinghe over 4 years ago in reply to Manu Mathew

Prodigy 35 points

I had a look inside the content of https://github.com/TexasInstruments/edgeai-tidl-tools/releases/download/08.00.01.10/tidl_tools.tar.gz

The tflite delegate in there (libtidl_tfl_delegate.so:) is still the x64 version. My question is where can I find the TI tflite delegate to use on actual hardware (C7x DSP on a Jacinto board)

0 Manu Mathew over 4 years ago in reply to Isharaka Gunasinghe

TI__Genius 11546 points

May be my explanation above was not clear. Tools for inference on the hardware is part of the EdgeAI StarterKit SDK: https://www.ti.com/tool/download/PROCESSOR-SDK-LINUX-SK-TDA4VM

0 Isharaka Gunasinghe over 4 years ago in reply to Manu Mathew

Prodigy 35 points

Thanks.

Processors

Processors forum

TDA4VM: Using Tensorflow Lite delegate