TDA4VM: How can I speed up TIDL operation on the PC emulation mode?

Jinsol Kim

Part Number: TDA4VM

Hi, I'm sol
I'm developing a app on the pc emulation mode.

Env.
- J721E RTOS PSDK 9.1.0.6

The application is running well. but speed is too slow.
Especially, the tidl inference speed is very slow. Is there any way to solve this problem?

For example,

1. Using CUDA for TIDL running.
2. How to use multi core for PC emulation mode

please check and let me know.

Thank you.

over 1 year ago

0 Pratik Kedar over 1 year ago

TI__Mastermind 24041 points

Hi,

Yes you can leverage GPU for better/faster tools, please read more about the same here : https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/advanced_setup.md#docker-based-setup-for-x86_pc

The multicore support of PC emulation is not supported with best of my knowledge, however it uses AVX instructions set for faster execution.

0 Jinsol Kim over 1 year ago in reply to Pratik Kedar

Prodigy 40 points

Thank you, If I use EdgeAI, How much speed does it improve?

0 Pratik Kedar over 1 year ago in reply to Jinsol Kim

TI__Mastermind 24041 points

Could you be more descriptive ? what do you mean by edgeai wrt the host emulation context ?

0 Jinsol Kim over 1 year ago in reply to Pratik Kedar

Prodigy 40 points

Isn't It the guide about Edgeai-tidl-tool?
https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/advanced_setup.md#docker-based-setup-for-x86_pc

So, I'm asking how much performance it would be if I followed the guide.

0 Pratik Kedar over 1 year ago in reply to Jinsol Kim

TI__Mastermind 24041 points

Jinsol Kim said:
Isn't It the guide about Edgeai-tidl-tool?
https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/advanced_setup.md#docker-based-setup-for-x86_pc

Yes, if its about host emulation speed up, then you can leverage the GPU tools as pointed out.

We dont have data that talk about exact percentage improvement at the movement.

Thanks

Processors

Processors forum

TDA4VM: How can I speed up TIDL operation on the PC emulation mode?