AM68A: ViT-B/S support on TIDL 10

Thanks for your question; The development/tool team will provide answer to you soon!

Wen Li

Any updates ?

Hi Wen!

Do you have any updates ? I've been waiting for it for over 9 months.
e2e.ti.com/.../am68a-vit-b-s-support-on-tidl-9-2

Hi Wen!

Is any progress on it ?

In TIDL10.0, we have verified the following transformer models:

swin_tiny_patch4_window7_224

levit_128_224

deit_tiny_patch16_224

segformer_b0_finetuned_ade_512_512

We shall be publishing more details and expected inference times of these in a few days in our Model Selection Tool. 

Thanks.

In TIDL10.1, specifically in tidl-tools version corresponding to (https://github.com/TexasInstruments/edgeai-tidl-tools tag:  10_01_04_00) we have verified the following transformer models:

swin_tiny_patch4_window7_224

levit_128_224

deit_tiny_patch16_224

segformer_b0_finetuned_ade_512_512

We shall be publishing more details and expected inference times of these in a few days in our Model Selection Tool. 

Note the above edgeai-tidl-tools tag is not compatible with the firmware included in SDK 10.1 release and you need to do firmware update as explained in: github.com/.../update_target.md

Thanks.

Hi, thanks a lot for link about current models.

I'm mostly interested in ViT-S models, in particular DINO/DINOv2. Is it on the roadmap ?

Also, I've checked DETR in Model Selection tool and it has NaN values for Latency and FPS

We are investigating an accuracy issue that was with DETR. 

ViT-Base is also another model being investigated. We shall try to investigate ViT-S as well.