AM68A: ViT-B/S support on TIDL 9.2

Hi,

Due to a holiday, half of our team is currently out of the office. Please expect a 1~2 delay in responses.

Apologies for the delay, and thank you for your patience.

-Fabiana

Hi,

We have only validated DeiT and DETR models end to end using timm based lib

And we support different transformer modules like attention, patch enabling etc and Window shifting and patch merging specific to SWIN.

I recommend to do diligence of TIs transformer support here : https://github.com/TexasInstruments/edgeai-tidl-tools/blob/09_02_06_00/docs/tidl_fsg_vtfr.md

Thank You

Is there any intention for ViT ? And what are the latencies for DETR?

Hi Roman,

Roman Milishchuk said:

Is there any intention for ViT ?

You can find the roadmap of our transformer model support here : https://github.com/TexasInstruments/edgeai-tidl-tools/blob/09_02_06_00/docs/tidl_fsg_vtfr.md

Roman Milishchuk said:

And what are the latencies for DETR?

Do you mean benchmark ? 

Pratik Kedar said:

Do you mean benchmark ? 

Yes, I would like to know which fps I should expect in a real-time system (typical time of inference) Also, accuracy degradation due to quantization would be great.