1. Its not mentioned anywhere to use OSRT in TIDL-RTs user guide or any other documentation from TI
2. If i use edgeai tidl tools repos, i cant use TIDL-RT in that case
3. I have developed Custom Operator, i cant take advantage for TIDL-RT or OSRT for this.
4. I have model that can be fully offloaded to DSP, but TIDL-RT cant be used to optimally run this.
Myth 1:
1. Its not mentioned anywhere to use OSRT in TIDL-RTs user guide or any other documentation from TI
No, we have documented this in our TIDL-RT user guide documentation !
See below in our documentation (for J721S2/AM68A) and you will see in the same in our documentation across devices (J721E, J784S4)
https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-j721s2/08_04_00_06/exports/docs/tidl_j721s2_08_04_00_16/ti_dl/docs/user_guide_html/index.html (even in 8.4 release ! )
Myth 2:
2. If i use edgeai tidl tools repos, i cant use TIDL-RT in that case
Big No, this is biggest confusion !
Edge AI TIDL Tools are mainly to provide a simple python based interface for compilation stage, After compilation stage, one can use OSRT or TIDL-RT either one of the run time. See below the TIDL-RT documentation which provides reference to Edge AI TIDL tools for compilation stage
Myth 3:
3. I have developed Custom Operator, i cant take advantage for TIDL-RT or OSRT for this.
Yes you can use TIDL-RT or OSRT, we are not sure from where this confusion is coming but hope this adds clarity to it.
Myth 4:
4. I have model that can be fully offloaded to DSP, but TIDL-RT cant be used to optimally run this.
We do have example,
One can check out object classification example tidl-rt cpp code base here : https://github.com/TexasInstruments/edgeai-tidl-tools/tree/master/examples/tidlrt_cpp
