SK-AM62A-LP: TIDL Tool

Part Number: SK-AM62A-LP

Tool/software:

Hello TI Dev,

Recently, I have found a thread related to EdgeAI Tool. https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1544678/faq-edge-ai-studio-tidl-rtos-tool-vs-edgeai-tidl-tools?tisearch=e2e-sitesearch&keymatch=tidl%20tool%20saturation%20output#

The author in this thread mentioned a relevant topic on EdgeAI Tool and TIDL RTOS. 
Could you please elaborate me on this thread regarding its purpose?

Best Regards,
Key

  • Hi Key,

    I think there is some confusion on the meaning of 'RT' in that FAQ from one of our field applications engineers. The RT in TIDL_RT stands for RunTime, not RTOS. 

    TIDL RT is a lower-level interface for compiling and running models. Like open source runtime (OSRT), it is a way an interface from PC/Arm-A core to leverage the TIDL acceleration.

    TIDL-RT import and inference are usually done using a series of TXT config files, whereas OSRT with python shall instead use a python-dictionary of similar options alongside the OSRT (e.g. ONNX) function arguments.  

    We strongly recommend using the OSRT-python approach for import/compilation. For runtime, OSRT is also generally recommended using CPP interface and shared-memory buffers. OSRT is only valid for Linux-based systems, by the way. For other OS like QNX, it is recommended to use the TIDL node in TIOVX.

    BR,
    Reese