This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

RTOS/TDA2EXEVM: TIDL performance

Part Number: TDA2EXEVM

Tool/software: TI-RTOS

Hi:

     I runned TIDL file I/O case and Semantic Segmentation case,I press "P" to check performance numbers ,

"Local Link Latency     : Avg = 1267175 us, Min = 1265815 us, Max = 1268133 us, "

Is the "Local Link Latency " present the DL model NET running time ? Or how can I see a DL model's running time ?

the semantic segmentation runing log is below:

[IPU1-0]     41.461080 s:  ### CPU [  EVE1], LinkID [ 49],
[IPU1-0]     41.461172 s:  
[IPU1-0]     41.461202 s:  [ ALG_TIDL ] Link Statistics,
[IPU1-0]     41.461263 s:  ******************************
[IPU1-0]     41.461385 s:  
[IPU1-0]     41.461416 s:  Elapsed time       = 11026 msec
[IPU1-0]     41.461507 s:  
[IPU1-0]     41.461568 s:  New data Recv      =   0.81 fps
[IPU1-0]     41.461660 s:  
[IPU1-0]     41.461690 s:  Input Statistics,
[IPU1-0]     41.461751 s:  
[IPU1-0]     41.461782 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]     41.461843 s:     | FPS     | FPS     | FPS          | FPS        
[IPU1-0]     41.461934 s:  --------------------------------------------------
[IPU1-0]     41.461995 s:   0 |   0.81      0. 0      0. 0           0.72
[IPU1-0]     41.462148 s:  
[IPU1-0]     41.462178 s:  Output Statistics,
[IPU1-0]     41.462209 s:  
[IPU1-0]     41.462270 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]     41.462331 s:     | ID  | FPS     | FPS      | FPS           
[IPU1-0]     41.462392 s:  ---------------------------------------------
[IPU1-0]     41.462483 s:   0 |  0      0.72     0. 0      0. 0
[IPU1-0]     41.462605 s:  
[IPU1-0]     41.462666 s:  [ ALG_TIDL ] LATENCY,
[IPU1-0]     41.462727 s:  ********************
[IPU1-0]     41.462758 s:  Local Link Latency     : Avg = 1267175 us, Min = 1265815 us, Max = 1268133 us,
[IPU1-0]     41.462880 s:  Source to Link Latency : Avg = 3547970 us, Min = 1297810 us, Max = 4909382 us,
[IPU1-0]     41.463002 s:  
[IPU1-0]     41.463094 s:  
[IPU1-0]     41.463155 s:  ### CPU [  EVE1], LinkID [  0],
[IPU1-0]     41.463216 s:  
[IPU1-0]     41.463246 s:  [ IPC_OUT_0 ] Link Statistics,
[IPU1-0]     41.463307 s:  ******************************
[IPU1-0]     41.463368 s:  
[IPU1-0]     41.463429 s:  Elapsed time       = 9762 msec
[IPU1-0]     41.463490 s:  
[IPU1-0]     41.463551 s:  New data Recv      =   0.81 fps
[IPU1-0]     41.463643 s:  Release data Recv  =   0.71 fps
[IPU1-0]     41.463704 s:  Driver/Notify Cb   =  10.85 fps
[IPU1-0]     41.463765 s:  
[IPU1-0]     41.463826 s:  Input Statistics,
[IPU1-0]     41.463856 s:  
[IPU1-0]     41.463887 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]     41.463978 s:     | FPS     | FPS     | FPS          | FPS        
[IPU1-0]     41.464039 s:  --------------------------------------------------
[IPU1-0]     41.464131 s:   0 |   0.81      0. 0      0. 0           0.81
[IPU1-0]     41.464253 s:  
[IPU1-0]     41.464283 s:  Output Statistics,
[IPU1-0]     41.464344 s:  
[IPU1-0]     41.464375 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]     41.464436 s:     | ID  | FPS     | FPS      | FPS           
[IPU1-0]     41.464558 s:  ---------------------------------------------
[IPU1-0]     41.464619 s:   0 |  0      0.81     0. 0      0. 0
[IPU1-0]     41.464741 s:  
[IPU1-0]     41.464771 s:  [ IPC_OUT_0 ] LATENCY,
[IPU1-0]     41.464832 s:  ********************
[IPU1-0]     41.464893 s:  Local Link Latency     : Avg =     22 us, Min =      0 us, Max =     31 us,
[IPU1-0]     41.465015 s:  Source to Link Latency : Avg = 3548461 us, Min = 1298573 us, Max = 4909839 us,
[IPU1-0]     41.465107 s:  
[IPU1-0]     41.964649 s:  
[IPU1-0]     41.964710 s:  ### CPU [  HOST], LinkID [ 12],
[IPU1-0]     41.964802 s:  
[IPU1-0]     41.964832 s:  [ IPC_IN_2 ] Link Statistics,
[IPU1-0]     41.964893 s:  ******************************
[IPU1-0]     41.964954 s:  
[IPU1-0]     41.964985 s:  Elapsed time       = 10262 msec
[IPU1-0]     41.965046 s:  
[IPU1-0]     41.965107 s:  Get Full Buf Cb    =   3.31 fps
[IPU1-0]     41.965168 s:  Put Empty Buf Cb   =   0.87 fps
[IPU1-0]     41.965259 s:  Driver/Notify Cb   =   0.77 fps
[IPU1-0]     41.965320 s:  
[IPU1-0]     41.965351 s:  Input Statistics,
[IPU1-0]     41.965412 s:  
[IPU1-0]     41.965442 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]     41.965747 s:     | FPS     | FPS     | FPS          | FPS        
[IPU1-0]     41.965808 s:  --------------------------------------------------
[IPU1-0]     41.965961 s:   0 |   0.87      0. 0      0. 0           0.87
[IPU1-0]     41.966113 s:  
[IPU1-0]     41.966144 s:  Output Statistics,
[IPU1-0]     41.966205 s:  
[IPU1-0]     41.966235 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]     41.966296 s:     | ID  | FPS     | FPS      | FPS           
[IPU1-0]     41.966388 s:  ---------------------------------------------
[IPU1-0]     41.966449 s:   0 |  0      0.87     0. 0      0. 0
[IPU1-0]     41.966601 s:  
[IPU1-0]     41.966662 s:  [ IPC_IN_2 ] LATENCY,
[IPU1-0]     41.966723 s:  ********************
[IPU1-0]     41.966754 s:  Local Link Latency     : Avg =      6 us, Min =      0 us, Max =     31 us,
[IPU1-0]     41.966876 s:  Source to Link Latency : Avg = 3703836 us, Min = 1298695 us, Max = 4945830 us,
[IPU1-0]     41.966998 s:  
[IPU1-0]     41.967120 s:  
[IPU1-0]     41.967150 s:  ### CPU [  HOST], LinkID [ 50],
[IPU1-0]     41.967242 s:  
[IPU1-0]     41.967272 s:  [ ALG_TIDLPOSTPROC ] Link Statistics,
[IPU1-0]     41.967333 s:  ******************************
[IPU1-0]     41.967394 s:  
[IPU1-0]     41.967425 s:  Elapsed time       = 10265 msec
[IPU1-0]     41.967516 s:  
[IPU1-0]     41.967577 s:  New data Recv      =   3.31 fps
[IPU1-0]     41.967669 s:  
[IPU1-0]     41.967699 s:  Input Statistics,
[IPU1-0]     41.967760 s:  
[IPU1-0]     41.967791 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]     41.967852 s:     | FPS     | FPS     | FPS          | FPS        
[IPU1-0]     41.967943 s:  --------------------------------------------------
[IPU1-0]     41.968004 s:   0 |   3.31      0. 0      0. 0           3.31
[IPU1-0]     41.968157 s:  
[IPU1-0]     41.968187 s:  Output Statistics,
[IPU1-0]     41.968218 s:  
[IPU1-0]     41.968279 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]     41.968340 s:     | ID  | FPS     | FPS      | FPS           
[IPU1-0]     41.968401 s:  ---------------------------------------------
[IPU1-0]     41.968492 s:   0 |  0      3.31     0. 0      0. 0
[IPU1-0]     41.968645 s:  
[IPU1-0]     41.968675 s:  [ ALG_TIDLPOSTPROC ] LATENCY,
[IPU1-0]     41.968736 s:  ********************
[IPU1-0]     41.968797 s:  Local Link Latency     : Avg =    837 us, Min =    823 us, Max =    854 us,
[IPU1-0]     41.968919 s:  Source to Link Latency : Avg = 3621124 us, Min = 1298023 us, Max = 4946684 us,

Best regards

  • Hi,

    I have forwarded your question to TIDL experts.

    Regards,

    Yordan

  • Hi
    Yes. Local Link Latency gives the processing time of Algorithm. 5-10% of this might include some system functions as well.
    below the numbers I got when I run sematic segmentation UC

    [IPU1-0] 97.482126 s: [ ALG_TIDL ] LATENCY,
    [IPU1-0] 97.482187 s: ********************
    [IPU1-0] 97.482248 s: Local Link Latency : Avg = 347296 us, Min = 340206 us, Max = 349417 us,

    please try 'p" 2 times after 1 minutes of run (after demo stabilized).
    The first one may not be correct always due to some of the counters are initialized to 0 in the begining.

    regards, Shiju