TDA4VM: 6_02 release issues, deploying the network on target

Hafiz Muhammad Owais

Part Number: TDA4VM

Hi TI,

I have recently moved my sdk from 6.01 to 6.02 release of PSDKRA. I have seen that the TIDL is utilizing the L1, L2 memory this time, so I had to re-import my network for this release.Following the same procedure, I have done importation, inference and then deployment on target. I am facing following issues which I would like to share with you to have your feedback on this matter.

1. In 6.01, I ran my network on target with almost 60 fps with image size (1024x512) and with better results. However, currently, in 6.02, it is running at 49 fps with the same image size and get stuck sometimes. I wonder what are the significant changes done in this release within TIDL and AVP Project. as I am currently utilizing them. Moverover, the image is cropped at the output which wasn't the case in 6.02.

2. For 6.02 release, I had to upgrade my system to 18.04 due the GLIB version isn't supported for the TIDL, if there is a way to run the import tool on 16.04, I would also like to know. Thank you.

With best regards,

H.M. Owais

over 5 years ago

0 kumar.desappan over 5 years ago

TI__Mastermind 22145 points

Follow the steps available here to get layer level performance and compare betweentwo releases and let us the layer at which you are observing the big difference.

http://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/latest/exports/docs/tidl_j7_01_01_00_10/ti_dl/docs/user_guide_html/md_tidl_fsg_steps_to_debug_mismatch.html#did_tidl_Analyse_perf_intro

We do not support 16.04 for TIDL tools. Please sue 18.04

0 Hafiz Muhammad Owais over 5 years ago in reply to kumar.desappan

Expert 1065 points

Hi Kumar,

I have tried debugging it by enabling the performance traces, i.e. enableLayerPerfTraces = 1 and debugTraceLevel = 1, however, it is not generating any results and layers performances are 0s. I have also check the debugTraceLevel = 2 and it seems that there is no problem in the layers.I have attached both the logs.

Fullscreen enableperftraces.txt Download

./PC_dsp_test_dl_algo.out testvecs/config/config_list.txt 

Processing config file #0 : testvecs/config/infer/public/caffe/tidl_infer_jSegNet21v2_9classes_1024.txt 

 Instance created for  testvecs/config/infer/public/caffe/tidl_infer_jSegNet21v2_9classes_1024.txt
 ----------------------- TIDL Process with REF_ONLY FLOW ------------------------

#    0 . ..
Network Cycles 0 
 Layer,   Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles, paddingTrigger,    paddingWait,LayerWithoutPad,LayerHandleCopy,   BackupCycles,  RestoreCycles,
     1,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     2,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     3,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     4,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     5,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     6,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     7,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     8,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
     9,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    10,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    11,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    12,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    13,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    14,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    15,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    16,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    17,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    18,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    19,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    20,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    21,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    22,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    23,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    24,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    25,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
    26,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,
 T    7992.92  ... .... .....

Fullscreen debugTraceLevel.txt Download

Processing config file #0 : testvecs/config/infer/public/caffe/tidl_infer_jSegNet21v2_9classes_1024.txt 
     2902848,      2.768 0x7f5ae8a1b010
Alg Alloc for Layer # -    0
Alg Alloc for Layer # -    1
Alg Alloc for Layer # -    2
Alg Alloc for Layer # -    3
Alg Alloc for Layer # -    4
Alg Alloc for Layer # -    5
Alg Alloc for Layer # -    6
Alg Alloc for Layer # -    7
Alg Alloc for Layer # -    8
Alg Alloc for Layer # -    9
Alg Alloc for Layer # -   10
Alg Alloc for Layer # -   11
Alg Alloc for Layer # -   12
Alg Alloc for Layer # -   13
Alg Alloc for Layer # -   14
Alg Alloc for Layer # -   15
Alg Alloc for Layer # -   16
Alg Alloc for Layer # -   17
Alg Alloc for Layer # -   18
Alg Alloc for Layer # -   19
Alg Alloc for Layer # -   20
Alg Alloc for Layer # -   21
Alg Alloc for Layer # -   22
Alg Alloc for Layer # -   23
Alg Alloc for Layer # -   24
Alg Alloc for Layer # -   25
Alg Alloc for Layer # -   26
Alg Alloc for Layer # -   27
Num,    Space,     SizeinBytes,   SineInMB
   0,    17,         2824,      0.003 0x55a28ce2d420
   1,    17,          128,      0.000 0x55a28ce0b460
   2,    17,        16384,      0.016 0x7f5ae8ce0080
   3,    17,       458752,      0.438 0x7f5ae8ce4080
   4,    17,      8159232,      7.781 0x7f5ae8d54080
   5,    17,       195132,      0.186 0x7f5b4b100010
   6,    17,          256,      0.000 0x7f5ae951c080
   7,    17,      6466304,      6.167 0x7f5ae951c180
   8,    17,    101844992,     97.127 0x7f5ae9b46c80
   9,    17,     40433664,     38.561 0x7f5aefc67480
  10,    17,      4788480,      4.567 0x7f5ae8589010
  11,    17,       365136,      0.348 0x7f5b4b0a6010
  12,    17,          256,      0.000 0x7f5af22f6c80
Total External Memory (DDR) Size =    162731540,    155.193 
Alg Init for Layer # -    0
Alg Init for Layer # -    1
Alg Init for Layer # -    2
Alg Init for Layer # -    3
Alg Init for Layer # -    4
Alg Init for Layer # -    5
Alg Init for Layer # -    6
Alg Init for Layer # -    7
Alg Init for Layer # -    8
Alg Init for Layer # -    9
Alg Init for Layer # -   10
Alg Init for Layer # -   11
Alg Init for Layer # -   12
Alg Init for Layer # -   13
Alg Init for Layer # -   14
Alg Init for Layer # -   15
Alg Init for Layer # -   16
Alg Init for Layer # -   17
Alg Init for Layer # -   18
Alg Init for Layer # -   19
Alg Init for Layer # -   20
Alg Init for Layer # -   21
Alg Init for Layer # -   22
Alg Init for Layer # -   23
Alg Init for Layer # -   24
Alg Init for Layer # -   25
Alg Init for Layer # -   26
Alg Init for Layer # -   27

 Instance created for  testvecs/config/infer/public/caffe/tidl_infer_jSegNet21v2_9classes_1024.txt

Processing Cnt :    0, InstCnt :    0 testvecs/config/tidl_models/caffe/9classes_1024/tidl_net_jSegNet21v2_1024x512.bin!
     3182652,      3.035 0x7f5ae827f010
     1073152,      1.023 0x7f5ae8178010
 ----------------------- TIDL Process with REF_ONLY FLOW ------------------------

#    0testvecs/config/fish_eye_test_png/0_000001.png
 . ..Starting Layer # -    1 
Processing Layer # -    1
End of Layer # -    1
Starting Layer # -    2 
Processing Layer # -    2
End of Layer # -    2
Starting Layer # -    3 
Processing Layer # -    3
End of Layer # -    3
Starting Layer # -    4 
Processing Layer # -    4
End of Layer # -    4
Starting Layer # -    5 
Processing Layer # -    5
End of Layer # -    5
Starting Layer # -    6 
Processing Layer # -    6
End of Layer # -    6
Starting Layer # -    7 
Processing Layer # -    7
End of Layer # -    7
Starting Layer # -    8 
Processing Layer # -    8
End of Layer # -    8
Starting Layer # -    9 
Processing Layer # -    9
End of Layer # -    9
Starting Layer # -   10 
Processing Layer # -   10
End of Layer # -   10
Starting Layer # -   11 
Processing Layer # -   11
End of Layer # -   11
Starting Layer # -   12 
Processing Layer # -   12
End of Layer # -   12
Starting Layer # -   13 
Processing Layer # -   13
End of Layer # -   13
Starting Layer # -   14 
Processing Layer # -   14
End of Layer # -   14
Starting Layer # -   15 
Processing Layer # -   15
End of Layer # -   15
Starting Layer # -   16 
Processing Layer # -   16
End of Layer # -   16
Starting Layer # -   17 
Processing Layer # -   17
End of Layer # -   17
Starting Layer # -   18 
Processing Layer # -   18
End of Layer # -   18
Starting Layer # -   19 
Processing Layer # -   19
End of Layer # -   19
Starting Layer # -   20 
Processing Layer # -   20
End of Layer # -   20
Starting Layer # -   21 
Processing Layer # -   21
End of Layer # -   21
Starting Layer # -   22 
Processing Layer # -   22
End of Layer # -   22
Starting Layer # -   23 
Processing Layer # -   23
End of Layer # -   23
Starting Layer # -   24 
Processing Layer # -   24
End of Layer # -   24
Starting Layer # -   25 
Processing Layer # -   25
End of Layer # -   25
Starting Layer # -   26 
Processing Layer # -   26
End of Layer # -   26
 T    8930.97  ...testvecs/config/fish_eye_test_png/0_000001.png
testvecs/config/fish_eye_test_png/0_000001.png
 .... .....

0 kumar.desappan over 5 years ago in reply to Hafiz Muhammad Owais

TI__Mastermind 22145 points

performance traces are applicable to TARGET mode - That is on EVM only

0 Hafiz Muhammad Owais over 5 years ago in reply to kumar.desappan

Expert 1065 points

Hi Kumar,

Thank you for your reply, meanwhile, I like to add something that I have just checked the latest release supported networks and layers. My network is same as JsegNet, only difference is that I don't have the pool4. So I believe it should be fully supported and optimized on the target.

With best regards,

H.M. Owais

0 kumar.desappan over 5 years ago in reply to Hafiz Muhammad Owais

TI__Mastermind 22145 points

Yes. Your network shall be supported

Processors

Processors forum

TDA4VM: 6_02 release issues, deploying the network on target