• State
  • Replies 18 replies
  • Subscribers 99 subscribers
  • Views 275 views
  • Users 0 members are here
Support feedback
Options
Options
Related

TDA4VH-Q1: TIDL Compilation Freezes Depending on Image Size

Olof Lissmats
Prodigy 30 points
Part Number: TDA4VH-Q1
Other Parts Discussed in Thread: TDA4VH, AM69A

Tool/software:

Hello!

I am trying to deploy a model on the TDA4VH card using release 11_00_08_00 of edgeai-tidl-tools. However, the compilation script freezes without outputting any information to the terminal. If I use images of half width and half height of what is intended, it compiles. It also compiles if I put the Add, Mul and Softmax nodes in the deny_list, but this would render the model too slow.

Attached, you find the following files:

  • model.onnx: The subdivision of the model to which the cause of the error has been isolated.
  • downscaled_model.onnx: The same subdivision of the model, but when using downscaled images. 
  • model_configs.py: The options used when compiling the model.
  • onnxrt_ep.py: The script used to compile the model - a modified version of your script.
  • log.txt: What the script outputs to the terminal up until the point where it freezes (using debug_level 6 and export TIDLRT_DEBUG=1).

I have managed to isolate the problem to the attached part of the model, as everything compiles and runs as expected up until, and after, this part.  To reproduce the error, first set up edgeai-tidl-tools version 11_00_08_00, then insert the attached files as follows:

  • model_configs.py -> edgeai-tidl-tools/examples/osrt_python/model_configs.py,
  • onnxrt_ep.py -> edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep.py,
  • model.onnx -> edgeai-tidl-tools/examples/osrt_python/ort/model.onnx,
  • downscaled_model.onnx -> edgeai-tidl-tools/examples/osrt_python/ort/downscaled_model.onnx.

Then, run python3 onnxrt_ep.py -c -m model while standing at edgeai-tidl-tools/examples/osrt_python/ort/.  To run the example with downscaled images, rename downscaled_model.onnx to model.onnx.

Since the model compiles when decreasing the image size or offloading fewer nodes to the DSP, we suspect that there could be some memory constraints for the DSPs that are causing the problem, but we don't have the expertise to investigate that idea. Maybe you could help us, or point us in another direction? Let us know if you need any additional information, and we will provide it to the best of our ability.

Best regards

Olof

downscaled_model.zip, onnxrt_ep.zip, model_configs.zip, 1033.model.zip, 3000.log.zip

  • 0
    TI__Genius 14500 points

    Hi Olof,

    Preliminary analysis of this model indicates many of the layers are not supported by TIDL.  Meaning they will run on the ARM core.  This is much slower.  Also, the input data is a bit strange.  Normal image input data is 3xHxW.   This model's inputs are 92x24x32 but are still "images".  Is this correct?  

    -------------------------------------------------------------------------------
    | Core | No. of Nodes | Number of Subgraphs |
    -------------------------------------------------------------------------------
    | C7x | 45 | 5 |
    | CPU | 37 | x |
    -------------------------------------------------------------------------------

    The above output reports 37 layers are not supported and they result in 5 subgraphs.  This means a context switch each time from C7x to ARM.  I will look into this some more but if we get this model to work, it will not run very fast.   

    Regards,

    Chris

  • 0 in reply to Chris Tsongas
    Prodigy 30 points

    That is strange. As you can see in log.txt, this is what I see when I run:

    -------------------------------------------------------------------------------
    |          Core           |      No. of Nodes       |   Number of Subgraphs   |
    -------------------------------------------------------------------------------
    | C7x                     |                      67 |                       1 |
    | CPU                     |                       0 |                       x |
    -------------------------------------------------------------------------------

    That is 67 nodes, all of which are listed as supported.

    You are correct in that the inputs to this model are not images. Instead, they are features extracted from images. The reason for that is that I isolated the problem to this part of the graph. To give you an easier time debugging, I only provided you with the part that provokes the freezing. Everything before and after this part works.

  • 0 in reply to Olof Lissmats
    TI__Genius 14500 points

    Hi Olof,

    I got it to compile with your script.  I usually do not like to use modified scripts and stick to the standard TIDL tools, but in this case it worked.  I was able to compile and run model.onnx inside a Docker Ubuntu 22.04 image with following TIDL version info:

    | TIDL Tools Version | 11_00_08_00 |
    -------------------------------------------------------------------------------
    | C7x Firmware Version | 11_00_08_00 |
    -------------------------------------------------------------------------------
    | Runtime Version | 1.15.0 |
    -------------------------------------------------------------------------------
    | Model Opset Version | 18 |
    -------------------------------------------------------------------------------

    I think model.onnx is the one you had a problem with.  Is that correct?  The md5sum of the model that successfully ran is:

    4c45697d0d9949a547cfe918131fc4de  ../../../model.onnx

    I have attached the compile and run logs.  I do not think the images sizes were altered but it appears to run.  Run/Compile logs attached.

    Regards,

    Chris

  • 0 in reply to Chris Tsongas
    Prodigy 30 points

    Thank you for trying it out!

    It is indeed model.onnx that causes problems. I get the same md5sum on my side.

    Since it ran for you, I tried reinstalling the dockers, both with and without GPU, and it does in fact compile. However, it takes about an hour in both cases, which is strange since we only have one calibration iteration. How long did it take for you? In any case, it still doesn't run on the TDA4VH card.

  • 0 in reply to Olof Lissmats
    TI__Genius 14500 points

    Hi Olof,

    Took care of the name thing.  Thought this was a private forum for you but it is not.  I have never gotten TIDL to work with GPU and many have tried so if it is actually going to the GPU, congratulations to you.  I run on an Ubunut 22.04 in CPU mode only and your model takes about 2-3 minutes to compile, not an hour.  So something else is up.  Can you try on CPU only and see it that makes a difference?

    I will try. out the artifacts on an AM69A (same processor as TDA4VH) and send you an update.

    Regards,

    Chris

  • 0 in reply to Chris Tsongas
    Prodigy 30 points

    Hi again Chris, and thanks thus far!

    Once more, I have tried reinstalling the docker, following the instructions as far as possible. That means setting SOC to am69a, leaving the rest of the variables unset, cloning the repo, switching branch to 11_00_08_00 and then executing the subsequent commands as indicated (except for exporting PROXY and REPO_LOCATION). Is this the same procedure as yours? In any case, I still don't see any difference, despite using only CPU. The model takes an hour to compile and doesn't seem to run on the card.

    Did you manage to run the model on the AM69A? If so, could you share the artifacts that are necessary to run the model? Maybe there are some clues to find by comparing them to mine.

    2425.artifacts.zip

  • 0 in reply to Olof Lissmats
    TI__Genius 14500 points

    Hi Olof,

    Are you trying to use a GPU?  I ask because that because I do not think using GPU works right or all the stars need to be aligned. Can you please try to compile on CPU only?  My compile takes less than 5 min on an Ubuntu 22.04 machine that is not very impressive.  An hour implies something went wrong.

    Regards,

    Chris 

  • 0 in reply to Chris Tsongas
    TI__Genius 14500 points

    BTW I am am69a-less for a few hours right now as I am letting someone use my board today, so I cannot test yet.

    Chris

  • 0 in reply to Chris Tsongas
    Prodigy 30 points

    Good morning!

    I am using CPU only. I didn't set the TIDL_TOOLS_TYPE flag, which should make the tools default to CPU, and nvtop doesn't report any GPU usage during compilation.

    Let me know when you have had the opportunity to test your artifacts on the board!

    Olof

  • 0 in reply to Olof Lissmats
    Prodigy 30 points

    Hi again !

    Have you had any success yet?

    Olof

  • 0 in reply to Olof Lissmats
    TI__Expert 5180 points

    Hi Olof,

    Chris is a bit busy due to bandwidth so I will be assisting. Please give me some time to test it out and get the artifacts for the board running. I will send an update on my status latest Friday.

    Thank you,

    Christina

  • 0 in reply to Christina Kuruvilla
    Prodigy 30 points

    Hello Christina!

    Thanks for the heads-up!

    Olof

  • 0 in reply to Olof Lissmats
    TI__Expert 5180 points

    Hi Olof,

    Could you share the hang or error that you get on the device? I believe I have been able to recreate it but need to compare. 

    Also, in terms of compiling, my compilation took about 23 minutes. My Ubuntu 22.04 machine is not as fast as Chris' so I expected a lower number. The 1 hour compilation may also be due to your setup. 

    I am going to try to recreate the issue using our alternative flow (TIDLRT) instead of OSRT(which is what is seen on the Github), and see if this might just be an OSRT behavior. 

    Warm regards,

    Christina

  • 0 in reply to Christina Kuruvilla
    Prodigy 30 points

    Hello!

    I have attached a file containing the output observed on the device after an inference time of 64 hours, but within a few seconds we had already observed all output. It might be misleading to call it inference time as the model seems to have frozen before the inference actually started. The model was run with debug_level=6 and TIDLRT_DEBUG=1.

    It appears that we have found a partial explanation for the long compilation time. When a compilation fails, the process don't terminate as it should. Instead we have to kill it with Control+C. Apparently this doesn't kill the process either, but instead it continues in the background, hogging resources. After properly killing the processes, the compilation time goes down, but it is still unproportionally long.

    Regards 

    Olof

    Fullscreen output_card.txt Download 
    root@j784s4-evm:~/edgeai-tidl-tools/examples/osrt_python/ort# python3 onnxrt_ep.py -m model
Available execution providers :  ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']

Running 1 Models - ['model']


Running_Model :  model  

libtidl_onnxrt_EP loaded 0x40503cf0 
artifacts_folder                                = artifacts 
debug_level                                     = 6 
target_priority                                 = 0 
max_pre_empt_delay                              = 340282346638528859811704183484516925440.000000 
Final number of subgraphs created are : 1, - Offloaded Nodes - 67, Total Nodes - 67 
In TIDL_createStateInfer 
Compute on node : TIDLExecutionProvider_TIDL_0_0
************ in TIDL_subgraphRtCreate ************ 
 APP: Init ... !!!
  8278.095397 s: MEM: Init ... !!!
  8278.095445 s: MEM: Initialized DMA HEAP (fd=5) !!!
  8278.095592 s: MEM: Init ... Done !!!
  8278.095616 s: IPC: Init ... !!!
  8278.126923 s: IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  8278.134860 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  8278.134987 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
  8278.134997 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
  8278.135004 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
  8278.135527 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-0 
  8278.135672 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-1 
  8278.135781 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-2 
  8278.135868 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-3 
  8278.135881 s:  VX_ZONE_INFO: [tivxInitLocal:202] Initialization Done !!!
  8278.135908 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
RT-Profile: TIDLRT_init_profiling 
tidlrt_create            :      162570575 ns,
tidl_rt_ovx_Init         :       43178955 ns,
vxCreateContext          :        1005675 ns,
init_tidl_tiovx          :       11556045 ns,
create_graph_tidl_tiovx  :         829625 ns,
verify_graph_tidl_tiovx  :      104478300 ns,
tivxTIDLLoadKernels      :          18680 ns,
mapConfig                :        1150250 ns,
tivxAddKernelTIDL        :         100625 ns,
mapNetwork               :        9736675 ns,
setCreateParams          :         258260 ns,
setArgs                  :         289520 ns,
vxCreateUserDataObject   :       10312795 ns,
vxMapUserDataObject      :        6222730 ns,
memcopy_network_buffer   :        3475860 ns,
vxUnmapUserDataObject    :           4655 ns,
************ TIDL_subgraphRtCreate done ************ 
 *******   In TIDL_subgraphRtInvoke  ********

  • 0 in reply to Olof Lissmats
    TI__Expert 5180 points

    Hi Olof,

    Today is a US Holiday, so please expect a response from me tomorrow. 

    Thank you for your patience.

    Warm regards,

    Christina

  • 0 in reply to Christina Kuruvilla
    TI__Expert 5180 points

    Hi Olof,

    The Ctrl+C is actually a known error (Jira TIDL-7842) and has a potential fix in the next release. For the parameters you shared, have you ran the model with  debug_level=0 and no TIDLRT_DEBUG set?

    Warm regards,

    Christina

  • 0 in reply to Christina Kuruvilla
    Prodigy 30 points

    Hi again!

    So far we have used debug_level=6 and TIDLRT_DEBUG=1, but now we tried to run the model again on device with debug_level=0 and TIDLRT_DEBUG unset. The model still froze however.

    Olof

  • 0 in reply to Olof Lissmats
    TI__Genius 14500 points

    Hi Olof,

    I'm back on this.  I re-ran this again to level set.   I timed the compile on my machine, and it took 808 seconds.   A bit long, but not in the hour range.  Inference was quick. When trying not to hang the model, turning up the debug level will make things worse.    Increasing debug will write to disk, and any IO problems not related to your model will also cause it to hang.  Best to leave them off by default.  Have you tried running the compilation outside of a Docker image or only within a Docker image?

    I have included a compile and inference log with an execution time in the compile log (at the end). To remind me again, since your model runs, where is the issue?  

    Regards,

    Chris

    Fullscreen inference.log Download 
    Available execution providers :  ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']

Running 1 Models - ['model']

libtidl_onnxrt_EP loaded 0x5ff24afd3e50 
artifacts_folder                                = artifacts 
debug_level                                     = 6 
target_priority                                 = 0 
max_pre_empt_delay                              = 340282346638528859811704183484516925440.000000 
Final number of subgraphs created are : 1, - Offloaded Nodes - 67, Total Nodes - 67 
In TIDL_createStateInfer 
Compute on node : TIDLExecutionProvider_TIDL_0_0
************ in TIDL_subgraphRtCreate ************ 
 The soft limit is 10240
The hard limit is 10240
MEM: Init ... !!!
MEM: Init ... Done !!!
 0.0s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
 0.5s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
TIDL_initDebugTraceParams Done 

--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum   , Space               , Attribute   , Alignment   , Size(KBytes), BasePtr     
0           , DDR Cacheable       , Persistent  ,  128, 19.67   , 0x00000000
1           , DDR Cacheable       , Persistent  ,  128, 0.66    , 0x00000000
2           , DDR Cacheable       , Scratch     ,  128, 16.00   , 0x00000000
3           , DDR Cacheable       , Scratch     ,  128, 448.00  , 0x00000000
4           , DDR Cacheable       , Scratch     ,  128, 2944.00 , 0x00000000
5           , DDR Cacheable       , Persistent  ,  128, 282.91  , 0x00000000
6           , DDR Cacheable       , Scratch     ,  128, 24.12   , 0x00000000
7           , DDR Cacheable       , Scratch     ,  128, 3905.25 , 0x00000000
8           , DDR Cacheable       , Scratch     ,  128, 27649.62, 0x00000000
9           , DDR Cacheable       , Scratch     ,  128, 5380.75 , 0x00000000
10          , DDR Cacheable       , Persistent  ,  128, 1439.19 , 0x00000000
11          , DDR Cacheable       , Scratch     ,  128, 4096.25 , 0x00000000
12          , DDR Cacheable       , Persistent  ,  128, 0.12    , 0x00000000
13          , DDR Cacheable       , Persistent  ,  128, 8895.43 , 0x00000000
14          , DDR Cacheable       , Persistent  ,  128, 0.00    , 0x00000000
15          , DDR Cacheable       , Persistent  ,  128, 7248.25 , 0x00000000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 62350.23
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
      To get the actual TIDL memory requirement make sure to run on EVM with 
      debugTraceLevel = 2

--------------------------------------------
TIDL init call from ivision API 

--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum   , Space               , Attribute   , Alignment   , Size(KBytes), BasePtr     
0           , DDR Cacheable       , Persistent  ,  128, 19.67   , 0xb940c000
1           , DDR Cacheable       , Persistent  ,  128, 0.66    , 0xc6068000
2           , DDR Cacheable       , Scratch     ,  128, 16.00   , 0xc3e8d000
3           , DDR Cacheable       , Scratch     ,  128, 448.00  , 0xb638c000
4           , DDR Cacheable       , Scratch     ,  128, 2944.00 , 0x5703b000
5           , DDR Cacheable       , Persistent  ,  128, 282.91  , 0xb6345000
6           , DDR Cacheable       , Scratch     ,  128, 24.12   , 0xb9405000
7           , DDR Cacheable       , Scratch     ,  128, 3905.25 , 0x56c6a000
8           , DDR Cacheable       , Scratch     ,  128, 27649.62, 0x55169000
9           , DDR Cacheable       , Scratch     ,  128, 5380.75 , 0x54c27000
10          , DDR Cacheable       , Persistent  ,  128, 1439.19 , 0xb3895000
11          , DDR Cacheable       , Scratch     ,  128, 4096.25 , 0x54826000
12          , DDR Cacheable       , Persistent  ,  128, 0.12    , 0xc6067000
13          , DDR Cacheable       , Persistent  ,  128, 8895.43 , 0x53f76000
14          , DDR Cacheable       , Persistent  ,  128, 0.00    , 0xc6066000
15          , DDR Cacheable       , Persistent  ,  128, 7248.25 , 0x53861000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 62350.23
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
      To get the actual TIDL memory requirement make sure to run on EVM with 
      debugTraceLevel = 2

--------------------------------------------
Alg Init for Layer # -   36
Alg Init for Layer # -   38
Alg Init for Layer # -   40
Alg Init for Layer # -   37
Alg Init for Layer # -   39
Alg Init for Layer # -   41
Alg Init for Layer # -   42
Alg Init for Layer # -   44
Alg Init for Layer # -    2
Alg Init for Layer # -   47
Alg Init for Layer # -    3
Alg Init for Layer # -   50
Alg Init for Layer # -   53
Alg Init for Layer # -   45
Alg Init for Layer # -    8
Alg Init for Layer # -   48
Alg Init for Layer # -    9
Alg Init for Layer # -   51
Alg Init for Layer # -   54
Alg Init for Layer # -   43
Alg Init for Layer # -   46
Alg Init for Layer # -    4
Alg Init for Layer # -   49
Alg Init for Layer # -    5
Alg Init for Layer # -   52
Alg Init for Layer # -   55
Alg Init for Layer # -   56
Alg Init for Layer # -    6
Alg Init for Layer # -   57
Alg Init for Layer # -    7
Alg Init for Layer # -   58
Alg Init for Layer # -   59
Alg Init for Layer # -   60
Alg Init for Layer # -   61
Alg Init for Layer # -   62
Alg Init for Layer # -   10
Alg Init for Layer # -   63
Alg Init for Layer # -   11
Alg Init for Layer # -   64
Alg Init for Layer # -   65
Alg Init for Layer # -   66
Alg Init for Layer # -   27
Alg Init for Layer # -   67
Alg Init for Layer # -   26
Alg Init for Layer # -   68
Alg Init for Layer # -   69
Alg Init for Layer # -   70
Alg Init for Layer # -   12
Alg Init for Layer # -   71
Alg Init for Layer # -   72
Alg Init for Layer # -   73
Alg Init for Layer # -   74
Alg Init for Layer # -   13
Alg Init for Layer # -   75
Alg Init for Layer # -   76
Alg Init for Layer # -   77
Alg Init for Layer # -   29
Alg Init for Layer # -   78
Alg Init for Layer # -   28
Alg Init for Layer # -   79
Alg Init for Layer # -   80
Alg Init for Layer # -   81
Alg Init for Layer # -   82
Alg Init for Layer # -   84
Alg Init for Layer # -   87
Alg Init for Layer # -   20
Alg Init for Layer # -   90
Alg Init for Layer # -   21
Alg Init for Layer # -   93
Alg Init for Layer # -   95
Alg Init for Layer # -   86
Alg Init for Layer # -   14
Alg Init for Layer # -   89
Alg Init for Layer # -   15
Alg Init for Layer # -   92
Alg Init for Layer # -   94
Alg Init for Layer # -   83
Alg Init for Layer # -   16
Alg Init for Layer # -   85
Alg Init for Layer # -   17
Alg Init for Layer # -   88
Alg Init for Layer # -   91
Alg Init for Layer # -   96
Alg Init for Layer # -   18
Alg Init for Layer # -   97
Alg Init for Layer # -   19
Alg Init for Layer # -   98
Alg Init for Layer # -   99
Alg Init for Layer # -  100
Alg Init for Layer # -  101
Alg Init for Layer # -  102
Alg Init for Layer # -   22
Alg Init for Layer # -  103
Alg Init for Layer # -   23
Alg Init for Layer # -  104
Alg Init for Layer # -  105
Alg Init for Layer # -  106
Alg Init for Layer # -   31
Alg Init for Layer # -  107
Alg Init for Layer # -   30
Alg Init for Layer # -  108
Alg Init for Layer # -  109
Alg Init for Layer # -  110
Alg Init for Layer # -   24
Alg Init for Layer # -  111
Alg Init for Layer # -  112
Alg Init for Layer # -  113
Alg Init for Layer # -  114
Alg Init for Layer # -   25
Alg Init for Layer # -  115
Alg Init for Layer # -  116
Alg Init for Layer # -  117
Alg Init for Layer # -   33
Alg Init for Layer # -  118
Alg Init for Layer # -   32
Alg Init for Layer # -  119
Alg Init for Layer # -  120
Alg Init for Layer # -  121
Alg Init for Layer # -   35
Alg Init for Layer # -  122
Alg Init for Layer # -   34
Alg Init for Layer # -  123
Alg Init for Layer # -  124
Alg Init for Layer # -  125
Alg Init for Layer # -  126
Alg Init for Layer # -  127
************ TIDL_subgraphRtCreate done ************ 
 *******   In TIDL_subgraphRtInvoke  ******** 
TIDL_process is started with handle : 0x70f5b940c000 
TIDL_activate is called with handle : 0x70f5b940c000 - Copying handle of size 20144 from 0x70f5b940c000 to 0x70f55730d000 
Coreid 0 Layerid to execute = 36 
Core 0 Alg Process for Layer # -   36, layer type 29
Processing Layer # -   36
Core 0 End of Layer # -   36 with outPtrs[0] = 0x70f55705d800
Coreid 0 Layerid to execute = 38 
Core 0 Alg Process for Layer # -   38, layer type 38
Processing Layer # -   38
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   38 with outPtrs[0] = 0x70f55705d800
Coreid 0 Layerid to execute = 40 
Core 0 Alg Process for Layer # -   40, layer type 41
Processing Layer # -   40
Core 0 End of Layer # -   40 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 37 
Core 0 Alg Process for Layer # -   37, layer type 29
Processing Layer # -   37
Core 0 End of Layer # -   37 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 39 
Core 0 Alg Process for Layer # -   39, layer type 38
Processing Layer # -   39
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   39 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 41 
Core 0 Alg Process for Layer # -   41, layer type 41
Processing Layer # -   41
Core 0 End of Layer # -   41 with outPtrs[0] = 0x70f55705d800
Coreid 0 Layerid to execute = 42 
Core 0 Alg Process for Layer # -   42, layer type 12
Processing Layer # -   42
Core 0 End of Layer # -   42 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 44 
Core 0 Alg Process for Layer # -   44, layer type 38
Processing Layer # -   44
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   44 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 2 
Core 0 Alg Process for Layer # -    2, layer type 39
Coreid 0 Layerid to execute = 47 
Core 0 Alg Process for Layer # -   47, layer type 6
Processing Layer # -   47
Executing reference flow for inner product layer 
Core 0 End of Layer # -   47 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 3 
Core 0 Alg Process for Layer # -    3, layer type 39
Coreid 0 Layerid to execute = 50 
Core 0 Alg Process for Layer # -   50, layer type 5
Processing Layer # -   50
Core 0 End of Layer # -   50 with outPtrs[0] = 0x70f556d7f000
Coreid 0 Layerid to execute = 53 
Core 0 Alg Process for Layer # -   53, layer type 38
Processing Layer # -   53
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   53 with outPtrs[0] = 0x70f556d7f000
Coreid 0 Layerid to execute = 45 
Core 0 Alg Process for Layer # -   45, layer type 38
Processing Layer # -   45
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   45 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 8 
Core 0 Alg Process for Layer # -    8, layer type 39
Coreid 0 Layerid to execute = 48 
Core 0 Alg Process for Layer # -   48, layer type 6
Processing Layer # -   48
Executing reference flow for inner product layer 
Core 0 End of Layer # -   48 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 9 
Core 0 Alg Process for Layer # -    9, layer type 39
Coreid 0 Layerid to execute = 51 
Core 0 Alg Process for Layer # -   51, layer type 5
Processing Layer # -   51
Core 0 End of Layer # -   51 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 54 
Core 0 Alg Process for Layer # -   54, layer type 38
Processing Layer # -   54
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   54 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 43 
Core 0 Alg Process for Layer # -   43, layer type 12
Processing Layer # -   43
Core 0 End of Layer # -   43 with outPtrs[0] = 0x70f556d39c00
Coreid 0 Layerid to execute = 46 
Core 0 Alg Process for Layer # -   46, layer type 38
Processing Layer # -   46
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   46 with outPtrs[0] = 0x70f556d39c00
Coreid 0 Layerid to execute = 4 
Core 0 Alg Process for Layer # -    4, layer type 39
Coreid 0 Layerid to execute = 49 
Core 0 Alg Process for Layer # -   49, layer type 6
Processing Layer # -   49
Executing reference flow for inner product layer 
Core 0 End of Layer # -   49 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 5 
Core 0 Alg Process for Layer # -    5, layer type 39
Coreid 0 Layerid to execute = 52 
Core 0 Alg Process for Layer # -   52, layer type 5
Processing Layer # -   52
Core 0 End of Layer # -   52 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 55 
Core 0 Alg Process for Layer # -   55, layer type 38
Processing Layer # -   55
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   55 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 56 
Core 0 Alg Process for Layer # -   56, layer type 6
Processing Layer # -   56
Executing reference flow for inner product layer 
Core 0 End of Layer # -   56 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 6 
Core 0 Alg Process for Layer # -    6, layer type 39
Coreid 0 Layerid to execute = 57 
Core 0 Alg Process for Layer # -   57, layer type 5
Processing Layer # -   57
Core 0 End of Layer # -   57 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 7 
Core 0 Alg Process for Layer # -    7, layer type 39
Coreid 0 Layerid to execute = 58 
Core 0 Alg Process for Layer # -   58, layer type 5
Processing Layer # -   58
Core 0 End of Layer # -   58 with outPtrs[0] = 0x70f556d7f000
Coreid 0 Layerid to execute = 59 
Core 0 Alg Process for Layer # -   59, layer type 41
Processing Layer # -   59
Core 0 End of Layer # -   59 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 60 
Core 0 Alg Process for Layer # -   60, layer type 7
Processing Layer # -   60
Core 0 End of Layer # -   60 with outPtrs[0] = 0x70f556d7f000
Coreid 0 Layerid to execute = 61 
Core 0 Alg Process for Layer # -   61, layer type 6
Processing Layer # -   61
Executing reference flow for inner product layer 
Core 0 End of Layer # -   61 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 62 
Core 0 Alg Process for Layer # -   62, layer type 38
Processing Layer # -   62
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   62 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 10 
Core 0 Alg Process for Layer # -   10, layer type 39
Coreid 0 Layerid to execute = 63 
Core 0 Alg Process for Layer # -   63, layer type 6
Processing Layer # -   63
Executing reference flow for inner product layer 
Core 0 End of Layer # -   63 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 11 
Core 0 Alg Process for Layer # -   11, layer type 39
Coreid 0 Layerid to execute = 64 
Core 0 Alg Process for Layer # -   64, layer type 5
Processing Layer # -   64
Core 0 End of Layer # -   64 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 65 
Core 0 Alg Process for Layer # -   65, layer type 38
Processing Layer # -   65
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   65 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 66 
Core 0 Alg Process for Layer # -   66, layer type 42
Processing Layer # -   66
Core 0 End of Layer # -   66 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 27 
Core 0 Alg Process for Layer # -   27, layer type 39
Coreid 0 Layerid to execute = 67 
Core 0 Alg Process for Layer # -   67, layer type 5
Processing Layer # -   67
Core 0 End of Layer # -   67 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 26 
Core 0 Alg Process for Layer # -   26, layer type 39
Coreid 0 Layerid to execute = 68 
Core 0 Alg Process for Layer # -   68, layer type 5
Processing Layer # -   68
Core 0 End of Layer # -   68 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 69 
Core 0 Alg Process for Layer # -   69, layer type 12
Processing Layer # -   69
Core 0 End of Layer # -   69 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 70 
Core 0 Alg Process for Layer # -   70, layer type 38
Processing Layer # -   70
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   70 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 12 
Core 0 Alg Process for Layer # -   12, layer type 39
Coreid 0 Layerid to execute = 71 
Core 0 Alg Process for Layer # -   71, layer type 6
Processing Layer # -   71
Executing reference flow for inner product layer 
Core 0 End of Layer # -   71 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 72 
Core 0 Alg Process for Layer # -   72, layer type 38
Processing Layer # -   72
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   72 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 73 
Core 0 Alg Process for Layer # -   73, layer type 8
Processing Layer # -   73
Core 0 End of Layer # -   73 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 74 
Core 0 Alg Process for Layer # -   74, layer type 38
Processing Layer # -   74
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   74 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 13 
Core 0 Alg Process for Layer # -   13, layer type 39
Coreid 0 Layerid to execute = 75 
Core 0 Alg Process for Layer # -   75, layer type 6
Processing Layer # -   75
Executing reference flow for inner product layer 
Core 0 End of Layer # -   75 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 76 
Core 0 Alg Process for Layer # -   76, layer type 38
Processing Layer # -   76
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   76 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 77 
Core 0 Alg Process for Layer # -   77, layer type 42
Processing Layer # -   77
Core 0 End of Layer # -   77 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 29 
Core 0 Alg Process for Layer # -   29, layer type 39
Coreid 0 Layerid to execute = 78 
Core 0 Alg Process for Layer # -   78, layer type 5
Processing Layer # -   78
Core 0 End of Layer # -   78 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 28 
Core 0 Alg Process for Layer # -   28, layer type 39
Coreid 0 Layerid to execute = 79 
Core 0 Alg Process for Layer # -   79, layer type 5
Processing Layer # -   79
Core 0 End of Layer # -   79 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 80 
Core 0 Alg Process for Layer # -   80, layer type 5
Processing Layer # -   80
Core 0 End of Layer # -   80 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 81 
Core 0 Alg Process for Layer # -   81, layer type 14
Processing Layer # -   81
Core 0 End of Layer # -   81 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 82 
Core 0 Alg Process for Layer # -   82, layer type 14
Processing Layer # -   82
Core 0 End of Layer # -   82 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 84 
Core 0 Alg Process for Layer # -   84, layer type 12
Processing Layer # -   84
Core 0 End of Layer # -   84 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 87 
Core 0 Alg Process for Layer # -   87, layer type 38
Processing Layer # -   87
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   87 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 20 
Core 0 Alg Process for Layer # -   20, layer type 39
Coreid 0 Layerid to execute = 90 
Core 0 Alg Process for Layer # -   90, layer type 6
Processing Layer # -   90
Executing reference flow for inner product layer 
Core 0 End of Layer # -   90 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 21 
Core 0 Alg Process for Layer # -   21, layer type 39
Coreid 0 Layerid to execute = 93 
Core 0 Alg Process for Layer # -   93, layer type 5
Processing Layer # -   93
Core 0 End of Layer # -   93 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 95 
Core 0 Alg Process for Layer # -   95, layer type 38
Processing Layer # -   95
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   95 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 86 
Core 0 Alg Process for Layer # -   86, layer type 38
Processing Layer # -   86
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   86 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 14 
Core 0 Alg Process for Layer # -   14, layer type 39
Coreid 0 Layerid to execute = 89 
Core 0 Alg Process for Layer # -   89, layer type 6
Processing Layer # -   89
Executing reference flow for inner product layer 
Core 0 End of Layer # -   89 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 15 
Core 0 Alg Process for Layer # -   15, layer type 39
Coreid 0 Layerid to execute = 92 
Core 0 Alg Process for Layer # -   92, layer type 5
Processing Layer # -   92
Core 0 End of Layer # -   92 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 94 
Core 0 Alg Process for Layer # -   94, layer type 38
Processing Layer # -   94
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   94 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 83 
Core 0 Alg Process for Layer # -   83, layer type 38
Processing Layer # -   83
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   83 with outPtrs[0] = 0x70f556cf4800
Coreid 0 Layerid to execute = 16 
Core 0 Alg Process for Layer # -   16, layer type 39
Coreid 0 Layerid to execute = 85 
Core 0 Alg Process for Layer # -   85, layer type 6
Processing Layer # -   85
Executing reference flow for inner product layer 
Core 0 End of Layer # -   85 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 17 
Core 0 Alg Process for Layer # -   17, layer type 39
Coreid 0 Layerid to execute = 88 
Core 0 Alg Process for Layer # -   88, layer type 5
Processing Layer # -   88
Core 0 End of Layer # -   88 with outPtrs[0] = 0x70f55710a080
Coreid 0 Layerid to execute = 91 
Core 0 Alg Process for Layer # -   91, layer type 38
Processing Layer # -   91
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -   91 with outPtrs[0] = 0x70f55710a080
Coreid 0 Layerid to execute = 96 
Core 0 Alg Process for Layer # -   96, layer type 6
Processing Layer # -   96
Executing reference flow for inner product layer 
Core 0 End of Layer # -   96 with outPtrs[0] = 0x70f556d39c00
Coreid 0 Layerid to execute = 18 
Core 0 Alg Process for Layer # -   18, layer type 39
Coreid 0 Layerid to execute = 97 
Core 0 Alg Process for Layer # -   97, layer type 5
Processing Layer # -   97
Core 0 End of Layer # -   97 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 19 
Core 0 Alg Process for Layer # -   19, layer type 39
Coreid 0 Layerid to execute = 98 
Core 0 Alg Process for Layer # -   98, layer type 5
Processing Layer # -   98
Core 0 End of Layer # -   98 with outPtrs[0] = 0x70f556d39c00
Coreid 0 Layerid to execute = 99 
Core 0 Alg Process for Layer # -   99, layer type 41
Processing Layer # -   99
Core 0 End of Layer # -   99 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 100 
Core 0 Alg Process for Layer # -  100, layer type 7
Processing Layer # -  100
Core 0 End of Layer # -  100 with outPtrs[0] = 0x70f556d99c80
Coreid 0 Layerid to execute = 101 
Core 0 Alg Process for Layer # -  101, layer type 6
Processing Layer # -  101
Executing reference flow for inner product layer 
Core 0 End of Layer # -  101 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 102 
Core 0 Alg Process for Layer # -  102, layer type 38
Processing Layer # -  102
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  102 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 22 
Core 0 Alg Process for Layer # -   22, layer type 39
Coreid 0 Layerid to execute = 103 
Core 0 Alg Process for Layer # -  103, layer type 6
Processing Layer # -  103
Executing reference flow for inner product layer 
Core 0 End of Layer # -  103 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 23 
Core 0 Alg Process for Layer # -   23, layer type 39
Coreid 0 Layerid to execute = 104 
Core 0 Alg Process for Layer # -  104, layer type 5
Processing Layer # -  104
Core 0 End of Layer # -  104 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 105 
Core 0 Alg Process for Layer # -  105, layer type 38
Processing Layer # -  105
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  105 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 106 
Core 0 Alg Process for Layer # -  106, layer type 42
Processing Layer # -  106
Core 0 End of Layer # -  106 with outPtrs[0] = 0x70f557080000
Coreid 0 Layerid to execute = 31 
Core 0 Alg Process for Layer # -   31, layer type 39
Coreid 0 Layerid to execute = 107 
Core 0 Alg Process for Layer # -  107, layer type 5
Processing Layer # -  107
Core 0 End of Layer # -  107 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 30 
Core 0 Alg Process for Layer # -   30, layer type 39
Coreid 0 Layerid to execute = 108 
Core 0 Alg Process for Layer # -  108, layer type 5
Processing Layer # -  108
Core 0 End of Layer # -  108 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 109 
Core 0 Alg Process for Layer # -  109, layer type 12
Processing Layer # -  109
Core 0 End of Layer # -  109 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 110 
Core 0 Alg Process for Layer # -  110, layer type 38
Processing Layer # -  110
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  110 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 24 
Core 0 Alg Process for Layer # -   24, layer type 39
Coreid 0 Layerid to execute = 111 
Core 0 Alg Process for Layer # -  111, layer type 6
Processing Layer # -  111
Executing reference flow for inner product layer 
Core 0 End of Layer # -  111 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 112 
Core 0 Alg Process for Layer # -  112, layer type 38
Processing Layer # -  112
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  112 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 113 
Core 0 Alg Process for Layer # -  113, layer type 8
Processing Layer # -  113
Core 0 End of Layer # -  113 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 114 
Core 0 Alg Process for Layer # -  114, layer type 38
Processing Layer # -  114
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  114 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 25 
Core 0 Alg Process for Layer # -   25, layer type 39
Coreid 0 Layerid to execute = 115 
Core 0 Alg Process for Layer # -  115, layer type 6
Processing Layer # -  115
Executing reference flow for inner product layer 
Core 0 End of Layer # -  115 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 116 
Core 0 Alg Process for Layer # -  116, layer type 38
Processing Layer # -  116
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  116 with outPtrs[0] = 0x70f5570c5000
Coreid 0 Layerid to execute = 117 
Core 0 Alg Process for Layer # -  117, layer type 42
Processing Layer # -  117
Core 0 End of Layer # -  117 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 33 
Core 0 Alg Process for Layer # -   33, layer type 39
Coreid 0 Layerid to execute = 118 
Core 0 Alg Process for Layer # -  118, layer type 5
Processing Layer # -  118
Core 0 End of Layer # -  118 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 32 
Core 0 Alg Process for Layer # -   32, layer type 39
Coreid 0 Layerid to execute = 119 
Core 0 Alg Process for Layer # -  119, layer type 5
Processing Layer # -  119
Core 0 End of Layer # -  119 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 120 
Core 0 Alg Process for Layer # -  120, layer type 5
Processing Layer # -  120
Core 0 End of Layer # -  120 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 121 
Core 0 Alg Process for Layer # -  121, layer type 42
Processing Layer # -  121
Core 0 End of Layer # -  121 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 35 
Core 0 Alg Process for Layer # -   35, layer type 39
Coreid 0 Layerid to execute = 122 
Core 0 Alg Process for Layer # -  122, layer type 5
Processing Layer # -  122
Core 0 End of Layer # -  122 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 34 
Core 0 Alg Process for Layer # -   34, layer type 39
Coreid 0 Layerid to execute = 123 
Core 0 Alg Process for Layer # -  123, layer type 5
Processing Layer # -  123
Core 0 End of Layer # -  123 with outPtrs[0] = 0x70f557080080
Coreid 0 Layerid to execute = 124 
Core 0 Alg Process for Layer # -  124, layer type 14
Processing Layer # -  124
Core 0 End of Layer # -  124 with outPtrs[0] = 0x70f557080080
Coreid 0 Layerid to execute = 125 
Core 0 Alg Process for Layer # -  125, layer type 38
Processing Layer # -  125
ForceInPlace Constraint for Reshape Failed, Copying Data!
Core 0 End of Layer # -  125 with outPtrs[0] = 0x70f557080080
Coreid 0 Layerid to execute = 126 
Core 0 Alg Process for Layer # -  126, layer type 41
Processing Layer # -  126
Core 0 End of Layer # -  126 with outPtrs[0] = 0x70f55703b000
Coreid 0 Layerid to execute = 127 
Core 0 Alg Process for Layer # -  127, layer type 29
Processing Layer # -  127
Core 0 End of Layer # -  127 with outPtrs[0] = 0x70f5b947d000
Coreid 0 Layerid to execute = -1 
TIDL_process is completed with handle : 0x70f5b940c000 
 Layer,   Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles, paddingTrigger,    paddingWait,LayerWithoutPad,LayerHandleCopy,   BackupCycles,  RestoreCycles,Multic7xContextCopyCycles,
    36,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    38,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    40,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    37,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    39,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    41,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    42,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    44,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    47,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    50,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    53,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    45,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    48,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    51,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    54,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    43,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    46,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    49,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    52,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    55,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    56,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    57,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    58,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    59,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    60,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    61,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    62,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    63,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    64,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    65,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    66,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    67,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    68,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    69,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    70,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    71,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    72,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    73,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    74,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    75,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    76,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    77,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    78,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    79,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    80,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    81,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    82,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    84,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    87,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    90,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    93,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    95,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    86,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    89,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    92,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    94,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    83,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    85,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    88,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    91,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    96,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    97,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    98,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
    99,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   100,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   101,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   102,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   103,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   104,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   105,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   106,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   107,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   108,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   109,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   110,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   111,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   112,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   113,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   114,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   115,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   116,              0,              0,              0,              0,              0,                 0,              0,                 0,              0,              0,              0,              0,              0,              0,              0,              0,              0,
   117,              0,              0,              Execution time: 1.5850675106048584 seconds

Running_Model :  model  


 
Completed_Model :     1, Name : model                                             , Total time :    1452.04, Offload Time :    1451.99
    7750.compile.log