Problem statement
I am trying to tune the parameters for converting a custom ONNX model into TIDL artifacts for performing inference on a TDA4VM SoC. I want to compare performance and runtime using 8bits against 16bits quantization. In both cases the model conversion process seems to work fine, but the issue appears when I try use the artifacts for inference at the TDA4VM. The first time I call inference (e.g. session.run(...)) with 16 bits artifacts on TDA4VM causes the software application to freeze. The 8-bits artifacts runs as expected.
Do you have ideas on what could cause this issue and on how to solve it? I can also run any debug procedure you suggest and share model and artifacts through e-mail.
Background information
Repo used for model conversion: GitHub - TexasInstruments/edgeai-tidl-tools at 08_05_00_11
SDK version used on the TDA4VM: v08_05
I have tried the same experiment on TI distribution of DeepLabV3-MobileNetV2 and it worked fine on both 8b and 16b quantization schemes.
Both 8b and 16b artifacts run well in emulation environment.
Logs
Model conversion in 8 bits debug_level=1
Preprocessor(applyNormalization=True, offset=[-128. -128. -128.], scale=[0.0078125 0.0078125 0.0078125], dtype=float32, pixelOrder=2, applyResize=True, height=768, width=1024)
ConfigurationConversionONNXToTIDL(debugLevel=1, modelBitdepth=8, maxNumSubgraphs=16, accuracyLevel=1, calibrationIterations=5, mixedPrecisionFactor=-1, quantizationScaleType=0, highResolutionOptimization=0, preBatchnormFold=1, tiInternalNCFlag=1601, activationClipping=1, weightClipping=1, biasCalibration=1, addDataConvertOperations=0, channelWiseQuantization=0, embedNormalization=False, embedArgmax=False)
tidl_tools_path = /home/root/edgeai-tidl-tools/tidl_tools
artifacts_folder = /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts
tidl_tensor_bits = 8
debug_level = 1
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
model_type =
tidl_calibration_accuracy_level = 7
tidl_calibration_options:num_frames_calibration = 3
tidl_calibration_options:bias_calibration_iterations = 5
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 0
output_feature_16bit_names_list =
m_params_16bit_names_list =
reserved_compile_constraints_flag = 1601
ti_internal_reserved_1 =
****** WARNING : Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options******
Supported TIDL layer type --- Conv -- Conv_0
Supported TIDL layer type --- Clip -- Clip_3
Supported TIDL layer type --- Conv -- Conv_4
Supported TIDL layer type --- Clip -- Clip_7
Supported TIDL layer type --- Conv -- Conv_8
Supported TIDL layer type --- Conv -- Conv_9
Supported TIDL layer type --- Clip -- Clip_12
Supported TIDL layer type --- Conv -- Conv_13
Supported TIDL layer type --- Clip -- Clip_16
Supported TIDL layer type --- Conv -- Conv_17
Supported TIDL layer type --- Conv -- Conv_18
Supported TIDL layer type --- Clip -- Clip_21
Supported TIDL layer type --- Conv -- Conv_22
Supported TIDL layer type --- Clip -- Clip_25
Supported TIDL layer type --- Conv -- Conv_26
Supported TIDL layer type --- Add -- Add_27
Supported TIDL layer type --- Conv -- Conv_28
Supported TIDL layer type --- Clip -- Clip_31
Supported TIDL layer type --- Conv -- Conv_32
Supported TIDL layer type --- Clip -- Clip_35
Supported TIDL layer type --- Conv -- Conv_36
Supported TIDL layer type --- Conv -- Conv_37
Supported TIDL layer type --- Clip -- Clip_40
Supported TIDL layer type --- Conv -- Conv_41
Supported TIDL layer type --- Clip -- Clip_44
Supported TIDL layer type --- Conv -- Conv_45
Supported TIDL layer type --- Add -- Add_46
Supported TIDL layer type --- Conv -- Conv_47
Supported TIDL layer type --- Clip -- Clip_50
Supported TIDL layer type --- Conv -- Conv_51
Supported TIDL layer type --- Clip -- Clip_54
Supported TIDL layer type --- Conv -- Conv_55
Supported TIDL layer type --- Add -- Add_56
Supported TIDL layer type --- Conv -- Conv_57
Supported TIDL layer type --- Clip -- Clip_60
Supported TIDL layer type --- Conv -- Conv_61
Supported TIDL layer type --- Clip -- Clip_64
Supported TIDL layer type --- Conv -- Conv_65
Supported TIDL layer type --- Conv -- Conv_66
Supported TIDL layer type --- Clip -- Clip_69
Supported TIDL layer type --- Conv -- Conv_70
Supported TIDL layer type --- Clip -- Clip_73
Supported TIDL layer type --- Conv -- Conv_74
Supported TIDL layer type --- Add -- Add_75
Supported TIDL layer type --- Conv -- Conv_76
Supported TIDL layer type --- Clip -- Clip_79
Supported TIDL layer type --- Conv -- Conv_80
Supported TIDL layer type --- Clip -- Clip_83
Supported TIDL layer type --- Conv -- Conv_84
Supported TIDL layer type --- Add -- Add_85
Supported TIDL layer type --- Conv -- Conv_86
Supported TIDL layer type --- Clip -- Clip_89
Supported TIDL layer type --- Conv -- Conv_90
Supported TIDL layer type --- Clip -- Clip_93
Supported TIDL layer type --- Conv -- Conv_94
Supported TIDL layer type --- Add -- Add_95
Supported TIDL layer type --- Conv -- Conv_96
Supported TIDL layer type --- Clip -- Clip_99
Supported TIDL layer type --- Conv -- Conv_100
Supported TIDL layer type --- Clip -- Clip_103
Supported TIDL layer type --- Conv -- Conv_104
Supported TIDL layer type --- Conv -- Conv_105
Supported TIDL layer type --- Clip -- Clip_108
Supported TIDL layer type --- Conv -- Conv_109
Supported TIDL layer type --- Clip -- Clip_112
Supported TIDL layer type --- Conv -- Conv_113
Supported TIDL layer type --- Add -- Add_114
Supported TIDL layer type --- Conv -- Conv_115
Supported TIDL layer type --- Clip -- Clip_118
Supported TIDL layer type --- Conv -- Conv_119
Supported TIDL layer type --- Clip -- Clip_122
Supported TIDL layer type --- Conv -- Conv_123
Supported TIDL layer type --- Add -- Add_124
Supported TIDL layer type --- Conv -- Conv_125
Supported TIDL layer type --- Clip -- Clip_128
Supported TIDL layer type --- Conv -- Conv_129
Supported TIDL layer type --- Clip -- Clip_132
Supported TIDL layer type --- Conv -- Conv_133
Supported TIDL layer type --- Conv -- Conv_134
Supported TIDL layer type --- Clip -- Clip_137
Supported TIDL layer type --- Conv -- Conv_138
Supported TIDL layer type --- Clip -- Clip_141
Supported TIDL layer type --- Conv -- Conv_142
Supported TIDL layer type --- Add -- Add_143
Supported TIDL layer type --- Conv -- Conv_144
Supported TIDL layer type --- Clip -- Clip_147
Supported TIDL layer type --- Conv -- Conv_148
Supported TIDL layer type --- Clip -- Clip_151
Supported TIDL layer type --- Conv -- Conv_152
Supported TIDL layer type --- Add -- Add_153
Supported TIDL layer type --- Conv -- Conv_154
Supported TIDL layer type --- Clip -- Clip_157
Supported TIDL layer type --- Conv -- Conv_158
Supported TIDL layer type --- Clip -- Clip_161
Supported TIDL layer type --- Conv -- Conv_162
Supported TIDL layer type --- Conv -- Conv_163
Supported TIDL layer type --- Clip -- Clip_166
Supported TIDL layer type --- Resize -- Resize_168
Supported TIDL layer type --- Concat -- Concat_169
Supported TIDL layer type --- Conv -- Conv_170
Supported TIDL layer type --- Relu -- Relu_171
Supported TIDL layer type --- Conv -- Conv_172
Supported TIDL layer type --- Relu -- Relu_173
Supported TIDL layer type --- Resize -- Resize_175
Supported TIDL layer type --- Concat -- Concat_176
Supported TIDL layer type --- Conv -- Conv_177
Supported TIDL layer type --- Relu -- Relu_178
Supported TIDL layer type --- Conv -- Conv_179
Supported TIDL layer type --- Relu -- Relu_180
Supported TIDL layer type --- Resize -- Resize_182
Supported TIDL layer type --- Concat -- Concat_183
Supported TIDL layer type --- Conv -- Conv_184
Supported TIDL layer type --- Relu -- Relu_185
Supported TIDL layer type --- Conv -- Conv_186
Supported TIDL layer type --- Relu -- Relu_187
Supported TIDL layer type --- Resize -- Resize_189
Supported TIDL layer type --- Concat -- Concat_190
Supported TIDL layer type --- Conv -- Conv_191
Supported TIDL layer type --- Relu -- Relu_192
Supported TIDL layer type --- Conv -- Conv_193
Supported TIDL layer type --- Relu -- Relu_194
Supported TIDL layer type --- Resize -- Resize_196
Supported TIDL layer type --- Conv -- Conv_197
Supported TIDL layer type --- Relu -- Relu_198
Supported TIDL layer type --- Conv -- Conv_199
Supported TIDL layer type --- Relu -- Relu_200
Supported TIDL layer type --- Conv -- Conv_201
Preliminary subgraphs created = 1
Final number of subgraphs created are : 1, - Offloaded Nodes - 127, Total Nodes - 127
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
Running runtimes graphviz - /home/root/edgeai-tidl-tools/tidl_tools/tidl_graphVisualiser_runtimes.out /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/allowedNode.txt /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/graphvizInfo.txt /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/runtimes_visualization.svg
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_0_0
0, Conv, 3, 1, input, 654
1, Clip, 3, 1, 654, 379
2, Conv, 3, 1, 379, 657
3, Clip, 3, 1, 657, 384
4, Conv, 3, 1, 384, 660
5, Conv, 3, 1, 660, 663
6, Clip, 3, 1, 663, 391
7, Conv, 3, 1, 391, 666
8, Clip, 3, 1, 666, 396
9, Conv, 3, 1, 396, 669
10, Conv, 3, 1, 669, 672
11, Clip, 3, 1, 672, 403
12, Conv, 3, 1, 403, 675
13, Clip, 3, 1, 675, 408
14, Conv, 3, 1, 408, 678
15, Add, 2, 1, 669, 411
16, Conv, 3, 1, 411, 681
17, Clip, 3, 1, 681, 416
18, Conv, 3, 1, 416, 684
19, Clip, 3, 1, 684, 421
20, Conv, 3, 1, 421, 687
21, Conv, 3, 1, 687, 690
22, Clip, 3, 1, 690, 428
23, Conv, 3, 1, 428, 693
24, Clip, 3, 1, 693, 433
25, Conv, 3, 1, 433, 696
26, Add, 2, 1, 687, 436
27, Conv, 3, 1, 436, 699
28, Clip, 3, 1, 699, 441
29, Conv, 3, 1, 441, 702
30, Clip, 3, 1, 702, 446
31, Conv, 3, 1, 446, 705
32, Add, 2, 1, 436, 449
33, Conv, 3, 1, 449, 708
34, Clip, 3, 1, 708, 454
35, Conv, 3, 1, 454, 711
36, Clip, 3, 1, 711, 459
37, Conv, 3, 1, 459, 714
38, Conv, 3, 1, 714, 717
39, Clip, 3, 1, 717, 466
40, Conv, 3, 1, 466, 720
41, Clip, 3, 1, 720, 471
42, Conv, 3, 1, 471, 723
43, Add, 2, 1, 714, 474
44, Conv, 3, 1, 474, 726
45, Clip, 3, 1, 726, 479
46, Conv, 3, 1, 479, 729
47, Clip, 3, 1, 729, 484
48, Conv, 3, 1, 484, 732
49, Add, 2, 1, 474, 487
50, Conv, 3, 1, 487, 735
51, Clip, 3, 1, 735, 492
52, Conv, 3, 1, 492, 738
53, Clip, 3, 1, 738, 497
54, Conv, 3, 1, 497, 741
55, Add, 2, 1, 487, 500
56, Conv, 3, 1, 500, 744
57, Clip, 3, 1, 744, 505
58, Conv, 3, 1, 505, 747
59, Clip, 3, 1, 747, 510
60, Conv, 3, 1, 510, 750
61, Conv, 3, 1, 750, 753
62, Clip, 3, 1, 753, 517
63, Conv, 3, 1, 517, 756
64, Clip, 3, 1, 756, 522
65, Conv, 3, 1, 522, 759
66, Add, 2, 1, 750, 525
67, Conv, 3, 1, 525, 762
68, Clip, 3, 1, 762, 530
69, Conv, 3, 1, 530, 765
70, Clip, 3, 1, 765, 535
71, Conv, 3, 1, 535, 768
72, Add, 2, 1, 525, 538
73, Conv, 3, 1, 538, 771
74, Clip, 3, 1, 771, 543
75, Conv, 3, 1, 543, 774
76, Clip, 3, 1, 774, 548
77, Conv, 3, 1, 548, 777
78, Conv, 3, 1, 777, 780
79, Clip, 3, 1, 780, 555
80, Conv, 3, 1, 555, 783
81, Clip, 3, 1, 783, 560
82, Conv, 3, 1, 560, 786
83, Add, 2, 1, 777, 563
84, Conv, 3, 1, 563, 789
85, Clip, 3, 1, 789, 568
86, Conv, 3, 1, 568, 792
87, Clip, 3, 1, 792, 573
88, Conv, 3, 1, 573, 795
89, Add, 2, 1, 563, 576
90, Conv, 3, 1, 576, 798
91, Clip, 3, 1, 798, 581
92, Conv, 3, 1, 581, 801
93, Clip, 3, 1, 801, 586
94, Conv, 3, 1, 586, 804
95, Conv, 3, 1, 804, 807
96, Clip, 3, 1, 807, 593
97, Resize, 3, 1, 593, 598
98, Concat, 2, 1, 598, 599
99, Conv, 3, 1, 599, 810
100, Relu, 1, 1, 810, 602
101, Conv, 3, 1, 602, 813
102, Relu, 1, 1, 813, 605
103, Resize, 3, 1, 605, 610
104, Concat, 2, 1, 610, 611
105, Conv, 3, 1, 611, 816
106, Relu, 1, 1, 816, 614
107, Conv, 3, 1, 614, 819
108, Relu, 1, 1, 819, 617
109, Resize, 3, 1, 617, 622
110, Concat, 2, 1, 622, 623
111, Conv, 3, 1, 623, 822
112, Relu, 1, 1, 822, 626
113, Conv, 3, 1, 626, 825
114, Relu, 1, 1, 825, 629
115, Resize, 3, 1, 629, 634
116, Concat, 2, 1, 634, 635
117, Conv, 3, 1, 635, 828
118, Relu, 1, 1, 828, 638
119, Conv, 3, 1, 638, 831
120, Relu, 1, 1, 831, 641
121, Resize, 3, 1, 641, 646
122, Conv, 3, 1, 646, 834
123, Relu, 1, 1, 834, 649
124, Conv, 3, 1, 649, 837
125, Relu, 1, 1, 837, 652
126, Conv, 3, 1, 652, output
Input tensor name - input
Output tensor name - output
In TIDL_onnxRtImportInit subgraph_name=output
Layer 0, subgraph id output, name=output
Layer 1, subgraph id output, name=input
In TIDL_runtimesOptimizeNet: LayerIndex = 129, dataIndex = 128
************** Frame index 1 : Running float import *************
In TIDL_runtimesPostProcessNet
INFORMATION: [TIDL_ResizeLayer] Resize_168 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_175 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_182 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_189 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_196 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM.
****************************************************
** 6 WARNINGS 0 ERRORS **
****************************************************
************ in TIDL_subgraphRtCreate ************
The soft limit is 2048
The hard limit is 2048
MEM: Init ... !!!
MEM: Init ... Done !!!
0.0s: VX_ZONE_INIT:Enabled
0.21s: VX_ZONE_ERROR:Enabled
0.23s: VX_ZONE_WARNING:Enabled
0.2758s: VX_ZONE_INIT:[tivxInit:184] Initialization Done !!!
************ TIDL_subgraphRtCreate done ************
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 1525.000000 14680106.000000 2354.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 1 : Running float inference **********
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 1143.000000 15396030.000000 2248.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 2 : Running float inference **********
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 1225.000000 14597101.000000 1822.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 3 : Running fixed point mode for calibration **********
In TIDL_runtimesPostProcessNet
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 15972.11 .... ..... ... .... .....
# 1 . .. T 15326.36 .... ..... ... .... .....
# 2 . .. T 15202.37 .... ..... ... .... .....
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 17828.10 .... ..... ... .... .....
# 1 . .. T 16989.79 .... ..... ... .... .....
# 2 . .. T 16970.69 .... ..... ... .... .....
***************** Calibration iteration number 0 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 17392.04 .... ..... ... .... .....
# 1 . .. T 17183.92 .... ..... ... .... .....
# 2 . .. T 16898.05 .... ..... ... .... .....
***************** Calibration iteration number 1 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 17098.39 .... ..... ... .... .....
# 1 . .. T 18213.91 .... ..... ... .... .....
# 2 . .. T 17217.02 .... ..... ... .... .....
***************** Calibration iteration number 2 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 16935.27 .... ..... ... .... .....
# 1 . .. T 16951.54 .... ..... ... .... .....
# 2 . .. T 17432.92 .... ..... ... .... .....
***************** Calibration iteration number 3 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 17654.12 .... ..... ... .... .....
# 1 . .. T 16970.58 .... ..... ... .... .....
# 2 . .. T 16611.82 .... ..... ... .... .....
***************** Calibration iteration number 4 completed ************************
------------------ Network Compiler Traces -----------------------------
successful Memory allocation
INFORMATION: [TIDL_ResizeLayer] Resize_168 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_175 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_182 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_189 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_196 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
****************************************************
** 5 WARNINGS 0 ERRORS **
****************************************************
************ in TIDL_subgraphRtDelete ************
MEM: Deinit ... !!!
MEM: Alloc's: 27 alloc's of 2054455767 bytes
MEM: Free's : 27 free's of 2054455767 bytes
MEM: Open's : 0 allocs of 0 bytes
MEM: Deinit ... Done !!!
Compiled model written to: ../shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth8debug1
Model conversion in 16 bits debug_level=1
Preprocessor(applyNormalization=True, offset=[-128. -128. -128.], scale=[0.0078125 0.0078125 0.0078125], dtype=float32, pixelOrder=2, applyResize=True, height=768, width=1024)
ConfigurationConversionONNXToTIDL(debugLevel=1, modelBitdepth=16, maxNumSubgraphs=16, accuracyLevel=1, calibrationIterations=5, mixedPrecisionFactor=-1, quantizationScaleType=0,
highResolutionOptimization=0, preBatchnormFold=1, tiInternalNCFlag=1601, activationClipping=1, weightClipping=1, biasCalibration=1, addDataConvertOperations=0, channelWiseQuantization=0, embedNormalization=False, embedArgmax=False)
tidl_tools_path = /home/root/edgeai-tidl-tools/tidl_tools
artifacts_folder = /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts
tidl_tensor_bits = 16
debug_level = 1
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
model_type =
tidl_calibration_accuracy_level = 7
tidl_calibration_options:num_frames_calibration = 3
tidl_calibration_options:bias_calibration_iterations = 5
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 0
output_feature_16bit_names_list =
m_params_16bit_names_list =
reserved_compile_constraints_flag = 1601
ti_internal_reserved_1 =
****** WARNING : Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options******
Supported TIDL layer type --- Conv -- Conv_0
Supported TIDL layer type --- Clip -- Clip_3
Supported TIDL layer type --- Conv -- Conv_4
Supported TIDL layer type --- Clip -- Clip_7
Supported TIDL layer type --- Conv -- Conv_8
Supported TIDL layer type --- Conv -- Conv_9
Supported TIDL layer type --- Clip -- Clip_12
Supported TIDL layer type --- Conv -- Conv_13
Supported TIDL layer type --- Clip -- Clip_16
Supported TIDL layer type --- Conv -- Conv_17
Supported TIDL layer type --- Conv -- Conv_18
Supported TIDL layer type --- Clip -- Clip_21
Supported TIDL layer type --- Conv -- Conv_22
Supported TIDL layer type --- Clip -- Clip_25
Supported TIDL layer type --- Conv -- Conv_26
Supported TIDL layer type --- Add -- Add_27
Supported TIDL layer type --- Conv -- Conv_28
Supported TIDL layer type --- Clip -- Clip_31
Supported TIDL layer type --- Conv -- Conv_32
Supported TIDL layer type --- Clip -- Clip_35
Supported TIDL layer type --- Conv -- Conv_36
Supported TIDL layer type --- Conv -- Conv_37
Supported TIDL layer type --- Clip -- Clip_40
Supported TIDL layer type --- Conv -- Conv_41
Supported TIDL layer type --- Clip -- Clip_44
Supported TIDL layer type --- Conv -- Conv_45
Supported TIDL layer type --- Add -- Add_46
Supported TIDL layer type --- Conv -- Conv_47
Supported TIDL layer type --- Clip -- Clip_50
Supported TIDL layer type --- Conv -- Conv_51
Supported TIDL layer type --- Clip -- Clip_54
Supported TIDL layer type --- Conv -- Conv_55
Supported TIDL layer type --- Add -- Add_56
Supported TIDL layer type --- Conv -- Conv_57
Supported TIDL layer type --- Clip -- Clip_60
Supported TIDL layer type --- Conv -- Conv_61
Supported TIDL layer type --- Clip -- Clip_64
Supported TIDL layer type --- Conv -- Conv_65
Supported TIDL layer type --- Conv -- Conv_66
Supported TIDL layer type --- Clip -- Clip_69
Supported TIDL layer type --- Conv -- Conv_70
Supported TIDL layer type --- Clip -- Clip_73
Supported TIDL layer type --- Conv -- Conv_74
Supported TIDL layer type --- Add -- Add_75
Supported TIDL layer type --- Conv -- Conv_76
Supported TIDL layer type --- Clip -- Clip_79
Supported TIDL layer type --- Conv -- Conv_80
Supported TIDL layer type --- Clip -- Clip_83
Supported TIDL layer type --- Conv -- Conv_84
Supported TIDL layer type --- Add -- Add_85
Supported TIDL layer type --- Conv -- Conv_86
Supported TIDL layer type --- Clip -- Clip_89
Supported TIDL layer type --- Conv -- Conv_90
Supported TIDL layer type --- Clip -- Clip_93
Supported TIDL layer type --- Conv -- Conv_94
Supported TIDL layer type --- Add -- Add_95
Supported TIDL layer type --- Conv -- Conv_96
Supported TIDL layer type --- Clip -- Clip_99
Supported TIDL layer type --- Conv -- Conv_100
Supported TIDL layer type --- Clip -- Clip_103
Supported TIDL layer type --- Conv -- Conv_104
Supported TIDL layer type --- Conv -- Conv_105
Supported TIDL layer type --- Clip -- Clip_108
Supported TIDL layer type --- Conv -- Conv_109
Supported TIDL layer type --- Clip -- Clip_112
Supported TIDL layer type --- Conv -- Conv_113
Supported TIDL layer type --- Add -- Add_114
Supported TIDL layer type --- Conv -- Conv_115
Supported TIDL layer type --- Clip -- Clip_118
Supported TIDL layer type --- Conv -- Conv_119
Supported TIDL layer type --- Clip -- Clip_122
Supported TIDL layer type --- Conv -- Conv_123
Supported TIDL layer type --- Add -- Add_124
Supported TIDL layer type --- Conv -- Conv_125
Supported TIDL layer type --- Clip -- Clip_128
Supported TIDL layer type --- Conv -- Conv_129
Supported TIDL layer type --- Clip -- Clip_132
Supported TIDL layer type --- Conv -- Conv_133
Supported TIDL layer type --- Conv -- Conv_134
Supported TIDL layer type --- Clip -- Clip_137
Supported TIDL layer type --- Conv -- Conv_138
Supported TIDL layer type --- Clip -- Clip_141
Supported TIDL layer type --- Conv -- Conv_142
Supported TIDL layer type --- Add -- Add_143
Supported TIDL layer type --- Conv -- Conv_144
Supported TIDL layer type --- Clip -- Clip_147
Supported TIDL layer type --- Conv -- Conv_148
Supported TIDL layer type --- Clip -- Clip_151
Supported TIDL layer type --- Conv -- Conv_152
Supported TIDL layer type --- Add -- Add_153
Supported TIDL layer type --- Conv -- Conv_154
Supported TIDL layer type --- Clip -- Clip_157
Supported TIDL layer type --- Conv -- Conv_158
Supported TIDL layer type --- Clip -- Clip_161
Supported TIDL layer type --- Conv -- Conv_162
Supported TIDL layer type --- Conv -- Conv_163
Supported TIDL layer type --- Clip -- Clip_166
Supported TIDL layer type --- Resize -- Resize_168
Supported TIDL layer type --- Concat -- Concat_169
Supported TIDL layer type --- Conv -- Conv_170
Supported TIDL layer type --- Relu -- Relu_171
Supported TIDL layer type --- Conv -- Conv_172
Supported TIDL layer type --- Relu -- Relu_173
Supported TIDL layer type --- Resize -- Resize_175
Supported TIDL layer type --- Concat -- Concat_176
Supported TIDL layer type --- Conv -- Conv_177
Supported TIDL layer type --- Relu -- Relu_178
Supported TIDL layer type --- Conv -- Conv_179
Supported TIDL layer type --- Relu -- Relu_180
Supported TIDL layer type --- Resize -- Resize_182
Supported TIDL layer type --- Concat -- Concat_183
Supported TIDL layer type --- Conv -- Conv_184
Supported TIDL layer type --- Relu -- Relu_185
Supported TIDL layer type --- Conv -- Conv_186
Supported TIDL layer type --- Relu -- Relu_187
Supported TIDL layer type --- Resize -- Resize_189
Supported TIDL layer type --- Concat -- Concat_190
Supported TIDL layer type --- Conv -- Conv_191
Supported TIDL layer type --- Relu -- Relu_192
Supported TIDL layer type --- Conv -- Conv_193
Supported TIDL layer type --- Relu -- Relu_194
Supported TIDL layer type --- Resize -- Resize_196
Supported TIDL layer type --- Conv -- Conv_197
Supported TIDL layer type --- Relu -- Relu_198
Supported TIDL layer type --- Conv -- Conv_199
Supported TIDL layer type --- Relu -- Relu_200
Supported TIDL layer type --- Conv -- Conv_201
Preliminary subgraphs created = 1
Final number of subgraphs created are : 1, - Offloaded Nodes - 127, Total Nodes - 127
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
Running runtimes graphviz - /home/root/edgeai-tidl-tools/tidl_tools/tidl_graphVisualiser_runtimes.out /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/allowedNode.txt /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/graphvizInfo.txt /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/runtimes_visualization.svg
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_0_0
0, Conv, 3, 1, input, 654
1, Clip, 3, 1, 654, 379
2, Conv, 3, 1, 379, 657
3, Clip, 3, 1, 657, 384
4, Conv, 3, 1, 384, 660
5, Conv, 3, 1, 660, 663
6, Clip, 3, 1, 663, 391
7, Conv, 3, 1, 391, 666
8, Clip, 3, 1, 666, 396
9, Conv, 3, 1, 396, 669
10, Conv, 3, 1, 669, 672
11, Clip, 3, 1, 672, 403
12, Conv, 3, 1, 403, 675
13, Clip, 3, 1, 675, 408
14, Conv, 3, 1, 408, 678
15, Add, 2, 1, 669, 411
16, Conv, 3, 1, 411, 681
17, Clip, 3, 1, 681, 416
18, Conv, 3, 1, 416, 684
19, Clip, 3, 1, 684, 421
20, Conv, 3, 1, 421, 687
21, Conv, 3, 1, 687, 690
22, Clip, 3, 1, 690, 428
23, Conv, 3, 1, 428, 693
24, Clip, 3, 1, 693, 433
25, Conv, 3, 1, 433, 696
26, Add, 2, 1, 687, 436
27, Conv, 3, 1, 436, 699
28, Clip, 3, 1, 699, 441
29, Conv, 3, 1, 441, 702
30, Clip, 3, 1, 702, 446
31, Conv, 3, 1, 446, 705
32, Add, 2, 1, 436, 449
33, Conv, 3, 1, 449, 708
34, Clip, 3, 1, 708, 454
35, Conv, 3, 1, 454, 711
36, Clip, 3, 1, 711, 459
37, Conv, 3, 1, 459, 714
38, Conv, 3, 1, 714, 717
39, Clip, 3, 1, 717, 466
40, Conv, 3, 1, 466, 720
41, Clip, 3, 1, 720, 471
42, Conv, 3, 1, 471, 723
43, Add, 2, 1, 714, 474
44, Conv, 3, 1, 474, 726
45, Clip, 3, 1, 726, 479
46, Conv, 3, 1, 479, 729
47, Clip, 3, 1, 729, 484
48, Conv, 3, 1, 484, 732
49, Add, 2, 1, 474, 487
50, Conv, 3, 1, 487, 735
51, Clip, 3, 1, 735, 492
52, Conv, 3, 1, 492, 738
53, Clip, 3, 1, 738, 497
54, Conv, 3, 1, 497, 741
55, Add, 2, 1, 487, 500
56, Conv, 3, 1, 500, 744
57, Clip, 3, 1, 744, 505
58, Conv, 3, 1, 505, 747
59, Clip, 3, 1, 747, 510
60, Conv, 3, 1, 510, 750
61, Conv, 3, 1, 750, 753
62, Clip, 3, 1, 753, 517
63, Conv, 3, 1, 517, 756
64, Clip, 3, 1, 756, 522
65, Conv, 3, 1, 522, 759
66, Add, 2, 1, 750, 525
67, Conv, 3, 1, 525, 762
68, Clip, 3, 1, 762, 530
69, Conv, 3, 1, 530, 765
70, Clip, 3, 1, 765, 535
71, Conv, 3, 1, 535, 768
72, Add, 2, 1, 525, 538
73, Conv, 3, 1, 538, 771
74, Clip, 3, 1, 771, 543
75, Conv, 3, 1, 543, 774
76, Clip, 3, 1, 774, 548
77, Conv, 3, 1, 548, 777
78, Conv, 3, 1, 777, 780
79, Clip, 3, 1, 780, 555
80, Conv, 3, 1, 555, 783
81, Clip, 3, 1, 783, 560
82, Conv, 3, 1, 560, 786
83, Add, 2, 1, 777, 563
84, Conv, 3, 1, 563, 789
85, Clip, 3, 1, 789, 568
86, Conv, 3, 1, 568, 792
87, Clip, 3, 1, 792, 573
88, Conv, 3, 1, 573, 795
89, Add, 2, 1, 563, 576
90, Conv, 3, 1, 576, 798
91, Clip, 3, 1, 798, 581
92, Conv, 3, 1, 581, 801
93, Clip, 3, 1, 801, 586
94, Conv, 3, 1, 586, 804
95, Conv, 3, 1, 804, 807
96, Clip, 3, 1, 807, 593
97, Resize, 3, 1, 593, 598
98, Concat, 2, 1, 598, 599
99, Conv, 3, 1, 599, 810
100, Relu, 1, 1, 810, 602
101, Conv, 3, 1, 602, 813
102, Relu, 1, 1, 813, 605
103, Resize, 3, 1, 605, 610
104, Concat, 2, 1, 610, 611
105, Conv, 3, 1, 611, 816
106, Relu, 1, 1, 816, 614
107, Conv, 3, 1, 614, 819
108, Relu, 1, 1, 819, 617
109, Resize, 3, 1, 617, 622
110, Concat, 2, 1, 622, 623
111, Conv, 3, 1, 623, 822
112, Relu, 1, 1, 822, 626
113, Conv, 3, 1, 626, 825
114, Relu, 1, 1, 825, 629
115, Resize, 3, 1, 629, 634
116, Concat, 2, 1, 634, 635
117, Conv, 3, 1, 635, 828
118, Relu, 1, 1, 828, 638
119, Conv, 3, 1, 638, 831
120, Relu, 1, 1, 831, 641
121, Resize, 3, 1, 641, 646
122, Conv, 3, 1, 646, 834
123, Relu, 1, 1, 834, 649
124, Conv, 3, 1, 649, 837
125, Relu, 1, 1, 837, 652
126, Conv, 3, 1, 652, output
Input tensor name - input
Output tensor name - output
In TIDL_onnxRtImportInit subgraph_name=output
Layer 0, subgraph id output, name=output
Layer 1, subgraph id output, name=input
In TIDL_runtimesOptimizeNet: LayerIndex = 129, dataIndex = 128
************** Frame index 1 : Running float import *************
In TIDL_runtimesPostProcessNet
INFORMATION: [TIDL_ResizeLayer] Resize_168 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_175 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_182 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_189 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_196 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM.
****************************************************
** 6 WARNINGS 0 ERRORS **
****************************************************
************ in TIDL_subgraphRtCreate ************
The soft limit is 2048
The hard limit is 2048
MEM: Init ... !!!
MEM: Init ... Done !!!
0.0s: VX_ZONE_INIT:Enabled
0.20s: VX_ZONE_ERROR:Enabled
0.22s: VX_ZONE_WARNING:Enabled
0.2065s: VX_ZONE_INIT:[tivxInit:184] Initialization Done !!!
************ TIDL_subgraphRtCreate done ************
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 1613.000000 14024995.000000 1843.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 1 : Running float inference **********
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 2022.000000 14473350.000000 1371.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 2 : Running float inference **********
******* In TIDL_subgraphRtInvoke ********
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles,
paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 1456.000000 15189774.000000 1508.000000
******* TIDL_subgraphRtInvoke done ********
********** Frame Index 3 : Running fixed point mode for calibration **********
In TIDL_runtimesPostProcessNet
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 17516.57 .... ..... ... .... .....
# 1 . .. T 14974.09 .... ..... ... .... .....
# 2 . .. T 16706.64 .... ..... ... .... .....
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 22367.07 .... ..... ... .... .....
# 1 . .. T 20714.71 .... ..... ... .... .....
# 2 . .. T 20733.08 .... ..... ... .... .....
***************** Calibration iteration number 0 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 21160.42 .... ..... ... .... .....
# 1 . .. T 20342.81 .... ..... ... .... .....
# 2 . .. T 20625.89 .... ..... ... .... .....
***************** Calibration iteration number 1 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 20791.53 .... ..... ... .... .....
# 1 . .. T 21245.86 .... ..... ... .... .....
# 2 . .. T 22869.03 .... ..... ... .... .....
***************** Calibration iteration number 2 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 23261.33 .... ..... ... .... .....
# 1 . .. T 22109.05 .... ..... ... .... .....
# 2 . .. T 21632.99 .... ..... ... .... .....
***************** Calibration iteration number 3 completed ************************
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~
Processing config file #0 : /home/root/shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1/artifacts/tempDir/output_tidl_io_.qunat_stats_config.txt
----------------------- TIDL Process with REF_ONLY FLOW ------------------------
# 0 . .. T 22005.56 .... ..... ... .... .....
# 1 . .. T 21579.24 .... ..... ... .... .....
# 2 . .. T 23421.30 .... ..... ... .... .....
***************** Calibration iteration number 4 completed ************************
------------------ Network Compiler Traces -----------------------------
successful Memory allocation
INFORMATION: [TIDL_ResizeLayer] Resize_168 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_175 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_182 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_189 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
INFORMATION: [TIDL_ResizeLayer] Resize_196 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
****************************************************
** 5 WARNINGS 0 ERRORS **
****************************************************
************ in TIDL_subgraphRtDelete ************
MEM: Deinit ... !!!
MEM: Alloc's: 27 alloc's of 2054455767 bytes
MEM: Free's : 27 free's of 2054455767 bytes
MEM: Open's : 0 allocs of 0 bytes
MEM: Deinit ... Done !!!
Compiled model written to: ../shared_folder/convertedModels/unetSenai_calibimg2calibiter5bitdepth16debug1
Inference in 8 bits using ORT_LOGGING_LEVEL_VERBOSE
2023-08-14 14:37:31.847507245 [I:onnxruntime:, inference_session.cc:237 operator()] Flush-to-zero and denormal-as-zero are off 2023-08-14 14:37:31.847696625 [I:onnxruntime:, inference_session.cc:244 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2023-08-14 14:37:31.901573855 [I:onnxruntime:, inference_session.cc:1124 Initialize] Initializing session. 2023-08-14 14:37:31.901656510 [I:onnxruntime:, inference_session.cc:1149 Initialize] Adding default CPU execution provider. 2023-08-14 14:37:31.901681965 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Cpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:37:31.901700065 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:37:31.907040930 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:37:31.908556760 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:37:31.912183025 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '592'. It is no longer used by any node. 2023-08-14 14:37:31.912253975 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '591'. It is no longer used by any node. 2023-08-14 14:37:31.912273875 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '490'. It is no longer used by any node. 2023-08-14 14:37:31.912292035 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '580'. It is no longer used by any node. 2023-08-14 14:37:31.912308800 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '464'. It is no longer used by any node. 2023-08-14 14:37:31.912325150 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '457'. It is no longer used by any node. 2023-08-14 14:37:31.912340515 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '503'. It is no longer used by any node. 2023-08-14 14:37:31.912356460 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '572'. It is no longer used by any node. 2023-08-14 14:37:31.912371910 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '432'. It is no longer used by any node. 2023-08-14 14:37:31.912387605 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '419'. It is no longer used by any node. 2023-08-14 14:37:31.912403965 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '483'. It is no longer used by any node. 2023-08-14 14:37:31.912419310 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '528'. It is no longer used by any node. 2023-08-14 14:37:31.912434570 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '566'. It is no longer used by any node. 2023-08-14 14:37:31.912449655 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '401'. It is no longer used by any node. 2023-08-14 14:37:31.912465600 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '520'. It is no longer used by any node. 2023-08-14 14:37:31.912480930 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '495'. It is no longer used by any node. 2023-08-14 14:37:31.912496970 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '394'. It is no longer used by any node. 2023-08-14 14:37:31.912512945 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '426'. It is no longer used by any node. 2023-08-14 14:37:31.912528250 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '415'. It is no longer used by any node. 2023-08-14 14:37:31.912544045 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '445'. It is no longer used by any node. 2023-08-14 14:37:31.912597095 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '414'. It is no longer used by any node. 2023-08-14 14:37:31.912614245 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '567'. It is no longer used by any node. 2023-08-14 14:37:31.912629890 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '378'. It is no longer used by any node. 2023-08-14 14:37:31.912645235 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '395'. It is no longer used by any node. 2023-08-14 14:37:31.912661115 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '406'. It is no longer used by any node. 2023-08-14 14:37:31.912676190 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '465'. It is no longer used by any node. 2023-08-14 14:37:31.912691790 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '420'. It is no longer used by any node. 2023-08-14 14:37:31.912707945 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '482'. It is no longer used by any node. 2023-08-14 14:37:31.912723235 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '383'. It is no longer used by any node. 2023-08-14 14:37:31.912738865 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '377'. It is no longer used by any node. 2023-08-14 14:37:31.912754005 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '382'. It is no longer used by any node. 2023-08-14 14:37:31.912769090 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '389'. It is no longer used by any node. 2023-08-14 14:37:31.912784300 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '521'. It is no longer used by any node. 2023-08-14 14:37:31.912800135 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '390'. It is no longer used by any node. 2023-08-14 14:37:31.912815210 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '402'. It is no longer used by any node. 2023-08-14 14:37:31.912830845 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '407'. It is no longer used by any node. 2023-08-14 14:37:31.912845955 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '427'. It is no longer used by any node. 2023-08-14 14:37:31.912861000 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '431'. It is no longer used by any node. 2023-08-14 14:37:31.912875935 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '439'. It is no longer used by any node. 2023-08-14 14:37:31.912890845 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '469'. It is no longer used by any node. 2023-08-14 14:37:31.912905745 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '440'. It is no longer used by any node. 2023-08-14 14:37:31.912920670 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '444'. It is no longer used by any node. 2023-08-14 14:37:31.912935430 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '452'. It is no longer used by any node. 2023-08-14 14:37:31.912950270 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '453'. It is no longer used by any node. 2023-08-14 14:37:31.912965240 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '458'. It is no longer used by any node. 2023-08-14 14:37:31.912980050 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '477'. It is no longer used by any node. 2023-08-14 14:37:31.912994845 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '478'. It is no longer used by any node. 2023-08-14 14:37:31.913009940 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '491'. It is no longer used by any node. 2023-08-14 14:37:31.913037305 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '504'. It is no longer used by any node. 2023-08-14 14:37:31.913053055 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '496'. It is no longer used by any node. 2023-08-14 14:37:31.913067965 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '470'. It is no longer used by any node. 2023-08-14 14:37:31.913082875 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '508'. It is no longer used by any node. 2023-08-14 14:37:31.913130455 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '509'. It is no longer used by any node. 2023-08-14 14:37:31.913146400 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '515'. It is no longer used by any node. 2023-08-14 14:37:31.913161500 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '516'. It is no longer used by any node. 2023-08-14 14:37:31.913176595 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '533'. It is no longer used by any node. 2023-08-14 14:37:31.913191290 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '534'. It is no longer used by any node. 2023-08-14 14:37:31.913206045 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '547'. It is no longer used by any node. 2023-08-14 14:37:31.913221100 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '541'. It is no longer used by any node. 2023-08-14 14:37:31.913235930 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '585'. It is no longer used by any node. 2023-08-14 14:37:31.913250895 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '542'. It is no longer used by any node. 2023-08-14 14:37:31.913265760 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '554'. It is no longer used by any node. 2023-08-14 14:37:31.913280565 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '546'. It is no longer used by any node. 2023-08-14 14:37:31.913295335 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '553'. It is no longer used by any node. 2023-08-14 14:37:31.913310060 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '558'. It is no longer used by any node. 2023-08-14 14:37:31.913327085 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '559'. It is no longer used by any node. 2023-08-14 14:37:31.913342150 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '529'. It is no longer used by any node. 2023-08-14 14:37:31.913357135 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '571'. It is no longer used by any node. 2023-08-14 14:37:31.913372120 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '579'. It is no longer used by any node. 2023-08-14 14:37:31.913387430 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '584'. It is no longer used by any node. 2023-08-14 14:37:31.922858295 [V:onnxruntime:, inference_session.cc:910 TransformGraph] Node placements 2023-08-14 14:37:31.922897180 [V:onnxruntime:, inference_session.cc:912 TransformGraph] All nodes have been placed on [CPUExecutionProvider]. 2023-08-14 14:37:31.923271715 [V:onnxruntime:, session_state.cc:76 CreateGraphInfo] SaveMLValueNameIndexMapping 2023-08-14 14:37:31.923441750 [V:onnxruntime:, session_state.cc:122 CreateGraphInfo] Done saving OrtValue mappings. 2023-08-14 14:37:31.925515715 [I:onnxruntime:, session_state_utils.cc:103 SaveInitializedTensors] Saving initialized tensors. 2023-08-14 14:37:31.925807290 [I:onnxruntime:, session_state_utils.cc:177 SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 26450688 bytes for Cpu 2023-08-14 14:37:31.949203110 [I:onnxruntime:, session_state_utils.cc:219 SaveInitializedTensors] Done saving initialized tensors 2023-08-14 14:37:31.952154735 [I:onnxruntime:, inference_session.cc:1299 Initialize] Session successfully initialized. 2023-08-14 14:37:31.952351590 [I:onnxruntime:, inference_session.cc:244 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2023-08-14 14:37:32.005656210 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Tidl with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:37:32.005737400 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:37:32.005767665 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for TidlCpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:37:32.005785665 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:37:32.006287605 [I:onnxruntime:, inference_session.cc:1124 Initialize] Initializing session. 2023-08-14 14:37:32.006319460 [I:onnxruntime:, inference_session.cc:1149 Initialize] Adding default CPU execution provider. 2023-08-14 14:37:32.006342970 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Cpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:37:32.006360420 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:37:32.007408455 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:37:32.183137340 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:37:32.183626070 [V:onnxruntime:, inference_session.cc:910 TransformGraph] Node placements 2023-08-14 14:37:32.183649005 [V:onnxruntime:, inference_session.cc:912 TransformGraph] All nodes have been placed on [TIDLExecutionProvider]. 2023-08-14 14:37:32.183792530 [V:onnxruntime:, session_state.cc:76 CreateGraphInfo] SaveMLValueNameIndexMapping 2023-08-14 14:37:32.183921330 [V:onnxruntime:, session_state.cc:122 CreateGraphInfo] Done saving OrtValue mappings. 2023-08-14 14:37:32.184240235 [I:onnxruntime:, session_state_utils.cc:103 SaveInitializedTensors] Saving initialized tensors. 2023-08-14 14:37:32.184629595 [I:onnxruntime:, session_state_utils.cc:177 SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 26468608 bytes for Tidl 2023-08-14 14:37:32.214474575 [I:onnxruntime:, session_state_utils.cc:219 SaveInitializedTensors] Done saving initialized tensors 2023-08-14 14:37:32.380963795 [I:onnxruntime:, inference_session.cc:1299 Initialize] Session successfully initialized. 2023-08-14 14:37:33.384171980 [I:onnxruntime:, sequential_executor.cc:157 Execute] Begin execution 2023-08-14 14:37:33.384288580 [I:onnxruntime:test, bfc_arena.cc:280 AllocateRawInternal] Extending BFCArena for Tidl. bin_num:15 rounded_bytes:9437184 2023-08-14 14:37:33.384318080 [I:onnxruntime:test, bfc_arena.cc:165 Extend] Extended allocation by 16777216 bytes. 2023-08-14 14:37:33.384336880 [I:onnxruntime:test, bfc_arena.cc:168 Extend] Total allocated bytes: 43245824 2023-08-14 14:37:33.384358470 [I:onnxruntime:test, bfc_arena.cc:171 Extend] Allocated memory at 0xb233100 to 0xc233100 2023-08-14 14:37:33.447925205 [I:onnxruntime:, sequential_executor.cc:486 Execute] [Memory] ExecutionFrame dynamically allocates 9437184 bytes for Tidl 2023-08-14 14:37:33.647380515 [I:onnxruntime:, sequential_executor.cc:157 Execute] Begin execution 2023-08-14 14:37:34.492358155 [I:onnxruntime:, sequential_executor.cc:157 Execute] Begin execution libtidl_onnxrt_EP loaded 0xffffa75314f0 Final number of subgraphs created are : 1, - Offloaded Nodes - 127, Total Nodes - 127 APP: Init ... !!! MEM: Init ... !!! MEM: Initialized DMA HEAP (fd=5) !!! MEM: Init ... Done !!! IPC: Init ... !!! IPC: Init ... Done !!! REMOTE_SERVICE: Init ... !!! REMOTE_SERVICE: Init ... Done !!! 10085.225136 s: GTC Frequency = 200 MHz APP: Init ... Done !!! 10085.225232 s: VX_ZONE_INIT:Enabled 10085.225235 s: VX_ZONE_ERROR:Enabled 10085.225237 s: VX_ZONE_WARNING:Enabled 10085.225898 s: VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!! 10085.226902 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!! 10088.089271 s: VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!! 10088.093655 s: VX_ZONE_INIT:[tivxDeInitLocal:223] De-Initialization Done !!! APP: Deinit ... !!! REMOTE_SERVICE: Deinit ... !!! REMOTE_SERVICE: Deinit ... Done !!! IPC: Deinit ... !!! IPC: DeInit ... Done !!! MEM: Deinit ... !!! DDR_SHARED_MEM: Alloc's: 9 alloc's of 32363507 bytes DDR_SHARED_MEM: Free's : 9 free's of 32363507 bytes DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes DDR_SHARED_MEM: Total size: 536870912 bytes MEM: Deinit ... Done !!! APP: Deinit ... Done !!!
Inference in 16 bits using ORT_LOGGING_LEVEL_VERBOSE (ORT session does not print anything for 20+ minutes after end of log)
2023-08-14 14:38:17.733895090 [I:onnxruntime:, inference_session.cc:237 operator()] Flush-to-zero and denormal-as-zero are off 2023-08-14 14:38:17.734028405 [I:onnxruntime:, inference_session.cc:244 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2023-08-14 14:38:17.787995160 [I:onnxruntime:, inference_session.cc:1124 Initialize] Initializing session. 2023-08-14 14:38:17.788069840 [I:onnxruntime:, inference_session.cc:1149 Initialize] Adding default CPU execution provider. 2023-08-14 14:38:17.788101045 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Cpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:38:17.788124060 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:38:17.793558780 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:38:17.795149635 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:38:17.798889170 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '592'. It is no longer used by any node. 2023-08-14 14:38:17.798947520 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '591'. It is no longer used by any node. 2023-08-14 14:38:17.798969135 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '490'. It is no longer used by any node. 2023-08-14 14:38:17.798989130 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '580'. It is no longer used by any node. 2023-08-14 14:38:17.799007580 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '464'. It is no longer used by any node. 2023-08-14 14:38:17.799025645 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '457'. It is no longer used by any node. 2023-08-14 14:38:17.799043250 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '503'. It is no longer used by any node. 2023-08-14 14:38:17.799061500 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '572'. It is no longer used by any node. 2023-08-14 14:38:17.799079680 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '432'. It is no longer used by any node. 2023-08-14 14:38:17.799097990 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '419'. It is no longer used by any node. 2023-08-14 14:38:17.799117900 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '483'. It is no longer used by any node. 2023-08-14 14:38:17.799168795 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '528'. It is no longer used by any node. 2023-08-14 14:38:17.799185990 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '566'. It is no longer used by any node. 2023-08-14 14:38:17.799202110 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '401'. It is no longer used by any node. 2023-08-14 14:38:17.799219955 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '520'. It is no longer used by any node. 2023-08-14 14:38:17.799237325 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '495'. It is no longer used by any node. 2023-08-14 14:38:17.799255425 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '394'. It is no longer used by any node. 2023-08-14 14:38:17.799273375 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '426'. It is no longer used by any node. 2023-08-14 14:38:17.799298805 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '415'. It is no longer used by any node. 2023-08-14 14:38:17.799316250 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '445'. It is no longer used by any node. 2023-08-14 14:38:17.799332385 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '414'. It is no longer used by any node. 2023-08-14 14:38:17.799349465 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '567'. It is no longer used by any node. 2023-08-14 14:38:17.799365765 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '378'. It is no longer used by any node. 2023-08-14 14:38:17.799382240 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '395'. It is no longer used by any node. 2023-08-14 14:38:17.799404665 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '406'. It is no longer used by any node. 2023-08-14 14:38:17.799422785 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '465'. It is no longer used by any node. 2023-08-14 14:38:17.799439865 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '420'. It is no longer used by any node. 2023-08-14 14:38:17.799457765 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '482'. It is no longer used by any node. 2023-08-14 14:38:17.799566725 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '383'. It is no longer used by any node. 2023-08-14 14:38:17.799585985 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '377'. It is no longer used by any node. 2023-08-14 14:38:17.799604290 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '382'. It is no longer used by any node. 2023-08-14 14:38:17.799620230 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '389'. It is no longer used by any node. 2023-08-14 14:38:17.799636510 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '521'. It is no longer used by any node. 2023-08-14 14:38:17.799676020 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '390'. It is no longer used by any node. 2023-08-14 14:38:17.799696560 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '402'. It is no longer used by any node. 2023-08-14 14:38:17.799714615 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '407'. It is no longer used by any node. 2023-08-14 14:38:17.799731780 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '427'. It is no longer used by any node. 2023-08-14 14:38:17.799748390 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '431'. It is no longer used by any node. 2023-08-14 14:38:17.799764965 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '439'. It is no longer used by any node. 2023-08-14 14:38:17.799789480 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '469'. It is no longer used by any node. 2023-08-14 14:38:17.799806170 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '440'. It is no longer used by any node. 2023-08-14 14:38:17.799822405 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '444'. It is no longer used by any node. 2023-08-14 14:38:17.799838470 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '452'. It is no longer used by any node. 2023-08-14 14:38:17.799854805 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '453'. It is no longer used by any node. 2023-08-14 14:38:17.799870845 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '458'. It is no longer used by any node. 2023-08-14 14:38:17.799887055 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '477'. It is no longer used by any node. 2023-08-14 14:38:17.799903490 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '478'. It is no longer used by any node. 2023-08-14 14:38:17.799924945 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '491'. It is no longer used by any node. 2023-08-14 14:38:17.799943100 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '504'. It is no longer used by any node. 2023-08-14 14:38:17.799959550 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '496'. It is no longer used by any node. 2023-08-14 14:38:17.799975605 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '470'. It is no longer used by any node. 2023-08-14 14:38:17.799991835 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '508'. It is no longer used by any node. 2023-08-14 14:38:17.800008415 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '509'. It is no longer used by any node. 2023-08-14 14:38:17.800024845 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '515'. It is no longer used by any node. 2023-08-14 14:38:17.800078355 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '516'. It is no longer used by any node. 2023-08-14 14:38:17.800099530 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '533'. It is no longer used by any node. 2023-08-14 14:38:17.800116170 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '534'. It is no longer used by any node. 2023-08-14 14:38:17.800132480 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '547'. It is no longer used by any node. 2023-08-14 14:38:17.800148730 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '541'. It is no longer used by any node. 2023-08-14 14:38:17.800164830 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '585'. It is no longer used by any node. 2023-08-14 14:38:17.800180765 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '542'. It is no longer used by any node. 2023-08-14 14:38:17.800197110 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '554'. It is no longer used by any node. 2023-08-14 14:38:17.800218320 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '546'. It is no longer used by any node. 2023-08-14 14:38:17.800236150 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '553'. It is no longer used by any node. 2023-08-14 14:38:17.800252120 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '558'. It is no longer used by any node. 2023-08-14 14:38:17.800271395 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '559'. It is no longer used by any node. 2023-08-14 14:38:17.800287575 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '529'. It is no longer used by any node. 2023-08-14 14:38:17.800303515 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '571'. It is no longer used by any node. 2023-08-14 14:38:17.800319775 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '579'. It is no longer used by any node. 2023-08-14 14:38:17.800373525 [I:onnxruntime:, graph.cc:3109 CleanUnusedInitializers] Removing initializer '584'. It is no longer used by any node. 2023-08-14 14:38:17.810059960 [V:onnxruntime:, inference_session.cc:910 TransformGraph] Node placements 2023-08-14 14:38:17.810102385 [V:onnxruntime:, inference_session.cc:912 TransformGraph] All nodes have been placed on [CPUExecutionProvider]. 2023-08-14 14:38:17.810572870 [V:onnxruntime:, session_state.cc:76 CreateGraphInfo] SaveMLValueNameIndexMapping 2023-08-14 14:38:17.810769785 [V:onnxruntime:, session_state.cc:122 CreateGraphInfo] Done saving OrtValue mappings. 2023-08-14 14:38:17.812984055 [I:onnxruntime:, session_state_utils.cc:103 SaveInitializedTensors] Saving initialized tensors. 2023-08-14 14:38:17.813323525 [I:onnxruntime:, session_state_utils.cc:177 SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 26450688 bytes for Cpu 2023-08-14 14:38:17.837556425 [I:onnxruntime:, session_state_utils.cc:219 SaveInitializedTensors] Done saving initialized tensors 2023-08-14 14:38:17.840293665 [I:onnxruntime:, inference_session.cc:1299 Initialize] Session successfully initialized. 2023-08-14 14:38:17.840477660 [I:onnxruntime:, inference_session.cc:244 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2023-08-14 14:38:17.894726470 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Tidl with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:38:17.894793155 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:38:17.894831180 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for TidlCpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:38:17.894850905 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 libtidl_onnxrt_EP loaded 0xffff97b3c4f0 2023-08-14 14:38:17.895414840 [I:onnxruntime:, inference_session.cc:1124 Initialize] Initializing session. 2023-08-14 14:38:17.895449325 [I:onnxruntime:, inference_session.cc:1149 Initialize] Adding default CPU execution provider. 2023-08-14 14:38:17.895475890 [I:onnxruntime:test, bfc_arena.cc:23 BFCArena] Creating BFCArena for Cpu with following configs: initial_chunk_size_bytes: 1048576 max_dead_bytes_per_chunk: 134217728 memory limit: 18446744073709551615 arena_extend_strategy 0 2023-08-14 14:38:17.895496020 [V:onnxruntime:test, bfc_arena.cc:41 BFCArena] Creating 21 bins of max chunk size 256 to 268435456 2023-08-14 14:38:17.896562135 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 Final number of subgraphs created are : 1, - Offloaded Nodes - 127, Total Nodes - 127 2023-08-14 14:38:18.074363720 [I:onnxruntime:, reshape_fusion.cc:37 ApplyImpl] Total fused reshape node count: 0 2023-08-14 14:38:18.074999120 [V:onnxruntime:, inference_session.cc:910 TransformGraph] Node placements 2023-08-14 14:38:18.075035250 [V:onnxruntime:, inference_session.cc:912 TransformGraph] All nodes have been placed on [TIDLExecutionProvider]. 2023-08-14 14:38:18.075214075 [V:onnxruntime:, session_state.cc:76 CreateGraphInfo] SaveMLValueNameIndexMapping 2023-08-14 14:38:18.075361560 [V:onnxruntime:, session_state.cc:122 CreateGraphInfo] Done saving OrtValue mappings. 2023-08-14 14:38:18.075723300 [I:onnxruntime:, session_state_utils.cc:103 SaveInitializedTensors] Saving initialized tensors. 2023-08-14 14:38:18.076149760 [I:onnxruntime:, session_state_utils.cc:177 SaveInitializedTensors] [Memory] SessionStateInitializer statically allocates 26468608 bytes for Tidl 2023-08-14 14:38:18.106381580 [I:onnxruntime:, session_state_utils.cc:219 SaveInitializedTensors] Done saving initialized tensors APP: Init ... !!! MEM: Init ... !!! MEM: Initialized DMA HEAP (fd=5) !!! MEM: Init ... Done !!! IPC: Init ... !!! IPC: Init ... Done !!! REMOTE_SERVICE: Init ... !!! REMOTE_SERVICE: Init ... Done !!! 10131.123546 s: GTC Frequency = 200 MHz APP: Init ... Done !!! 10131.123622 s: VX_ZONE_INIT:Enabled 10131.123632 s: VX_ZONE_ERROR:Enabled 10131.123640 s: VX_ZONE_WARNING:Enabled 10131.124317 s: VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!! 10131.125467 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!! 2023-08-14 14:38:18.307358925 [I:onnxruntime:, inference_session.cc:1299 Initialize] Session successfully initialized. 2023-08-14 14:38:19.312266685 [I:onnxruntime:, sequential_executor.cc:157 Execute] Begin execution 2023-08-14 14:38:19.312377605 [I:onnxruntime:test, bfc_arena.cc:280 AllocateRawInternal] Extending BFCArena for Tidl. bin_num:15 rounded_bytes:9437184 2023-08-14 14:38:19.312454870 [I:onnxruntime:test, bfc_arena.cc:165 Extend] Extended allocation by 16777216 bytes. 2023-08-14 14:38:19.312478035 [I:onnxruntime:test, bfc_arena.cc:168 Extend] Total allocated bytes: 43245824 2023-08-14 14:38:19.312503485 [I:onnxruntime:test, bfc_arena.cc:171 Extend] Allocated memory at 0x17e41b60 to 0x18e41b60
