This thread has been locked.
If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.
Original question:
Part Number: AM62A7
Tool/software:
run 'python3 onnxrt_ep.py' to run the 8bit model in PC emulation mode crash crash.
Hi Zhiwe,
It is out pleasure to help. Would you please make sure to:
Best regards,
Qutaiba
Qutaiba,
Use the latest SDK, float32 model output is consistent.
debug_level=3,Sometimes it crashes.
Two logs are provided, one is running normally and the other is crash.
root@4ca06c9a0e36:/work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/examples/osrt_python/ort# python3 onnxrt_ep.py -m dad-3dheads_v3
Skipping import of model optimizer
Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']
Running 1 Models - ['dad-3dheads_v3']
Running_Model : dad-3dheads_v3
\platform.machine : x86_64
numFrames 1
libtidl_onnxrt_EP loaded 0x55e99fdb3cc0
artifacts_folder = ../../../model-artifacts//dad-3dheads_v3/
debug_level = 3
target_priority = 0
max_pre_empt_delay = 340282346638528859811704183484516925440.000000
Final number of subgraphs created are : 1, - Offloaded Nodes - 163, Total Nodes - 163
In TIDL_createStateInfer
Compute on node : TIDLExecutionProvider_TIDL_0_0
************ in TIDL_subgraphRtCreate ************
The soft limit is 10240
The hard limit is 10240
MEM: Init ... !!!
MEM: Init ... Done !!!
0.0s: VX_ZONE_INIT:Enabled
0.20s: VX_ZONE_ERROR:Enabled
0.22s: VX_ZONE_WARNING:Enabled
0.1860s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!!
************ TIDL_subgraphRtCreate done ************
[1, 3, 256, 256]
shape [1, 3, 256, 256]
enter floating_model
******* In TIDL_subgraphRtInvoke ********
0 1.00000 -1.82678 2.64000 6
1 32.00000 -1.76562 2.62500 1
2 5.72365 0.00000 24.02312 0
3 7.18640 -14.26305 14.88923 1
4 2.72968 0.00000 66.67459 0
5 2.47689 -38.96021 36.33594 1
6 12.96401 0.00000 18.47423 0
7 16.63772 -6.97211 5.95033 1
8 5.43261 0.00000 27.79512 0
9 29.53938 -2.86059 2.75903 1
10 8.73972 -12.58622 14.30252 1
11 14.23418 0.00000 13.10227 0
12 17.38975 -4.91669 4.08286 1
13 11.88770 0.00000 11.98718 0
14 20.43881 -5.06390 4.45231 1
15 44.01099 -2.32896 2.03358 1
54 203.86581 -0.50278 0.43901 1
16 12.48491 -5.36648 6.28759 1
17 24.42386 0.00000 8.29107 0
18 40.68316 -2.67924 2.87588 1
19 17.01681 0.00000 7.66889 0
20 29.37257 -2.65554 2.48531 1
21 24.41737 0.00000 8.02707 0
22 23.56140 -2.27066 3.01340 1
23 34.62054 0.00000 6.51347 0
24 29.02790 -2.42870 2.65262 1
25 28.81691 0.00000 8.31109 0
26 21.86626 -3.22415 3.31561 1
27 28.14654 0.00000 8.20705 0
28 19.46270 -5.31786 3.80214 1
29 42.24090 -2.42656 1.71635 1
63 113.47041 -0.90332 0.63893 1
30 4.36347 -9.62536 10.54207 1
31 21.00973 -3.95055 4.33133 1
32 46.10099 0.00000 3.81567 0
33 46.10099 0.00000 3.81567 0
34 39.41442 -0.02543 2.23785 1
35 21.00973 -3.95055 5.92583 1
36 25.26387 -3.38428 2.63222 1
37 58.25418 0.00000 3.41606 0
38 58.25418 0.00000 3.22724 0
39 53.99453 0.00000 1.73166 1
40 42.24090 -2.29635 2.24901 1
41 51.52152 -1.48482 2.25149 1
42 70.61263 0.00000 3.35634 0
43 70.61263 0.00000 3.32094 0
44 65.89487 -0.01518 1.78314 1
45 44.01099 -2.14719 2.40849 1
46 54.09252 -2.02431 1.56214 1
47 69.17455 0.00000 3.45503 0
48 69.17455 0.00000 3.45503 0
49 46.69369 0.00000 2.52711 1
50 29.53938 -2.65747 3.38531 1
51 36.10205 -2.10514 2.35444 1
52 42.20007 0.00000 4.05213 0
53 279.87558 0.00000 0.30371 1
57 42.20007 0.00000 3.22274 0
58 33.92274 0.00000 1.96034 1
55 124.39621 -0.00804 0.95260 1
56 124.39621 -0.47027 0.98878 1
59 33.92274 -0.38322 2.28460 1
60 37.59957 -1.25001 1.36970 1
61 57.66321 0.00000 3.03486 0
62 90.16902 0.00000 0.96485 1
66 57.66321 0.00000 2.47125 0
67 50.89007 0.00000 1.40499 1
115 84.63920 0.00000 1.02789 1
64 134.63828 -0.00743 0.87271 1
65 113.47041 -0.78435 0.96942 1
68 50.89007 -0.62881 1.76852 1
69 31.49768 -1.04770 1.06357 1
70 54.52596 0.00000 2.42087 0
71 62.53254 0.00000 1.05545 1
75 109.05192 0.00000 1.99905 0
76 90.48623 -0.01105 1.19355 1
112 113.49120 0.00000 0.58154 1
73 95.16112 -0.01051 1.04034 1
72 95.24136 -0.87147 0.96072 1
74 47.58056 -0.81966 1.46068 1
77 47.58056 -0.77763 1.82848 1
78 51.11521 -1.05644 1.13469 1
79 53.80313 0.00000 2.52773 0
80 52.03996 0.00000 1.30669 1
83 107.60626 0.00000 1.72388 0
84 91.17462 -0.01097 1.00905 1
81 112.38960 0.00000 0.78480 1
82 56.19480 0.00000 1.56960 1
85 56.19480 -0.00892 1.82823 1
86 62.88666 -1.14757 1.17147 1
87 49.20263 0.00000 2.78066 0
88 49.20263 0.00000 2.78066 0
89 50.90704 0.00000 1.32901 1
90 50.90704 0.00000 1.95906 1
91 30.25549 -1.44108 1.60672 1
92 47.70362 0.00000 2.85753 0
93 47.70362 0.00000 2.72096 0
94 84.54800 -0.01185 1.46409 1
95 62.53254 -0.01599 1.82305 1
96 19.74141 -1.87423 1.74760 1
97 61.07684 0.00000 2.49685 0
98 61.07684 0.00000 2.46411 0
99 44.87978 0.00000 1.64885 1
100 44.87978 0.00000 1.94965 1
101 25.63089 -1.95077 1.71668 1
102 103.59212 0.00000 2.17198 0
103 103.59212 0.00000 2.17198 0
104 56.00729 0.00000 1.98188 1
105 56.00729 0.00000 2.01759 1
106 29.67235 -2.22429 2.05579 1
107 64.37078 0.00000 2.15160 0
108 3.34933 -27.61747 -2.23925 1
109 3.34933 -27.76675 -2.53782 1
110 3.34933 -27.76675 -2.83639 1
111 428.71420 0.00000 0.05482 0
118 64.37078 0.00000 2.12053 0
119 101.47776 0.00000 0.66517 1
116 151.23299 0.00000 0.73397 1
117 84.63920 0.00000 1.32917 1
120 84.63920 0.00000 1.49458 1
121 26.68995 -1.14275 1.25515 1
122 72.84452 0.00000 3.26723 0
123 72.84452 0.00000 2.80735 0
124 85.71568 0.00000 1.18415 1
113 91.11609 0.00000 0.82313 1
114 91.11609 0.00000 0.99873 1
125 42.85784 0.00000 1.62164 1
126 28.27353 -1.43244 1.30864 1
127 41.94308 0.00000 4.39882 0
128 28.14654 0.00000 7.81624 0
129 6.64402 -12.26667 8.42863 1
130 1.46099 -86.92761 50.99297 1
131 2.00544 -60.08668 21.94036 1
132 33.67317 0.00000 6.57794 0
133 22.50267 -2.62191 5.24382 1
134 24.00285 0.00000 7.74908 0
135 1.00000 0.00000 8.41567 6
Layer, Layer Cycles,kernelOnlyCycles, coreLoopCycles,LayerSetupCycles,dmaPipeupCycles, dmaPipeDownCycles, PrefetchCycles,copyKerCoeffCycles,LayerDeinitCycles,LastBlockCycles, paddingTrigger, paddingWait,LayerWithoutPad,LayerHandleCopy, BackupCycles, RestoreCycles,Multic7xContextCopyCycles,
1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
9, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
12, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
13, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
14, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
15, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
54, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
16, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
17, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
20, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
22, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
24, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
26, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
27, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
28, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
29, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
63, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
30, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
31, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
32, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
33, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
34, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
35, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
36, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
37, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
38, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
39, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
40, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
41, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
42, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
43, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
44, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
45, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
46, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
47, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
48, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
49, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
50, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
52, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
53, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
57, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
58, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
55, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
56, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
59, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
60, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
61, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
62, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
66, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
67, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
115, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
64, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
65, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
68, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
69, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
70, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
71, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
75, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
76, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
112, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
73, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
72, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
74, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
77, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
78, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
79, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
80, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
83, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
84, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
81, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
82, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
85, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
86, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
87, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
88, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
89, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
90, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
91, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
92, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
93, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
94, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
95, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
96, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
97, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
98, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
99, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
100, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
101, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
102, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
103, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
104, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
105, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
106, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
107, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
108, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
109, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
110, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
111, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
118, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
119, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
116, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
117, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
120, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
121, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
122, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
124, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
113, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
114, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
125, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
126, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
127, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
128, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
129, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
130, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
131, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
132, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
133, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
134, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
135, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
Sum of Layer Cycles 0
Sub Graph Stats 173.000000 2430551.000000 1521.000000
******* TIDL_subgraphRtInvoke done ********
(1, 1, 1, 512, 8, 8)
[[[[[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
...
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]]
[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
...
[0. 0. 0.291632 ... 0.08332343 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]]
[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
...
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]]
...
[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0.12498514 ... 0.20830856 0.583264
0. ]
...
[0. 0. 0.49994057 ... 1.2915131 1.4164983
0.20830856]
[0. 0. 0. ... 0. 0.74991083
0. ]
[0. 0. 0. ... 0. 0.
0. ]]
[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
...
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]]
[[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
...
[0. 0. 0.6249257 ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]
[0. 0. 0. ... 0. 0.
0. ]]]]]]
Saving image to ../../../output_images/
Completed_Model : 1, Name : dad-3dheads_v3 , Total time : 2432.41, Offload Time : 0.00 , DDR RW MBs : 0, Output File : py_out_dad-3dheads_v3_airshow.jpg
************ in TIDL_subgraphRtDelete ************
MEM: Deinit ... !!!
MEM: Alloc's: 27 alloc's of 101391369 bytes
MEM: Free's : 27 free's of 101391369 bytes
MEM: Open's : 0 allocs of 0 bytes
MEM: Deinit ... Done !!!
root@4ca06c9a0e36:/work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/examples/osrt_python/ort#
root@4ca06c9a0e36:/work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/examples/osrt_python/ort# python3 onnxrt_ep.py -m dad-3dheads_v3 Skipping import of model optimizer Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 1 Models - ['dad-3dheads_v3'] Running_Model : dad-3dheads_v3 \platform.machine : x86_64 numFrames 1 libtidl_onnxrt_EP loaded 0x55e28f708cc0 artifacts_folder = ../../../model-artifacts//dad-3dheads_v3/ debug_level = 3 target_priority = 0 max_pre_empt_delay = 340282346638528859811704183484516925440.000000 Final number of subgraphs created are : 1, - Offloaded Nodes - 163, Total Nodes - 163 In TIDL_createStateInfer Compute on node : TIDLExecutionProvider_TIDL_0_0 ************ in TIDL_subgraphRtCreate ************ The soft limit is 10240 The hard limit is 10240 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.21s: VX_ZONE_ERROR:Enabled 0.23s: VX_ZONE_WARNING:Enabled 0.1663s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! ************ TIDL_subgraphRtCreate done ************ [1, 3, 256, 256] shape [1, 3, 256, 256] enter floating_model ******* In TIDL_subgraphRtInvoke ******** 0 1.00000 -1.82678 2.64000 6 1 32.00000 -1.76562 2.62500 1 2 5.72365 0.00000 24.02312 0 3 7.18640 -14.26305 14.88923 1 4 2.72968 0.00000 66.67459 0 5 2.47689 -38.96021 36.33594 1 6 12.96401 0.00000 18.47423 0 7 16.63772 -6.97211 5.95033 1 8 5.43261 0.00000 27.79512 0 9 29.53938 -2.86059 2.75903 1 10 8.73972 -12.58622 14.30252 1 11 14.23418 0.00000 13.10227 0 12 17.38975 -4.91669 4.08286 1 13 11.88770 0.00000 11.98718 0 14 20.43881 -5.06390 4.45231 1 15 44.01099 -2.32896 2.03358 1 54 203.86581 -0.50278 0.43901 1 16 12.48491 -5.36648 6.28759 1 17 24.42386 0.00000 8.29107 0 18 40.68316 -2.67924 2.87588 1 19 17.01681 0.00000 7.66889 0 20 29.37257 -2.65554 2.48531 1 21 24.41737 0.00000 8.02707 0 22 23.56140 -2.27066 3.01340 1 23 34.62054 0.00000 6.51347 0 24 29.02790 -2.42870 2.65262 1 25 28.81691 0.00000 8.31109 0 26 21.86626 -3.22415 3.31561 1 27 28.14654 0.00000 8.20705 0 28 19.46270 -5.31786 3.80214 1 29 42.24090 -2.42656 1.71635 1 63 113.47041 -0.90332 0.63893 1 30 4.36347 -9.62536 10.54207 1 31 21.00973 -3.95055 4.33133 1 32 46.10099 0.00000 3.81567 0 33 46.10099 0.00000 3.81567 0 34 39.41442 -0.02543 2.23785 1 35 21.00973 -3.95055 5.92583 1 36 25.26387 -3.38428 2.63222 1 37 58.25418 0.00000 3.41606 0 38 58.25418 0.00000 3.22724 0 39 53.99453 0.00000 1.73166 1 40 42.24090 -2.29635 2.24901 1 41 51.52152 -1.48482 2.25149 1 42 70.61263 0.00000 3.35634 0 43 70.61263 0.00000 3.32094 0 44 65.89487 -0.01518 1.78314 1 45 44.01099 -2.14719 2.40849 1 46 54.09252 -2.02431 1.56214 1 47 69.17455 0.00000 3.45503 0 48 69.17455 0.00000 3.45503 0 49 46.69369 0.00000 2.52711 1
Hi Zhiwei,
Thank you for providing the logs. This is a weird behavior and we are investigating. Meanwhile, would you please consider the following:
Best regards,
Qutaiba
HI, Qutaiba,
I will update sdk to V10.0, push it to the EVM board today and test it.
Hi Zhiwei,
I will update sdk to V10.0, push it to the EVM board today and test it.
Please, run on the background /opt/vx_app_arm_remote_log.out which will provide more details about running the model on target.
Also did you try set/export this environment variable to 1 "export TIDL_RT_DEBUG=1" when running on host simulation?
Best regards,
Qutaiba
