This thread has been locked.
If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.
Hello Champs ,
I am trying to run my custom onnx model using edgeai at 9.2 sdk and during compilation mode getting the following error
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : This is an invalid model. Error: Duplicate definition of name (seeds).
Hi Abhi,
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : This is an invalid model. Error: Duplicate definition of name (seeds).
1. Did you tried running model in onnx rt ? (-d mode) what is the observation ?
2. Can you share debug_level 2 logs for model compilation ? so we can understand the issue better
1. I was able to run the model in onnx rt and get the required output
2. i have shared both debug_level2 and 6 of model compilation
cd /home/abhilash/edgeai-tidl-tools ; /usr/bin/env /home/abhilash/anaconda3/envs/edgeai/bin/python /home/abhilash/.vscode/extensions/ms-python.debugpy-2024.4.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher 45749 -- /home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py -c
Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']
Running 1 Models - ['condlanet_org']
Running_Model : condlanet_org
Running shape inference on model /home/abhilash/edgeai-tidl-tools/lucid/model_onnx/FNC_NewForkV1_July14_epoch80_opset9_sim.onnx
***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! *****
tidl_tools_path = /home/abhilash/edgeai-tidl-tools/tidl_tools
artifacts_folder = /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org/
tidl_tensor_bits = 32
debug_level = 6
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
tidl_allowlist_layer_name =
model_type =
tidl_calibration_accuracy_level = 64
tidl_calibration_options:num_frames_calibration = 3
tidl_calibration_options:bias_calibration_iterations = 3
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
ONNX QDQ Enabled = 0
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 0
output_feature_16bit_names_list =
m_params_16bit_names_list =
m_single_core_layers_names_list =
reserved_compile_constraints_flag = 1601
ti_internal_reserved_1 =
WARNING : 'meta_layers_names_list' is not provided - running OD post processing in ARM mode
Number of OD backbone nodes = 0
Size of odBackboneNodeIds = 0
Layer 0 -- layer name -- Conv_0
Input dims size = 4 dims --- 1 3 320 800
Supported TIDL layer type --- Conv -- Conv_0
Layer 1 -- layer name -- Relu_1
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- Relu -- Relu_1
Layer 2 -- layer name -- MaxPool_2
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- MaxPool -- MaxPool_2
Layer 3 -- layer name -- Conv_3
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_3
Layer 4 -- layer name -- Relu_4
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_4
Layer 5 -- layer name -- Conv_5
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_5
Layer 6 -- layer name -- Add_6
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_6
Layer 7 -- layer name -- Relu_7
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_7
Layer 8 -- layer name -- Conv_8
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_8
Layer 9 -- layer name -- Relu_9
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_9
Layer 10 -- layer name -- Conv_10
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_10
Layer 11 -- layer name -- Add_11
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_11
Layer 12 -- layer name -- Relu_12
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_12
Layer 13 -- layer name -- Conv_16
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_16
Layer 14 -- layer name -- Conv_13
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_13
Layer 15 -- layer name -- Relu_14
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_14
Layer 16 -- layer name -- Conv_15
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_15
Layer 17 -- layer name -- Add_17
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_17
Layer 18 -- layer name -- Relu_18
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_18
Layer 19 -- layer name -- Conv_19
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_19
Layer 20 -- layer name -- Relu_20
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_20
Layer 21 -- layer name -- Conv_21
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_21
Layer 22 -- layer name -- Add_22
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_22
Layer 23 -- layer name -- Relu_23
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_23
Layer 24 -- layer name -- Conv_27
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_27
Layer 25 -- layer name -- Conv_24
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_24
Layer 26 -- layer name -- Relu_25
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_25
Layer 27 -- layer name -- Conv_26
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_26
Layer 28 -- layer name -- Add_28
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_28
Layer 29 -- layer name -- Relu_29
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_29
Layer 30 -- layer name -- Conv_30
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_30
Layer 31 -- layer name -- Relu_31
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_31
Layer 32 -- layer name -- Conv_32
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_32
Layer 33 -- layer name -- Add_33
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_33
Layer 34 -- layer name -- Relu_34
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_34
Layer 35 -- layer name -- Conv_38
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_38
Layer 36 -- layer name -- Conv_35
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_35
Layer 37 -- layer name -- Relu_36
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_36
Layer 38 -- layer name -- Conv_37
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_37
Layer 39 -- layer name -- Add_39
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_39
Layer 40 -- layer name -- Relu_40
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_40
Layer 41 -- layer name -- Conv_41
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_41
Layer 42 -- layer name -- Relu_42
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_42
Layer 43 -- layer name -- Conv_43
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_43
Layer 44 -- layer name -- Add_44
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_44
Layer 45 -- layer name -- Relu_45
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_45
Layer 46 -- layer name -- Conv_46
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_46
Layer 47 -- layer name -- Relu_47
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_47
Layer 48 -- layer name -- Add_58
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_58
Layer 49 -- layer name -- Conv_75
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_75
Layer 50 -- layer name -- Reshape_80
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_80
Layer 51 -- layer name -- Conv_66
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_66
Layer 52 -- layer name -- Reshape_71
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_71
Layer 53 -- layer name -- Conv_59
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_59
Layer 54 -- layer name -- Reshape_64
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_64
Layer 55 -- layer name -- Transpose_65
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_65
Layer 56 -- layer name -- MatMul_72
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_72
Layer 57 -- layer name -- Softmax_73
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_73
Layer 58 -- layer name -- Transpose_74
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_74
Layer 59 -- layer name -- MatMul_81
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_81
Layer 60 -- layer name -- Reshape_86
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_86
Layer 61 -- layer name -- Mul_87
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_87
Layer 62 -- layer name -- Add_88
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_88
Layer 63 -- layer name -- Conv_89
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_89
Layer 64 -- layer name -- Relu_90
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_90
Layer 65 -- layer name -- Conv_91
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_91
Layer 66 -- layer name -- Relu_92
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_92
Layer 67 -- layer name -- Add_103
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_103
Layer 68 -- layer name -- Conv_120
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_120
Layer 69 -- layer name -- Reshape_125
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_125
Layer 70 -- layer name -- Conv_111
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_111
Layer 71 -- layer name -- Reshape_116
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_116
Layer 72 -- layer name -- Conv_104
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_104
Layer 73 -- layer name -- Reshape_109
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_109
Layer 74 -- layer name -- Transpose_110
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_110
Layer 75 -- layer name -- MatMul_117
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_117
Layer 76 -- layer name -- Softmax_118
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_118
Layer 77 -- layer name -- Transpose_119
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_119
Layer 78 -- layer name -- MatMul_126
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_126
Layer 79 -- layer name -- Reshape_131
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_131
Layer 80 -- layer name -- Mul_132
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_132
Layer 81 -- layer name -- Add_133
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_133
Layer 82 -- layer name -- Conv_134
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_134
Layer 83 -- layer name -- Relu_135
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_135
Layer 84 -- layer name -- Conv_138
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_138
Layer 85 -- layer name -- Upsample_139
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Upsample -- Upsample_139
Layer 86 -- layer name -- Conv_137
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_137
Layer 87 -- layer name -- Add_140
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Add -- Add_140
Layer 88 -- layer name -- Conv_144
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_144
Layer 89 -- layer name -- Conv_148
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_148
Layer 90 -- layer name -- Relu_149
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_149
Layer 91 -- layer name -- Conv_150
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_150
Layer 92 -- layer name -- Sigmoid_166
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sigmoid -- Sigmoid_166
Layer 93 -- layer name -- Clip_167
Input dims size = 4 dims --- 1 8 20 50
Unsupported (TIDL check) TIDL layer type --- Clip
Layer 94 -- layer name -- MaxPool_182
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- MaxPool -- MaxPool_182
Layer 95 -- layer name -- Sub_183
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sub -- Sub_183
Layer 96 -- layer name -- Add_185
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Add -- Add_185
Layer 97 -- layer name -- Div_186
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Div -- Div_186
Layer 98 -- layer name -- Sub_188
Input dims size = 0 dims ---
Supported TIDL layer type --- Sub -- Sub_188
Layer 99 -- layer name -- Mul_189
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Mul -- Mul_189
Layer 100 -- layer name -- Squeeze_190
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Squeeze -- Squeeze_190
Layer 101 -- layer name -- Reshape_192
Input dims size = 3 dims --- 8 20 50
Supported TIDL layer type --- Reshape -- Reshape_192
Layer 102 -- layer name -- TopK_193
Input dims size = 1 dims --- 8000
Unsupported (imports) TIDL layer type for ONNX op type --- TopK
Layer 103 -- layer name -- Reshape_195
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_195
Layer 104 -- layer name -- Mul_199
Input dims size = 0 dims ---
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 105 -- layer name -- Slice_203
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_203
Layer 106 -- layer name -- Gather_207
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 107 -- layer name -- Conv_151
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_151
Layer 108 -- layer name -- Relu_152
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_152
Layer 109 -- layer name -- Conv_153
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_153
Layer 110 -- layer name -- Reshape_172
Input dims size = 4 dims --- 1 1072 20 50
Supported TIDL layer type --- Reshape -- Reshape_172
Layer 111 -- layer name -- Transpose_179
Input dims size = 5 dims --- 1 8 134 20 50
Unsupported (TIDL check) TIDL layer type --- Transpose
Layer 112 -- layer name -- Reshape_181
Input dims size = 5 dims --- 1 8 20 50 134
Supported TIDL layer type --- Reshape -- Reshape_181
Layer 113 -- layer name -- Slice_205
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_205
Layer 114 -- layer name -- Gather_209
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_209
Layer 115 -- layer name -- Slice_229
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_229
Layer 116 -- layer name -- Sub_231
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_231
Layer 117 -- layer name -- Reshape_241
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_241
Layer 118 -- layer name -- Reshape_249
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_249
Layer 119 -- layer name -- Slice_228
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_228
Layer 120 -- layer name -- Reshape_236
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_236
Layer 121 -- layer name -- Reshape_243
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_243
Layer 122 -- layer name -- Upsample_141
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Upsample -- Upsample_141
Layer 123 -- layer name -- Conv_136
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_136
Layer 124 -- layer name -- Add_142
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Add -- Add_142
Layer 125 -- layer name -- Conv_143
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_143
Layer 126 -- layer name -- Conv_173
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_173
Layer 127 -- layer name -- Relu_174
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_174
Layer 128 -- layer name -- Conv_175
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_175
Layer 129 -- layer name -- Relu_176
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_176
Layer 130 -- layer name -- Conv_177
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_177
Layer 131 -- layer name -- Relu_178
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_178
Layer 132 -- layer name -- Concat_217
Input dims size = 0 dims ---
Supported TIDL layer type --- Concat -- Concat_217
Layer 133 -- layer name -- Slice_218
Input dims size = 4 dims --- 1 66 40 100
Unsupported (TIDL check) TIDL layer type --- Slice
Layer 134 -- layer name -- Concat_220
Input dims size = 4 dims --- 1 66 40 100
Supported TIDL layer type --- Concat -- Concat_220
Layer 135 -- layer name -- Reshape_224
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_224
Layer 136 -- layer name -- Mul_244
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 137 -- layer name -- Reshape_246
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_246
Layer 138 -- layer name -- ReduceSum_247
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 139 -- layer name -- Add_250
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 140 -- layer name -- Reshape_254
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_254
Layer 141 -- layer name -- Transpose_305
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Transpose -- Transpose_305
Layer 142 -- layer name -- Reshape_312
Input dims size = 4 dims --- 1 6 100 40
Supported TIDL layer type --- Reshape -- Reshape_312
Layer 143 -- layer name -- Conv_313
Input dims size = 3 dims --- 6 100 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 144 -- layer name -- Relu_314
Input dims size = 3 dims --- 6 64 40
Supported TIDL layer type --- Relu -- Relu_314
Layer 145 -- layer name -- Conv_315
Input dims size = 3 dims --- 6 64 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 146 -- layer name -- Transpose_316
Input dims size = 3 dims --- 6 2 40
Supported TIDL layer type --- Transpose -- Transpose_316
Layer 147 -- layer name -- Slice_204
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_204
Layer 148 -- layer name -- Gather_257
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 149 -- layer name -- Slice_255
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_255
Layer 150 -- layer name -- Gather_259
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_259
Layer 151 -- layer name -- Slice_279
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_279
Layer 152 -- layer name -- Sub_281
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_281
Layer 153 -- layer name -- Reshape_291
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_291
Layer 154 -- layer name -- Reshape_299
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_299
Layer 155 -- layer name -- Slice_278
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_278
Layer 156 -- layer name -- Reshape_286
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_286
Layer 157 -- layer name -- Reshape_293
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_293
Layer 158 -- layer name -- Reshape_274
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_274
Layer 159 -- layer name -- Mul_294
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 160 -- layer name -- Reshape_296
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_296
Layer 161 -- layer name -- ReduceSum_297
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 162 -- layer name -- Add_300
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 163 -- layer name -- Reshape_304
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_304
Layer 164 -- layer name -- Reshape_197
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_197
Preliminary subgraphs created = 14
Final number of subgraphs created are : 13, - Offloaded Nodes - 150, Total Nodes - 165
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
TIDL ALLOWLISTING LAYER CHECK -- [TIDL_ClipLayer] Clip must have min <= 0 and max > 0.
Layers type not supported by TIDL --- layer type - TopK, Node name -TopK_193
ALLOWLISTING : ADD/MUL layer : Eltwise operator is supported only with operands of similar dimensions or broadcast supported patterns of both inputs -- file info - tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 542
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 757
TIDL ALLOWLISTING LAYER CHECK -- [TIDL_TransposeLayer] Unsupported transpose, only permutes (last dim not changing) are supported when numDim > 4
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
ALLOWLISTING : Slice layer : Unsupported axis parameters2-- file info - tidl_onnxImport.cpp , TIDL_onnxMapSliceBaseParams , 1591
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_247
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 757
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_297
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Running runtimes graphviz - /home/abhilash/edgeai-tidl-tools/tidl_tools/tidl_graphVisualiser_runtimes.out /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//allowedNode.txt /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//tempDir/graphvizInfo.txt /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//tempDir/runtimes_visualization.svg
Traceback (most recent call last):
File "/home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py", line 429, in <module>
run_model(model, mIdx)
File "/home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py", line 311, in run_model
sess = rt.InferenceSession(config['model_path'] ,providers=EP_list, provider_options=[delegate_options, {}], sess_options=so)
File "/home/abhilash/anaconda3/envs/edgeai/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 362, in __init__
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/abhilash/anaconda3/envs/edgeai/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 410, in _create_inference_session
sess.initialize_session(providers, provider_options, disabled_optimizers)
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : This is an invalid model. Error: Duplicate definition of name (seeds).
cd /home/abhilash/edgeai-tidl-tools ; /usr/bin/env /home/abhilash/anaconda3/envs/edgeai/bin/python /home/abhilash/.vscode/extensions/ms-python.debugpy-2024.4.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher 45749 -- /home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py -c
Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']
Running 1 Models - ['condlanet_org']
Running_Model : condlanet_org
Running shape inference on model /home/abhilash/edgeai-tidl-tools/lucid/model_onnx/FNC_NewForkV1_July14_epoch80_opset9_sim.onnx
***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! *****
tidl_tools_path = /home/abhilash/edgeai-tidl-tools/tidl_tools
artifacts_folder = /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org/
tidl_tensor_bits = 32
debug_level = 6
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
tidl_allowlist_layer_name =
model_type =
tidl_calibration_accuracy_level = 64
tidl_calibration_options:num_frames_calibration = 3
tidl_calibration_options:bias_calibration_iterations = 3
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
ONNX QDQ Enabled = 0
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 0
output_feature_16bit_names_list =
m_params_16bit_names_list =
m_single_core_layers_names_list =
reserved_compile_constraints_flag = 1601
ti_internal_reserved_1 =
WARNING : 'meta_layers_names_list' is not provided - running OD post processing in ARM mode
Number of OD backbone nodes = 0
Size of odBackboneNodeIds = 0
Layer 0 -- layer name -- Conv_0
Input dims size = 4 dims --- 1 3 320 800
Supported TIDL layer type --- Conv -- Conv_0
Layer 1 -- layer name -- Relu_1
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- Relu -- Relu_1
Layer 2 -- layer name -- MaxPool_2
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- MaxPool -- MaxPool_2
Layer 3 -- layer name -- Conv_3
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_3
Layer 4 -- layer name -- Relu_4
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_4
Layer 5 -- layer name -- Conv_5
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_5
Layer 6 -- layer name -- Add_6
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_6
Layer 7 -- layer name -- Relu_7
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_7
Layer 8 -- layer name -- Conv_8
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_8
Layer 9 -- layer name -- Relu_9
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_9
Layer 10 -- layer name -- Conv_10
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_10
Layer 11 -- layer name -- Add_11
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_11
Layer 12 -- layer name -- Relu_12
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_12
Layer 13 -- layer name -- Conv_16
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_16
Layer 14 -- layer name -- Conv_13
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_13
Layer 15 -- layer name -- Relu_14
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_14
Layer 16 -- layer name -- Conv_15
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_15
Layer 17 -- layer name -- Add_17
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_17
Layer 18 -- layer name -- Relu_18
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_18
Layer 19 -- layer name -- Conv_19
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_19
Layer 20 -- layer name -- Relu_20
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_20
Layer 21 -- layer name -- Conv_21
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_21
Layer 22 -- layer name -- Add_22
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_22
Layer 23 -- layer name -- Relu_23
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_23
Layer 24 -- layer name -- Conv_27
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_27
Layer 25 -- layer name -- Conv_24
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_24
Layer 26 -- layer name -- Relu_25
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_25
Layer 27 -- layer name -- Conv_26
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_26
Layer 28 -- layer name -- Add_28
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_28
Layer 29 -- layer name -- Relu_29
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_29
Layer 30 -- layer name -- Conv_30
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_30
Layer 31 -- layer name -- Relu_31
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_31
Layer 32 -- layer name -- Conv_32
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_32
Layer 33 -- layer name -- Add_33
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_33
Layer 34 -- layer name -- Relu_34
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_34
Layer 35 -- layer name -- Conv_38
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_38
Layer 36 -- layer name -- Conv_35
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_35
Layer 37 -- layer name -- Relu_36
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_36
Layer 38 -- layer name -- Conv_37
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_37
Layer 39 -- layer name -- Add_39
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_39
Layer 40 -- layer name -- Relu_40
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_40
Layer 41 -- layer name -- Conv_41
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_41
Layer 42 -- layer name -- Relu_42
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_42
Layer 43 -- layer name -- Conv_43
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_43
Layer 44 -- layer name -- Add_44
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_44
Layer 45 -- layer name -- Relu_45
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_45
Layer 46 -- layer name -- Conv_46
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_46
Layer 47 -- layer name -- Relu_47
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_47
Layer 48 -- layer name -- Add_58
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_58
Layer 49 -- layer name -- Conv_75
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_75
Layer 50 -- layer name -- Reshape_80
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_80
Layer 51 -- layer name -- Conv_66
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_66
Layer 52 -- layer name -- Reshape_71
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_71
Layer 53 -- layer name -- Conv_59
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_59
Layer 54 -- layer name -- Reshape_64
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_64
Layer 55 -- layer name -- Transpose_65
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_65
Layer 56 -- layer name -- MatMul_72
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_72
Layer 57 -- layer name -- Softmax_73
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_73
Layer 58 -- layer name -- Transpose_74
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_74
Layer 59 -- layer name -- MatMul_81
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_81
Layer 60 -- layer name -- Reshape_86
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_86
Layer 61 -- layer name -- Mul_87
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_87
Layer 62 -- layer name -- Add_88
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_88
Layer 63 -- layer name -- Conv_89
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_89
Layer 64 -- layer name -- Relu_90
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_90
Layer 65 -- layer name -- Conv_91
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_91
Layer 66 -- layer name -- Relu_92
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_92
Layer 67 -- layer name -- Add_103
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_103
Layer 68 -- layer name -- Conv_120
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_120
Layer 69 -- layer name -- Reshape_125
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_125
Layer 70 -- layer name -- Conv_111
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_111
Layer 71 -- layer name -- Reshape_116
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_116
Layer 72 -- layer name -- Conv_104
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_104
Layer 73 -- layer name -- Reshape_109
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_109
Layer 74 -- layer name -- Transpose_110
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_110
Layer 75 -- layer name -- MatMul_117
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_117
Layer 76 -- layer name -- Softmax_118
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_118
Layer 77 -- layer name -- Transpose_119
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_119
Layer 78 -- layer name -- MatMul_126
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_126
Layer 79 -- layer name -- Reshape_131
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_131
Layer 80 -- layer name -- Mul_132
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_132
Layer 81 -- layer name -- Add_133
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_133
Layer 82 -- layer name -- Conv_134
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_134
Layer 83 -- layer name -- Relu_135
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_135
Layer 84 -- layer name -- Conv_138
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_138
Layer 85 -- layer name -- Upsample_139
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Upsample -- Upsample_139
Layer 86 -- layer name -- Conv_137
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_137
Layer 87 -- layer name -- Add_140
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Add -- Add_140
Layer 88 -- layer name -- Conv_144
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_144
Layer 89 -- layer name -- Conv_148
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_148
Layer 90 -- layer name -- Relu_149
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_149
Layer 91 -- layer name -- Conv_150
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_150
Layer 92 -- layer name -- Sigmoid_166
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sigmoid -- Sigmoid_166
Layer 93 -- layer name -- Clip_167
Input dims size = 4 dims --- 1 8 20 50
Unsupported (TIDL check) TIDL layer type --- Clip
Layer 94 -- layer name -- MaxPool_182
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- MaxPool -- MaxPool_182
Layer 95 -- layer name -- Sub_183
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sub -- Sub_183
Layer 96 -- layer name -- Add_185
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Add -- Add_185
Layer 97 -- layer name -- Div_186
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Div -- Div_186
Layer 98 -- layer name -- Sub_188
Input dims size = 0 dims ---
Supported TIDL layer type --- Sub -- Sub_188
Layer 99 -- layer name -- Mul_189
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Mul -- Mul_189
Layer 100 -- layer name -- Squeeze_190
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Squeeze -- Squeeze_190
Layer 101 -- layer name -- Reshape_192
Input dims size = 3 dims --- 8 20 50
Supported TIDL layer type --- Reshape -- Reshape_192
Layer 102 -- layer name -- TopK_193
Input dims size = 1 dims --- 8000
Unsupported (imports) TIDL layer type for ONNX op type --- TopK
Layer 103 -- layer name -- Reshape_195
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_195
Layer 104 -- layer name -- Mul_199
Input dims size = 0 dims ---
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 105 -- layer name -- Slice_203
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_203
Layer 106 -- layer name -- Gather_207
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 107 -- layer name -- Conv_151
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_151
Layer 108 -- layer name -- Relu_152
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_152
Layer 109 -- layer name -- Conv_153
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_153
Layer 110 -- layer name -- Reshape_172
Input dims size = 4 dims --- 1 1072 20 50
Supported TIDL layer type --- Reshape -- Reshape_172
Layer 111 -- layer name -- Transpose_179
Input dims size = 5 dims --- 1 8 134 20 50
Unsupported (TIDL check) TIDL layer type --- Transpose
Layer 112 -- layer name -- Reshape_181
Input dims size = 5 dims --- 1 8 20 50 134
Supported TIDL layer type --- Reshape -- Reshape_181
Layer 113 -- layer name -- Slice_205
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_205
Layer 114 -- layer name -- Gather_209
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_209
Layer 115 -- layer name -- Slice_229
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_229
Layer 116 -- layer name -- Sub_231
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_231
Layer 117 -- layer name -- Reshape_241
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_241
Layer 118 -- layer name -- Reshape_249
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_249
Layer 119 -- layer name -- Slice_228
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_228
Layer 120 -- layer name -- Reshape_236
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_236
Layer 121 -- layer name -- Reshape_243
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_243
Layer 122 -- layer name -- Upsample_141
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Upsample -- Upsample_141
Layer 123 -- layer name -- Conv_136
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_136
Layer 124 -- layer name -- Add_142
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Add -- Add_142
Layer 125 -- layer name -- Conv_143
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_143
Layer 126 -- layer name -- Conv_173
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_173
Layer 127 -- layer name -- Relu_174
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_174
Layer 128 -- layer name -- Conv_175
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_175
Layer 129 -- layer name -- Relu_176
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_176
Layer 130 -- layer name -- Conv_177
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_177
Layer 131 -- layer name -- Relu_178
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_178
Layer 132 -- layer name -- Concat_217
Input dims size = 0 dims ---
Supported TIDL layer type --- Concat -- Concat_217
Layer 133 -- layer name -- Slice_218
Input dims size = 4 dims --- 1 66 40 100
Unsupported (TIDL check) TIDL layer type --- Slice
Layer 134 -- layer name -- Concat_220
Input dims size = 4 dims --- 1 66 40 100
Supported TIDL layer type --- Concat -- Concat_220
Layer 135 -- layer name -- Reshape_224
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_224
Layer 136 -- layer name -- Mul_244
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 137 -- layer name -- Reshape_246
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_246
Layer 138 -- layer name -- ReduceSum_247
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 139 -- layer name -- Add_250
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 140 -- layer name -- Reshape_254
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_254
Layer 141 -- layer name -- Transpose_305
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Transpose -- Transpose_305
Layer 142 -- layer name -- Reshape_312
Input dims size = 4 dims --- 1 6 100 40
Supported TIDL layer type --- Reshape -- Reshape_312
Layer 143 -- layer name -- Conv_313
Input dims size = 3 dims --- 6 100 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 144 -- layer name -- Relu_314
Input dims size = 3 dims --- 6 64 40
Supported TIDL layer type --- Relu -- Relu_314
Layer 145 -- layer name -- Conv_315
Input dims size = 3 dims --- 6 64 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 146 -- layer name -- Transpose_316
Input dims size = 3 dims --- 6 2 40
Supported TIDL layer type --- Transpose -- Transpose_316
Layer 147 -- layer name -- Slice_204
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_204
Layer 148 -- layer name -- Gather_257
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 149 -- layer name -- Slice_255
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_255
Layer 150 -- layer name -- Gather_259
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_259
Layer 151 -- layer name -- Slice_279
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_279
Layer 152 -- layer name -- Sub_281
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_281
Layer 153 -- layer name -- Reshape_291
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_291
Layer 154 -- layer name -- Reshape_299
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_299
Layer 155 -- layer name -- Slice_278
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_278
Layer 156 -- layer name -- Reshape_286
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_286
Layer 157 -- layer name -- Reshape_293
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_293
Layer 158 -- layer name -- Reshape_274
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_274
Layer 159 -- layer name -- Mul_294
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 160 -- layer name -- Reshape_296
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_296
Layer 161 -- layer name -- ReduceSum_297
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 162 -- layer name -- Add_300
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 163 -- layer name -- Reshape_304
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_304
Layer 164 -- layer name -- Reshape_197
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_197
Preliminary subgraphs created = 14
Final number of subgraphs created are : 13, - Offloaded Nodes - 150, Total Nodes - 165
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
TIDL ALLOWLISTING LAYER CHECK -- [TIDL_ClipLayer] Clip must have min <= 0 and max > 0.
Layers type not supported by TIDL --- layer type - TopK, Node name -TopK_193
ALLOWLISTING : ADD/MUL layer : Eltwise operator is supported only with operands of similar dimensions or broadcast supported patterns of both inputs -- file info - tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 542
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 757
TIDL ALLOWLISTING LAYER CHECK -- [TIDL_TransposeLayer] Unsupported transpose, only permutes (last dim not changing) are supported when numDim > 4
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
ALLOWLISTING : Slice layer : Unsupported axis parameters2-- file info - tidl_onnxImport.cpp , TIDL_onnxMapSliceBaseParams , 1591
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_247
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 757
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_297
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 331
Running runtimes graphviz - /home/abhilash/edgeai-tidl-tools/tidl_tools/tidl_graphVisualiser_runtimes.out /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//allowedNode.txt /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//tempDir/graphvizInfo.txt /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//tempDir/runtimes_visualization.svg
Traceback (most recent call last):
File "/home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py", line 429, in <module>
run_model(model, mIdx)
File "/home/abhilash/edgeai-tidl-tools/examples/osrt_python/ort/onnxrt_ep_lucidv3.py", line 311, in run_model
sess = rt.InferenceSession(config['model_path'] ,providers=EP_list, provider_options=[delegate_options, {}], sess_options=so)
File "/home/abhilash/anaconda3/envs/edgeai/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 362, in __init__
self._create_inference_session(providers, provider_options, disabled_optimizers)
File "/home/abhilash/anaconda3/envs/edgeai/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 410, in _create_inference_session
sess.initialize_session(providers, provider_options, disabled_optimizers)
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : This is an invalid model. Error: Duplicate definition of name (seeds).
Hi Abhi,
"Running runtimes graphviz - /home/abhilash/edgeai-tidl-tools/tidl_tools/tidl_graphVisualiser_runtimes.out /home/abhilash/edgeai-tidl-tools/model artifacts/condlanet_org/condlanet_org//allowedNode.txt /home/abhilash/edgeai-tidl-tools/model artifacts/condlanet_org/condlanet_org//tempDir/graphvizInfo.txt /home/abhilash/edgeai-tidl-tools/model-artifacts/condlanet_org/condlanet_org//tempDir/runtimes_visualization.svg "
From the above shared logs it seems like model import failed during execution of graph visualizer tool.
Have you shared the same model "FNC_NewForkV1_July14_epoch80_opset9_sim.onnx" with us ?
If not i would recommend to share the same (model and workspace delta) with us so we can try to replicate the issue at my end.
Pratik
Hi Pratik
can we disable the graph visualizer tool to check if other steps are getting processed ? Is there any flag to disable it
No you donot have that model , i shall share that model with you guys shortly
Thanks for sharing the models.
Will look into it and get back to you shortly.
Hi Abhilash,
We have external dependency for the current thread, i have informed respective stakeholder on this.
Will update as soon i get reply on this.
Thanks
Pratik Kedar @pramod swami we kind of hit this never ending loop again here.
Could you pls share more details on what is your supplier looking in to now?
1. They could identify the root cause?
2. Do they have the break down of the tasks?
this will help us in what we need to focus on and what is coming our way!
Regards,
Ramesh.
Hi Ramesh,
I understand the concerns, allow me list down next action items we are planning at our end.
First and foremost, we have internal dev release on updated 9.2 tools, we plan to check the observation on the same. Secondly, since model import failed at graph viz stage, we plan to rebuild the tools without this functionality and bypassing it to check next level of details.
We plan to update this thread post above experiments are concluded.
Thank You
Thanks Pratik Kedar
Could you pls update the ETA as well. Not to push you but we are blocked on this and our demo time is approaching fast 
Hi Pratik ,
we have analysed and generated new log with tag 09_02_07_00 , the logs are attached . Please have a look and please share your solutions , wanted to know is there option to disable the graph generation in the pipeline
Hi Abhilash,
Here are few observations from my end.
With the latest 9.2.7.0 tools, when i have tried compiling the condlane model, I was able to see 152 nodes are supported outof 165 and total 12 subgraphs were created. There seems to be no issue with graphviz least from console logs. During calibration stage, where the REF_Kernels calls invoked, in particularly in convolution kernel i can verify that core dump has occurred.
~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/root/examples/osrt_python/advanced_examples/unit_tests_validation/model-artifacts/FNC_NewForkV1_July14_epoch80_opset9_sim_rand_weight_model/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . ..PC_dsp_test_dl_algo.out: src/tidl_conv2d_base.c:1549: int32_t TIDL_refConv2dProcess(const TIDL_CreateParams*, sTIDL_AlgLayer_t*, sTIDL_Layer_t*, sTIDL_ConvParams_t*, tidlConv2dBuffParams_t*, void*, void*): Assertion `0' failed. Aborted (core dumped)
I have briefed about the issue to team, let me check again for an update on this observation post, upon confirmation we plan to track this as JIRA.
Thank you for patience.
Hello Pratik
adding more details , in the "condlanet_int8.txt" log we had made the #calibration images as 1 and we were getting that error and even in the graph creation is still have the issue "TIDL_RT_OVX: ERROR: Verify OpenVX graph failed " and "ERROR: Running TIDL graph ... Failed !!!"
In the current attachment i have shared the logs for int8 and fp32 for tag 9.2.7.0 with default calibration and u can see that there still persists the error of graph creation
***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! *****
tidl_tools_path = /home/root/tidl_tools
artifacts_folder = ../../../model-artifacts//condlanet_org/
tidl_tensor_bits = 32
debug_level = 6
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
tidl_allowlist_layer_name =
model_type =
tidl_calibration_accuracy_level = 64
tidl_calibration_options:num_frames_calibration = 3
tidl_calibration_options:bias_calibration_iterations = 3
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
ONNX QDQ Enabled = 0
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 0
output_feature_16bit_names_list =
m_params_16bit_names_list =
m_single_core_layers_names_list =
reserved_compile_constraints_flag = 1601
ti_internal_reserved_1 =
WARNING : 'meta_layers_names_list' is not provided - running OD post processing in ARM mode
Number of OD backbone nodes = 0
Size of odBackboneNodeIds = 0
Layer 0 -- layer name -- Conv_0
Input dims size = 4 dims --- 1 3 320 800
Supported TIDL layer type --- Conv -- Conv_0
Layer 1 -- layer name -- Relu_1
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- Relu -- Relu_1
Layer 2 -- layer name -- MaxPool_2
Input dims size = 4 dims --- 1 64 160 400
Supported TIDL layer type --- MaxPool -- MaxPool_2
Layer 3 -- layer name -- Conv_3
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_3
Layer 4 -- layer name -- Relu_4
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_4
Layer 5 -- layer name -- Conv_5
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_5
Layer 6 -- layer name -- Add_6
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_6
Layer 7 -- layer name -- Relu_7
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_7
Layer 8 -- layer name -- Conv_8
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_8
Layer 9 -- layer name -- Relu_9
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_9
Layer 10 -- layer name -- Conv_10
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_10
Layer 11 -- layer name -- Add_11
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Add -- Add_11
Layer 12 -- layer name -- Relu_12
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Relu -- Relu_12
Layer 13 -- layer name -- Conv_16
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_16
Layer 14 -- layer name -- Conv_13
Input dims size = 4 dims --- 1 64 80 200
Supported TIDL layer type --- Conv -- Conv_13
Layer 15 -- layer name -- Relu_14
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_14
Layer 16 -- layer name -- Conv_15
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_15
Layer 17 -- layer name -- Add_17
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_17
Layer 18 -- layer name -- Relu_18
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_18
Layer 19 -- layer name -- Conv_19
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_19
Layer 20 -- layer name -- Relu_20
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_20
Layer 21 -- layer name -- Conv_21
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_21
Layer 22 -- layer name -- Add_22
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Add -- Add_22
Layer 23 -- layer name -- Relu_23
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Relu -- Relu_23
Layer 24 -- layer name -- Conv_27
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_27
Layer 25 -- layer name -- Conv_24
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_24
Layer 26 -- layer name -- Relu_25
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_25
Layer 27 -- layer name -- Conv_26
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_26
Layer 28 -- layer name -- Add_28
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_28
Layer 29 -- layer name -- Relu_29
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_29
Layer 30 -- layer name -- Conv_30
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_30
Layer 31 -- layer name -- Relu_31
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_31
Layer 32 -- layer name -- Conv_32
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_32
Layer 33 -- layer name -- Add_33
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Add -- Add_33
Layer 34 -- layer name -- Relu_34
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Relu -- Relu_34
Layer 35 -- layer name -- Conv_38
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_38
Layer 36 -- layer name -- Conv_35
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_35
Layer 37 -- layer name -- Relu_36
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_36
Layer 38 -- layer name -- Conv_37
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_37
Layer 39 -- layer name -- Add_39
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_39
Layer 40 -- layer name -- Relu_40
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_40
Layer 41 -- layer name -- Conv_41
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_41
Layer 42 -- layer name -- Relu_42
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_42
Layer 43 -- layer name -- Conv_43
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_43
Layer 44 -- layer name -- Add_44
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Add -- Add_44
Layer 45 -- layer name -- Relu_45
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Relu -- Relu_45
Layer 46 -- layer name -- Conv_46
Input dims size = 4 dims --- 1 512 10 25
Supported TIDL layer type --- Conv -- Conv_46
Layer 47 -- layer name -- Relu_47
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_47
Layer 48 -- layer name -- Add_58
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_58
Layer 49 -- layer name -- Conv_75
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_75
Layer 50 -- layer name -- Reshape_80
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_80
Layer 51 -- layer name -- Conv_66
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_66
Layer 52 -- layer name -- Reshape_71
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_71
Layer 53 -- layer name -- Conv_59
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_59
Layer 54 -- layer name -- Reshape_64
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_64
Layer 55 -- layer name -- Transpose_65
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_65
Layer 56 -- layer name -- MatMul_72
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_72
Layer 57 -- layer name -- Softmax_73
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_73
Layer 58 -- layer name -- Transpose_74
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_74
Layer 59 -- layer name -- MatMul_81
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_81
Layer 60 -- layer name -- Reshape_86
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_86
Layer 61 -- layer name -- Mul_87
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_87
Layer 62 -- layer name -- Add_88
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_88
Layer 63 -- layer name -- Conv_89
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_89
Layer 64 -- layer name -- Relu_90
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_90
Layer 65 -- layer name -- Conv_91
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_91
Layer 66 -- layer name -- Relu_92
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_92
Layer 67 -- layer name -- Add_103
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_103
Layer 68 -- layer name -- Conv_120
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_120
Layer 69 -- layer name -- Reshape_125
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Reshape -- Reshape_125
Layer 70 -- layer name -- Conv_111
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_111
Layer 71 -- layer name -- Reshape_116
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_116
Layer 72 -- layer name -- Conv_104
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_104
Layer 73 -- layer name -- Reshape_109
Input dims size = 4 dims --- 1 16 10 25
Supported TIDL layer type --- Reshape -- Reshape_109
Layer 74 -- layer name -- Transpose_110
Input dims size = 3 dims --- 1 16 250
Supported TIDL layer type --- Transpose -- Transpose_110
Layer 75 -- layer name -- MatMul_117
Input dims size = 3 dims --- 1 250 16
Supported TIDL layer type --- MatMul -- MatMul_117
Layer 76 -- layer name -- Softmax_118
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Softmax -- Softmax_118
Layer 77 -- layer name -- Transpose_119
Input dims size = 3 dims --- 1 250 250
Supported TIDL layer type --- Transpose -- Transpose_119
Layer 78 -- layer name -- MatMul_126
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- MatMul -- MatMul_126
Layer 79 -- layer name -- Reshape_131
Input dims size = 3 dims --- 1 64 250
Supported TIDL layer type --- Reshape -- Reshape_131
Layer 80 -- layer name -- Mul_132
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_132
Layer 81 -- layer name -- Add_133
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Add -- Add_133
Layer 82 -- layer name -- Conv_134
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_134
Layer 83 -- layer name -- Relu_135
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Relu -- Relu_135
Layer 84 -- layer name -- Conv_138
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Conv -- Conv_138
Layer 85 -- layer name -- Upsample_139
Input dims size = 4 dims --- 1 64 10 25
Supported TIDL layer type --- Upsample -- Upsample_139
Layer 86 -- layer name -- Conv_137
Input dims size = 4 dims --- 1 256 20 50
Supported TIDL layer type --- Conv -- Conv_137
Layer 87 -- layer name -- Add_140
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Add -- Add_140
Layer 88 -- layer name -- Conv_144
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_144
Layer 89 -- layer name -- Conv_148
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_148
Layer 90 -- layer name -- Relu_149
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_149
Layer 91 -- layer name -- Conv_150
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_150
Layer 92 -- layer name -- Sigmoid_166
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sigmoid -- Sigmoid_166
Layer 93 -- layer name -- Clip_167
Input dims size = 4 dims --- 1 8 20 50
Unsupported (TIDL check) TIDL layer type --- Clip
Layer 94 -- layer name -- MaxPool_182
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- MaxPool -- MaxPool_182
Layer 95 -- layer name -- Sub_183
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Sub -- Sub_183
Layer 96 -- layer name -- Add_185
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Add -- Add_185
Layer 97 -- layer name -- Div_186
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Div -- Div_186
Layer 98 -- layer name -- Sub_188
Input dims size = 0 dims ---
Supported TIDL layer type --- Sub -- Sub_188
Layer 99 -- layer name -- Mul_189
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Mul -- Mul_189
Layer 100 -- layer name -- Squeeze_190
Input dims size = 4 dims --- 1 8 20 50
Supported TIDL layer type --- Squeeze -- Squeeze_190
Layer 101 -- layer name -- Reshape_192
Input dims size = 3 dims --- 8 20 50
Supported TIDL layer type --- Reshape -- Reshape_192
Layer 102 -- layer name -- TopK_193
Input dims size = 1 dims --- 8000
Unsupported (imports) TIDL layer type for ONNX op type --- TopK
Layer 103 -- layer name -- Reshape_195
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_195
Layer 104 -- layer name -- Mul_199
Input dims size = 0 dims ---
Supported TIDL layer type --- Mul -- Mul_199
Layer 105 -- layer name -- Slice_203
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_203
Layer 106 -- layer name -- Gather_207
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 107 -- layer name -- Conv_151
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_151
Layer 108 -- layer name -- Relu_152
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Relu -- Relu_152
Layer 109 -- layer name -- Conv_153
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Conv -- Conv_153
Layer 110 -- layer name -- Reshape_172
Input dims size = 4 dims --- 1 1072 20 50
Supported TIDL layer type --- Reshape -- Reshape_172
Layer 111 -- layer name -- Transpose_179
Input dims size = 5 dims --- 1 8 134 20 50
Supported TIDL layer type --- Transpose -- Transpose_179
Layer 112 -- layer name -- Reshape_181
Input dims size = 5 dims --- 1 8 20 50 134
Supported TIDL layer type --- Reshape -- Reshape_181
Layer 113 -- layer name -- Slice_205
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_205
Layer 114 -- layer name -- Gather_209
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_209
Layer 115 -- layer name -- Slice_229
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_229
Layer 116 -- layer name -- Sub_231
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_231
Layer 117 -- layer name -- Reshape_241
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_241
Layer 118 -- layer name -- Reshape_249
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_249
Layer 119 -- layer name -- Slice_228
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_228
Layer 120 -- layer name -- Reshape_236
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_236
Layer 121 -- layer name -- Reshape_243
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_243
Layer 122 -- layer name -- Upsample_141
Input dims size = 4 dims --- 1 64 20 50
Supported TIDL layer type --- Upsample -- Upsample_141
Layer 123 -- layer name -- Conv_136
Input dims size = 4 dims --- 1 128 40 100
Supported TIDL layer type --- Conv -- Conv_136
Layer 124 -- layer name -- Add_142
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Add -- Add_142
Layer 125 -- layer name -- Conv_143
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_143
Layer 126 -- layer name -- Conv_173
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_173
Layer 127 -- layer name -- Relu_174
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_174
Layer 128 -- layer name -- Conv_175
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_175
Layer 129 -- layer name -- Relu_176
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_176
Layer 130 -- layer name -- Conv_177
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Conv -- Conv_177
Layer 131 -- layer name -- Relu_178
Input dims size = 4 dims --- 1 64 40 100
Supported TIDL layer type --- Relu -- Relu_178
Layer 132 -- layer name -- Concat_217
Input dims size = 0 dims ---
Supported TIDL layer type --- Concat -- Concat_217
Layer 133 -- layer name -- Slice_218
Input dims size = 4 dims --- 1 66 40 100
Unsupported (TIDL check) TIDL layer type --- Slice
Layer 134 -- layer name -- Concat_220
Input dims size = 4 dims --- 1 66 40 100
Supported TIDL layer type --- Concat -- Concat_220
Layer 135 -- layer name -- Reshape_224
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_224
Layer 136 -- layer name -- Mul_244
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 137 -- layer name -- Reshape_246
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_246
Layer 138 -- layer name -- ReduceSum_247
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 139 -- layer name -- Add_250
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 140 -- layer name -- Reshape_254
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_254
Layer 141 -- layer name -- Transpose_305
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Transpose -- Transpose_305
Layer 142 -- layer name -- Reshape_312
Input dims size = 4 dims --- 1 6 100 40
Supported TIDL layer type --- Reshape -- Reshape_312
Layer 143 -- layer name -- Conv_313
Input dims size = 3 dims --- 6 100 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 144 -- layer name -- Relu_314
Input dims size = 3 dims --- 6 64 40
Supported TIDL layer type --- Relu -- Relu_314
Layer 145 -- layer name -- Conv_315
Input dims size = 3 dims --- 6 64 40
Unsupported (TIDL check) TIDL layer type --- Conv
Layer 146 -- layer name -- Transpose_316
Input dims size = 3 dims --- 6 2 40
Supported TIDL layer type --- Transpose -- Transpose_316
Layer 147 -- layer name -- Slice_204
Input dims size = 2 dims --- 6 134
Supported TIDL layer type --- Slice -- Slice_204
Layer 148 -- layer name -- Gather_257
Input dims size = 2 dims --- 6 67
Unsupported (TIDL check) TIDL layer type --- Gather
Layer 149 -- layer name -- Slice_255
Input dims size = 2 dims --- 8000 134
Supported TIDL layer type --- Slice -- Slice_255
Layer 150 -- layer name -- Gather_259
Input dims size = 2 dims --- 8000 67
Supported TIDL layer type --- Gather -- Gather_259
Layer 151 -- layer name -- Slice_279
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_279
Layer 152 -- layer name -- Sub_281
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Sub -- Sub_281
Layer 153 -- layer name -- Reshape_291
Input dims size = 2 dims --- 6 1
Supported TIDL layer type --- Reshape -- Reshape_291
Layer 154 -- layer name -- Reshape_299
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_299
Layer 155 -- layer name -- Slice_278
Input dims size = 2 dims --- 6 67
Supported TIDL layer type --- Slice -- Slice_278
Layer 156 -- layer name -- Reshape_286
Input dims size = 2 dims --- 6 66
Supported TIDL layer type --- Reshape -- Reshape_286
Layer 157 -- layer name -- Reshape_293
Input dims size = 4 dims --- 6 66 1 1
Supported TIDL layer type --- Reshape -- Reshape_293
Layer 158 -- layer name -- Reshape_274
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_274
Layer 159 -- layer name -- Mul_294
Input dims size = 4 dims --- 1 396 40 100
Unsupported (TIDL check) TIDL layer type --- Mul
Layer 160 -- layer name -- Reshape_296
Input dims size = 4 dims --- 1 396 40 100
Supported TIDL layer type --- Reshape -- Reshape_296
Layer 161 -- layer name -- ReduceSum_297
Input dims size = 5 dims --- 1 6 66 40 100
Unsupported (imports) TIDL layer type for ONNX op type --- ReduceSum
Layer 162 -- layer name -- Add_300
Input dims size = 4 dims --- 1 6 40 100
Unsupported (TIDL check) TIDL layer type --- Add
Layer 163 -- layer name -- Reshape_304
Input dims size = 4 dims --- 1 6 40 100
Supported TIDL layer type --- Reshape -- Reshape_304
Layer 164 -- layer name -- Reshape_197
Input dims size = 1 dims --- 6
Supported TIDL layer type --- Reshape -- Reshape_197
Preliminary subgraphs created = 12
Final number of subgraphs created are : 12, - Offloaded Nodes - 152, Total Nodes - 165
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
TIDL ALLOWLISTING LAYER CHECK -- [TIDL_ClipLayer] Clip must have min <= 0 and max > 0.
Layers type not supported by TIDL --- layer type - TopK, Node name -TopK_193
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 825
INFORMATION -- [TIDL_ResizeLayer] Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
ALLOWLISTING : Slice layer : Unsupported axis parameters2-- file info - tidl_onnxImport.cpp , TIDL_onnxMapSliceBaseParams , 1591
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 403
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_247
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 403
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
WARNING -- [TIDL_ConvolutionLayer] Layer parameter combination has undergone limited validation and may have some issues. Following are the parameters:
Kernel 1x0 Stride 1x1 dilation 1x1 Pad 0x0 Bias 1
ALLOWLISTING : Unsupported axis configuration for gather layer!, only line gather is supported -- file info - tidl_import_common_model_check.cpp , TIDL_checkGatherTensorProperties , 825
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 403
Layers type not supported by TIDL --- layer type - ReduceSum, Node name -ReduceSum_297
ALLOWLISTING : ADD/MUL/SUB/DIV layer : The variable inputs must of be same dimensions --tidl_import_common_model_check.cpp , TIDL_checkAddMulSubDivTensorProperties , 403
Running runtimes graphviz - /home/root/tidl_tools/tidl_graphVisualiser_runtimes.out ../../../model-artifacts//condlanet_org//allowedNode.txt ../../../model-artifacts//condlanet_org//tempDir/graphvizInfo.txt ../../../model-artifacts//condlanet_org//tempDir/runtimes_visualization.svg
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_0_0
0, Conv, 3, 1, image, 600
1, Relu, 1, 1, 600, 203
2, MaxPool, 1, 1, 203, 204
3, Conv, 3, 1, 204, 603
4, Relu, 1, 1, 603, 207
5, Conv, 3, 1, 207, 606
6, Add, 2, 1, 606, 210
7, Relu, 1, 1, 210, 211
8, Conv, 3, 1, 211, 609
9, Relu, 1, 1, 609, 214
10, Conv, 3, 1, 214, 612
11, Add, 2, 1, 612, 217
12, Relu, 1, 1, 217, 218
13, Conv, 3, 1, 218, 615
14, Relu, 1, 1, 615, 221
15, Conv, 3, 1, 221, 618
16, Conv, 3, 1, 218, 621
17, Add, 2, 1, 618, 226
18, Relu, 1, 1, 226, 227
19, Conv, 3, 1, 227, 624
20, Relu, 1, 1, 624, 230
21, Conv, 3, 1, 230, 627
22, Add, 2, 1, 627, 233
23, Relu, 1, 1, 233, 234
24, Conv, 3, 1, 234, 630
25, Relu, 1, 1, 630, 237
26, Conv, 3, 1, 237, 633
27, Conv, 3, 1, 234, 636
28, Add, 2, 1, 633, 242
29, Relu, 1, 1, 242, 243
30, Conv, 3, 1, 243, 639
31, Relu, 1, 1, 639, 246
32, Conv, 3, 1, 246, 642
33, Add, 2, 1, 642, 249
34, Relu, 1, 1, 249, 250
35, Conv, 3, 1, 250, 378
36, Conv, 3, 1, 250, 645
37, Relu, 1, 1, 645, 253
38, Conv, 3, 1, 253, 648
39, Conv, 3, 1, 250, 651
40, Add, 2, 1, 648, 258
41, Relu, 1, 1, 258, 259
42, Conv, 3, 1, 259, 654
43, Relu, 1, 1, 654, 262
44, Conv, 3, 1, 262, 657
45, Add, 2, 1, 657, 265
46, Relu, 1, 1, 265, 266
47, Conv, 3, 1, 266, 660
48, Relu, 1, 1, 660, 269
49, Add, 2, 1, 269, 280
50, Conv, 3, 1, 280, 281
51, Reshape, 2, 1, 281, 288
52, Transpose, 1, 1, 288, 289
53, Conv, 3, 1, 280, 290
54, Reshape, 2, 1, 290, 297
55, MatMul, 2, 1, 289, 298
56, Softmax, 1, 1, 298, 299
57, Transpose, 1, 1, 299, 300
58, Conv, 3, 1, 280, 301
59, Reshape, 2, 1, 301, 308
60, MatMul, 2, 1, 308, 309
61, Reshape, 2, 1, 309, 316
62, Mul, 2, 1, ortshared_5_1_1, 317
63, Add, 2, 1, 317, 318
64, Conv, 3, 1, 318, 663
65, Relu, 1, 1, 663, 321
66, Conv, 3, 1, 321, 666
67, Relu, 1, 1, 666, 324
68, Add, 2, 1, 324, 335
69, Conv, 3, 1, 335, 336
70, Reshape, 2, 1, 336, 343
71, Transpose, 1, 1, 343, 344
72, Conv, 3, 1, 335, 345
73, Reshape, 2, 1, 345, 352
74, MatMul, 2, 1, 344, 353
75, Softmax, 1, 1, 353, 354
76, Transpose, 1, 1, 354, 355
77, Conv, 3, 1, 335, 356
78, Reshape, 2, 1, 356, 363
79, MatMul, 2, 1, 363, 364
80, Reshape, 2, 1, 364, 371
81, Mul, 2, 1, ortshared_7_1_1, 372
82, Add, 2, 1, 372, 373
83, Conv, 3, 1, 373, 669
84, Relu, 1, 1, 669, 376
85, Conv, 3, 1, 376, 379
86, Upsample, 2, 1, 379, 383
87, Add, 2, 1, 378, 384
88, Conv, 3, 1, 384, 391
89, Conv, 3, 1, 391, 395
90, Relu, 1, 1, 395, 396
91, Conv, 3, 1, 396, 397
92, Sigmoid, 1, 1, 397, 413
Input tensor name - image
Output tensor name - 234
Output tensor name - 384
Output tensor name - 391
Output tensor name - 413
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_1_1
0, MaxPool, 1, 1, 414, 436
1, Sub, 2, 1, 414, 437
2, Add, 2, 1, 437, 439
3, Div, 2, 1, 437, 440
4, Sub, 2, 1, ortshared_2_1_0, 442
5, Mul, 2, 1, 414, 443
6, Squeeze, 1, 1, 443, 444
7, Reshape, 2, 1, 444, 446
Input tensor name - 414
Output tensor name - 446
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_2_2
0, Reshape, 2, 1, 448, seeds
1, Mul, 2, 1, 453, 454
2, Slice, 1, 1, 454, 458
Input tensor name - 448
Output tensor name - seeds
Output tensor name - 454
Output tensor name - 458
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_3_3
0, Conv, 3, 1, 234, 377
1, Upsample, 2, 1, 384, 388
2, Add, 2, 1, 377, 389
3, Conv, 3, 1, 389, 390
4, Conv, 3, 1, 390, 672
5, Relu, 1, 1, 672, 426
6, Conv, 3, 1, 426, 675
7, Relu, 1, 1, 675, 429
8, Conv, 3, 1, 429, 678
9, Relu, 1, 1, 678, 432
10, Concat, 2, 1, 471, 472
11, Conv, 3, 1, 391, 398
12, Relu, 1, 1, 398, 399
13, Conv, 3, 1, 399, 400
14, Reshape, 2, 1, 400, 423
15, Transpose, 1, 1, 423, 433
16, Reshape, 2, 1, 433, 435
17, Slice, 1, 1, 435, 460
18, Gather, 2, 1, 460, 464
19, Slice, 1, 1, 464, 487
20, Reshape, 2, 1, 487, 501
21, Reshape, 2, 1, 501, 508
22, Slice, 1, 1, 464, 488
23, Sub, 2, 1, 488, 490
24, Reshape, 2, 1, 490, 506
25, Reshape, 2, 1, 506, 514
Input tensor name - 391
Input tensor name - 462
Input tensor name - 384
Input tensor name - 234
Output tensor name - 435
Output tensor name - 514
Output tensor name - 508
Output tensor name - 472
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_4_4
0, Concat, 6, 1, 473, 475
1, Reshape, 2, 1, 475, 483
Input tensor name - 473
Output tensor name - 475
Output tensor name - 483
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_5_5
0, Reshape, 2, 1, 509, 511
Input tensor name - 509
Output tensor name - 511
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_6_6
0, Reshape, 2, 1, 515, 523
1, Transpose, 1, 1, 523, 588
2, Reshape, 2, 1, 588, 595
Input tensor name - 515
Output tensor name - 523
Output tensor name - 595
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_7_7
0, Relu, 1, 1, 596, 597
Input tensor name - 596
Output tensor name - 597
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_8_8
0, Slice, 1, 1, 454, 459
1, Transpose, 1, 1, 598, 599
Input tensor name - 598
Input tensor name - 454
Output tensor name - 599
Output tensor name - 459
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_9_9
0, Reshape, 2, 1, 475, 547
1, Slice, 1, 1, 435, 524
2, Gather, 2, 1, 524, 528
3, Slice, 1, 1, 528, 551
4, Reshape, 2, 1, 551, 565
5, Reshape, 2, 1, 565, 572
6, Slice, 1, 1, 528, 552
7, Sub, 2, 1, 552, 554
8, Reshape, 2, 1, 554, 570
9, Reshape, 2, 1, 570, 578
Input tensor name - 435
Input tensor name - 526
Input tensor name - 475
Output tensor name - 578
Output tensor name - 572
Output tensor name - 547
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_10_10
0, Reshape, 2, 1, 573, 575
Input tensor name - 573
Output tensor name - 575
*** In TIDL_createStateImportFunc ***
Compute on node : TIDLExecutionProvider_TIDL_11_11
0, Reshape, 2, 1, 447, output_dict_list
1, Reshape, 2, 1, 579, 587
Input tensor name - 579
Input tensor name - 447
Output tensor name - 587
Output tensor name - output_dict_list
Graph Domain TO version : 9In TIDL_onnxRtImportInit subgraph_name=subgraph_0
Layer 0, subgraph id subgraph_0, name=234
Layer 1, subgraph id subgraph_0, name=384
Layer 2, subgraph id subgraph_0, name=391
Layer 3, subgraph id subgraph_0, name=413
Layer 4, subgraph id subgraph_0, name=image
In TIDL_runtimesOptimizeNet: LayerIndex = 98, dataIndex = 94
WARNING: Batch Norm Layer Mul_87's coeff cannot be found(or not match) in coef file, Random bias will be generated! Only for evaluation usage! Results are all random!
WARNING: Batch Norm Layer Mul_132's coeff cannot be found(or not match) in coef file, Random bias will be generated! Only for evaluation usage! Results are all random!
************** Frame index 1 : Running float import *************
In TIDL_runtimesPostProcessNet
In TIDL_runtimesPostProcessNet 1
In TIDL_runtimesPostProcessNet 2
In TIDL_runtimesPostProcessNet 3
INFORMATION: [TIDL_ResizeLayer] Upsample_139 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize.
****************************************************
** 1 WARNINGS 0 ERRORS **
****************************************************
In TIDL_runtimesPostProcessNet 4
************ in TIDL_subgraphRtCreate ************
The soft limit is 2048
The hard limit is 2048
MEM: Init ... !!!
MEM: Init ... Done !!!
0.0s: VX_ZONE_INIT:Enabled
0.5s: VX_ZONE_ERROR:Enabled
0.6s: VX_ZONE_WARNING:Enabled
0.2100s: VX_ZONE_INIT:[tivxInit:185] Initialization Done !!!
TIDL_initDebugTraceParams Done
--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum , Space , Attribute , Alignment , Size(KBytes), BasePtr
0 , DDR Cacheable , Persistent , 128, 19.25 , 0x00000000
1 , DDR Cacheable , Persistent , 128, 0.64 , 0x00000000
2 , DDR Cacheable , Scratch , 128, 16.00 , 0x00000000
3 , DDR Cacheable , Scratch , 128, 4.00 , 0x00000000
4 , DDR Cacheable , Scratch , 128, 56.00 , 0x00000000
5 , DDR Cacheable , Persistent , 128, 459.16 , 0x00000000
6 , DDR Cacheable , Scratch , 128, 45120.19, 0x00000000
7 , DDR Cacheable , Scratch , 128, 0.12 , 0x00000000
8 , DDR Cacheable , Scratch , 128, 24511.25, 0x00000000
9 , DDR Cacheable , Scratch , 128, 32684.50, 0x00000000
10 , DDR Cacheable , Persistent , 128, 1371.98 , 0x00000000
11 , DDR Cacheable , Scratch , 128, 512.25 , 0x00000000
12 , DDR Cacheable , Persistent , 128, 0.12 , 0x00000000
13 , DDR Cacheable , Persistent , 128, 52202.63, 0x00000000
14 , DDR Cacheable , Persistent , 128, 0.00 , 0x00000000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 156958.09
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
To get the actual TIDL memory requirement make sure to run on EVM with
debugTraceLevel = 2
--------------------------------------------
TIDL init call from ivision API
--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum , Space , Attribute , Alignment , Size(KBytes), BasePtr
0 , DDR Cacheable , Persistent , 128, 19.25 , 0x55d90000
1 , DDR Cacheable , Persistent , 128, 0.64 , 0x72f56000
2 , DDR Cacheable , Scratch , 128, 16.00 , 0x72cc1000
3 , DDR Cacheable , Scratch , 128, 4.00 , 0x70290000
4 , DDR Cacheable , Scratch , 128, 56.00 , 0x52217000
5 , DDR Cacheable , Persistent , 128, 459.16 , 0xe5a8d000
6 , DDR Cacheable , Scratch , 128, 45120.19, 0x5d3ef000
7 , DDR Cacheable , Scratch , 128, 0.12 , 0x7028f000
8 , DDR Cacheable , Scratch , 128, 24511.25, 0x5bbff000
9 , DDR Cacheable , Scratch , 128, 32684.50, 0x59c13000
10 , DDR Cacheable , Persistent , 128, 1371.98 , 0x99ea5000
11 , DDR Cacheable , Scratch , 128, 512.25 , 0xa404d000
12 , DDR Cacheable , Persistent , 128, 0.12 , 0x7028e000
13 , DDR Cacheable , Persistent , 128, 52202.63, 0x56918000
14 , DDR Cacheable , Persistent , 128, 0.00 , 0x7028d000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 156958.09
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
To get the actual TIDL memory requirement make sure to run on EVM with
debugTraceLevel = 2
--------------------------------------------
Alg Init for Layer # - 1
Alg Init for Layer # - 2
Alg Init for Layer # - 3
Alg Init for Layer # - 4
Alg Init for Layer # - 5
Alg Init for Layer # - 6
Alg Init for Layer # - 7
Alg Init for Layer # - 8
Alg Init for Layer # - 9
Alg Init for Layer # - 10
Alg Init for Layer # - 11
Alg Init for Layer # - 12
Alg Init for Layer # - 13
Alg Init for Layer # - 14
Alg Init for Layer # - 15
Alg Init for Layer # - 16
Alg Init for Layer # - 17
Alg Init for Layer # - 18
Alg Init for Layer # - 19
Alg Init for Layer # - 20
Alg Init for Layer # - 21
Alg Init for Layer # - 22
Alg Init for Layer # - 23
Alg Init for Layer # - 24
Alg Init for Layer # - 25
Alg Init for Layer # - 26
Alg Init for Layer # - 27
Alg Init for Layer # - 28
Alg Init for Layer # - 29
Alg Init for Layer # - 30
Alg Init for Layer # - 31
Alg Init for Layer # - 32
Alg Init for Layer # - 33
Alg Init for Layer # - 35
Alg Init for Layer # - 36
Alg Init for Layer # - 37
Alg Init for Layer # - 38
Alg Init for Layer # - 39
Alg Init for Layer # - 40
Alg Init for Layer # - 41
Alg Init for Layer # - 42
Alg Init for Layer # - 43
Alg Init for Layer # - 44
Alg Init for Layer # - 45
Alg Init for Layer # - 46
Alg Init for Layer # - 47
Alg Init for Layer # - 48
Alg Init for Layer # - 49
Alg Init for Layer # - 50
Alg Init for Layer # - 51
Alg Init for Layer # - 52
Alg Init for Layer # - 53
Alg Init for Layer # - 54
Alg Init for Layer # - 55
Alg Init for Layer # - 56
Alg Init for Layer # - 57
Alg Init for Layer # - 58
Alg Init for Layer # - 59
Alg Init for Layer # - 60
Alg Init for Layer # - 61
Alg Init for Layer # - 62
Alg Init for Layer # - 63
Alg Init for Layer # - 64
Alg Init for Layer # - 65
Alg Init for Layer # - 66
Alg Init for Layer # - 67
Alg Init for Layer # - 68
Alg Init for Layer # - 69
Alg Init for Layer # - 70
Alg Init for Layer # - 71
Alg Init for Layer # - 72
Alg Init for Layer # - 73
Alg Init for Layer # - 74
Alg Init for Layer # - 75
Alg Init for Layer # - 76
Alg Init for Layer # - 77
Alg Init for Layer # - 78
Alg Init for Layer # - 79
Alg Init for Layer # - 80
Alg Init for Layer # - 81
Alg Init for Layer # - 82
Alg Init for Layer # - 83
Alg Init for Layer # - 84
Alg Init for Layer # - 85
Alg Init for Layer # - 86
Alg Init for Layer # - 87
Alg Init for Layer # - 88
Alg Init for Layer # - 89
Alg Init for Layer # - 90
Alg Init for Layer # - 91
Alg Init for Layer # - 92
Alg Init for Layer # - 93
Alg Init for Layer # - 94
Alg Init for Layer # - 95
Alg Init for Layer # - 96
Alg Init for Layer # - 97
Alg Init for Layer # - 98
Alg Init for Layer # - 99
Alg Init for Layer # - 100
Alg Init for Layer # - 101
Alg Init for Layer # - 102
Alg Init for Layer # - 103
Alg Init for Layer # - 104
Alg Init for Layer # - 105
Alg Init for Layer # - 106
Alg Init for Layer # - 107
Alg Init for Layer # - 108
Alg Init for Layer # - 109
Alg Init for Layer # - 110
Alg Init for Layer # - 111
Alg Init for Layer # - 112
Alg Init for Layer # - 113
Alg Init for Layer # - 114
Alg Init for Layer # - 115
Alg Init for Layer # - 116
Alg Init for Layer # - 117
Alg Init for Layer # - 118
Alg Init for Layer # - 119
Alg Init for Layer # - 120
PREEMPTION: Adding a new priority object for targetPriority = 2, handle = 0x72ae55d90000
PREEMPTION: Now total number of priority objects = 1 at priorityId = 2, with new memRec of base = 0x72ae7028e000 and size = 128
PREEMPTION: Requesting context memory addr for handle 0x72ae55d90000, return Addr = 0x72ad84039db8
************ TIDL_subgraphRtCreate done ************
********** Frame Index 1 : Running float inference **********
Graph Domain TO version : 9In TIDL_onnxRtImportInit subgraph_name=subgraph_1
Layer 0, subgraph id subgraph_1, name=446
Layer 1, subgraph id subgraph_1, name=414
In TIDL_runtimesOptimizeNet: LayerIndex = 10, dataIndex = 9
************** Frame index 1 : Running float import *************
In TIDL_runtimesPostProcessNet
In TIDL_runtimesPostProcessNet 1
In TIDL_runtimesPostProcessNet 2
In TIDL_runtimesPostProcessNet 3
****************************************************
** ALL MODEL CHECK PASSED **
****************************************************
In TIDL_runtimesPostProcessNet 4
************ in TIDL_subgraphRtCreate ************
TIDL_initDebugTraceParams Done
--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum , Space , Attribute , Alignment , Size(KBytes), BasePtr
0 , DDR Cacheable , Persistent , 128, 19.25 , 0x00000000
1 , DDR Cacheable , Persistent , 128, 0.64 , 0x00000000
2 , L1D , Scratch , 128, 16.00 , 0x00000000
3 , L2 , Scratch , 128, 4.00 , 0x00000000
4 , L3/MSMC , Scratch , 128, 56.00 , 0x00000000
5 , DDR Cacheable , Persistent , 128, 256.25 , 0x00000000
6 , DDR Cacheable , Scratch , 128, 31.75 , 0x00000000
7 , L1D , Scratch , 0, 0.00 , 0x00000000
8 , DDR Cacheable , Scratch , 128, 47.00 , 0x00000000
9 , L1D , Scratch , 0, 0.00 , 0x00000000
10 , DDR Cacheable , Persistent , 128, 255.59 , 0x00000000
11 , DDR Cacheable , Scratch , 128, 512.25 , 0x00000000
12 , L1D , Scratch , 0, 0.00 , 0x00000000
13 , L1D , Scratch , 0, 0.00 , 0x00000000
14 , DDR Cacheable , Persistent , 128, 0.00 , 0x00000000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
L1D , 16.00
L2 , 4.00
L3/MSMC , 56.00
DDR Cacheable, 1122.73
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
To get the actual TIDL memory requirement make sure to run on EVM with
debugTraceLevel = 2
--------------------------------------------
0.730175s: VX_ZONE_ERROR:[tivxAlgiVisionCreate:363] Calling ialg.algAlloc failed with status = -1120
0.730210s: VX_ZONE_ERROR:[tivxKernelTIDLCreate:926] tivxAlgiVisionCreate returned NULL
0.730280s: VX_ZONE_ERROR:[ownContextSendCmd:822] Command ack message returned failure cmd_status: -1
0.730282s: VX_ZONE_ERROR:[ownContextSendCmd:862] tivxEventWait() failed.
0.730284s: VX_ZONE_ERROR:[ownNodeKernelInit:584] Target kernel, TIVX_CMD_NODE_CREATE failed for node TIDLNode
0.730284s: VX_ZONE_ERROR:[ownNodeKernelInit:585] Please be sure the target callbacks have been registered for this core
0.730285s: VX_ZONE_ERROR:[ownNodeKernelInit:586] If the target callbacks have been registered, please ensure no errors are occurring within the create callback of this kernel
0.730295s: VX_ZONE_ERROR:[ownGraphNodeKernelInit:583] kernel init for node 0, kernel com.ti.tidl:1:1 ... failed !!!
0.730297s: VX_ZONE_ERROR:[vxVerifyGraph:2059] Node kernel init failed
0.730298s: VX_ZONE_ERROR:[vxVerifyGraph:2113] Graph verify failed
TIDL_RT_OVX: ERROR: Verifying TIDL graph ... Failed !!!
TIDL_RT_OVX: ERROR: Verify OpenVX graph failed
************ TIDL_subgraphRtCreate done ************
********** Frame Index 1 : Running float inference **********
Graph Domain TO version : 9In TIDL_onnxRtImportInit subgraph_name=subgraph_2
Layer 0, subgraph id subgraph_2, name=seeds
Layer 1, subgraph id subgraph_2, name=454
Layer 2, subgraph id subgraph_2, name=458
Layer 3, subgraph id subgraph_2, name=448
In TIDL_runtimesOptimizeNet: LayerIndex = 7, dataIndex = 4
************** Frame index 1 : Running float import *************
In TIDL_runtimesPostProcessNet
In TIDL_runtimesPostProcessNet 1
In TIDL_runtimesPostProcessNet 2
In TIDL_runtimesPostProcessNet 3
****************************************************
** ALL MODEL CHECK PASSED **
****************************************************
In TIDL_runtimesPostProcessNet 4
************ in TIDL_subgraphRtCreate ************
TIDL_initDebugTraceParams Done
--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum , Space , Attribute , Alignment , Size(KBytes), BasePtr
0 , DDR Cacheable , Persistent , 128, 19.25 , 0x00000000
1 , DDR Cacheable , Persistent , 128, 0.64 , 0x00000000
2 , DDR Cacheable , Scratch , 128, 16.00 , 0x00000000
3 , DDR Cacheable , Scratch , 128, 4.00 , 0x00000000
4 , DDR Cacheable , Scratch , 128, 56.00 , 0x00000000
5 , DDR Cacheable , Persistent , 128, 260.64 , 0x00000000
6 , DDR Cacheable , Scratch , 128, 1.67 , 0x00000000
7 , DDR Cacheable , Scratch , 128, 0.12 , 0x00000000
8 , DDR Cacheable , Scratch , 128, 4.88 , 0x00000000
9 , DDR Cacheable , Scratch , 128, 9.28 , 0x00000000
10 , DDR Cacheable , Persistent , 128, 302.89 , 0x00000000
11 , DDR Cacheable , Scratch , 128, 512.25 , 0x00000000
12 , DDR Cacheable , Persistent , 128, 0.12 , 0x00000000
13 , DDR Cacheable , Persistent , 128, 6233.32 , 0x00000000
14 , DDR Cacheable , Persistent , 128, 0.00 , 0x00000000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 7421.07
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
To get the actual TIDL memory requirement make sure to run on EVM with
debugTraceLevel = 2
--------------------------------------------
TIDL init call from ivision API
--------------------------------------------
TIDL Memory size requiement (record wise):
MemRecNum , Space , Attribute , Alignment , Size(KBytes), BasePtr
0 , DDR Cacheable , Persistent , 128, 19.25 , 0x51e2e000
1 , DDR Cacheable , Persistent , 128, 0.64 , 0x526aa000
2 , DDR Cacheable , Scratch , 128, 16.00 , 0x51e2a000
3 , DDR Cacheable , Scratch , 128, 4.00 , 0x526a9000
4 , DDR Cacheable , Scratch , 128, 56.00 , 0xe87a1000
5 , DDR Cacheable , Persistent , 128, 260.64 , 0xdf497000
6 , DDR Cacheable , Scratch , 128, 1.67 , 0x526a8000
7 , DDR Cacheable , Scratch , 128, 0.12 , 0x526a7000
8 , DDR Cacheable , Scratch , 128, 4.88 , 0x5220b000
9 , DDR Cacheable , Scratch , 128, 9.28 , 0x0502a000
10 Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']
Running 1 Models - ['condlanet_org']
Running_Model : condlanet_org
Running shape inference on model /home/root/lucid/model_onnx/FNC_NewForkV1_July14_epoch80_opset9_sim.onnx
***************Running_Inference Section **********
This is Lucid Model for image /home/root/lucid/data_onnx/test_images/img0221.png
, DDR Cacheable , Persistent , 128, 302.89 , 0xa95b4000
11 , DDR Cacheable , Scratch , 128, 512.25 , 0xa3c7f000
12 , DDR Cacheable , Persistent , 128, 0.12 , 0x5220a000
13 , DDR Cacheable , Persistent , 128, 6233.32 , 0x66dc7000
14 , DDR Cacheable , Persistent , 128, 0.00 , 0x05029000
--------------------------------------------
Total memory size requirement (space wise):
Mem Space , Size(KBytes)
DDR Cacheable, 7421.07
--------------------------------------------
NOTE: Memory requirement in host emulation can be different from the same on EVM
To get the actual TIDL memory requirement make sure to run on EVM with
debugTraceLevel = 2
--------------------------------------------
Alg Init for Layer # - 1
Alg Init for Layer # - 2
Alg Init for Layer # - 3
Alg Init for Layer # - 4
Alg Init for Layer # - 6
Alg Init for Layer # - 7
PREEMPTION: Adding a new priority object for targetPriority = 2, handle = 0x72ae51e2e000
PREEMPTION: Now total number of priority objects = 2 at priorityId = 2, with new memRec of base = 0x72ae5220a000 and size = 128
PREEMPTION: Requesting context memory addr for handle 0x72ae51e2e000, return Addr = 0x72ad84039db8
************ TIDL_subgraphRtCreate done ************
Warning : Couldn't find corresponding ioBuf tensor for onnx tensor with matching name
********** Frame Index 1 : Running float inference **********
run_model(model, mIdx)
File "/home/root/examples/osrt_python/ort/onnxrt_ep_dock927_condlanet_fp32.py", line 329, in run_model
imgs, output, proc_time, sub_graph_time, height, width,org_imgs,img_name = infer_image(sess, input_images, config)
File "/home/root/examples/osrt_python/ort/onnxrt_ep_dock927_condlanet_fp32.py", line 186, in infer_image
output = list(sess.run(None, {input_name: input_data }))
File "/usr/local/lib/python3.10/dist-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 200, in run
return self._sess.run(output_names, input_feed, run_options)
onnxruntime.capi.onnxruntime_pybind11_state.RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running Gather node. Name:'Gather_207' Status Message: /onnxruntime/onnxruntime/core/framework/op_kernel.cc:83 virtual OrtValue* onnxruntime::OpKernelContext::OutputMLValue(int, const onnxruntime::TensorShape&) status.IsOK() was false. Shape mismatch attempting to re-use buffer. {1,1,1,1,1,6} != {1,1,1,6,67}. Validate usage of dim_value (values should be > 0) and dim_param (all values with the same string should equate to the same size) in shapes in the model.
Request ur support with upmost priority as we r blocked with the model with the whole demo so
Hi Team,
Am checking again with team, internally for an update on my shared RCA on this thread, am waiting for there reply as its external dependency for us.
Setting expectation clearly here.
Thank you
Can you please let us knw what is the ETA for getting any response from ur internal team so that we can plan the activities accordingly
Update :
As per my discussion with team this seems be issue specific to allowlisting mechanism, as result unsupported layer might have considered as supported during ref kernel inference call, error code -1120 confirms the same.
As next step i have filed JIRA to track this issue,
Adding JIRA link for TIs internal tracking purpose :
jira.itg.ti.com/.../TIDL-4049