This thread has been locked.
If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.
Original question:
Part Number: AM62A7
Tool/software:
Hi Zhiwei,
Model quantization uses int16 quantization, which has better results, but int8 quantization is poor. How to locate which layer is causing the difference?
You can use the instructions provided at: https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/tidl_osr_debug.md#feature-map-comparison-with-reference to compare layers outputs between different level of quantization. Also follow this section for more details regarding host emulation: https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/tidl_osr_debug.md#steps-to-debug-functional-mismatch-in-host-emulation.
Found a problem: need to remove the mal, sub, and mal in Figure 1 (marked with yellow boxes), int16 quantization is normal, and the modified model output is shown in Figure 2
I don't understand the exact question here but I can comment that when the mul, sub, mul are deleted, the concatenate layer is deleted with them causing the model in figure 2 to have four outputs while the original model in figure 1 has only two outputs. I am not sure if you intended to have this difference but I wanted to highlight it here. If this is not what you are asking about, please explain your question.
Best regards,
Qutaiba
HI, Qutaiba
Hi Zhiwei,
I need more details to understand the problem here. Would you please set/export this environment variable to 1 "export TIDL_RT_DEBUG=1" and provide printed log?
Did you change the model to fix the four outputs issue I mentioned above? Would you please provide more details about the model?
Best regards,
Qutaiba
root@7416735c47c6:/work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/examples/osrt_python/ort# python3 onnxrt_ep.py -m dad-3dheads_v0924 -c
Skipping import of model optimizer
Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']
Running 1 Models - ['dad-3dheads_v0924']
Running_Model : dad-3dheads_v0924
\platform.machine : x86_64
folder_path /work/task2024/project/ims-edgeai-tidl-tools/edgeai-tidl-tools-09_02_06_00/test_data/headpose_alignment_imgs_100
Running shape inference on model ../../../models/public/desay/headpose/v1.0/headPoseGaze-78.onnx
numFrames 2
tidl_tools_path = /work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/tidl_tools
artifacts_folder = ../../../model-artifacts//dad-3dheads_v0924/
tidl_tensor_bits = 8
debug_level = 4
num_tidl_subgraphs = 16
tidl_denylist =
tidl_denylist_layer_name =
tidl_denylist_layer_type =
tidl_allowlist_layer_name =
model_type =
tidl_calibration_accuracy_level = 7
tidl_calibration_options:num_frames_calibration = 2
tidl_calibration_options:bias_calibration_iterations = 5
mixed_precision_factor = -1.000000
model_group_id = 0
power_of_2_quantization = 2
ONNX QDQ Enabled = 0
enable_high_resolution_optimization = 0
pre_batchnorm_fold = 1
add_data_convert_ops = 3
output_feature_16bit_names_list =
m_params_16bit_names_list =
m_single_core_layers_names_list =
Inference mode = 0
Number of cores = 1
reserved_compile_constraints_flag = 1601
partial_init_during_compile = 0
ti_internal_reserved_1 =
========================= [Model Compilation Started] =========================
Model compilation will perform the following stages:
1. Parsing
2. Graph Optimization
3. Quantization & Calibration
4. Memory Planning
============================== [Version Summary] ==============================
-------------------------------------------------------------------------------
| TIDL Tools Version | 10_00_06_00 |
-------------------------------------------------------------------------------
| C7x Firmware Version | 10_00_02_00 |
-------------------------------------------------------------------------------
| Runtime Version | 1.14.0+10000005 |
-------------------------------------------------------------------------------
| Model Opset Version | 11 |
-------------------------------------------------------------------------------
NOTE: The runtime version here specifies ONNXRT_VERSION+TIDL_VERSION
Ex: 1.14.0+1000XXXX -> ONNXRT 1.14.0 and a TIDL_VERSION 10.00.XX.XX
============================== [Parsing Started] ==============================
[TIDL Import] [PARSER] WARNING: Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /init_block/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /init_block/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage1/unit1/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage1/unit1/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage1/unit1/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage2/unit1/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage2/unit1/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage2/unit1/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage2/unit2/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage2/unit2/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage2/unit2/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage3/unit1/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage3/unit1/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage3/unit1/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage3/unit2/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage3/unit2/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage3/unit2/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit1/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit1/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit1/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit2/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit2/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit2/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit3/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit3/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit3/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit4/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit4/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit4/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit5/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit5/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit5/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit6/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage4/unit6/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage4/unit6/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/p6/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/p7/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/p7/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.0/upsample/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_1 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_2 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p6_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p6_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p6_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.0/upsample_1/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_3 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/p5/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_2 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_3 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p5_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p5_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p5_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.0/upsample_2/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_5 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/p4/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_4 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_4 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p4_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p4_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p4_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.0/upsample_3/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_7 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/p3/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_6 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_5 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p3_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p3_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p3_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.0/downsample/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_10 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_9 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_8 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_6 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_7 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p4_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p4_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p4_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.0/downsample_1/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_13 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_12 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_11 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_8 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_9 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p5_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p5_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p5_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.0/downsample_2/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_16 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_15 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_14 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_10 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_11 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p6_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p6_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p6_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.0/downsample_3/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_19 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.0/Mul_18 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_12 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.0/Add_13 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p7_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.0/p7_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.0/p7_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.1/upsample/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_1 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_2 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p6_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p6_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p6_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.1/upsample_1/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_3 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_2 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_3 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p5_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p5_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p5_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.1/upsample_2/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_5 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_4 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_4 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p4_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p4_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p4_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Resize, Node name - /bifpn/bifpn.1/upsample_3/Resize -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_7 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_6 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_5 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p3_td/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p3_td/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p3_td/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.1/downsample/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_10 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_9 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_8 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_6 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_7 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p4_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p4_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p4_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /bifpn/bifpn.1/downsample_1/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_13 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_12 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /bifpn/bifpn.1/Mul_11 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_8 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Add, Node name - /bifpn/bifpn.1/Add_9 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p5_out/depthwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /bifpn/bifpn.1/p5_out/pointwise/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /bifpn/bifpn.1/p5_out/act/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /head/heatmap/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /fusion_layer/downsample/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - AveragePool, Node name - /fusion_layer/downsample_1/AveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Sigmoid, Node name - /fusion_layer/Sigmoid -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Concat, Node name - /fusion_layer/Concat -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /fusion_layer/conv1x1/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /fusion_layer/Mul -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage5/unit1/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage5/unit1/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage5/unit1/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage5/unit2/dw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Conv, Node name - /stage5/unit2/pw_conv/conv/Conv -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /stage5/unit2/pw_conv/activ/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - GlobalAveragePool, Node name - /GlobalAveragePool -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Reshape, Node name - /shape/Reshape -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /shape/logit_image/logit_image.0/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /shape/logit_image/logit_image.1/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /shape/logit_image/logit_image.3/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /Mul -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Sigmoid, Node name - /Sigmoid -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /Mul_1 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Sub, Node name - /Sub -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Mul, Node name - /Mul_2 -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /location/logit_image/logit_image.0/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /location/logit_image/logit_image.1/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /location/logit_image/logit_image.3/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /pose/logit_image/logit_image.0/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /pose/logit_image/logit_image.1/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /pose/logit_image/logit_image.3/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Concat, Node name - /Concat -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /landmarks/logit_image/logit_image.0/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /landmarks/logit_image/logit_image.1/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /landmarks/logit_image/logit_image.3/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Reshape, Node name - /Reshape -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /gaze/logit_image/logit_image.0/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Relu, Node name - /gaze/logit_image/logit_image.1/Relu -- [tidl_onnxRtImport_core.cpp, 524]
[TIDL Import] [PARSER] SUPPORTED: Layers type supported by TIDL --- layer type - Gemm, Node name - /gaze/logit_image/logit_image.3/Gemm -- [tidl_onnxRtImport_core.cpp, 524]
------------------------- Subgraph Information Summary -------------------------
-------------------------------------------------------------------------------
| Core | No. of Nodes | Number of Subgraphs |
-------------------------------------------------------------------------------
| C7x | 188 | 1 |
| CPU | 0 | x |
-------------------------------------------------------------------------------
Running Runtimes GraphViz - /work/task2024/edgeai-tidl/edgeai-tidl-tools-10_00_06_00/tidl_tools/tidl_graphVisualiser_runtimes.out ../../../model-artifacts//dad-3dheads_v0924//allowedNode.txt ../../../model-artifacts//dad-3dheads_v0924//tempDir/graphvizInfo.txt ../../../model-artifacts//dad-3dheads_v0924//tempDir/runtimes_visualization.svg
============================= [Parsing Completed] =============================
TIDL_createStateImportFunc Started:
Compute on node : TIDLExecutionProvider_TIDL_0_0
0, Conv, 3, 1, input, /init_block/conv/Conv_output_0
1, Relu, 1, 1, /init_block/conv/Conv_output_0, /init_block/activ/Relu_output_0
2, Conv, 2, 1, /init_block/activ/Relu_output_0, /stage1/unit1/dw_conv/conv/Conv_output_0
3, Conv, 3, 1, /stage1/unit1/dw_conv/conv/Conv_output_0, /stage1/unit1/pw_conv/conv/Conv_output_0
4, Relu, 1, 1, /stage1/unit1/pw_conv/conv/Conv_output_0, /stage1/unit1/pw_conv/activ/Relu_output_0
5, Conv, 2, 1, /stage1/unit1/pw_conv/activ/Relu_output_0, /stage2/unit1/dw_conv/conv/Conv_output_0
6, Conv, 3, 1, /stage2/unit1/dw_conv/conv/Conv_output_0, /stage2/unit1/pw_conv/conv/Conv_output_0
7, Relu, 1, 1, /stage2/unit1/pw_conv/conv/Conv_output_0, /stage2/unit1/pw_conv/activ/Relu_output_0
8, Conv, 2, 1, /stage2/unit1/pw_conv/activ/Relu_output_0, /stage2/unit2/dw_conv/conv/Conv_output_0
9, Conv, 3, 1, /stage2/unit2/dw_conv/conv/Conv_output_0, /stage2/unit2/pw_conv/conv/Conv_output_0
10, Relu, 1, 1, /stage2/unit2/pw_conv/conv/Conv_output_0, /stage2/unit2/pw_conv/activ/Relu_output_0
11, Conv, 3, 1, /stage2/unit2/pw_conv/activ/Relu_output_0, /bifpn/p3/Conv_output_0
12, Mul, 2, 1, ortshared_16_1_0, /bifpn/bifpn.0/Mul_6_output_0
13, Conv, 2, 1, /stage2/unit2/pw_conv/activ/Relu_output_0, /stage3/unit1/dw_conv/conv/Conv_output_0
14, Conv, 3, 1, /stage3/unit1/dw_conv/conv/Conv_output_0, /stage3/unit1/pw_conv/conv/Conv_output_0
15, Relu, 1, 1, /stage3/unit1/pw_conv/conv/Conv_output_0, /stage3/unit1/pw_conv/activ/Relu_output_0
16, Conv, 2, 1, /stage3/unit1/pw_conv/activ/Relu_output_0, /stage3/unit2/dw_conv/conv/Conv_output_0
17, Conv, 3, 1, /stage3/unit2/dw_conv/conv/Conv_output_0, /stage3/unit2/pw_conv/conv/Conv_output_0
18, Relu, 1, 1, /stage3/unit2/pw_conv/conv/Conv_output_0, /stage3/unit2/pw_conv/activ/Relu_output_0
19, Conv, 3, 1, /stage3/unit2/pw_conv/activ/Relu_output_0, /bifpn/p4/Conv_output_0
20, Mul, 2, 1, ortshared_17_1_0, /bifpn/bifpn.0/Mul_4_output_0
21, Conv, 2, 1, /stage3/unit2/pw_conv/activ/Relu_output_0, /stage4/unit1/dw_conv/conv/Conv_output_0
22, Conv, 3, 1, /stage4/unit1/dw_conv/conv/Conv_output_0, /stage4/unit1/pw_conv/conv/Conv_output_0
23, Relu, 1, 1, /stage4/unit1/pw_conv/conv/Conv_output_0, /stage4/unit1/pw_conv/activ/Relu_output_0
24, Conv, 2, 1, /stage4/unit1/pw_conv/activ/Relu_output_0, /stage4/unit2/dw_conv/conv/Conv_output_0
25, Conv, 3, 1, /stage4/unit2/dw_conv/conv/Conv_output_0, /stage4/unit2/pw_conv/conv/Conv_output_0
26, Relu, 1, 1, /stage4/unit2/pw_conv/conv/Conv_output_0, /stage4/unit2/pw_conv/activ/Relu_output_0
27, Conv, 2, 1, /stage4/unit2/pw_conv/activ/Relu_output_0, /stage4/unit3/dw_conv/conv/Conv_output_0
28, Conv, 3, 1, /stage4/unit3/dw_conv/conv/Conv_output_0, /stage4/unit3/pw_conv/conv/Conv_output_0
29, Relu, 1, 1, /stage4/unit3/pw_conv/conv/Conv_output_0, /stage4/unit3/pw_conv/activ/Relu_output_0
30, Conv, 2, 1, /stage4/unit3/pw_conv/activ/Relu_output_0, /stage4/unit4/dw_conv/conv/Conv_output_0
31, Conv, 3, 1, /stage4/unit4/dw_conv/conv/Conv_output_0, /stage4/unit4/pw_conv/conv/Conv_output_0
32, Relu, 1, 1, /stage4/unit4/pw_conv/conv/Conv_output_0, /stage4/unit4/pw_conv/activ/Relu_output_0
33, Conv, 2, 1, /stage4/unit4/pw_conv/activ/Relu_output_0, /stage4/unit5/dw_conv/conv/Conv_output_0
34, Conv, 3, 1, /stage4/unit5/dw_conv/conv/Conv_output_0, /stage4/unit5/pw_conv/conv/Conv_output_0
35, Relu, 1, 1, /stage4/unit5/pw_conv/conv/Conv_output_0, /stage4/unit5/pw_conv/activ/Relu_output_0
36, Conv, 2, 1, /stage4/unit5/pw_conv/activ/Relu_output_0, /stage4/unit6/dw_conv/conv/Conv_output_0
37, Conv, 3, 1, /stage4/unit6/dw_conv/conv/Conv_output_0, /stage4/unit6/pw_conv/conv/Conv_output_0
38, Relu, 1, 1, /stage4/unit6/pw_conv/conv/Conv_output_0, /stage4/unit6/pw_conv/activ/Relu_output_0
39, Conv, 3, 1, /stage4/unit6/pw_conv/activ/Relu_output_0, /bifpn/p5/Conv_output_0
40, Mul, 2, 1, ortshared_34_1_0, /bifpn/bifpn.0/Mul_2_output_0
41, Conv, 3, 1, /stage4/unit6/pw_conv/activ/Relu_output_0, /bifpn/p6/Conv_output_0
42, Mul, 2, 1, ortshared_33_1_0, /bifpn/bifpn.0/Mul_output_0
43, Conv, 3, 1, /bifpn/p6/Conv_output_0, /bifpn/p7/conv/Conv_output_0
44, Relu, 1, 1, /bifpn/p7/conv/Conv_output_0, /bifpn/p7/act/Relu_output_0
45, Resize, 3, 1, /bifpn/p7/act/Relu_output_0, /bifpn/bifpn.0/upsample/Resize_output_0
46, Mul, 2, 1, ortshared_30_1_0, /bifpn/bifpn.0/Mul_1_output_0
47, Add, 2, 1, /bifpn/bifpn.0/Mul_output_0, /bifpn/bifpn.0/Add_2_output_0
48, Conv, 2, 1, /bifpn/bifpn.0/Add_2_output_0, /bifpn/bifpn.0/p6_td/depthwise/Conv_output_0
49, Conv, 3, 1, /bifpn/bifpn.0/p6_td/depthwise/Conv_output_0, /bifpn/bifpn.0/p6_td/pointwise/Conv_output_0
50, Relu, 1, 1, /bifpn/bifpn.0/p6_td/pointwise/Conv_output_0, /bifpn/bifpn.0/p6_td/act/Relu_output_0
51, Resize, 3, 1, /bifpn/bifpn.0/p6_td/act/Relu_output_0, /bifpn/bifpn.0/upsample_1/Resize_output_0
52, Mul, 2, 1, ortshared_31_1_0, /bifpn/bifpn.0/Mul_3_output_0
53, Add, 2, 1, /bifpn/bifpn.0/Mul_2_output_0, /bifpn/bifpn.0/Add_3_output_0
54, Conv, 2, 1, /bifpn/bifpn.0/Add_3_output_0, /bifpn/bifpn.0/p5_td/depthwise/Conv_output_0
55, Conv, 3, 1, /bifpn/bifpn.0/p5_td/depthwise/Conv_output_0, /bifpn/bifpn.0/p5_td/pointwise/Conv_output_0
56, Relu, 1, 1, /bifpn/bifpn.0/p5_td/pointwise/Conv_output_0, /bifpn/bifpn.0/p5_td/act/Relu_output_0
57, Resize, 3, 1, /bifpn/bifpn.0/p5_td/act/Relu_output_0, /bifpn/bifpn.0/upsample_2/Resize_output_0
58, Mul, 2, 1, ortshared_22_1_0, /bifpn/bifpn.0/Mul_5_output_0
59, Add, 2, 1, /bifpn/bifpn.0/Mul_4_output_0, /bifpn/bifpn.0/Add_4_output_0
60, Conv, 2, 1, /bifpn/bifpn.0/Add_4_output_0, /bifpn/bifpn.0/p4_td/depthwise/Conv_output_0
61, Conv, 3, 1, /bifpn/bifpn.0/p4_td/depthwise/Conv_output_0, /bifpn/bifpn.0/p4_td/pointwise/Conv_output_0
62, Relu, 1, 1, /bifpn/bifpn.0/p4_td/pointwise/Conv_output_0, /bifpn/bifpn.0/p4_td/act/Relu_output_0
63, Resize, 3, 1, /bifpn/bifpn.0/p4_td/act/Relu_output_0, /bifpn/bifpn.0/upsample_3/Resize_output_0
64, Mul, 2, 1, ortshared_27_1_0, /bifpn/bifpn.0/Mul_7_output_0
65, Add, 2, 1, /bifpn/bifpn.0/Mul_6_output_0, /bifpn/bifpn.0/Add_5_output_0
66, Conv, 2, 1, /bifpn/bifpn.0/Add_5_output_0, /bifpn/bifpn.0/p3_td/depthwise/Conv_output_0
67, Conv, 3, 1, /bifpn/bifpn.0/p3_td/depthwise/Conv_output_0, /bifpn/bifpn.0/p3_td/pointwise/Conv_output_0
68, Relu, 1, 1, /bifpn/bifpn.0/p3_td/pointwise/Conv_output_0, /bifpn/bifpn.0/p3_td/act/Relu_output_0
69, Mul, 2, 1, ortshared_5_1_0, /bifpn/bifpn.1/Mul_6_output_0
70, Mul, 2, 1, ortshared_15_1_0, /bifpn/bifpn.0/Mul_8_output_0
71, Mul, 2, 1, ortshared_14_1_0, /bifpn/bifpn.0/Mul_9_output_0
72, Add, 2, 1, /bifpn/bifpn.0/Mul_8_output_0, /bifpn/bifpn.0/Add_6_output_0
73, AveragePool, 1, 1, /bifpn/bifpn.0/p3_td/act/Relu_output_0, /bifpn/bifpn.0/downsample/AveragePool_output_0
74, Mul, 2, 1, ortshared_13_1_0, /bifpn/bifpn.0/Mul_10_output_0
75, Add, 2, 1, /bifpn/bifpn.0/Add_6_output_0, /bifpn/bifpn.0/Add_7_output_0
76, Conv, 2, 1, /bifpn/bifpn.0/Add_7_output_0, /bifpn/bifpn.0/p4_out/depthwise/Conv_output_0
77, Conv, 3, 1, /bifpn/bifpn.0/p4_out/depthwise/Conv_output_0, /bifpn/bifpn.0/p4_out/pointwise/Conv_output_0
78, Relu, 1, 1, /bifpn/bifpn.0/p4_out/pointwise/Conv_output_0, /bifpn/bifpn.0/p4_out/act/Relu_output_0
79, Mul, 2, 1, ortshared_6_1_0, /bifpn/bifpn.1/Mul_4_output_0
80, Mul, 2, 1, ortshared_12_1_0, /bifpn/bifpn.0/Mul_11_output_0
81, Mul, 2, 1, ortshared_11_1_0, /bifpn/bifpn.0/Mul_12_output_0
82, Add, 2, 1, /bifpn/bifpn.0/Mul_11_output_0, /bifpn/bifpn.0/Add_8_output_0
83, AveragePool, 1, 1, /bifpn/bifpn.0/p4_out/act/Relu_output_0, /bifpn/bifpn.0/downsample_1/AveragePool_output_0
84, Mul, 2, 1, ortshared_28_1_0, /bifpn/bifpn.0/Mul_13_output_0
85, Add, 2, 1, /bifpn/bifpn.0/Add_8_output_0, /bifpn/bifpn.0/Add_9_output_0
86, Conv, 2, 1, /bifpn/bifpn.0/Add_9_output_0, /bifpn/bifpn.0/p5_out/depthwise/Conv_output_0
87, Conv, 3, 1, /bifpn/bifpn.0/p5_out/depthwise/Conv_output_0, /bifpn/bifpn.0/p5_out/pointwise/Conv_output_0
88, Relu, 1, 1, /bifpn/bifpn.0/p5_out/pointwise/Conv_output_0, /bifpn/bifpn.0/p5_out/act/Relu_output_0
89, Mul, 2, 1, ortshared_20_1_0, /bifpn/bifpn.1/Mul_2_output_0
90, Mul, 2, 1, ortshared_19_1_0, /bifpn/bifpn.0/Mul_14_output_0
91, Mul, 2, 1, ortshared_10_1_0, /bifpn/bifpn.0/Mul_15_output_0
92, Add, 2, 1, /bifpn/bifpn.0/Mul_14_output_0, /bifpn/bifpn.0/Add_10_output_0
93, AveragePool, 1, 1, /bifpn/bifpn.0/p5_out/act/Relu_output_0, /bifpn/bifpn.0/downsample_2/AveragePool_output_0
94, Mul, 2, 1, ortshared_9_1_0, /bifpn/bifpn.0/Mul_16_output_0
95, Add, 2, 1, /bifpn/bifpn.0/Add_10_output_0, /bifpn/bifpn.0/Add_11_output_0
96, Conv, 2, 1, /bifpn/bifpn.0/Add_11_output_0, /bifpn/bifpn.0/p6_out/depthwise/Conv_output_0
97, Conv, 3, 1, /bifpn/bifpn.0/p6_out/depthwise/Conv_output_0, /bifpn/bifpn.0/p6_out/pointwise/Conv_output_0
98, Relu, 1, 1, /bifpn/bifpn.0/p6_out/pointwise/Conv_output_0, /bifpn/bifpn.0/p6_out/act/Relu_output_0
99, Mul, 2, 1, ortshared_7_1_0, /bifpn/bifpn.1/Mul_output_0
100, Mul, 2, 1, ortshared_24_1_0, /bifpn/bifpn.0/Mul_18_output_0
101, Add, 2, 1, /bifpn/bifpn.0/Mul_18_output_0, /bifpn/bifpn.0/Add_12_output_0
102, AveragePool, 1, 1, /bifpn/bifpn.0/p6_out/act/Relu_output_0, /bifpn/bifpn.0/downsample_3/AveragePool_output_0
103, Mul, 2, 1, ortshared_8_1_0, /bifpn/bifpn.0/Mul_19_output_0
104, Add, 2, 1, /bifpn/bifpn.0/Add_12_output_0, /bifpn/bifpn.0/Add_13_output_0
105, Conv, 2, 1, /bifpn/bifpn.0/Add_13_output_0, /bifpn/bifpn.0/p7_out/depthwise/Conv_output_0
106, Conv, 3, 1, /bifpn/bifpn.0/p7_out/depthwise/Conv_output_0, /bifpn/bifpn.0/p7_out/pointwise/Conv_output_0
107, Relu, 1, 1, /bifpn/bifpn.0/p7_out/pointwise/Conv_output_0, /bifpn/bifpn.0/p7_out/act/Relu_output_0
108, Resize, 3, 1, /bifpn/bifpn.0/p7_out/act/Relu_output_0, /bifpn/bifpn.1/upsample/Resize_output_0
109, Mul, 2, 1, ortshared_21_1_0, /bifpn/bifpn.1/Mul_1_output_0
110, Add, 2, 1, /bifpn/bifpn.1/Mul_output_0, /bifpn/bifpn.1/Add_2_output_0
111, Conv, 2, 1, /bifpn/bifpn.1/Add_2_output_0, /bifpn/bifpn.1/p6_td/depthwise/Conv_output_0
112, Conv, 3, 1, /bifpn/bifpn.1/p6_td/depthwise/Conv_output_0, /bifpn/bifpn.1/p6_td/pointwise/Conv_output_0
113, Relu, 1, 1, /bifpn/bifpn.1/p6_td/pointwise/Conv_output_0, /bifpn/bifpn.1/p6_td/act/Relu_output_0
114, Resize, 3, 1, /bifpn/bifpn.1/p6_td/act/Relu_output_0, /bifpn/bifpn.1/upsample_1/Resize_output_0
115, Mul, 2, 1, ortshared_18_1_0, /bifpn/bifpn.1/Mul_3_output_0
116, Add, 2, 1, /bifpn/bifpn.1/Mul_2_output_0, /bifpn/bifpn.1/Add_3_output_0
117, Conv, 2, 1, /bifpn/bifpn.1/Add_3_output_0, /bifpn/bifpn.1/p5_td/depthwise/Conv_output_0
118, Conv, 3, 1, /bifpn/bifpn.1/p5_td/depthwise/Conv_output_0, /bifpn/bifpn.1/p5_td/pointwise/Conv_output_0
119, Relu, 1, 1, /bifpn/bifpn.1/p5_td/pointwise/Conv_output_0, /bifpn/bifpn.1/p5_td/act/Relu_output_0
120, Resize, 3, 1, /bifpn/bifpn.1/p5_td/act/Relu_output_0, /bifpn/bifpn.1/upsample_2/Resize_output_0
121, Mul, 2, 1, ortshared_23_1_0, /bifpn/bifpn.1/Mul_5_output_0
122, Add, 2, 1, /bifpn/bifpn.1/Mul_4_output_0, /bifpn/bifpn.1/Add_4_output_0
123, Conv, 2, 1, /bifpn/bifpn.1/Add_4_output_0, /bifpn/bifpn.1/p4_td/depthwise/Conv_output_0
124, Conv, 3, 1, /bifpn/bifpn.1/p4_td/depthwise/Conv_output_0, /bifpn/bifpn.1/p4_td/pointwise/Conv_output_0
125, Relu, 1, 1, /bifpn/bifpn.1/p4_td/pointwise/Conv_output_0, /bifpn/bifpn.1/p4_td/act/Relu_output_0
126, Resize, 3, 1, /bifpn/bifpn.1/p4_td/act/Relu_output_0, /bifpn/bifpn.1/upsample_3/Resize_output_0
127, Mul, 2, 1, ortshared_4_1_0, /bifpn/bifpn.1/Mul_7_output_0
128, Add, 2, 1, /bifpn/bifpn.1/Mul_6_output_0, /bifpn/bifpn.1/Add_5_output_0
129, Conv, 2, 1, /bifpn/bifpn.1/Add_5_output_0, /bifpn/bifpn.1/p3_td/depthwise/Conv_output_0
130, Conv, 3, 1, /bifpn/bifpn.1/p3_td/depthwise/Conv_output_0, /bifpn/bifpn.1/p3_td/pointwise/Conv_output_0
131, Relu, 1, 1, /bifpn/bifpn.1/p3_td/pointwise/Conv_output_0, /bifpn/bifpn.1/p3_td/act/Relu_output_0
132, Conv, 3, 1, /bifpn/bifpn.1/p3_td/act/Relu_output_0, /head/heatmap/Conv_output_0
133, AveragePool, 1, 1, /head/heatmap/Conv_output_0, /fusion_layer/downsample/AveragePool_output_0
134, AveragePool, 1, 1, /fusion_layer/downsample/AveragePool_output_0, /fusion_layer/downsample_1/AveragePool_output_0
135, Sigmoid, 1, 1, /fusion_layer/downsample_1/AveragePool_output_0, /fusion_layer/Sigmoid_output_0
136, Mul, 2, 1, ortshared_1_1_0, /bifpn/bifpn.1/Mul_11_output_0
137, Mul, 2, 1, ortshared_32_1_0, /bifpn/bifpn.1/Mul_12_output_0
138, Add, 2, 1, /bifpn/bifpn.1/Mul_11_output_0, /bifpn/bifpn.1/Add_8_output_0
139, Mul, 2, 1, ortshared_3_1_0, /bifpn/bifpn.1/Mul_8_output_0
140, Mul, 2, 1, ortshared_26_1_0, /bifpn/bifpn.1/Mul_9_output_0
141, Add, 2, 1, /bifpn/bifpn.1/Mul_8_output_0, /bifpn/bifpn.1/Add_6_output_0
142, AveragePool, 1, 1, /bifpn/bifpn.1/p3_td/act/Relu_output_0, /bifpn/bifpn.1/downsample/AveragePool_output_0
143, Mul, 2, 1, ortshared_2_1_0, /bifpn/bifpn.1/Mul_10_output_0
144, Add, 2, 1, /bifpn/bifpn.1/Add_6_output_0, /bifpn/bifpn.1/Add_7_output_0
145, Conv, 2, 1, /bifpn/bifpn.1/Add_7_output_0, /bifpn/bifpn.1/p4_out/depthwise/Conv_output_0
146, Conv, 3, 1, /bifpn/bifpn.1/p4_out/depthwise/Conv_output_0, /bifpn/bifpn.1/p4_out/pointwise/Conv_output_0
147, Relu, 1, 1, /bifpn/bifpn.1/p4_out/pointwise/Conv_output_0, /bifpn/bifpn.1/p4_out/act/Relu_output_0
148, AveragePool, 1, 1, /bifpn/bifpn.1/p4_out/act/Relu_output_0, /bifpn/bifpn.1/downsample_1/AveragePool_output_0
149, Mul, 2, 1, ortshared_0_1_0, /bifpn/bifpn.1/Mul_13_output_0
150, Add, 2, 1, /bifpn/bifpn.1/Add_8_output_0, /bifpn/bifpn.1/Add_9_output_0
151, Conv, 2, 1, /bifpn/bifpn.1/Add_9_output_0, /bifpn/bifpn.1/p5_out/depthwise/Conv_output_0
152, Conv, 3, 1, /bifpn/bifpn.1/p5_out/depthwise/Conv_output_0, /bifpn/bifpn.1/p5_out/pointwise/Conv_output_0
153, Relu, 1, 1, /bifpn/bifpn.1/p5_out/pointwise/Conv_output_0, /bifpn/bifpn.1/p5_out/act/Relu_output_0
154, Concat, 3, 1, /stage4/unit6/pw_conv/activ/Relu_output_0, /fusion_layer/Concat_output_0
155, Conv, 3, 1, /fusion_layer/Concat_output_0, /fusion_layer/conv1x1/Conv_output_0
156, Mul, 2, 1, /fusion_layer/conv1x1/Conv_output_0, /fusion_layer/Mul_output_0
157, Conv, 2, 1, /fusion_layer/Mul_output_0, /stage5/unit1/dw_conv/conv/Conv_output_0
158, Conv, 3, 1, /stage5/unit1/dw_conv/conv/Conv_output_0, /stage5/unit1/pw_conv/conv/Conv_output_0
159, Relu, 1, 1, /stage5/unit1/pw_conv/conv/Conv_output_0, /stage5/unit1/pw_conv/activ/Relu_output_0
160, Conv, 2, 1, /stage5/unit1/pw_conv/activ/Relu_output_0, /stage5/unit2/dw_conv/conv/Conv_output_0
161, Conv, 3, 1, /stage5/unit2/dw_conv/conv/Conv_output_0, /stage5/unit2/pw_conv/conv/Conv_output_0
162, Relu, 1, 1, /stage5/unit2/pw_conv/conv/Conv_output_0, /stage5/unit2/pw_conv/activ/Relu_output_0
163, GlobalAveragePool, 1, 1, /stage5/unit2/pw_conv/activ/Relu_output_0, /GlobalAveragePool_output_0
164, Reshape, 2, 1, /GlobalAveragePool_output_0, /shape/Reshape_output_0
165, Gemm, 3, 1, /shape/Reshape_output_0, /gaze/logit_image/logit_image.0/Gemm_output_0
166, Relu, 1, 1, /gaze/logit_image/logit_image.0/Gemm_output_0, /gaze/logit_image/logit_image.1/Relu_output_0
167, Gemm, 3, 1, /gaze/logit_image/logit_image.1/Relu_output_0, gaze
168, Gemm, 3, 1, /shape/Reshape_output_0, /landmarks/logit_image/logit_image.0/Gemm_output_0
169, Relu, 1, 1, /landmarks/logit_image/logit_image.0/Gemm_output_0, /landmarks/logit_image/logit_image.1/Relu_output_0
170, Gemm, 3, 1, /landmarks/logit_image/logit_image.1/Relu_output_0, /landmarks/logit_image/logit_image.3/Gemm_output_0
171, Reshape, 2, 1, /landmarks/logit_image/logit_image.3/Gemm_output_0, /Reshape_output_0
172, Relu, 1, 1, /Reshape_output_0, facelandmarks
173, Gemm, 3, 1, /shape/Reshape_output_0, /pose/logit_image/logit_image.0/Gemm_output_0
174, Relu, 1, 1, /pose/logit_image/logit_image.0/Gemm_output_0, /pose/logit_image/logit_image.1/Relu_output_0
175, Gemm, 3, 1, /pose/logit_image/logit_image.1/Relu_output_0, /pose/logit_image/logit_image.3/Gemm_output_0
176, Gemm, 3, 1, /shape/Reshape_output_0, /location/logit_image/logit_image.0/Gemm_output_0
177, Relu, 1, 1, /location/logit_image/logit_image.0/Gemm_output_0, /location/logit_image/logit_image.1/Relu_output_0
178, Gemm, 3, 1, /location/logit_image/logit_image.1/Relu_output_0, /location/logit_image/logit_image.3/Gemm_output_0
179, Gemm, 3, 1, /shape/Reshape_output_0, /shape/logit_image/logit_image.0/Gemm_output_0
180, Relu, 1, 1, /shape/logit_image/logit_image.0/Gemm_output_0, /shape/logit_image/logit_image.1/Relu_output_0
181, Gemm, 3, 1, /shape/logit_image/logit_image.1/Relu_output_0, /shape/logit_image/logit_image.3/Gemm_output_0
182, Mul, 2, 1, /shape/logit_image/logit_image.3/Gemm_output_0, /Mul_output_0
183, Sigmoid, 1, 1, /Mul_output_0, /Sigmoid_output_0
184, Mul, 2, 1, /Sigmoid_output_0, /Mul_1_output_0
185, Sub, 2, 1, /Mul_1_output_0, /Sub_output_0
186, Mul, 2, 1, /Sub_output_0, /Mul_2_output_0
187, Concat, 3, 1, /Mul_2_output_0, 3dmm
Input tensor name - input
Output tensor name - 3dmm
Output tensor name - facelandmarks
Output tensor name - gaze
[1, 3, 256, 256]
shape [1, 3, 256, 256]
enter floating_model
In TIDL_onnxRtImportInit subgraph_name=subgraph_0
Layer 0, subgraph id subgraph_0, name=3dmm
Layer 1, subgraph id subgraph_0, name=facelandmarks
Layer 2, subgraph id subgraph_0, name=gaze
Layer 3, subgraph id subgraph_0, name=input
==================== [Optimization for subgraph_0 Started] ====================
In TIDL_runtimesOptimizeNet: LayerIndex = 192, dataIndex = 189
----------------------------- Optimization Summary -----------------------------
---------------------------------------------------------------------------------
| Layer | Nodes before optimization | Nodes after optimization |
---------------------------------------------------------------------------------
| TIDL_BatchNormLayer | 0 | 37 |
| TIDL_InnerProductLayer | 10 | 10 |
| TIDL_SigmoidLayer | 2 | 0 |
| TIDL_EltWiseLayer | 58 | 22 |
| TIDL_ConcatLayer | 2 | 2 |
| TIDL_ReLULayer | 35 | 0 |
| TIDL_ConstDataLayer | 0 | 1 |
| TIDL_ResizeLayer | 8 | 8 |
| TIDL_ConvolutionLayer | 62 | 62 |
| TIDL_PoolingLayer | 9 | 9 |
---------------------------------------------------------------------------------
=================== [Optimization for subgraph_0 Completed] ===================
In TIDL_runtimesPostProcessNet
************ in TIDL_subgraphRtCreate ************
TIDL_RT_OVX: Set default TIDLRT params done
Calling appInit() in TIDL-RT!
The soft limit is 10240
The hard limit is 10240
MEM: Init ... !!!
MEM: Init ... Done !!!
0.0s: VX_ZONE_INIT:Enabled
0.43s: VX_ZONE_ERROR:Enabled
0.46s: VX_ZONE_WARNING:Enabled
0.3420s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!!
TIDL_RT_OVX: Init ...
TIDL_RT_OVX: Mapping config file ...
HI, Qutaiba
Generate these traces for floating/16-bit and 8-bit by setting tensor_bits during model inference and compare them.
0 0 input 1 1 input_netFormat 2 2 253 3 3 254 4 4 257 5 5 258 6 6 261 7 7 262 8 8 265 9 9 266 10 10 269 11 11 270 12 12 273 13 13 274 14 14 277 15 15 278 16 16 281 17 17 282 18 18 285 19 19 286 20 20 289 21 21 290 22 22 293 23 23 294 24 24 297 25 25 300 26 26 423 27 27 339 28 28 301 29 29 319 30 30 304 31 31 328 32 32 329 33 33 330 34 34 331 35 35 334 36 36 348 37 37 349 38 38 350 39 39 351 40 40 354 41 41 428 42 42 429 43 43 299 44 44 399 45 45 359 46 46 368 47 47 369 48 48 370 49 49 371 50 50 374 51 51 404 52 52 405 53 53 379 54 54 388 55 55 389 56 56 390 57 57 391 58 58 394 59 59 412 60 60 413 61 61 414 62 62 415 63 63 418 64 64 436 65 65 437 66 66 438 67 67 439 68 68 442 69 69 609 70 70 525 71 71 447 72 72 452 73 73 453 74 74 460 75 75 461 76 76 462 77 77 463 78 78 466 79 79 505 80 80 476 81 81 477 82 82 484 83 83 485 84 84 486 85 85 487 86 86 490 87 87 514 88 88 515 89 89 516 90 90 517 91 91 520 92 92 534 93 93 535 94 94 536 95 95 537 96 96 540 97 97 614 98 98 615 99 99 585 100 100 545 101 101 554 102 102 555 103 103 556 104 104 557 105 105 560 106 106 590 107 107 591 108 108 565 109 109 574 110 110 575 111 111 576 112 112 577 113 113 580 114 114 598 115 115 599 116 116 600 117 117 601 118 118 604 119 119 622 120 120 623 121 121 624 122 122 625 123 123 628 124 124 629 125 125 630 126 126 631 127 127 632 128 128 635 129 129 636 130 130 639 131 131 640_1 132 132 640 133 133 680_0 134 134 680 135 135 693 136 136 694_3 137 137 726 138 138 727 139 139 gaze_netFormat 140 140 650 141 141 651 142 142 653 143 143 654 144 144 661 145 145 671 146 146 672 147 147 682 148 148 683 149 149 3dmm_netFormat 150 150 3dmm 151 151 gaze 152 0 input 153 0 input 154 154 694 155 155 710_2 156 156 710 157 157 711 158 158 facelandmarks_netFormat 159 159 facelandmarks 160 0 input
HI, Qutaiba,
Attempt to modify configuration items in examples/osrt_python/common_utils.py, but nothing improved.
output_feature_16bit_names_list = "639, 640_1" params_16bit_names_list = "639, 640_1"
Hello,
I assume accuracy in tensor_bits=32 / fp32 mode (reference; not accelerated) is sufficient
Is the int-16 accuracy sufficient, in general? If not, then selective 16-bit likely won't solve the problem anyway. I see some evidence of imperfect quantization in the int-16 vs. FP32 traces. The errors are more prevalent and appear sooner in your in int8. In int16, some traces have error but it typically recovers, but int8 is showing far more sensitivity throughout the network
Is regularization used while training the network? I recommend looking at the guidelines for accuracy here:https://github.com/TexasInstruments/edgeai-tidl-tools/blob/master/docs/tidl_fsg_quantization.md#e-guidelines-for-getting-best-accuracy
There are a few instances of clipping in the early traces, but the comparison of float vs. fixed is stable later on. It recovers from inaccuracies in most cases. data ID 134 has become much worse, though - the traces do not match hardly at all. Can we try delegating that node to Arm?
Hello，
Hello,
It is challenging to say a specific layer here in the network is the cause of this, since the error in quantization gradually worsens. I see some odd distributions starting from layers 9 and 13. Are these the same layer type? I would suggest either denying those layers or designating at 16-bit within the compile options. Please let me know if you need help mapping from layer/data ID to the layer name in your network.
BR,
Reese
Hello,
output_feature_16bit_names_list = "702, 703, 649, 650"#"conv1_2, fire9/concat_1" params_16bit_names_list = "702, 703, 649, 650" #"fire3/squeeze1x1_2" quantization_scale_type = 4 calibration_frames = 100 calibration_iterations = 5
