• State
  • Locked Locked
  • Replies 7 replies
  • Subscribers 99 subscribers
  • Views 521 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TDA4VM: Edge AI :Output resuts dimension changes as we add the data convert flag

abhilash sk
Intellectual 530 points
Part Number: TDA4VM


Tool/software:

Hi , 

Setting:

Edgeai sdk : 09_02_07_00

AM68PA/J721E (TDA4VM)

When i run my custom model for fp32 mode , it works well for -d can -c and get the expected op results but when i enable 

'advanced_options:calibration_iterations' : 3, then my op dimension changes from [1,1,1,2,256,384] to [1,1,1,8,12]  I have attached the log and svg file and found dimension is changing in the middle of the network 

Fullscreen log_fp32_c.txt Download 
Available execution providers :  ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']

Running 1 Models - ['Blockage_FNC_FWC']


***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! ***** 
tidl_tools_path                                 = /home/root/tidl_tools 
artifacts_folder                                = ../../../model-artifacts//Blockage_FNC_FWC/ 
tidl_tensor_bits                                = 32 
debug_level                                     = 4 
num_tidl_subgraphs                              = 16 
tidl_denylist                                   = 
tidl_denylist_layer_name                        = 
tidl_denylist_layer_type                         = 
tidl_allowlist_layer_name                        = 
model_type                                      =  
tidl_calibration_accuracy_level                 = 64 
tidl_calibration_options:num_frames_calibration = 4 
tidl_calibration_options:bias_calibration_iterations = 3 
mixed_precision_factor = -1.000000 
model_group_id = 0 
power_of_2_quantization                         = 2 
ONNX QDQ Enabled                                = 0 
enable_high_resolution_optimization             = 0 
pre_batchnorm_fold                              = 1 
add_data_convert_ops                            = 0 
output_feature_16bit_names_list                 =  
m_params_16bit_names_list                       =  
m_single_core_layers_names_list                    =  
reserved_compile_constraints_flag               = 1601 
ti_internal_reserved_1                          = 


 ****** WARNING : Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options******

Supported TIDL layer type ---            Conv -- /base/base_layer/base_layer.0/Conv 
Supported TIDL layer type ---            Relu -- /base/base_layer/base_layer.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level0/level0.0/Conv 
Supported TIDL layer type ---            Relu -- /base/level0/level0.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level1/level1.0/Conv 
Supported TIDL layer type ---            Relu -- /base/level1/level1.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level2/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level2/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level3/tree1/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree1/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree1/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level3/tree1/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree1/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level3/tree2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level4/tree1/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree1/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree1/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level4/tree1/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree1/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level4/tree2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level5/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level5/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level5/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level5/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level5/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level5/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level5/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level5/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_4_0/upconv_4_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_4_0/upconv_4_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_4_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_4_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat 
Supported TIDL layer type ---            Conv -- /bl/upconv_4_1/upconv_4_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_4_1/upconv_4_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_3_0/upconv_3_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_3_0/upconv_3_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_3_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_3_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_1 
Supported TIDL layer type ---            Conv -- /bl/upconv_3_1/upconv_3_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_3_1/upconv_3_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_2_0/upconv_2_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_2_0/upconv_2_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_2_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_2_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_2 
Supported TIDL layer type ---            Conv -- /bl/upconv_2_1/upconv_2_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_2_1/upconv_2_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_1_0/upconv_1_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_1_0/upconv_1_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_1_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_1_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_3 
Supported TIDL layer type ---            Conv -- /bl/upconv_1_1/upconv_1_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_1_1/upconv_1_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_0_0/upconv_0_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_0_0/upconv_0_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_0_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_0_0/shuffle/DepthToSpace 
Supported TIDL layer type ---            Conv -- /bl/semantic_conv_0/Conv 

Preliminary subgraphs created = 1 
Final number of subgraphs created are : 1, - Offloaded Nodes - 125, Total Nodes - 125 
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
Running runtimes graphviz - /home/root/tidl_tools/tidl_graphVisualiser_runtimes.out ../../../model-artifacts//Blockage_FNC_FWC//allowedNode.txt ../../../model-artifacts//Blockage_FNC_FWC//tempDir/graphvizInfo.txt ../../../model-artifacts//Blockage_FNC_FWC//tempDir/runtimes_visualization.svg 
*** In TIDL_createStateImportFunc *** 
Compute on node : TIDLExecutionProvider_TIDL_0_0
  0,            Conv, 3, 1, input.1, /base/base_layer/base_layer.0/Conv_output_0
  1,            Relu, 1, 1, /base/base_layer/base_layer.0/Conv_output_0, /base/base_layer/base_layer.2/Relu_output_0
  2,            Conv, 3, 1, /base/base_layer/base_layer.2/Relu_output_0, /base/level0/level0.0/Conv_output_0
  3,            Relu, 1, 1, /base/level0/level0.0/Conv_output_0, /base/level0/level0.2/Relu_output_0
  4,            Conv, 3, 1, /base/level0/level0.2/Relu_output_0, /base/level1/level1.0/Conv_output_0
  5,            Relu, 1, 1, /base/level1/level1.0/Conv_output_0, /base/level1/level1.2/Relu_output_0
  6,         MaxPool, 1, 1, /base/level1/level1.2/Relu_output_0, /base/level2/downsample/MaxPool_output_0
  7,            Conv, 3, 1, /base/level2/downsample/MaxPool_output_0, /base/level2/project/project.0/Conv_output_0
  8,            Conv, 3, 1, /base/level1/level1.2/Relu_output_0, /base/level2/tree1/conv1/Conv_output_0
  9,            Relu, 1, 1, /base/level2/tree1/conv1/Conv_output_0, /base/level2/tree1/relu/Relu_output_0
 10,            Conv, 3, 1, /base/level2/tree1/relu/Relu_output_0, /base/level2/tree1/conv2/Conv_output_0
 11,             Add, 2, 1, /base/level2/tree1/conv2/Conv_output_0, /base/level2/tree1/Add_output_0
 12,            Relu, 1, 1, /base/level2/tree1/Add_output_0, /base/level2/tree1/relu_1/Relu_output_0
 13,            Conv, 3, 1, /base/level2/tree1/relu_1/Relu_output_0, /base/level2/tree2/conv1/Conv_output_0
 14,            Relu, 1, 1, /base/level2/tree2/conv1/Conv_output_0, /base/level2/tree2/relu/Relu_output_0
 15,            Conv, 3, 1, /base/level2/tree2/relu/Relu_output_0, /base/level2/tree2/conv2/Conv_output_0
 16,             Add, 2, 1, /base/level2/tree2/conv2/Conv_output_0, /base/level2/tree2/Add_output_0
 17,            Relu, 1, 1, /base/level2/tree2/Add_output_0, /base/level2/tree2/relu_1/Relu_output_0
 18,          Concat, 2, 1, /base/level2/tree2/relu_1/Relu_output_0, /base/level2/root/Concat_output_0
 19,            Conv, 3, 1, /base/level2/root/Concat_output_0, /base/level2/root/conv/Conv_output_0
 20,            Relu, 1, 1, /base/level2/root/conv/Conv_output_0, /base/level2/root/relu/Relu_output_0
 21,         MaxPool, 1, 1, /base/level2/root/relu/Relu_output_0, /base/level3/tree1/downsample/MaxPool_output_0
 22,            Conv, 3, 1, /base/level3/tree1/downsample/MaxPool_output_0, /base/level3/tree1/project/project.0/Conv_output_0
 23,            Conv, 3, 1, /base/level2/root/relu/Relu_output_0, /base/level3/tree1/tree1/conv1/Conv_output_0
 24,            Relu, 1, 1, /base/level3/tree1/tree1/conv1/Conv_output_0, /base/level3/tree1/tree1/relu/Relu_output_0
 25,            Conv, 3, 1, /base/level3/tree1/tree1/relu/Relu_output_0, /base/level3/tree1/tree1/conv2/Conv_output_0
 26,             Add, 2, 1, /base/level3/tree1/tree1/conv2/Conv_output_0, /base/level3/tree1/tree1/Add_output_0
 27,            Relu, 1, 1, /base/level3/tree1/tree1/Add_output_0, /base/level3/tree1/tree1/relu_1/Relu_output_0
 28,            Conv, 3, 1, /base/level3/tree1/tree1/relu_1/Relu_output_0, /base/level3/tree1/tree2/conv1/Conv_output_0
 29,            Relu, 1, 1, /base/level3/tree1/tree2/conv1/Conv_output_0, /base/level3/tree1/tree2/relu/Relu_output_0
 30,            Conv, 3, 1, /base/level3/tree1/tree2/relu/Relu_output_0, /base/level3/tree1/tree2/conv2/Conv_output_0
 31,             Add, 2, 1, /base/level3/tree1/tree2/conv2/Conv_output_0, /base/level3/tree1/tree2/Add_output_0
 32,            Relu, 1, 1, /base/level3/tree1/tree2/Add_output_0, /base/level3/tree1/tree2/relu_1/Relu_output_0
 33,          Concat, 2, 1, /base/level3/tree1/tree2/relu_1/Relu_output_0, /base/level3/tree1/root/Concat_output_0
 34,            Conv, 3, 1, /base/level3/tree1/root/Concat_output_0, /base/level3/tree1/root/conv/Conv_output_0
 35,            Relu, 1, 1, /base/level3/tree1/root/conv/Conv_output_0, /base/level3/tree1/root/relu/Relu_output_0
 36,            Conv, 3, 1, /base/level3/tree1/root/relu/Relu_output_0, /base/level3/tree2/tree1/conv1/Conv_output_0
 37,            Relu, 1, 1, /base/level3/tree2/tree1/conv1/Conv_output_0, /base/level3/tree2/tree1/relu/Relu_output_0
 38,            Conv, 3, 1, /base/level3/tree2/tree1/relu/Relu_output_0, /base/level3/tree2/tree1/conv2/Conv_output_0
 39,             Add, 2, 1, /base/level3/tree2/tree1/conv2/Conv_output_0, /base/level3/tree2/tree1/Add_output_0
 40,            Relu, 1, 1, /base/level3/tree2/tree1/Add_output_0, /base/level3/tree2/tree1/relu_1/Relu_output_0
 41,            Conv, 3, 1, /base/level3/tree2/tree1/relu_1/Relu_output_0, /base/level3/tree2/tree2/conv1/Conv_output_0
 42,            Relu, 1, 1, /base/level3/tree2/tree2/conv1/Conv_output_0, /base/level3/tree2/tree2/relu/Relu_output_0
 43,            Conv, 3, 1, /base/level3/tree2/tree2/relu/Relu_output_0, /base/level3/tree2/tree2/conv2/Conv_output_0
 44,             Add, 2, 1, /base/level3/tree2/tree2/conv2/Conv_output_0, /base/level3/tree2/tree2/Add_output_0
 45,            Relu, 1, 1, /base/level3/tree2/tree2/Add_output_0, /base/level3/tree2/tree2/relu_1/Relu_output_0
 46,          Concat, 4, 1, /base/level3/tree2/tree2/relu_1/Relu_output_0, /base/level3/tree2/root/Concat_output_0
 47,            Conv, 3, 1, /base/level3/tree2/root/Concat_output_0, /base/level3/tree2/root/conv/Conv_output_0
 48,            Relu, 1, 1, /base/level3/tree2/root/conv/Conv_output_0, /base/level3/tree2/root/relu/Relu_output_0
 49,         MaxPool, 1, 1, /base/level3/tree2/root/relu/Relu_output_0, /base/level4/tree1/downsample/MaxPool_output_0
 50,            Conv, 3, 1, /base/level4/tree1/downsample/MaxPool_output_0, /base/level4/tree1/project/project.0/Conv_output_0
 51,            Conv, 3, 1, /base/level3/tree2/root/relu/Relu_output_0, /base/level4/tree1/tree1/conv1/Conv_output_0
 52,            Relu, 1, 1, /base/level4/tree1/tree1/conv1/Conv_output_0, /base/level4/tree1/tree1/relu/Relu_output_0
 53,            Conv, 3, 1, /base/level4/tree1/tree1/relu/Relu_output_0, /base/level4/tree1/tree1/conv2/Conv_output_0
 54,             Add, 2, 1, /base/level4/tree1/tree1/conv2/Conv_output_0, /base/level4/tree1/tree1/Add_output_0
 55,            Relu, 1, 1, /base/level4/tree1/tree1/Add_output_0, /base/level4/tree1/tree1/relu_1/Relu_output_0
 56,            Conv, 3, 1, /base/level4/tree1/tree1/relu_1/Relu_output_0, /base/level4/tree1/tree2/conv1/Conv_output_0
 57,            Relu, 1, 1, /base/level4/tree1/tree2/conv1/Conv_output_0, /base/level4/tree1/tree2/relu/Relu_output_0
 58,            Conv, 3, 1, /base/level4/tree1/tree2/relu/Relu_output_0, /base/level4/tree1/tree2/conv2/Conv_output_0
 59,             Add, 2, 1, /base/level4/tree1/tree2/conv2/Conv_output_0, /base/level4/tree1/tree2/Add_output_0
 60,            Relu, 1, 1, /base/level4/tree1/tree2/Add_output_0, /base/level4/tree1/tree2/relu_1/Relu_output_0
 61,          Concat, 2, 1, /base/level4/tree1/tree2/relu_1/Relu_output_0, /base/level4/tree1/root/Concat_output_0
 62,            Conv, 3, 1, /base/level4/tree1/root/Concat_output_0, /base/level4/tree1/root/conv/Conv_output_0
 63,            Relu, 1, 1, /base/level4/tree1/root/conv/Conv_output_0, /base/level4/tree1/root/relu/Relu_output_0
 64,            Conv, 3, 1, /base/level4/tree1/root/relu/Relu_output_0, /base/level4/tree2/tree1/conv1/Conv_output_0
 65,            Relu, 1, 1, /base/level4/tree2/tree1/conv1/Conv_output_0, /base/level4/tree2/tree1/relu/Relu_output_0
 66,            Conv, 3, 1, /base/level4/tree2/tree1/relu/Relu_output_0, /base/level4/tree2/tree1/conv2/Conv_output_0
 67,             Add, 2, 1, /base/level4/tree2/tree1/conv2/Conv_output_0, /base/level4/tree2/tree1/Add_output_0
 68,            Relu, 1, 1, /base/level4/tree2/tree1/Add_output_0, /base/level4/tree2/tree1/relu_1/Relu_output_0
 69,            Conv, 3, 1, /base/level4/tree2/tree1/relu_1/Relu_output_0, /base/level4/tree2/tree2/conv1/Conv_output_0
 70,            Relu, 1, 1, /base/level4/tree2/tree2/conv1/Conv_output_0, /base/level4/tree2/tree2/relu/Relu_output_0
 71,            Conv, 3, 1, /base/level4/tree2/tree2/relu/Relu_output_0, /base/level4/tree2/tree2/conv2/Conv_output_0
 72,             Add, 2, 1, /base/level4/tree2/tree2/conv2/Conv_output_0, /base/level4/tree2/tree2/Add_output_0
 73,            Relu, 1, 1, /base/level4/tree2/tree2/Add_output_0, /base/level4/tree2/tree2/relu_1/Relu_output_0
 74,          Concat, 4, 1, /base/level4/tree2/tree2/relu_1/Relu_output_0, /base/level4/tree2/root/Concat_output_0
 75,            Conv, 3, 1, /base/level4/tree2/root/Concat_output_0, /base/level4/tree2/root/conv/Conv_output_0
 76,            Relu, 1, 1, /base/level4/tree2/root/conv/Conv_output_0, /base/level4/tree2/root/relu/Relu_output_0
 77,         MaxPool, 1, 1, /base/level4/tree2/root/relu/Relu_output_0, /base/level5/downsample/MaxPool_output_0
 78,            Conv, 3, 1, /base/level5/downsample/MaxPool_output_0, /base/level5/project/project.0/Conv_output_0
 79,            Conv, 3, 1, /base/level4/tree2/root/relu/Relu_output_0, /base/level5/tree1/conv1/Conv_output_0
 80,            Relu, 1, 1, /base/level5/tree1/conv1/Conv_output_0, /base/level5/tree1/relu/Relu_output_0
 81,            Conv, 3, 1, /base/level5/tree1/relu/Relu_output_0, /base/level5/tree1/conv2/Conv_output_0
 82,             Add, 2, 1, /base/level5/tree1/conv2/Conv_output_0, /base/level5/tree1/Add_output_0
 83,            Relu, 1, 1, /base/level5/tree1/Add_output_0, /base/level5/tree1/relu_1/Relu_output_0
 84,            Conv, 3, 1, /base/level5/tree1/relu_1/Relu_output_0, /base/level5/tree2/conv1/Conv_output_0
 85,            Relu, 1, 1, /base/level5/tree2/conv1/Conv_output_0, /base/level5/tree2/relu/Relu_output_0
 86,            Conv, 3, 1, /base/level5/tree2/relu/Relu_output_0, /base/level5/tree2/conv2/Conv_output_0
 87,             Add, 2, 1, /base/level5/tree2/conv2/Conv_output_0, /base/level5/tree2/Add_output_0
 88,            Relu, 1, 1, /base/level5/tree2/Add_output_0, /base/level5/tree2/relu_1/Relu_output_0
 89,          Concat, 3, 1, /base/level5/tree2/relu_1/Relu_output_0, /base/level5/root/Concat_output_0
 90,            Conv, 3, 1, /base/level5/root/Concat_output_0, /base/level5/root/conv/Conv_output_0
 91,            Relu, 1, 1, /base/level5/root/conv/Conv_output_0, /base/level5/root/relu/Relu_output_0
 92,            Conv, 3, 1, /base/level5/root/relu/Relu_output_0, /bl/upconv_4_0/upconv_4_0.0/Conv_output_0
 93,            Relu, 1, 1, /bl/upconv_4_0/upconv_4_0.0/Conv_output_0, /bl/upconv_4_0/upconv_4_0.2/Relu_output_0
 94,            Conv, 2, 1, /bl/upconv_4_0/upconv_4_0.2/Relu_output_0, /bl/shuffle_conv_4_0/conv/Conv_output_0
 95,    DepthToSpace, 1, 1, /bl/shuffle_conv_4_0/conv/Conv_output_0, /bl/shuffle_conv_4_0/shuffle/DepthToSpace_output_0
 96,          Concat, 2, 1, /bl/shuffle_conv_4_0/shuffle/DepthToSpace_output_0, /bl/Concat_output_0
 97,            Conv, 3, 1, /bl/Concat_output_0, /bl/upconv_4_1/upconv_4_1.0/Conv_output_0
 98,            Relu, 1, 1, /bl/upconv_4_1/upconv_4_1.0/Conv_output_0, /bl/upconv_4_1/upconv_4_1.2/Relu_output_0
 99,            Conv, 3, 1, /bl/upconv_4_1/upconv_4_1.2/Relu_output_0, /bl/upconv_3_0/upconv_3_0.0/Conv_output_0
100,            Relu, 1, 1, /bl/upconv_3_0/upconv_3_0.0/Conv_output_0, /bl/upconv_3_0/upconv_3_0.2/Relu_output_0
101,            Conv, 2, 1, /bl/upconv_3_0/upconv_3_0.2/Relu_output_0, /bl/shuffle_conv_3_0/conv/Conv_output_0
102,    DepthToSpace, 1, 1, /bl/shuffle_conv_3_0/conv/Conv_output_0, /bl/shuffle_conv_3_0/shuffle/DepthToSpace_output_0
103,          Concat, 2, 1, /bl/shuffle_conv_3_0/shuffle/DepthToSpace_output_0, /bl/Concat_1_output_0
104,            Conv, 3, 1, /bl/Concat_1_output_0, /bl/upconv_3_1/upconv_3_1.0/Conv_output_0
105,            Relu, 1, 1, /bl/upconv_3_1/upconv_3_1.0/Conv_output_0, /bl/upconv_3_1/upconv_3_1.2/Relu_output_0
106,            Conv, 3, 1, /bl/upconv_3_1/upconv_3_1.2/Relu_output_0, /bl/upconv_2_0/upconv_2_0.0/Conv_output_0
107,            Relu, 1, 1, /bl/upconv_2_0/upconv_2_0.0/Conv_output_0, /bl/upconv_2_0/upconv_2_0.2/Relu_output_0
108,            Conv, 2, 1, /bl/upconv_2_0/upconv_2_0.2/Relu_output_0, /bl/shuffle_conv_2_0/conv/Conv_output_0
109,    DepthToSpace, 1, 1, /bl/shuffle_conv_2_0/conv/Conv_output_0, /bl/shuffle_conv_2_0/shuffle/DepthToSpace_output_0
110,          Concat, 2, 1, /bl/shuffle_conv_2_0/shuffle/DepthToSpace_output_0, /bl/Concat_2_output_0
111,            Conv, 3, 1, /bl/Concat_2_output_0, /bl/upconv_2_1/upconv_2_1.0/Conv_output_0
112,            Relu, 1, 1, /bl/upconv_2_1/upconv_2_1.0/Conv_output_0, /bl/upconv_2_1/upconv_2_1.2/Relu_output_0
113,            Conv, 3, 1, /bl/upconv_2_1/upconv_2_1.2/Relu_output_0, /bl/upconv_1_0/upconv_1_0.0/Conv_output_0
114,            Relu, 1, 1, /bl/upconv_1_0/upconv_1_0.0/Conv_output_0, /bl/upconv_1_0/upconv_1_0.2/Relu_output_0
115,            Conv, 2, 1, /bl/upconv_1_0/upconv_1_0.2/Relu_output_0, /bl/shuffle_conv_1_0/conv/Conv_output_0
116,    DepthToSpace, 1, 1, /bl/shuffle_conv_1_0/conv/Conv_output_0, /bl/shuffle_conv_1_0/shuffle/DepthToSpace_output_0
117,          Concat, 2, 1, /bl/shuffle_conv_1_0/shuffle/DepthToSpace_output_0, /bl/Concat_3_output_0
118,            Conv, 3, 1, /bl/Concat_3_output_0, /bl/upconv_1_1/upconv_1_1.0/Conv_output_0
119,            Relu, 1, 1, /bl/upconv_1_1/upconv_1_1.0/Conv_output_0, /bl/upconv_1_1/upconv_1_1.2/Relu_output_0
120,            Conv, 3, 1, /bl/upconv_1_1/upconv_1_1.2/Relu_output_0, /bl/upconv_0_0/upconv_0_0.0/Conv_output_0
121,            Relu, 1, 1, /bl/upconv_0_0/upconv_0_0.0/Conv_output_0, /bl/upconv_0_0/upconv_0_0.2/Relu_output_0
122,            Conv, 2, 1, /bl/upconv_0_0/upconv_0_0.2/Relu_output_0, /bl/shuffle_conv_0_0/conv/Conv_output_0
123,    DepthToSpace, 1, 1, /bl/shuffle_conv_0_0/conv/Conv_output_0, /bl/shuffle_conv_0_0/shuffle/DepthToSpace_output_0
124,            Conv, 2, 1, /bl/shuffle_conv_0_0/shuffle/DepthToSpace_output_0, 656

Input tensor name -  input.1 
Output tensor name - 656 
 Graph Domain TO version : 14In TIDL_onnxRtImportInit subgraph_name=subgraph_0
Layer 0, subgraph id subgraph_0, name=656
Layer 1, subgraph id subgraph_0, name=input.1
In TIDL_runtimesOptimizeNet: LayerIndex = 127, dataIndex = 126 

 ************** Frame index 1 : Running float import ************* 
In TIDL_runtimesPostProcessNet 
In TIDL_runtimesPostProcessNet 1
In TIDL_runtimesPostProcessNet 2
In TIDL_runtimesPostProcessNet 3
****************************************************
**                ALL MODEL CHECK PASSED          **
****************************************************

In TIDL_runtimesPostProcessNet 4
************ in TIDL_subgraphRtCreate ************ 
 The soft limit is 2048
The hard limit is 2048
MEM: Init ... !!!
MEM: Init ... Done !!!
 0.0s:  VX_ZONE_INIT:Enabled
 0.3s:  VX_ZONE_ERROR:Enabled
 0.4s:  VX_ZONE_WARNING:Enabled
 0.1860s:  VX_ZONE_INIT:[tivxInit:185] Initialization Done !!!
************ TIDL_subgraphRtCreate done ************ 
 
**********  Frame Index 1 : Running float inference **********
 Graph Domain TO version : 14
**********  Frame Index 2 : Running float inference **********
 Graph Domain TO version : 14
**********  Frame Index 3 : Running float inference **********
 Graph Domain TO version : 14
 ************ Frame index 4 : Running float inference **************** 
************ in TIDL_subgraphRtDelete ************ 
 MEM: Deinit ... !!!
MEM: Alloc's: 26 alloc's of 350150041 bytes 
MEM: Free's : 26 free's  of 350150041 bytes 
MEM: Open's : 0 allocs  of 0 bytes 
MEM:
Running_Model :  Blockage_FNC_FWC  


Running shape inference on model /home/root/lucid/model_onnx/blockage_v1.onnx 


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/1lPI05-cam-03-PRIMAX-IMX390-20220127_134757-000000.png
*********The Model output is :[[[[[[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]

    [[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 256, 384)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/BCMr0p-cam-03-PRIMAX-IMX390-20220127_142921-000270.png
*********The Model output is :[[[[[[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]

    [[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 256, 384)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/Dh020b-cam-03-PRIMAX-IMX390-20220127_185825-000180.png
*********The Model output is :[[[[[[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]

    [[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 256, 384)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/dQcJ01-cam-03-PRIMAX-IMX390-20220415_160448-000001.png
*********The Model output is :[[[[[[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]

    [[0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     ...
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]
     [0. 0. 0. ... 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 256, 384)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


 
Completed_Model :     1, Name : Blockage_FNC_FWC                                  , Total time : -3030295561403.24, Offload Time : -1299569907245.47 , DDR RW MBs : 0, Output File : py_out_Blockage_FNC_FWC_dQcJ01-cam-03-PRIMAX-IMX390-20220415_160448-000001.png
Fullscreen log_fp32_c_dataconvert.txt Download 
Available execution providers :  ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider']

Running 1 Models - ['Blockage_FNC_FWC']


***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! ***** 
tidl_tools_path                                 = /home/root/tidl_tools 
artifacts_folder                                = ../../../model-artifacts//Blockage_FNC_FWC/ 
tidl_tensor_bits                                = 32 
debug_level                                     = 4 
num_tidl_subgraphs                              = 16 
tidl_denylist                                   = 
tidl_denylist_layer_name                        = 
tidl_denylist_layer_type                         = 
tidl_allowlist_layer_name                        = 
model_type                                      =  
tidl_calibration_accuracy_level                 = 64 
tidl_calibration_options:num_frames_calibration = 4 
tidl_calibration_options:bias_calibration_iterations = 3 
mixed_precision_factor = -1.000000 
model_group_id = 0 
power_of_2_quantization                         = 2 
ONNX QDQ Enabled                                = 0 
enable_high_resolution_optimization             = 0 
pre_batchnorm_fold                              = 1 
add_data_convert_ops                            = 3 
output_feature_16bit_names_list                 =  
m_params_16bit_names_list                       =  
m_single_core_layers_names_list                    =  
reserved_compile_constraints_flag               = 1601 
ti_internal_reserved_1                          = 


 ****** WARNING : Network not identified as Object Detection network : (1) Ignore if network is not Object Detection network (2) If network is Object Detection network, please specify "model_type":"OD" as part of OSRT compilation options******

Supported TIDL layer type ---            Conv -- /base/base_layer/base_layer.0/Conv 
Supported TIDL layer type ---            Relu -- /base/base_layer/base_layer.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level0/level0.0/Conv 
Supported TIDL layer type ---            Relu -- /base/level0/level0.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level1/level1.0/Conv 
Supported TIDL layer type ---            Relu -- /base/level1/level1.2/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level2/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level2/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level3/tree1/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree1/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree1/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level3/tree1/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level3/tree1/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree1/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree1/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level3/tree2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level3/tree2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level3/tree2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level3/tree2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level4/tree1/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree1/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree1/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level4/tree1/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level4/tree1/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree1/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree1/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree2/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level4/tree2/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level4/tree2/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level4/tree2/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level4/tree2/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree1/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/tree1/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree1/conv2/Conv 
Supported TIDL layer type ---         MaxPool -- /base/level5/downsample/MaxPool 
Supported TIDL layer type ---            Conv -- /base/level5/project/project.0/Conv 
Supported TIDL layer type ---             Add -- /base/level5/tree1/Add 
Supported TIDL layer type ---            Relu -- /base/level5/tree1/relu_1/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree2/conv1/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/tree2/relu/Relu 
Supported TIDL layer type ---            Conv -- /base/level5/tree2/conv2/Conv 
Supported TIDL layer type ---             Add -- /base/level5/tree2/Add 
Supported TIDL layer type ---            Relu -- /base/level5/tree2/relu_1/Relu 
Supported TIDL layer type ---          Concat -- /base/level5/root/Concat 
Supported TIDL layer type ---            Conv -- /base/level5/root/conv/Conv 
Supported TIDL layer type ---            Relu -- /base/level5/root/relu/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_4_0/upconv_4_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_4_0/upconv_4_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_4_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_4_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat 
Supported TIDL layer type ---            Conv -- /bl/upconv_4_1/upconv_4_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_4_1/upconv_4_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_3_0/upconv_3_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_3_0/upconv_3_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_3_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_3_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_1 
Supported TIDL layer type ---            Conv -- /bl/upconv_3_1/upconv_3_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_3_1/upconv_3_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_2_0/upconv_2_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_2_0/upconv_2_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_2_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_2_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_2 
Supported TIDL layer type ---            Conv -- /bl/upconv_2_1/upconv_2_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_2_1/upconv_2_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_1_0/upconv_1_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_1_0/upconv_1_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_1_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_1_0/shuffle/DepthToSpace 
Supported TIDL layer type ---          Concat -- /bl/Concat_3 
Supported TIDL layer type ---            Conv -- /bl/upconv_1_1/upconv_1_1.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_1_1/upconv_1_1.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/upconv_0_0/upconv_0_0.0/Conv 
Supported TIDL layer type ---            Relu -- /bl/upconv_0_0/upconv_0_0.2/Relu 
Supported TIDL layer type ---            Conv -- /bl/shuffle_conv_0_0/conv/Conv 
Supported TIDL layer type ---    DepthToSpace -- /bl/shuffle_conv_0_0/shuffle/DepthToSpace 
Supported TIDL layer type ---            Conv -- /bl/semantic_conv_0/Conv 

Preliminary subgraphs created = 1 
Final number of subgraphs created are : 1, - Offloaded Nodes - 125, Total Nodes - 125 
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
SUGGESTION -- [TIDL_DepthToSpaceLayer]  Standalone DepthToSpace layer is not optimal in this version, it is optimal if it is next to 1x1 convolutions  
Running runtimes graphviz - /home/root/tidl_tools/tidl_graphVisualiser_runtimes.out ../../../model-artifacts//Blockage_FNC_FWC//allowedNode.txt ../../../model-artifacts//Blockage_FNC_FWC//tempDir/graphvizInfo.txt ../../../model-artifacts//Blockage_FNC_FWC//tempDir/runtimes_visualization.svg 
*** In TIDL_createStateImportFunc *** 
Compute on node : TIDLExecutionProvider_TIDL_0_0
  0,            Conv, 3, 1, input.1, /base/base_layer/base_layer.0/Conv_output_0
  1,            Relu, 1, 1, /base/base_layer/base_layer.0/Conv_output_0, /base/base_layer/base_layer.2/Relu_output_0
  2,            Conv, 3, 1, /base/base_layer/base_layer.2/Relu_output_0, /base/level0/level0.0/Conv_output_0
  3,            Relu, 1, 1, /base/level0/level0.0/Conv_output_0, /base/level0/level0.2/Relu_output_0
  4,            Conv, 3, 1, /base/level0/level0.2/Relu_output_0, /base/level1/level1.0/Conv_output_0
  5,            Relu, 1, 1, /base/level1/level1.0/Conv_output_0, /base/level1/level1.2/Relu_output_0
  6,         MaxPool, 1, 1, /base/level1/level1.2/Relu_output_0, /base/level2/downsample/MaxPool_output_0
  7,            Conv, 3, 1, /base/level2/downsample/MaxPool_output_0, /base/level2/project/project.0/Conv_output_0
  8,            Conv, 3, 1, /base/level1/level1.2/Relu_output_0, /base/level2/tree1/conv1/Conv_output_0
  9,            Relu, 1, 1, /base/level2/tree1/conv1/Conv_output_0, /base/level2/tree1/relu/Relu_output_0
 10,            Conv, 3, 1, /base/level2/tree1/relu/Relu_output_0, /base/level2/tree1/conv2/Conv_output_0
 11,             Add, 2, 1, /base/level2/tree1/conv2/Conv_output_0, /base/level2/tree1/Add_output_0
 12,            Relu, 1, 1, /base/level2/tree1/Add_output_0, /base/level2/tree1/relu_1/Relu_output_0
 13,            Conv, 3, 1, /base/level2/tree1/relu_1/Relu_output_0, /base/level2/tree2/conv1/Conv_output_0
 14,            Relu, 1, 1, /base/level2/tree2/conv1/Conv_output_0, /base/level2/tree2/relu/Relu_output_0
 15,            Conv, 3, 1, /base/level2/tree2/relu/Relu_output_0, /base/level2/tree2/conv2/Conv_output_0
 16,             Add, 2, 1, /base/level2/tree2/conv2/Conv_output_0, /base/level2/tree2/Add_output_0
 17,            Relu, 1, 1, /base/level2/tree2/Add_output_0, /base/level2/tree2/relu_1/Relu_output_0
 18,          Concat, 2, 1, /base/level2/tree2/relu_1/Relu_output_0, /base/level2/root/Concat_output_0
 19,            Conv, 3, 1, /base/level2/root/Concat_output_0, /base/level2/root/conv/Conv_output_0
 20,            Relu, 1, 1, /base/level2/root/conv/Conv_output_0, /base/level2/root/relu/Relu_output_0
 21,         MaxPool, 1, 1, /base/level2/root/relu/Relu_output_0, /base/level3/tree1/downsample/MaxPool_output_0
 22,            Conv, 3, 1, /base/level3/tree1/downsample/MaxPool_output_0, /base/level3/tree1/project/project.0/Conv_output_0
 23,            Conv, 3, 1, /base/level2/root/relu/Relu_output_0, /base/level3/tree1/tree1/conv1/Conv_output_0
 24,            Relu, 1, 1, /base/level3/tree1/tree1/conv1/Conv_output_0, /base/level3/tree1/tree1/relu/Relu_output_0
 25,            Conv, 3, 1, /base/level3/tree1/tree1/relu/Relu_output_0, /base/level3/tree1/tree1/conv2/Conv_output_0
 26,             Add, 2, 1, /base/level3/tree1/tree1/conv2/Conv_output_0, /base/level3/tree1/tree1/Add_output_0
 27,            Relu, 1, 1, /base/level3/tree1/tree1/Add_output_0, /base/level3/tree1/tree1/relu_1/Relu_output_0
 28,            Conv, 3, 1, /base/level3/tree1/tree1/relu_1/Relu_output_0, /base/level3/tree1/tree2/conv1/Conv_output_0
 29,            Relu, 1, 1, /base/level3/tree1/tree2/conv1/Conv_output_0, /base/level3/tree1/tree2/relu/Relu_output_0
 30,            Conv, 3, 1, /base/level3/tree1/tree2/relu/Relu_output_0, /base/level3/tree1/tree2/conv2/Conv_output_0
 31,             Add, 2, 1, /base/level3/tree1/tree2/conv2/Conv_output_0, /base/level3/tree1/tree2/Add_output_0
 32,            Relu, 1, 1, /base/level3/tree1/tree2/Add_output_0, /base/level3/tree1/tree2/relu_1/Relu_output_0
 33,          Concat, 2, 1, /base/level3/tree1/tree2/relu_1/Relu_output_0, /base/level3/tree1/root/Concat_output_0
 34,            Conv, 3, 1, /base/level3/tree1/root/Concat_output_0, /base/level3/tree1/root/conv/Conv_output_0
 35,            Relu, 1, 1, /base/level3/tree1/root/conv/Conv_output_0, /base/level3/tree1/root/relu/Relu_output_0
 36,            Conv, 3, 1, /base/level3/tree1/root/relu/Relu_output_0, /base/level3/tree2/tree1/conv1/Conv_output_0
 37,            Relu, 1, 1, /base/level3/tree2/tree1/conv1/Conv_output_0, /base/level3/tree2/tree1/relu/Relu_output_0
 38,            Conv, 3, 1, /base/level3/tree2/tree1/relu/Relu_output_0, /base/level3/tree2/tree1/conv2/Conv_output_0
 39,             Add, 2, 1, /base/level3/tree2/tree1/conv2/Conv_output_0, /base/level3/tree2/tree1/Add_output_0
 40,            Relu, 1, 1, /base/level3/tree2/tree1/Add_output_0, /base/level3/tree2/tree1/relu_1/Relu_output_0
 41,            Conv, 3, 1, /base/level3/tree2/tree1/relu_1/Relu_output_0, /base/level3/tree2/tree2/conv1/Conv_output_0
 42,            Relu, 1, 1, /base/level3/tree2/tree2/conv1/Conv_output_0, /base/level3/tree2/tree2/relu/Relu_output_0
 43,            Conv, 3, 1, /base/level3/tree2/tree2/relu/Relu_output_0, /base/level3/tree2/tree2/conv2/Conv_output_0
 44,             Add, 2, 1, /base/level3/tree2/tree2/conv2/Conv_output_0, /base/level3/tree2/tree2/Add_output_0
 45,            Relu, 1, 1, /base/level3/tree2/tree2/Add_output_0, /base/level3/tree2/tree2/relu_1/Relu_output_0
 46,          Concat, 4, 1, /base/level3/tree2/tree2/relu_1/Relu_output_0, /base/level3/tree2/root/Concat_output_0
 47,            Conv, 3, 1, /base/level3/tree2/root/Concat_output_0, /base/level3/tree2/root/conv/Conv_output_0
 48,            Relu, 1, 1, /base/level3/tree2/root/conv/Conv_output_0, /base/level3/tree2/root/relu/Relu_output_0
 49,         MaxPool, 1, 1, /base/level3/tree2/root/relu/Relu_output_0, /base/level4/tree1/downsample/MaxPool_output_0
 50,            Conv, 3, 1, /base/level4/tree1/downsample/MaxPool_output_0, /base/level4/tree1/project/project.0/Conv_output_0
 51,            Conv, 3, 1, /base/level3/tree2/root/relu/Relu_output_0, /base/level4/tree1/tree1/conv1/Conv_output_0
 52,            Relu, 1, 1, /base/level4/tree1/tree1/conv1/Conv_output_0, /base/level4/tree1/tree1/relu/Relu_output_0
 53,            Conv, 3, 1, /base/level4/tree1/tree1/relu/Relu_output_0, /base/level4/tree1/tree1/conv2/Conv_output_0
 54,             Add, 2, 1, /base/level4/tree1/tree1/conv2/Conv_output_0, /base/level4/tree1/tree1/Add_output_0
 55,            Relu, 1, 1, /base/level4/tree1/tree1/Add_output_0, /base/level4/tree1/tree1/relu_1/Relu_output_0
 56,            Conv, 3, 1, /base/level4/tree1/tree1/relu_1/Relu_output_0, /base/level4/tree1/tree2/conv1/Conv_output_0
 57,            Relu, 1, 1, /base/level4/tree1/tree2/conv1/Conv_output_0, /base/level4/tree1/tree2/relu/Relu_output_0
 58,            Conv, 3, 1, /base/level4/tree1/tree2/relu/Relu_output_0, /base/level4/tree1/tree2/conv2/Conv_output_0
 59,             Add, 2, 1, /base/level4/tree1/tree2/conv2/Conv_output_0, /base/level4/tree1/tree2/Add_output_0
 60,            Relu, 1, 1, /base/level4/tree1/tree2/Add_output_0, /base/level4/tree1/tree2/relu_1/Relu_output_0
 61,          Concat, 2, 1, /base/level4/tree1/tree2/relu_1/Relu_output_0, /base/level4/tree1/root/Concat_output_0
 62,            Conv, 3, 1, /base/level4/tree1/root/Concat_output_0, /base/level4/tree1/root/conv/Conv_output_0
 63,            Relu, 1, 1, /base/level4/tree1/root/conv/Conv_output_0, /base/level4/tree1/root/relu/Relu_output_0
 64,            Conv, 3, 1, /base/level4/tree1/root/relu/Relu_output_0, /base/level4/tree2/tree1/conv1/Conv_output_0
 65,            Relu, 1, 1, /base/level4/tree2/tree1/conv1/Conv_output_0, /base/level4/tree2/tree1/relu/Relu_output_0
 66,            Conv, 3, 1, /base/level4/tree2/tree1/relu/Relu_output_0, /base/level4/tree2/tree1/conv2/Conv_output_0
 67,             Add, 2, 1, /base/level4/tree2/tree1/conv2/Conv_output_0, /base/level4/tree2/tree1/Add_output_0
 68,            Relu, 1, 1, /base/level4/tree2/tree1/Add_output_0, /base/level4/tree2/tree1/relu_1/Relu_output_0
 69,            Conv, 3, 1, /base/level4/tree2/tree1/relu_1/Relu_output_0, /base/level4/tree2/tree2/conv1/Conv_output_0
 70,            Relu, 1, 1, /base/level4/tree2/tree2/conv1/Conv_output_0, /base/level4/tree2/tree2/relu/Relu_output_0
 71,            Conv, 3, 1, /base/level4/tree2/tree2/relu/Relu_output_0, /base/level4/tree2/tree2/conv2/Conv_output_0
 72,             Add, 2, 1, /base/level4/tree2/tree2/conv2/Conv_output_0, /base/level4/tree2/tree2/Add_output_0
 73,            Relu, 1, 1, /base/level4/tree2/tree2/Add_output_0, /base/level4/tree2/tree2/relu_1/Relu_output_0
 74,          Concat, 4, 1, /base/level4/tree2/tree2/relu_1/Relu_output_0, /base/level4/tree2/root/Concat_output_0
 75,            Conv, 3, 1, /base/level4/tree2/root/Concat_output_0, /base/level4/tree2/root/conv/Conv_output_0
 76,            Relu, 1, 1, /base/level4/tree2/root/conv/Conv_output_0, /base/level4/tree2/root/relu/Relu_output_0
 77,         MaxPool, 1, 1, /base/level4/tree2/root/relu/Relu_output_0, /base/level5/downsample/MaxPool_output_0
 78,            Conv, 3, 1, /base/level5/downsample/MaxPool_output_0, /base/level5/project/project.0/Conv_output_0
 79,            Conv, 3, 1, /base/level4/tree2/root/relu/Relu_output_0, /base/level5/tree1/conv1/Conv_output_0
 80,            Relu, 1, 1, /base/level5/tree1/conv1/Conv_output_0, /base/level5/tree1/relu/Relu_output_0
 81,            Conv, 3, 1, /base/level5/tree1/relu/Relu_output_0, /base/level5/tree1/conv2/Conv_output_0
 82,             Add, 2, 1, /base/level5/tree1/conv2/Conv_output_0, /base/level5/tree1/Add_output_0
 83,            Relu, 1, 1, /base/level5/tree1/Add_output_0, /base/level5/tree1/relu_1/Relu_output_0
 84,            Conv, 3, 1, /base/level5/tree1/relu_1/Relu_output_0, /base/level5/tree2/conv1/Conv_output_0
 85,            Relu, 1, 1, /base/level5/tree2/conv1/Conv_output_0, /base/level5/tree2/relu/Relu_output_0
 86,            Conv, 3, 1, /base/level5/tree2/relu/Relu_output_0, /base/level5/tree2/conv2/Conv_output_0
 87,             Add, 2, 1, /base/level5/tree2/conv2/Conv_output_0, /base/level5/tree2/Add_output_0
 88,            Relu, 1, 1, /base/level5/tree2/Add_output_0, /base/level5/tree2/relu_1/Relu_output_0
 89,          Concat, 3, 1, /base/level5/tree2/relu_1/Relu_output_0, /base/level5/root/Concat_output_0
 90,            Conv, 3, 1, /base/level5/root/Concat_output_0, /base/level5/root/conv/Conv_output_0
 91,            Relu, 1, 1, /base/level5/root/conv/Conv_output_0, /base/level5/root/relu/Relu_output_0
 92,            Conv, 3, 1, /base/level5/root/relu/Relu_output_0, /bl/upconv_4_0/upconv_4_0.0/Conv_output_0
 93,            Relu, 1, 1, /bl/upconv_4_0/upconv_4_0.0/Conv_output_0, /bl/upconv_4_0/upconv_4_0.2/Relu_output_0
 94,            Conv, 2, 1, /bl/upconv_4_0/upconv_4_0.2/Relu_output_0, /bl/shuffle_conv_4_0/conv/Conv_output_0
 95,    DepthToSpace, 1, 1, /bl/shuffle_conv_4_0/conv/Conv_output_0, /bl/shuffle_conv_4_0/shuffle/DepthToSpace_output_0
 96,          Concat, 2, 1, /bl/shuffle_conv_4_0/shuffle/DepthToSpace_output_0, /bl/Concat_output_0
 97,            Conv, 3, 1, /bl/Concat_output_0, /bl/upconv_4_1/upconv_4_1.0/Conv_output_0
 98,            Relu, 1, 1, /bl/upconv_4_1/upconv_4_1.0/Conv_output_0, /bl/upconv_4_1/upconv_4_1.2/Relu_output_0
 99,            Conv, 3, 1, /bl/upconv_4_1/upconv_4_1.2/Relu_output_0, /bl/upconv_3_0/upconv_3_0.0/Conv_output_0
100,            Relu, 1, 1, /bl/upconv_3_0/upconv_3_0.0/Conv_output_0, /bl/upconv_3_0/upconv_3_0.2/Relu_output_0
101,            Conv, 2, 1, /bl/upconv_3_0/upconv_3_0.2/Relu_output_0, /bl/shuffle_conv_3_0/conv/Conv_output_0
102,    DepthToSpace, 1, 1, /bl/shuffle_conv_3_0/conv/Conv_output_0, /bl/shuffle_conv_3_0/shuffle/DepthToSpace_output_0
103,          Concat, 2, 1, /bl/shuffle_conv_3_0/shuffle/DepthToSpace_output_0, /bl/Concat_1_output_0
104,            Conv, 3, 1, /bl/Concat_1_output_0, /bl/upconv_3_1/upconv_3_1.0/Conv_output_0
105,            Relu, 1, 1, /bl/upconv_3_1/upconv_3_1.0/Conv_output_0, /bl/upconv_3_1/upconv_3_1.2/Relu_output_0
106,            Conv, 3, 1, /bl/upconv_3_1/upconv_3_1.2/Relu_output_0, /bl/upconv_2_0/upconv_2_0.0/Conv_output_0
107,            Relu, 1, 1, /bl/upconv_2_0/upconv_2_0.0/Conv_output_0, /bl/upconv_2_0/upconv_2_0.2/Relu_output_0
108,            Conv, 2, 1, /bl/upconv_2_0/upconv_2_0.2/Relu_output_0, /bl/shuffle_conv_2_0/conv/Conv_output_0
109,    DepthToSpace, 1, 1, /bl/shuffle_conv_2_0/conv/Conv_output_0, /bl/shuffle_conv_2_0/shuffle/DepthToSpace_output_0
110,          Concat, 2, 1, /bl/shuffle_conv_2_0/shuffle/DepthToSpace_output_0, /bl/Concat_2_output_0
111,            Conv, 3, 1, /bl/Concat_2_output_0, /bl/upconv_2_1/upconv_2_1.0/Conv_output_0
112,            Relu, 1, 1, /bl/upconv_2_1/upconv_2_1.0/Conv_output_0, /bl/upconv_2_1/upconv_2_1.2/Relu_output_0
113,            Conv, 3, 1, /bl/upconv_2_1/upconv_2_1.2/Relu_output_0, /bl/upconv_1_0/upconv_1_0.0/Conv_output_0
114,            Relu, 1, 1, /bl/upconv_1_0/upconv_1_0.0/Conv_output_0, /bl/upconv_1_0/upconv_1_0.2/Relu_output_0
115,            Conv, 2, 1, /bl/upconv_1_0/upconv_1_0.2/Relu_output_0, /bl/shuffle_conv_1_0/conv/Conv_output_0
116,    DepthToSpace, 1, 1, /bl/shuffle_conv_1_0/conv/Conv_output_0, /bl/shuffle_conv_1_0/shuffle/DepthToSpace_output_0
117,          Concat, 2, 1, /bl/shuffle_conv_1_0/shuffle/DepthToSpace_output_0, /bl/Concat_3_output_0
118,            Conv, 3, 1, /bl/Concat_3_output_0, /bl/upconv_1_1/upconv_1_1.0/Conv_output_0
119,            Relu, 1, 1, /bl/upconv_1_1/upconv_1_1.0/Conv_output_0, /bl/upconv_1_1/upconv_1_1.2/Relu_output_0
120,            Conv, 3, 1, /bl/upconv_1_1/upconv_1_1.2/Relu_output_0, /bl/upconv_0_0/upconv_0_0.0/Conv_output_0
121,            Relu, 1, 1, /bl/upconv_0_0/upconv_0_0.0/Conv_output_0, /bl/upconv_0_0/upconv_0_0.2/Relu_output_0
122,            Conv, 2, 1, /bl/upconv_0_0/upconv_0_0.2/Relu_output_0, /bl/shuffle_conv_0_0/conv/Conv_output_0
123,    DepthToSpace, 1, 1, /bl/shuffle_conv_0_0/conv/Conv_output_0, /bl/shuffle_conv_0_0/shuffle/DepthToSpace_output_0
124,            Conv, 2, 1, /bl/shuffle_conv_0_0/shuffle/DepthToSpace_output_0, 656

Input tensor name -  input.1 
Output tensor name - 656 
 Graph Domain TO version : 14In TIDL_onnxRtImportInit subgraph_name=subgraph_0
Layer 0, subgraph id subgraph_0, name=656
Layer 1, subgraph id subgraph_0, name=input.1
In TIDL_runtimesOptimizeNet: LayerIndex = 127, dataIndex = 126 
WARNING: Conv Layer /bl/upconv_4_1/upconv_4_1.0/Conv's coeff cannot be found(or not match) in coef file, Random coeff will be generated! Only for evaluation usage! Results are all random!
WARNING: Conv Layer /bl/upconv_3_1/upconv_3_1.0/Conv's coeff cannot be found(or not match) in coef file, Random coeff will be generated! Only for evaluation usage! Results are all random!
WARNING: Conv Layer /bl/upconv_2_1/upconv_2_1.0/Conv's coeff cannot be found(or not match) in coef file, Random coeff will be generated! Only for evaluation usage! Results are all random!
WARNING: Conv Layer /bl/upconv_1_1/upconv_1_1.0/Conv's coeff cannot be found(or not match) in coef file, Random coeff will be generated! Only for evaluation usage! Results are all random!
WARNING: Conv Layer /bl/semantic_conv_0/Conv's coeff cannot be found(or not match) in coef file, Random coeff will be generated! Only for evaluation usage! Results are all random!

 ************** Frame index 1 : Running float import ************* 
In TIDL_runtimesPostProcessNet 
In TIDL_runtimesPostProcessNet 1
In TIDL_runtimesPostProcessNet 2
In TIDL_runtimesPostProcessNet 3
****************************************************
**                ALL MODEL CHECK PASSED          **
****************************************************

In TI
Running_Model :  Blockage_FNC_FWC  


Running shape inference on model /home/root/lucid/model_onnx/blockage_v1.onnx 


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/1lPI05-cam-03-PRIMAX-IMX390-20220127_134757-000000.png
*********The Model output is :[[[[[[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]

    [[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 8, 12)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/BCMr0p-cam-03-PRIMAX-IMX390-20220127_142921-000270.png
*********The Model output is :[[[[[[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]

    [[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 8, 12)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/Dh020b-cam-03-PRIMAX-IMX390-20220127_185825-000180.png
*********The Model output is :[[[[[[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]

    [[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 8, 12)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


***************Running_Inference Section **********

This is Lucid Model for image : /home/root/lucid/data_onnx/blockage_tst_imgs/dQcJ01-cam-03-PRIMAX-IMX390-20220415_160448-000001.png
*********The Model output is :[[[[[[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]

    [[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
     [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]]]]]
*********The Model output shape is :(1, 1, 1, 2, 8, 12)
/n The max value in the op :0.0

***************Running_Benchmark_Section **********


 
Completed_Model :     1, Name : Blockage_FNC_FWC                                  , Total time : -3030290789126.60, Offload Time : -1299569907245.47 , DDR RW MBs : 0, Output File : py_out_Blockage_FNC_FWC_dQcJ01-cam-03-PRIMAX-IMX390-20220415_160448-000001.png

  • 0
    TI__Genius 10170 points

    Hello,

    Thank you for posting your question. Would you be able to confirm my understanding of the behavior you are seeing?

    1. When disabling offload to C7x (running ARM only mode with -d) you are seeing the expected result

    2. When enabling offload to C7x (running compilation with -c) with tensor bits set to fp32, you are seeing the expected result (left svg file, first log)

    3. Replicating scenario 2, the only change is changing the calibration iterations, You are then seeing the dimension change issue (right svg file, second log)

    Best,

    Asha

  • 0 in reply to Asha Bhandarkar
    Intellectual 530 points

    1. yes 

    2. yes

    3. by adding the dataconvert flag i am see the issue where the dimension is changed

  • 0 in reply to abhilash sk
    TI__Genius 10170 points

    Hi,

    Thank you for the clarifications on that point. I think in the original post you mentioned advanced_options:calibration_iterations instead of advanced_options:add_data_convert_ops, so thank you for the clarification in your last response - I see this is what you have changed based on your logs. 

    Currently we are still giving this as an experimental option as noted in https://github.com/TexasInstruments/edgeai-tidl-tools/tree/master/examples/osrt_python, but I would like to help narrow the down this issue further. Have you tried the other options (1 and 2) for this model? Can you comment on what the behavior is in this case? Does the mismatch continue? 

    Best,

    Asha

  • 0 in reply to Asha Bhandarkar
    Intellectual 530 points

    Apologies for the typo error  in the orginal post 

    Yes i have tried option 1 and 2 ; same thing happens in the option 2 but i cannot set the flag at 1 or 2 it has to be on 3 only , can you please expedite the response on this shall be helpful 

  • 0 in reply to abhilash sk
    TI__Genius 10170 points

    Hi,

    Thank you for clarifying that behavior. Would you be able to provide a model + model artifacts so we can reproduce and investigate further on our end?

    Best,

    Asha

  • 0 in reply to Asha Bhandarkar
    Intellectual 530 points

    blockagev1_rand.zipCan you let me knw what shall be eta to resolve this as , getting a response from TI is too much delayed which is blocking our other activities .. so need to understand how much time shall be taken by TI for getting a solution  

  • 0 in reply to abhilash sk
    TI__Genius 10170 points

    Hi Abhilash,

    I do apologize for not being able to get back to your question due to bandwidth issues and being out of office - I realize this is a blocking issue for you. 

    Thank you for providing the model - I ran with both data convert layer options that you mention and I am able to reproduce your error using the latest 09_02_09 tools. 

    It looks that with both the input and output data convert layers that the DepthToSpace layer is merged differently resulting in the incorrect dimension output tensor. I've gone ahead and filed a ticket for this for further investigation on our end (for reference, TIDL-4446). 

    It looks like you have pointed this out in your related thread here and are trying to add the layer to the deny list. Let me check internally regarding this to see if that can unblock you for the time being.

    Again, I do apologize for the delay in getting to your issue.

    Best,

    Asha