/user/a0132471/Apps/anaconda2/envs/tidlrt/bin/python /user/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/yolo_onnx_inference_tidl.py TIDL Meta PipeLine (Proto) File : ./yolov5s6_ti_lite_640_weedDetect.prototxt yolo_v3 yolo_v3 Number of OD backbone nodes = 192 Size of odBackboneNodeIds = 192 Preliminary subgraphs created = 1 Final number of subgraphs created are : 1, - Offloaded Nodes - 295, Total Nodes - 295 TIDL Meta PipeLine (Proto) File : ./yolov5s6_ti_lite_640_weedDetect.prototxt yolo_v3 yolo_v3 ************** Frame index 1 : Running float import ************* INFORMATION: [TIDL_ResizeLayer] Resize_107 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_123 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_139 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] ti_cnnperfsim.out fails to allocate memory in MSMC. Please look into perfsim log. This model can only be used on PC emulation, it will get fault on target. **************************************************** ** 4 WARNINGS 0 ERRORS ** **************************************************** 0.0s: VX_ZONE_INIT:Enabled 0.8s: VX_ZONE_ERROR:Enabled 0.10s: VX_ZONE_WARNING:Enabled 0.475s: VX_ZONE_INIT:[tivxInit:178] Initialization Done !!! ********** Frame Index 1 : Running float inference ********** ********** Frame Index 2 : Running fixed point mode for calibration ********** ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 522.20 .... ..... ... .... ..... # 1 . .. T 308.56 .... ..... ... .... ..... ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 616.70 .... ..... ... .... ..... # 1 . .. T 431.99 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 533.83 .... ..... ... .... ..... # 1 . .. T 373.12 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 559.46 .... ..... ... .... ..... # 1 . .. T 460.85 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 544.86 .... ..... ... .... ..... # 1 . .. T 380.33 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /data/hdd_data1/a0132471/Files/bit-bucket/utils/yolov5_onnx_weed_detector/artifacts/tempDir/detections_tidl_io_.qunat_stats_config.txt ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 565.80 .... ..... ... .... ..... # 1 . .. T 411.45 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ------------------ Network Compiler Traces ----------------------------- successful Memory allocation substitute string tidl_net_ not found INFORMATION: [TIDL_ResizeLayer] Resize_107 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_123 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_139 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** libtidl_onnxrt_EP loaded 0x5571e5845e80 Final number of subgraphs created are : 1, - Offloaded Nodes - 295, Total Nodes - 295 16.614467s: VX_ZONE_INIT:Enabled 16.614474s: VX_ZONE_ERROR:Enabled 16.614475s: VX_ZONE_WARNING:Enabled 16.614883s: VX_ZONE_INIT:[tivxInit:178] Initialization Done !!! Starting Inference 1/8 2/8 3/8 4/8 5/8 6/8 7/8 8/8 Process finished with exit code 0