root@ff2ad4988eca:/home/root/examples/osrt_python/ort# python3 onnxrt_yolact.py -c Multiple GPUs detected! Turning off JIT. Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 1 Models - ['yolact'] Running_Model : yolact Running shape inference on model /home/root/zzz/model_onnx/yolact_org.onnx ***** WARNING : tensor_bits = 32 -- Compiling for floating point - target execution is not supported for 32 bit compilation !! ***** Preliminary subgraphs created = 1 Final number of subgraphs created are : 1, - Offloaded Nodes - 211, Total Nodes - 211 ***************Running_Inference Section ********** This is Lucid Model for image ../../../test_data/airshow.jpg Graph Domain TO version : 11 ************** Frame index 1 : Running float import ************* **************************************************** ** All the Tensor Dimensions has to be greater then Zero ** DIM Error - For Tensor 72, Dim 4 is 0 **************************************************** SUGGESTION: [TIDL_ResizeLayer] Resize_130 Resize Layer with non-symmetric resize ratio across width and height is not optimal. SUGGESTION: [TIDL_ResizeLayer] Resize_141 Resize Layer with non-symmetric resize ratio across width and height is not optimal. INFORMATION: [TIDL_ResizeLayer] Resize_159 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.8s: VX_ZONE_ERROR:Enabled 0.9s: VX_ZONE_WARNING:Enabled 0.2233s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! Warning : Couldn't find corresponding ioBuf tensor for onnx tensor with matching name ********** Frame Index 1 : Running float inference ********** 5 (1, 1, 1, 1, 19248, 4) (1, 1, 1, 1, 19248, 81) (1, 1, 1, 1, 19248, 32) (19248, 4) () ***************Running_Benchmark_Section ********** ***************Running_Inference Section ********** This is Lucid Model for image ../../../test_data/ADE_val_00001801.jpg Graph Domain TO version : 11Warning : Couldn't find corresponding ioBuf tensor for onnx tensor with matching name ************ Frame index 2 : Running float inference **************** 5 (1, 1, 1, 1, 19248, 4) (1, 1, 1, 1, 19248, 81) (1, 1, 1, 1, 19248, 32) (19248, 4) () ***************Running_Benchmark_Section ********** Completed_Model : 1, Name : yolact , Total time : 7585417308788.64, Offload Time : 67270367807.26 , DDR RW MBs : 0, Output File : py_out_yolact_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 28 alloc's of 718949141 bytes MEM: Free's : 28 free's of 718949141 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!!