/opt/edgeai-gst-apps/PatchCore_anomaly_detection/live_detection:9: UserWarning: A NumPy version >=1.23.5 and <2.3.0 is required for this version of SciPy (detected version 1.23.0) from scipy.ndimage import gaussian_filter libtidl_onnxrt_EP loaded 0x269fe940 Final number of subgraphs created are : 1, - Offloaded Nodes - 98, Total Nodes - 98 TIDL_RT_OVX: Set default TIDLRT params done Calling appInit() in TIDL-RT! APP: Init ... !!! MEM: Init ... !!! MEM: Initialized DMA HEAP (fd=5) !!! MEM: Init ... Done !!! IPC: Init ... !!! IPC: Init ... Done !!! REMOTE_SERVICE: Init ... !!! REMOTE_SERVICE: Init ... Done !!! 617.390773 s: GTC Frequency = 200 MHz APP: Init ... Done !!! 617.390873 s: VX_ZONE_INIT:Enabled 617.390880 s: VX_ZONE_ERROR:Enabled 617.390885 s: VX_ZONE_WARNING:Enabled 617.392547 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!! 617.392733 s: VX_ZONE_INIT:[tivxHostInitLocal:101] Initialization Done for HOST !!! TIDL_RT_OVX: Init ... TIDL_RT_OVX: Mapping config file ... TIDL_RT_OVX: Mapping config file ... Done. 37912 bytes TIDL_RT_OVX: Tensors, input = 1, output = 2 Host kernel - 0xffff5fc6cbe8 TIDL_RT_OVX: Mapping network file TIDL_RT_OVX: Mapping network file... Done 28330240 bytes TIDL_RT_OVX: Init done. TIDL_RT_OVX: Creating graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: Creating graph ... Done. TIDL_RT_OVX: Verifying TIDL graph ... Done. [ WARN:0@30.690] global /usr/src/debug/opencv/4.5.5-r0/git/modules/videoio/src/cap_gstreamer.cpp (1405) open OpenCV | GStreamer warning: Cannot query video position: status=0, value=-1, duration=-1 (python:1462): Gdk-CRITICAL **: 20:36:37.148: gdk_seat_get_keyboard: assertion 'GDK_IS_SEAT (seat)' failed TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632Model loading time: 1.3373 seconds FAISS index loading time: 0.0005 seconds Frame read time: 0.0192 seconds Frame preprocessing time: 0.0870 seconds 3 Model inference time: 0.0783 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1049 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0198 seconds Heatmap overlay time: 0.0403 seconds Display time: 0.2753 seconds Frame processing time: 0.2754 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0391 seconds 3 Model inference time: 0.0782 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1095 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0195 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0384 seconds 3 Model inference time: 0.0762 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0963 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0176 seconds Heatmap overlay time: 0.0370 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0387 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0897 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0178 seconds Heatmap overlay time: 0.0366 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0382 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0950 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0185 seconds Heatmap overlay time: 0.0364 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0537 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1494 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0207 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0521 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1613 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0220 seconds Heatmap overlay time: 0.0377 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0550 seconds 3 Model inference time: 0.0771 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1525 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0217 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0611 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1593 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0207 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0543 seconds 3 Model inference time: 0.0772 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1599 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0207 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0537 seconds 3 Model inference time: 0.0783 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1608 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0539 seconds 3 Model inference time: 0.0771 seconds torch.Size([1, 512, 28, 28]) add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcptorch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1607 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0177 seconds Heatmap overlay time: 0.0366 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0535 seconds 3 Model inference time: 0.0781 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1586 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1561 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0178 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0544 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1549 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0028 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0392 seconds 3 Model inference time: 0.0782 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1067 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0180 seconds Heatmap overlay time: 0.0366 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0514 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1542 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0208 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0535 seconds 3 Model inference time: 0.0764 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1545 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0503 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1574 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0221 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0524 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1534 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0220 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0523 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1590 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0382 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0541 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1583 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0375 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0537 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1528 seconds y output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0214 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1606 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0217 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1567 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1509 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0220 seconds Heatmap overlay time: 0.0370 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0536 seconds 3 Model inference time: 0.0785 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1510 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0230 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0533 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1548 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0220 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0440 seconds 3 Model inference time: 0.0757 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0949 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0179 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0563 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1539 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0542 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1518 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0402 seconds 3 Model inference time: 0.0751 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0929 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0179 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0529 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1572 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0219 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0384 seconds 3 Model inference time: 0.0750 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0926 seconds OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtScore patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0178 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0543 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1587 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0375 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0521 seconds 3 Model inference time: 0.0764 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1570 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0206 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0520 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1569 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0205 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0400 seconds 3 Model inference time: 0.0751 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0937 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0545 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1574 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0530 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1596 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0217 seconds Heatmap overlay time: 0.0382 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0541 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1561 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0525 seconds 3 Model inference time: 0.0764 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1561 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0219 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0531 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1577 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0399 seconds 3 Model inference time: 0.0919 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0933 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0176 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0516 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1583 seconds elemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElemeScore patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0375 seconds Display time: 0.0030 seconds Frame processing time: 0.0031 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0391 seconds 3 Model inference time: 0.0752 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0953 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0190 seconds Heatmap overlay time: 0.0370 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0527 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1580 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0216 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0518 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1557 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0217 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0392 seconds 3 Model inference time: 0.0824 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0938 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0178 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0492 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1540 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0205 seconds Heatmap overlay time: 0.0376 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0416 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0941 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0177 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0538 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1560 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0222 seconds Heatmap overlay time: 0.0370 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0401 seconds 3 Model inference time: 0.0986 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0926 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0176 seconds Heatmap overlay time: 0.0365 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0543 seconds 3 Model inference time: 0.0787 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1566 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0556 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1577 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0535 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1541 seconds ntType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0219 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0387 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0926 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0177 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0547 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1607 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0205 seconds Heatmap overlay time: 0.0388 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0535 seconds 3 Model inference time: 0.0777 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1555 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0544 seconds 3 Model inference time: 0.0789 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1472 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0378 seconds Display time: 0.0029 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0557 seconds 3 Model inference time: 0.0776 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1604 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0377 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0518 seconds 3 Model inference time: 0.0795 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1314 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0182 seconds Heatmap overlay time: 0.0366 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0528 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1587 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0213 seconds Heatmap overlay time: 0.0380 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0012 seconds Frame preprocessing time: 0.0522 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1606 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0211 seconds Heatmap overlay time: 0.0378 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0012 seconds Frame preprocessing time: 0.0551 seconds 3 Model inference time: 0.0771 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1455 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0231 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0387 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0960 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0432 seconds Heatmap overlay time: 0.0375 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0532 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1586 seconds = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.0Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0219 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0537 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1537 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0212 seconds Heatmap overlay time: 0.0374 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0395 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0869 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0184 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0524 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1573 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0206 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0030 seconds Frame processing time: 0.0031 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0404 seconds 3 Model inference time: 0.0758 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0902 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0174 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0549 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1481 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0374 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0384 seconds 3 Model inference time: 0.0763 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0882 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0177 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0532 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1543 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0222 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0552 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1521 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0215 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0401 seconds 3 Model inference time: 0.0751 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0871 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0174 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0530 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1572 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0204 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0538 seconds 3 Model inference time: 0.0773 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1588 seconds 00000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704,Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0547 seconds 3 Model inference time: 0.0764 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1548 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0533 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1595 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0218 seconds Heatmap overlay time: 0.0374 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0532 seconds 3 Model inference time: 0.0769 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1516 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0372 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0383 seconds 3 Model inference time: 0.0749 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0924 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0177 seconds Heatmap overlay time: 0.0366 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0531 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1507 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0213 seconds Heatmap overlay time: 0.0380 seconds Display time: 0.0029 seconds Frame processing time: 0.0030 seconds Frame read time: 0.0012 seconds Frame preprocessing time: 0.0408 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0957 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0178 seconds Heatmap overlay time: 0.0373 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0011 seconds Frame preprocessing time: 0.0561 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1580 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0205 seconds Heatmap overlay time: 0.0391 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0386 seconds 3 Model inference time: 0.0772 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1590 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0174 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0388 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.0893 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0174 seconds Heatmap overlay time: 0.0364 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0542 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1577 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0223 seconds Heatmap overlay time: 0.0371 seconds Display time: 0.0027 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0664 seconds 3 Model inference time: 0.0770 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1560 seconds dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidhScore patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0223 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0541 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1586 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0223 seconds Heatmap overlay time: 0.0376 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0768 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1560 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0219 seconds Heatmap overlay time: 0.0367 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0536 seconds 3 Model inference time: 0.0765 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1588 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0217 seconds Heatmap overlay time: 0.0374 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0541 seconds 3 Model inference time: 0.0766 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1572 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0209 seconds Heatmap overlay time: 0.0369 seconds Display time: 0.0028 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0010 seconds Frame preprocessing time: 0.0549 seconds 3 Model inference time: 0.0793 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1553 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0207 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0028 seconds Frame processing time: 0.0028 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0534 seconds 3 Model inference time: 0.0767 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) Feature extraction time: 0.1524 seconds Score patches: [[9.5458945e+03 9.6918467e+03 3.4028235e+38 3.4028235e+38] [1.6305024e+04 1.6471969e+04 3.4028235e+38 3.4028235e+38] [2.0695094e+04 2.0928885e+04 3.4028235e+38 3.4028235e+38] ... [2.2477152e+04 2.2710682e+04 3.4028235e+38 3.4028235e+38] [1.6455756e+04 1.6627607e+04 3.4028235e+38 3.4028235e+38] [9.5593936e+03 9.7104756e+03 3.4028235e+38 3.4028235e+38]] FAISS search time: 0.0210 seconds Heatmap overlay time: 0.0368 seconds Display time: 0.0029 seconds Frame processing time: 0.0029 seconds Frame read time: 0.0009 seconds Frame preprocessing time: 0.0400 seconds 3 Model inference time: 0.0753 seconds torch.Size([1, 512, 28, 28]) torch.Size([1, 1024, 14, 14]) t = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Set default TIDLRT tensor done TIDL_RT_OVX: Running Graph ... TIDL_RT_OVX: input_sizes[0] = 896, dim = 224 padL = 0 padR = 0 TIDL_RT_OVX: input_sizes[1] = 200704, dim = 224 padT = 0 padB = 0 TIDL_RT_OVX: input_sizes[2] = 3, dim = 3 TIDL_RT_OVX: input_sizes[3] = 1, dim = 1 TIDL_RT_OVX : Memcpy Input Buffer TIDL_RT_OVX: input_buffer = 0xffff6c018000 150528 TIDL_RT_OVX: memset_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: vxProcessGraph ... Done. TIDL_RT_OVX : Memcpy output Buffer 0xffff50e4d640 802816 input.332 input.332 TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[0] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 14, outWidht = 14 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 14, outHeight = 14 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 4103, outNumChannels = 1024 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX : Memcpy output Buffer 0xffff50cc5640 1605632 add_output add_output TIDL_RT_OVX: elementSize = 4, OutElementType = 10 scale[1] = 1.000000, rtelemType = 6, rtZp = 0, rtScale = 1.000000 TIDL_RT_OVX: output_sizes[0] = 28, outWidht = 28 padL = 0 padR = 0 TIDL_RT_OVX: output_sizes[1] = 28, outHeight = 28 padT = 0 padB = 0 TIDL_RT_OVX: output_sizes[2] = 2051, outNumChannels = 512 TIDL_RT_OVX: output_sizes[3] = 1, outNumBatches = 1 TIDL_RT_OVX: map_cp_out_tensor_tidlrt_tiovx ... Done. TIDL_RT_OVX: Ran TIDL graph ... Done. Traceback (most recent call last): File "/opt/edgeai-gst-apps/PatchCore_anomaly_detection/live_detection", line 183, in main() File "/opt/edgeai-gst-apps/PatchCore_anomaly_detection/live_detection", line 123, in main embedding_test = np.array(reshape_embedding(np.array(embedding_))) KeyboardInterrupt TIDL_RT_OVX: Delete ... TIDL_RT_OVX: Delete TIDL graph ... TIDL_RT_OVX: Delete TIDL graph ... Done. TIDL_RT_OVX: DeInit ... TIDL_RT_OVX: DeInit... Done. Calling appDeInit() in TIDL-RT! TIDL_RT_OVX: Delete ... Done 657.501459 s: VX_ZONE_INIT:[tivxHostDeInitLocal:115] De-Initialization Done for HOST !!! 657.506603 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!! APP: Deinit ... !!! REMOTE_SERVICE: Deinit ... !!! REMOTE_SERVICE: Deinit ... Done !!! IPC: Deinit ... !!! IPC: DeInit ... Done !!! MEM: Deinit ... !!! DDR_SHARED_MEM: Alloc's: 35 alloc's of 46141815 bytes DDR_SHARED_MEM: Free's : 35 free's of 46141815 bytes DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! APP: Deinit ... Done !!!