user001@user001-CoffeeLake:~/edgeai-tidl-tools$ mkdir build && cd build user001@user001-CoffeeLake:~/edgeai-tidl-tools/build$ cmake ../examples && make -j && cd .. -- The C compiler identification is GNU 11.4.0 -- The CXX compiler identification is GNU 11.4.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Found OpenCV: /usr (found version "4.5.4") -- Detected processor: x86_64 -- TARGET_DEVICE setting to: am62a -- TARGET_CPU not specicfied using x86 -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = edgeai_tidl_examples -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = edgeai_tidl_examples -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = edgeai_tidl_examples -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = tfl_main -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = tfl_priority_scheduling -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = ort_priority_scheduling -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = edgeai_tidl_examples -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = tidlrt_clasification -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = dlr_main -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- CMAKE_BUILD_TYPE = Release PROJECT_NAME = ort_main -- setting TENSORFLOW_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/tflite_2.12_x86_u22/ -- setting DLR_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/dlr_1.10.0_x86_u22/ -- setting OPENCV_INSTALL_DIR path:/home/user001/edgeai-tidl-tools/tidl_tools/osrt_deps/opencv_4.2.0_x86_u22/ -- Compiling for x86 with am62a config -- Configuring done -- Generating done -- Build files have been written to: /home/user001/edgeai-tidl-tools/build [ 3%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/ti_logger.cpp.o [ 11%] Building CXX object osrt_cpp/pre_process/CMakeFiles/pre_process.dir/pre_process.cpp.o [ 11%] Building CXX object osrt_cpp/post_process/CMakeFiles/post_process.dir/post_process.cpp.o [ 14%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/utility_functs.cpp.o [ 22%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/model_info.cpp.o [ 22%] Building CXX object osrt_cpp/advanced_examples/utils/CMakeFiles/utils_adv.dir/src/arg_parsing.cpp.o [ 29%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/edgeai_classnames.cpp.o [ 29%] Building CXX object osrt_cpp/advanced_examples/utils/CMakeFiles/utils_adv.dir/src/print_utils.cpp.o [ 37%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/pbPlots.cpp.o [ 37%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/arg_parsing.cpp.o [ 40%] Building CXX object osrt_cpp/utils/CMakeFiles/utils.dir/src/supportLib.cpp.o [ 44%] Linking CXX static library /home/user001/edgeai-tidl-tools/lib/Release/libutils_adv.a [ 44%] Built target utils_adv [ 48%] Linking CXX static library /home/user001/edgeai-tidl-tools/lib/Release/libpre_process.a [ 48%] Built target pre_process [ 51%] Linking CXX static library /home/user001/edgeai-tidl-tools/lib/Release/libutils.a [ 51%] Built target utils [ 55%] Linking CXX static library /home/user001/edgeai-tidl-tools/lib/Release/libpost_process.a [ 55%] Built target post_process [ 66%] Building CXX object osrt_cpp/advanced_examples/ort/CMakeFiles/ort_priority_scheduling.dir/ort_priority_scheduling.cpp.o [ 66%] Building CXX object osrt_cpp/tfl/CMakeFiles/tfl_main.dir/tfl_main.cpp.o [ 66%] Building CXX object osrt_cpp/advanced_examples/tfl/CMakeFiles/tfl_priority_scheduling.dir/tfl_priority_scheduling.cpp.o [ 70%] Building CXX object tidlrt_cpp/CMakeFiles/tidlrt_clasification.dir/classification.cpp.o [ 74%] Building CXX object osrt_cpp/dlr/CMakeFiles/dlr_main.dir/dlr_main.cpp.o [ 77%] Building CXX object osrt_cpp/ort/CMakeFiles/ort_main.dir/onnx_main.cpp.o /home/user001/edgeai-tidl-tools/examples/tidlrt_cpp/classification.cpp: In function ‘void getModelNameromArtifactsDir(char*, char*, char*)’: /home/user001/edgeai-tidl-tools/examples/tidlrt_cpp/classification.cpp:155:9: warning: ignoring return value of ‘int fscanf(FILE*, const char*, ...)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 155 | fscanf(fp, "%s", net_name); | ~~~~~~^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/tidlrt_cpp/classification.cpp:164:9: warning: ignoring return value of ‘int fscanf(FILE*, const char*, ...)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 164 | fscanf(fp, "%s", io_name); | ~~~~~~^~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/tidlrt_cpp/classification.cpp: In function ‘int32_t TIDLReadBinFromFile(const char*, void*, int32_t)’: /home/user001/edgeai-tidl-tools/examples/tidlrt_cpp/classification.cpp:174:12: warning: ignoring return value of ‘size_t fread(void*, size_t, size_t, FILE*)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 174 | fread(addr, size, 1, fptr); | ~~~~~^~~~~~~~~~~~~~~~~~~~~ [ 81%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/tidlrt_clasification [ 81%] Built target tidlrt_clasification /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp: In function ‘int tflite::main::getInvokeTime(tflite::main::tfl_model_struct*)’: /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:250:47: warning: format ‘%d’ expects argument of type ‘int’, but argument 3 has type ‘double’ [-Wformat=] 250 | std::sprintf(pre_empt_char, "%d", FLT_MAX); | ~^ | | | int | %f /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:251:33: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 251 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:251:53: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 251 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:251:75: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 251 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:251:90: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 251 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:251:102: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 251 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:252:94: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 252 | char *values[] = {(char *)arg->modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0", (char *)prior_char, (char *)pre_empt_char}; | ^~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:252:100: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 252 | char *values[] = {(char *)arg->modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0", (char *)prior_char, (char *)pre_empt_char}; | ^~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp: In function ‘void* tflite::main::infer(void*)’: /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:439:33: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 439 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:439:53: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 439 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:439:75: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 439 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:439:90: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 439 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:439:102: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 439 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level", "priority", "max_pre_empt_delay"}; | ^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:440:94: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 440 | char *values[] = {(char *)arg->modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0", (char *)prior_char, (char *)pre_empt_char}; | ^~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/tfl/tfl_priority_scheduling.cpp:440:100: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 440 | char *values[] = {(char *)arg->modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0", (char *)prior_char, (char *)pre_empt_char}; | ^~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp: In function ‘int tflite::main::runInference(tidl::modelInfo::ModelInfo*, tidl::arg_parsing::Settings*)’: /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp:255:25: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 255 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level"}; | ^~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp:255:45: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 255 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level"}; | ^~~~~~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp:255:67: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 255 | char *keys[] = {"artifacts_folder", "num_tidl_subgraphs", "debug_level"}; | ^~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp:256:81: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 256 | char *values[] = {(char *)modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0"}; | ^~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/tfl/tfl_main.cpp:256:87: warning: ISO C++ forbids converting a string constant to ‘char*’ [-Wwrite-strings] 256 | char *values[] = {(char *)modelInfo->m_infConfig.artifactsPath.c_str(), "16", "0"}; | ^~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp: In function ‘int onnx::main::getInvokeTime(onnx::main::ort_model_struct*)’: /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp:379:50: warning: ignoring return value of ‘OrtStatus* OrtSessionsOptionsSetDefault_Tidl(c_api_tidl_options*)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 379 | OrtSessionsOptionsSetDefault_Tidl(options); | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp: In function ‘int onnx::main::runInference(tidl::modelInfo::ModelInfo**, tidl::arg_parsing_adv::Settings*)’: /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp:995:49: warning: ignoring return value of function declared with attribute ‘warn_unused_result’ [-Wunused-result] 995 | Ort::GetApi().CreateThreadingOptions(&envOpts); | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp:996:53: warning: ignoring return value of function declared with attribute ‘warn_unused_result’ [-Wunused-result] 996 | Ort::GetApi().SetGlobalInterOpNumThreads(envOpts, 0); | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp:997:47: warning: ignoring return value of function declared with attribute ‘warn_unused_result’ [-Wunused-result] 997 | Ort::GetApi().SetGlobalSpinControl(envOpts, false); | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~ /home/user001/edgeai-tidl-tools/examples/osrt_cpp/advanced_examples/ort/ort_priority_scheduling.cpp:998:57: warning: ignoring return value of function declared with attribute ‘warn_unused_result’ [-Wunused-result] 998 | Ort::GetApi().CreateEnvWithGlobalThreadPools(ORT_LOGGING_LEVEL_WARNING, "test", envOpts, &environment); | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ [ 85%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/dlr_main [ 88%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/tfl_main [ 92%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/ort_main [ 96%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/tfl_priority_scheduling [ 96%] Built target dlr_main [ 96%] Built target tfl_main [100%] Linking CXX executable /home/user001/edgeai-tidl-tools/bin/Release/ort_priority_scheduling [100%] Built target ort_main [100%] Built target tfl_priority_scheduling [100%] Built target ort_priority_scheduling user001@user001-CoffeeLake:~/edgeai-tidl-tools$ source ./scripts/run_python_examples.sh X64 Architecture Running 4 Models - ['cl-tfl-mobilenet_v1_1.0_224', 'ss-tfl-deeplabv3_mnv2_ade20k_float', 'od-tfl-ssd_mobilenet_v2_300_float', 'od-tfl-ssdlite_mobiledet_dsp_320x320_coco'] Running_Model : cl-tfl-mobilenet_v1_1.0_224 Running_Model : ss-tfl-deeplabv3_mnv2_ade20k_float Running_Model : od-tfl-ssd_mobilenet_v2_300_float Running_Model : od-tfl-ssdlite_mobiledet_dsp_320x320_coco Number of OD backbone nodes = 89 Size of odBackboneNodeIds = 89 TIDL Meta PipeLine (Proto) File : ../../../models/public/ssdlite_mobiledet_dsp_320x320_coco_20200519.prototxt Number of OD backbone nodes = 112 Size of odBackboneNodeIds = 112 Preliminary number of subgraphs:1 , 81 nodes delegated out of 81 nodes Preliminary number of subgraphs:1 , 34 nodes delegated out of 34 nodes Preliminary number of subgraphs:1 , 129 nodes delegated out of 129 nodes TF Meta PipeLine (Proto) File : ../../../models/public/ssdlite_mobiledet_dsp_320x320_coco_20200519.prototxt num_classes : 91 y_scale : 10.000000 x_scale : 10.000000 w_scale : 5.000000 h_scale : 5.000000 num_keypoints : 5.000000 score_threshold : 0.600000 iou_threshold : 0.450000 max_detections_per_class : 200 max_total_detections : 100 scales, height_stride, width_stride, height_offset, width_offset 0.2000000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 0.3500000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 0.5000000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 0.6500000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 0.8000000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 0.9500000, -1.0000000, -1.0000000, -1.0000000, -1.0000000 aspect_ratios 1.0000000 2.0000000 0.5000000 3.0000000 0.3333000 Preliminary number of subgraphs:1 , 107 nodes delegated out of 107 nodes Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal ************** Frame index 1 : Running float import ************* ************** Frame index 1 : Running float import ************* ************** Frame index 1 : Running float import ************* INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_TIDL_0 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_TIDL_1 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] decoder/ResizeBilinear Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_1 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 5 WARNINGS 0 ERRORS ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.7s: VX_ZONE_ERROR:Enabled 0.9s: VX_ZONE_WARNING:Enabled **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** 0.2060s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.6s: VX_ZONE_ERROR:Enabled 0.9s: VX_ZONE_WARNING:Enabled ************** Frame index 1 : Running float import ************* 0.1832s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.6s: VX_ZONE_ERROR:Enabled 0.8s: VX_ZONE_WARNING:Enabled 0.1735s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.6s: VX_ZONE_ERROR:Enabled 0.7s: VX_ZONE_WARNING:Enabled 0.1617s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! ************ Frame index 1 : Running float inference **************** ************ Frame index 2 : Running fixed point mode for calibration **************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 607.39 .... ..... ... .... ..... # 1 . .. ************ Frame index 1 : Running float inference **************** T 600.97 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ************ Frame index 1 : Running float inference **************** T 412.18 .... ..... ... .... ..... # 1 . .. T 407.15 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 427.59 .... ..... ... .... ..... # 1 . .. ************ Frame index 2 : Running fixed point mode for calibration **************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 445.92 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 442.22 .... ..... ... .... ..... # 1 . .. T 430.37 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ************ Frame index 2 : Running fixed point mode for calibration **************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 438.36 .... ..... ... .... ..... # 1 . .. T 2162.69 .... ..... ... .... ..... # 1 . .. T 431.91 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 433.83 .... ..... ... .... ..... # 1 . .. T 427.32 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-tfl-mobilenet_v1_1.0_224/tempDir/86_tidl_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Final number of subgraphs:1 , 34 nodes delegated to accelerator Completed_Model : 1, Name : cl-tfl-mobilenet_v1_1.0_224 , Total time : 4092.64, Offload Time : 0.00 , DDR RW MBs : 18446744073709.55, Output File : py_out_cl-tfl-mobilenet_v1_1.0_224_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 76349821 bytes MEM: Free's : 25 free's of 76349821 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! T 2073.12 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration T 3089.14 .... ..... ... .... ..... # 1 . .. ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1509.89 .... ..... ... .... ..... # 1 . .. T 2931.07 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration T 1520.04 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ************ Frame index 1 : Running float inference **************** ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1520.69 .... ..... ... .... ..... # 1 . .. T 1822.69 .... ..... ... .... ..... # 1 . .. T 1524.72 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration T 1806.19 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1540.10 .... ..... ... .... ..... # 1 . .. T 1813.55 .... ..... ... .... ..... # 1 . .. T 1534.03 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1806.44 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1507.62 .... ..... ... .... ..... # 1 . .. T 1777.05 .... ..... ... .... ..... # 1 . .. T 1513.32 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1818.08 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ************ Frame index 2 : Running fixed point mode for calibration **************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1569.38 .... ..... ... .... ..... # 1 . .. T 1846.21 .... ..... ... .... ..... # 1 . .. T 1557.23 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssd_mobilenet_v2_300_float/tempDir/264_tidl_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Final number of subgraphs:1 , 107 nodes delegated to accelerator Completed_Model : 3, Name : od-tfl-ssd_mobilenet_v2_300_float , Total time : 13843.25, Offload Time : 0.00 , DDR RW MBs : 18446744073709.55, Output File : py_out_od-tfl-ssd_mobilenet_v2_300_float_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 28 alloc's of 221052901 bytes MEM: Free's : 28 free's of 221052901 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! T 1836.71 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1736.97 .... ..... ... .... ..... # 1 . .. T 1733.23 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/od-tfl-ssdlite_mobiledet_dsp_320x320_coco/tempDir/321_tidl_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Final number of subgraphs:1 , 129 nodes delegated to accelerator Completed_Model : 4, Name : od-tfl-ssdlite_mobiledet_dsp_320x320_coco , Total time : 16485.44, Offload Time : 0.00 , DDR RW MBs : 18446744073709.55, Output File : py_out_od-tfl-ssdlite_mobiledet_dsp_320x320_coco_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 28 alloc's of 127510629 bytes MEM: Free's : 28 free's of 127510629 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! T 8928.20 .... ..... ... .... ..... # 1 . .. T 8434.30 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 4504.25 .... ..... ... .... ..... # 1 . .. T 4490.23 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 4451.47 .... ..... ... .... ..... # 1 . .. T 4475.25 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 4567.31 .... ..... ... .... ..... # 1 . .. T 4530.87 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 4459.77 .... ..... ... .... ..... # 1 . .. T 4424.44 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 4454.43 .... ..... ... .... ..... # 1 . .. T 4437.97 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/ss-tfl-deeplabv3_mnv2_ade20k_float/tempDir/201_tidl_net/perfSimInfo.bin INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_TIDL_0 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_TIDL_1 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] decoder/ResizeBilinear Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] ResizeBilinear_1 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 6 WARNINGS 0 ERRORS ** **************************************************** Final number of subgraphs:1 , 81 nodes delegated to accelerator Completed_Model : 2, Name : ss-tfl-deeplabv3_mnv2_ade20k_float , Total time : 44707.92, Offload Time : 0.00 , DDR RW MBs : 18446744073709.55, Output File : py_out_ss-tfl-deeplabv3_mnv2_ade20k_float_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 396397913 bytes MEM: Free's : 25 free's of 396397913 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! run python3 tflrt_delegate.py Running 4 Models - ['cl-tfl-mobilenet_v1_1.0_224', 'ss-tfl-deeplabv3_mnv2_ade20k_float', 'od-tfl-ssd_mobilenet_v2_300_float', 'od-tfl-ssdlite_mobiledet_dsp_320x320_coco'] Running_Model : cl-tfl-mobilenet_v1_1.0_224 Running_Model : ss-tfl-deeplabv3_mnv2_ade20k_float Running_Model : od-tfl-ssd_mobilenet_v2_300_float Running_Model : od-tfl-ssdlite_mobiledet_dsp_320x320_coco Number of subgraphs:1 , 34 nodes delegated out of 34 nodes Number of subgraphs:1 , 81 nodes delegated out of 81 nodes Number of subgraphs:1 , 107 nodes delegated out of 107 nodes Number of subgraphs:1 , 129 nodes delegated out of 129 nodes The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! The soft limit is 2048 0.0s: VX_ZONE_INIT:Enabled The hard limit is 2048 0.11s: VX_ZONE_ERROR:Enabled MEM: Init ... !!! 0.27s: VX_ZONE_WARNING:Enabled MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.22s: VX_ZONE_ERROR:Enabled 0.24s: VX_ZONE_WARNING:Enabled 0.1835s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! 0.1793s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.8s: VX_ZONE_ERROR:Enabled 0.10s: VX_ZONE_WARNING:Enabled 0.1629s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.9s: VX_ZONE_ERROR:Enabled 0.11s: VX_ZONE_WARNING:Enabled 0.1809s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! , 0 0.691726 warplane, military plane ,, 1 0.181373 missile ,, 2 0.109571 projectile, missile ,, 3 0.006352 cannon ,, 4 0.005370 aircraft carrier, carrier, flattop, attack aircraft carrier , Saving image to ../../../output_images/ Completed_Model : 1, Name : cl-tfl-mobilenet_v1_1.0_224 , Total time : 398.39, Offload Time : 398.38 , DDR RW MBs : 18446744073709.55, Output File : py_out_cl-tfl-mobilenet_v1_1.0_224_airshow.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 34018651 bytes MEM: Free's : 25 free's of 34018651 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! Saving image to ../../../output_images/ Completed_Model : 3, Name : od-tfl-ssd_mobilenet_v2_300_float , Total time : 1340.18, Offload Time : 1340.17 , DDR RW MBs : 18446744073709.55, Output File : py_out_od-tfl-ssd_mobilenet_v2_300_float_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 28 alloc's of 77169496 bytes MEM: Free's : 28 free's of 77169496 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! Saving image to ../../../output_images/ Completed_Model : 4, Name : od-tfl-ssdlite_mobiledet_dsp_320x320_coco , Total time : 1725.58, Offload Time : 1725.57 , DDR RW MBs : 18446744073709.55, Output File : py_out_od-tfl-ssdlite_mobiledet_dsp_320x320_coco_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 28 alloc's of 47996448 bytes MEM: Free's : 28 free's of 47996448 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! Saving image to ../../../output_images/ Completed_Model : 2, Name : ss-tfl-deeplabv3_mnv2_ade20k_float , Total time : 4438.13, Offload Time : 4438.13 , DDR RW MBs : 18446744073709.55, Output File : py_out_ss-tfl-deeplabv3_mnv2_ade20k_float_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 128638014 bytes MEM: Free's : 25 free's of 128638014 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! Skipping import of model optimizer Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 2 Models - ['cl-ort-resnet18-v1', 'od-ort-ssd-lite_mobilenetv2_fpn'] Running_Model : cl-ort-resnet18-v1 Running_Model : od-ort-ssd-lite_mobilenetv2_fpn Running shape inference on model ../../../models/public/ssd-lite_mobilenetv2_fpn.onnx Running shape inference on model ../../../models/public/resnet18_opset9.onnx ssd is meta arch name Number of OD backbone nodes = 159 Size of odBackboneNodeIds = 159 Preliminary subgraphs created = 1 Final number of subgraphs created are : 1, - Offloaded Nodes - 482, Total Nodes - 482 Preliminary subgraphs created = 1 Final number of subgraphs created are : 1, - Offloaded Nodes - 52, Total Nodes - 52 Graph Domain TO version : 11 ************** Frame index 1 : Running float import ************* **************************************************** ** ALL MODEL CHECK PASSED ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.6s: VX_ZONE_ERROR:Enabled 0.7s: VX_ZONE_WARNING:Enabled 0.1714s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! Graph Domain TO version : 11TIDL Meta PipeLine (Proto) File : ../../../models/public/ssd-lite_mobilenetv2_fpn.prototxt ssd Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning :: img_w & img_h or img_size is not provided as part of prior_box_param, hence using img_w = 512 and img_h = 512 in prior box decoding Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal ************** Frame index 1 : Running float import ************* INFORMATION: [TIDL_ResizeLayer] Resize_153 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_156 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.5s: VX_ZONE_ERROR:Enabled 0.7s: VX_ZONE_WARNING:Enabled 0.2227s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! ********** Frame Index 1 : Running float inference ********** Graph Domain TO version : 11 ********** Frame Index 2 : Running fixed point mode for calibration ********** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ********** Frame Index 1 : Running float inference ********** T 1754.10 .... ..... ... .... ..... # 1 . .. Graph Domain TO version : 11 ********** Frame Index 2 : Running fixed point mode for calibration ********** Empty prototxt path, running calibration T 1745.05 .... ..... ... .... ..... ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1134.21 .... ..... ... .... ..... # 1 . .. T 1129.11 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 3729.27 .... ..... ... .... ..... # 1 . .. T 1135.45 .... ..... ... .... ..... # 1 . .. T 1130.98 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1130.47 .... ..... ... .... ..... # 1 . .. T 3676.34 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1138.83 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2008.96 .... ..... ... .... ..... # 1 . .. T 1135.07 .... ..... ... .... ..... # 1 . .. T 1185.64 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2001.40 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1197.28 .... ..... ... .... ..... # 1 . .. T 1186.13 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration T 2152.99 .... ..... ... .... ..... # 1 . .. ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-ort-resnet18-v1/tempDir/subgraph_0_tidl_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Completed_Model : 1, Name : cl-ort-resnet18-v1 , Total time : 11603.12, Offload Time : 1741.69 , DDR RW MBs : 0, Output File : py_out_cl-ort-resnet18-v1_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 129813609 bytes MEM: Free's : 25 free's of 129813609 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! T 2014.91 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2000.44 .... ..... ... .... ..... # 1 . .. T 1984.45 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2024.23 .... ..... ... .... ..... # 1 . .. T 2062.34 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_io_.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2056.59 .... ..... ... .... ..... # 1 . .. T 2036.03 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/od-ort-ssd-lite_mobilenetv2_fpn/tempDir/subgraph_0_tidl_net/perfSimInfo.bin INFORMATION: [TIDL_ResizeLayer] Resize_153 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. INFORMATION: [TIDL_ResizeLayer] Resize_156 Any resize ratio which is power of 2 and greater than 4 will be placed by combination of 4x4 resize layer and 2x2 resize layer. For example a 8x8 resize will be replaced by 4x4 resize followed by 2x2 resize. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Completed_Model : 2, Name : od-ort-ssd-lite_mobilenetv2_fpn , Total time : 18519.62, Offload Time : 3516.40 , DDR RW MBs : 0, Output File : py_out_od-ort-ssd-lite_mobilenetv2_fpn_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 26 alloc's of 260732640 bytes MEM: Free's : 26 free's of 260732640 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! run python3 onnxrt_ep.py Skipping import of model optimizer Available execution providers : ['TIDLExecutionProvider', 'TIDLCompilationProvider', 'CPUExecutionProvider'] Running 2 Models - ['cl-ort-resnet18-v1', 'od-ort-ssd-lite_mobilenetv2_fpn'] Running_Model : cl-ort-resnet18-v1 Running_Model : od-ort-ssd-lite_mobilenetv2_fpn libtidl_onnxrt_EP loaded 0x587d57ffb870 libtidl_onnxrt_EP loaded 0x587d57774a00 Final number of subgraphs created are : 1, - Offloaded Nodes - 482, Total Nodes - 482 Final number of subgraphs created are : 1, - Offloaded Nodes - 52, Total Nodes - 52 The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.11s: VX_ZONE_ERROR:Enabled 0.18s: VX_ZONE_WARNING:Enabled 0.2198s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.9s: VX_ZONE_ERROR:Enabled 0.10s: VX_ZONE_WARNING:Enabled 0.2101s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! , 0 23.847309 warplane, military plane ,, 1 22.507572 aircraft carrier, carrier, flattop, attack aircraft carrier ,, 2 19.024258 projectile, missile ,, 3 18.756310 missile ,, 4 15.808890 airliner , Saving image to ../../../output_images/ Completed_Model : 1, Name : cl-ort-resnet18-v1 , Total time : 992.47, Offload Time : 992.43 , DDR RW MBs : 0, Output File : py_out_cl-ort-resnet18-v1_airshow.jpg MEM: Deinit ... !!! MEM: Alloc's: 25 alloc's of 47468308 bytes MEM: Free's : 25 free's of 47468308 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! 2 Saving image to ../../../output_images/ Completed_Model : 2, Name : od-ort-ssd-lite_mobilenetv2_fpn , Total time : 1751.78, Offload Time : 1751.71 , DDR RW MBs : 0, Output File : py_out_od-ort-ssd-lite_mobilenetv2_fpn_ADE_val_00001801.jpg MEM: Deinit ... !!! MEM: Alloc's: 26 alloc's of 109804069 bytes MEM: Free's : 26 free's of 109804069 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! ../../../models/public/mobilenetv2-1.0.onnx Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... Running graph on host for tensor data collection... Importing subgraph into TIDL... Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 352.96 .... ..... ... .... ..... # 1 . .. T 349.12 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 233.38 .... ..... ... .... ..... # 1 . .. T 232.89 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.51 .... ..... ... .... ..... # 1 . .. T 225.78 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 233.67 .... ..... ... .... ..... # 1 . .. T 234.35 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.32 .... ..... ... .... ..... # 1 . .. T 232.32 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 231.18 .... ..... ... .... ..... # 1 . .. T 225.39 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ***************** Calibration iteration number 5 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 231.62 .... ..... ... .... ..... # 1 . .. T 226.15 .... ..... ... .... ..... ***************** Calibration iteration number 5 completed ************************ ***************** Calibration iteration number 6 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 232.73 .... ..... ... .... ..... # 1 . .. T 232.81 .... ..... ... .... ..... ***************** Calibration iteration number 6 completed ************************ ***************** Calibration iteration number 7 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 228.17 .... ..... ... .... ..... # 1 . .. T 221.62 .... ..... ... .... ..... ***************** Calibration iteration number 7 completed ************************ ***************** Calibration iteration number 8 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 229.60 .... ..... ... .... ..... # 1 . .. T 221.59 .... ..... ... .... ..... ***************** Calibration iteration number 8 completed ************************ ***************** Calibration iteration number 9 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 232.84 .... ..... ... .... ..... # 1 . .. T 233.04 .... ..... ... .... ..... ***************** Calibration iteration number 9 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2/tempDir/subgraph0_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 1 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-onnx_mobilenetv2 /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_onnx_example.py:167: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. Running graph on host for tensor data collection... Importing subgraph into TIDL... Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 6751.05 .... ..... ... .... ..... # 1 . .. T 6776.54 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5692.47 .... ..... ... .... ..... # 1 . .. T 5823.32 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5725.21 .... ..... ... .... ..... # 1 . .. T 5678.56 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5782.04 .... ..... ... .... ..... # 1 . .. T 5793.54 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5738.62 .... ..... ... .... ..... # 1 . .. T 5712.32 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5733.17 .... ..... ... .... ..... # 1 . .. T 5733.65 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3/tempDir/subgraph0_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 1 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-tflite_inceptionnetv3 /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_tflite_example.py:168: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) ../../../models/public/mobilenetv2-1.0.onnx Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... Running graph on host for tensor data collection... Importing subgraph into TIDL... Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 347.68 .... ..... ... .... ..... # 1 . .. T 337.21 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.36 .... ..... ... .... ..... # 1 . .. T 226.56 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 225.65 .... ..... ... .... ..... # 1 . .. T 219.09 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 231.87 .... ..... ... .... ..... # 1 . .. T 229.44 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 231.06 .... ..... ... .... ..... # 1 . .. T 226.02 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.50 .... ..... ... .... ..... # 1 . .. T 226.59 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ ***************** Calibration iteration number 5 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 231.36 .... ..... ... .... ..... # 1 . .. T 220.92 .... ..... ... .... ..... ***************** Calibration iteration number 5 completed ************************ ***************** Calibration iteration number 6 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.36 .... ..... ... .... ..... # 1 . .. T 225.27 .... ..... ... .... ..... ***************** Calibration iteration number 6 completed ************************ ***************** Calibration iteration number 7 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 229.79 .... ..... ... .... ..... # 1 . .. T 225.73 .... ..... ... .... ..... ***************** Calibration iteration number 7 completed ************************ ***************** Calibration iteration number 8 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 229.00 .... ..... ... .... ..... # 1 . .. T 225.60 .... ..... ... .... ..... ***************** Calibration iteration number 8 completed ************************ ***************** Calibration iteration number 9 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 230.63 .... ..... ... .... ..... # 1 . .. T 225.75 .... ..... ... .... ..... ***************** Calibration iteration number 9 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-onnx_mobilenetv2_device/tempDir/subgraph0_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 1 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-onnx_mobilenetv2_device /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_onnx_example.py:167: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. conv2d NHWC layout is not optimized for x86 with autotvm. Running graph on host for tensor data collection... Importing subgraph into TIDL... Warning : Requested Output Data Convert Layer is not Added to the network, It is currently not Optimal Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 6726.48 .... ..... ... .... ..... # 1 . .. T 6704.53 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5586.58 .... ..... ... .... ..... # 1 . .. T 5633.80 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ ***************** Calibration iteration number 1 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5701.88 .... ..... ... .... ..... # 1 . .. T 5756.59 .... ..... ... .... ..... ***************** Calibration iteration number 1 completed ************************ ***************** Calibration iteration number 2 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5605.79 .... ..... ... .... ..... # 1 . .. T 5680.58 .... ..... ... .... ..... ***************** Calibration iteration number 2 completed ************************ ***************** Calibration iteration number 3 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5739.41 .... ..... ... .... ..... # 1 . .. T 5689.00 .... ..... ... .... ..... ***************** Calibration iteration number 3 completed ************************ ***************** Calibration iteration number 4 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 5589.66 .... ..... ... .... ..... # 1 . .. T 5632.54 .... ..... ... .... ..... ***************** Calibration iteration number 4 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-tflite_inceptionnetv3_device/tempDir/subgraph0_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 1 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-tflite_inceptionnetv3_device /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_tflite_example.py:168: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) ../../../models/public/mobilenetv3_large_100.onnx Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... Running graph on host for tensor data collection... Importing subgraph into TIDL... Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1.57 .... ..... ... .... ..... # 1 . .. T 1.47 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1.74 .... ..... ... .... ..... # 1 . .. T 1.68 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph0_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_0_2 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph1.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 20.48 .... ..... ... .... ..... # 1 . .. T 19.08 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph1.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 14.08 .... ..... ... .... ..... # 1 . .. T 13.19 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph1_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_1_14 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph2.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 19.60 .... ..... ... .... ..... # 1 . .. T 17.86 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph2.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 15.79 .... ..... ... .... ..... # 1 . .. T 14.43 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph2_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_2_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_2_24 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph3.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 17.64 .... ..... ... .... ..... # 1 . .. T 16.34 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph3.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 13.96 .... ..... ... .... ..... # 1 . .. T 12.65 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph3_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_3_12 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_3_22 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph4.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 34.74 .... ..... ... .... ..... # 1 . .. T 32.24 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph4.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 28.11 .... ..... ... .... ..... # 1 . .. T 25.52 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph4_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_4_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_4_24 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph5.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 33.52 .... ..... ... .... ..... # 1 . .. T 31.05 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph5.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 26.36 .... ..... ... .... ..... # 1 . .. T 23.78 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph5_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_5_12 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_5_22 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph6.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 57.72 .... ..... ... .... ..... # 1 . .. T 54.50 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph6.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 45.96 .... ..... ... .... ..... # 1 . .. T 42.90 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph6_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_6_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_24 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_38 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_48 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_63 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_73 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_88 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_98 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_113 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_123 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 11 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph7.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 12.82 .... ..... ... .... ..... # 1 . .. T 11.75 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph7.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 12.91 .... ..... ... .... ..... # 1 . .. T 11.52 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph7_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph8.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 10.65 .... ..... ... .... ..... # 1 . .. T 9.73 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph8.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 11.24 .... ..... ... .... ..... # 1 . .. T 10.34 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph8_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph9.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 72.24 .... ..... ... .... ..... # 1 . .. T 67.93 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/tidl_import_subgraph9.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 72.58 .... ..... ... .... ..... # 1 . .. T 66.50 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device/tempDir/subgraph9_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_9_8 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 10 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_timm_example.py:175: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) Generating subgraph boundary tensors for calibration... Building graph on host for tensor data collection... Running graph on host for tensor data collection... Importing subgraph into TIDL... Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 1.53 .... ..... ... .... ..... # 1 . .. T 1.48 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph0.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 2.81 .... ..... ... .... ..... # 1 . .. T 1.95 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph0_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_0_2 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph1.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 17.60 .... ..... ... .... ..... # 1 . .. T 16.52 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph1.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 14.24 .... ..... ... .... ..... # 1 . .. T 13.15 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph1_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_1_14 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph2.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 19.64 .... ..... ... .... ..... # 1 . .. T 18.20 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph2.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 15.71 .... ..... ... .... ..... # 1 . .. T 14.16 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph2_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_2_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_2_24 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph3.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 17.40 .... ..... ... .... ..... # 1 . .. T 16.50 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph3.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 13.81 .... ..... ... .... ..... # 1 . .. T 12.33 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph3_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_3_12 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_3_22 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph4.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 34.32 .... ..... ... .... ..... # 1 . .. T 32.40 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph4.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 28.23 .... ..... ... .... ..... # 1 . .. T 26.00 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph4_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_4_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_4_24 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph5.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 32.97 .... ..... ... .... ..... # 1 . .. T 30.83 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph5.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 25.78 .... ..... ... .... ..... # 1 . .. T 23.78 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph5_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_5_12 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_5_22 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 3 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph6.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 57.57 .... ..... ... .... ..... # 1 . .. T 55.72 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph6.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 45.38 .... ..... ... .... ..... # 1 . .. T 44.01 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph6_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_6_14 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_24 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_38 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_48 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_63 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_73 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_88 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_98 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_113 16 bits is not optimal in this release. SUGGESTION: [TIDL_BatchNormLayer] tidl_6_123 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 11 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph7.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 13.08 .... ..... ... .... ..... # 1 . .. T 12.15 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph7.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 12.76 .... ..... ... .... ..... # 1 . .. T 12.24 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph7_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph8.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 10.86 .... ..... ... .... ..... # 1 . .. T 10.03 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph8.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 11.07 .... ..... ... .... ..... # 1 . .. T 10.20 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph8_net/perfSimInfo.bin WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 1 WARNINGS 0 ERRORS ** **************************************************** Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph9.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 72.86 .... ..... ... .... ..... # 1 . .. T 68.31 .... ..... ... .... ..... ***************** Calibration iteration number 0 started ************************ Empty prototxt path, running calibration ~~~~~Running TIDL in PC emulation mode to collect Activations range for each layer~~~~~ Processing config file #0 : /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/tidl_import_subgraph9.txt.qunat_stats_config.txt Freeing memory for user provided Net ----------------------- TIDL Process with REF_ONLY FLOW ------------------------ # 0 . .. T 71.85 .... ..... ... .... ..... # 1 . .. T 67.71 .... ..... ... .... ..... ***************** Calibration iteration number 0 completed ************************ Empty prototxt path, running calibration ------------------ Network Compiler Traces ----------------------------- NC running for device: 4 Running with OTF buffer optimizations Segmentation fault (core dumped) Could not open /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir/subgraph9_net/perfSimInfo.bin SUGGESTION: [TIDL_BatchNormLayer] tidl_9_8 16 bits is not optimal in this release. WARNING: [TIDL_E_DATAFLOW_INFO_NULL] Network compiler returned with error or didn't executed, this model can only be used on PC/Host emulation mode, it is not expected to work on target/EVM. **************************************************** ** 2 WARNINGS 0 ERRORS ** **************************************************** TIDL import of 10 Relay IR subgraphs succeeded. TIDL artifacts are stored at ../../../model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x Building C7x tvm deployable module: generating c files... Building C7x tvm deployable module: building... (log in c7x_deploy_mod.log) make SILICON_VERSION=7504 TVM_ROOT=/home/user001/.local/lib/python3.10/site-packages/tvm TVM_C7X_ROOT=/home/user001/.local/lib/python3.10/site-packages/tvm/src/runtime/contrib/tidl/c7x QUIET= -C /home/user001/edgeai-tidl-tools/model-artifacts/cl-dlr-timm_mobilenetv3_large_100_device_c7x/tempDir -f /home/user001/.local/lib/python3.10/site-packages/tvm/src/runtime/contrib/tidl/c7x/Makefile.c7x_mod -j$(nproc) Creating Arm wrapper tvm module... /home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/tvm_compilation_timm_example.py:175: DeprecationWarning: legacy graph executor behavior of producing json / lib / params will be removed in the next release. Please see documents of tvm.contrib.graph_executor.GraphModule for the new recommended usage. graph, lib, params = relay.build_module.build(mod, target=build_target, params=params) run python3 dlr_inference_example.py Running Inference on Model - ../../../model-artifacts/cl-dlr-tflite_inceptionnetv3 2025-03-27 10:50:21,870 INFO Could not find libdlr.so in model artifact. Using dlr from /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so The soft limit is 2048 The hard limit is 2048 MEM: Init ... !!! MEM: Init ... Done !!! 0.0s: VX_ZONE_INIT:Enabled 0.24s: VX_ZONE_ERROR:Enabled 0.26s: VX_ZONE_WARNING:Enabled 0.1933s: VX_ZONE_INIT:[tivxInit:190] Initialization Done !!! TIDL_RT_OVX: ERROR: Invalid core number specified - 0 , expected core number is 1 TIDL_RT_OVX: ERROR: Create OpenVX graph failed TIDL_RT_OVX: ERROR: Verify OpenVX graph failed 0.73658s: VX_ZONE_ERROR:[tivxKernelTIDLCreate:907] Network version - 0x00000000, Expected version - 0x20240401 0.73817s: VX_ZONE_ERROR:[ownContextSendCmd:875] Command ack message returned failure cmd_status: -1 0.73824s: VX_ZONE_ERROR:[ownNodeKernelInit:590] Target kernel, TIVX_CMD_NODE_CREATE failed for node node_79 0.73826s: VX_ZONE_ERROR:[ownNodeKernelInit:591] Please be sure the target callbacks have been registered for this core 0.73828s: VX_ZONE_ERROR:[ownNodeKernelInit:592] If the target callbacks have been registered, please ensure no errors are occurring within the create callback of this kernel 0.73843s: VX_ZONE_ERROR:[ownGraphNodeKernelInit:608] kernel init for node 0, kernel com.ti.tidl:1:1 ... failed !!! 0.73848s: VX_ZONE_ERROR:[vxVerifyGraph:2159] Node kernel init failed 0.73868s: VX_ZONE_ERROR:[vxVerifyGraph:2213] Graph verify failed 0.73888s: VX_ZONE_ERROR:[ownGraphScheduleGraphWrapper:885] graph is not in a state required to be scheduled 0.73890s: VX_ZONE_ERROR:[vxProcessGraph:813] schedule graph failed 0.73892s: VX_ZONE_ERROR:[vxProcessGraph:818] wait graph failed ERROR: Running TIDL graph ... Failed !!! 2025-03-27 10:50:22,915 ERROR error in running inference DLRModelImpl TVMError: TIDLRT_invoke failed Stack trace: File "/dlr/neo-ai-dlr/3rdparty/tvm/src/runtime/contrib/tidl/tidl_runtime.cc", line 283 [bt] (0) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x170e9c) [0x7bee98770e9c] [bt] (1) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::detail::LogFatal::Entry::Finalize()+0x45) [0x7bee9863c4d9] [bt] (2) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::PackedFuncObj::Extractor, std::allocator > const&, tvm::runtime::ObjectPtr const&)::{lambda(tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)#3}> >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)+0xbc) [0x7bee9872583c] [bt] (3) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd202) [0x7bee987dd202] [bt] (4) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd4bb) [0x7bee987dd4bb] [bt] (5) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(dlr::TVMModel::Run()+0xd6) [0x7bee9870f0c6] [bt] (6) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(RunDLRModel+0x79) [0x7bee986d8ae9] Traceback (most recent call last): File "/home/user001/.local/lib/python3.10/site-packages/dlr/api.py", line 116, in run return self._impl.run(input_values) File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 451, in run self._run() File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 333, in _run self._check_call(self._lib.RunDLRModel(byref(self.handle))) File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 160, in _check_call raise DLRError(self._lib.DLRGetLastError().decode('ascii')) dlr.dlr_model.DLRError: TVMError: TIDLRT_invoke failed Stack trace: File "/dlr/neo-ai-dlr/3rdparty/tvm/src/runtime/contrib/tidl/tidl_runtime.cc", line 283 [bt] (0) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x170e9c) [0x7bee98770e9c] [bt] (1) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::detail::LogFatal::Entry::Finalize()+0x45) [0x7bee9863c4d9] [bt] (2) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::PackedFuncObj::Extractor, std::allocator > const&, tvm::runtime::ObjectPtr const&)::{lambda(tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)#3}> >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)+0xbc) [0x7bee9872583c] [bt] (3) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd202) [0x7bee987dd202] [bt] (4) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd4bb) [0x7bee987dd4bb] [bt] (5) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(dlr::TVMModel::Run()+0xd6) [0x7bee9870f0c6] [bt] (6) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(RunDLRModel+0x79) [0x7bee986d8ae9] Traceback (most recent call last): File "/home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/dlr_inference_example.py", line 199, in model_create_and_run(model_output_directory, 'input', File "/home/user001/edgeai-tidl-tools/examples/osrt_python/tvm_dlr/dlr_inference_example.py", line 172, in model_create_and_run res = model.run({model_input_name : img}) File "/home/user001/.local/lib/python3.10/site-packages/dlr/api.py", line 119, in run raise ex File "/home/user001/.local/lib/python3.10/site-packages/dlr/api.py", line 116, in run return self._impl.run(input_values) File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 451, in run self._run() File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 333, in _run self._check_call(self._lib.RunDLRModel(byref(self.handle))) File "/home/user001/.local/lib/python3.10/site-packages/dlr/dlr_model.py", line 160, in _check_call raise DLRError(self._lib.DLRGetLastError().decode('ascii')) dlr.dlr_model.DLRError: TVMError: TIDLRT_invoke failed Stack trace: File "/dlr/neo-ai-dlr/3rdparty/tvm/src/runtime/contrib/tidl/tidl_runtime.cc", line 283 [bt] (0) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x170e9c) [0x7bee98770e9c] [bt] (1) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::detail::LogFatal::Entry::Finalize()+0x45) [0x7bee9863c4d9] [bt] (2) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(tvm::runtime::PackedFuncObj::Extractor, std::allocator > const&, tvm::runtime::ObjectPtr const&)::{lambda(tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)#3}> >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*)+0xbc) [0x7bee9872583c] [bt] (3) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd202) [0x7bee987dd202] [bt] (4) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(+0x1dd4bb) [0x7bee987dd4bb] [bt] (5) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(dlr::TVMModel::Run()+0xd6) [0x7bee9870f0c6] [bt] (6) /home/user001/.local/lib/python3.10/site-packages/dlr/libdlr.so(RunDLRModel+0x79) [0x7bee986d8ae9] MEM: Deinit ... !!! MEM: Alloc's: 9 alloc's of 62439632 bytes MEM: Free's : 9 free's of 62439632 bytes MEM: Open's : 0 allocs of 0 bytes MEM: Deinit ... Done !!! user001@user001-CoffeeLake:~/edgeai-tidl-tools$