Docker log: =========== # bash root@be331b938317:/# cd root@be331b938317:~# source quick_setup.sh Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease Fetched 229 kB in 1s (288 kB/s) Reading package lists... Done Reading package lists... Done Building dependency tree... Done Reading state information... Done libyaml-cpp-dev is already the newest version (0.7.0+dfsg-8build1). wget is already the newest version (1.21.2-2ubuntu1). cmake is already the newest version (3.22.1-1ubuntu1.22.04.1). git is already the newest version (1:2.34.1-1ubuntu1.10). 0 upgraded, 0 newly installed, 0 to remove and 3 not upgraded. Cloning into 'edgeai-tidl-tools'... remote: Enumerating objects: 3897, done. remote: Counting objects: 100% (1076/1076), done. remote: Compressing objects: 100% (392/392), done. remote: Total 3897 (delta 703), reused 999 (delta 657), pack-reused 2821 Receiving objects: 100% (3897/3897), 16.36 MiB | 7.12 MiB/s, done. Resolving deltas: 100% (2391/2391), done. Switched to a new branch '09_01_00_02' root@be331b938317:~# pip3 install --index-url https://google-coral.github.io/py-repo/ tflite_runtime Looking in indexes: https://google-coral.github.io/py-repo/ ERROR: Could not find a version that satisfies the requirement tflite_runtime (from versions: none) ERROR: No matching distribution found for tflite_runtime root@be331b938317:~# pip3 install --index-url https://google-coral.github.io/py-repo/ tflite-runtime Looking in indexes: https://google-coral.github.io/py-repo/ ERROR: Could not find a version that satisfies the requirement tflite-runtime (from versions: none) ERROR: No matching distribution found for tflite-runtime root@be331b938317:~# cd HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2/ root@be331b938317:~/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2# python3 app_compile_model.py Traceback (most recent call last): File "/root/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2/app_compile_model.py", line 5, in import tflite_runtime.interpreter as tflite ModuleNotFoundError: No module named 'tflite_runtime' root@be331b938317:~/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2# cd .. root@be331b938317:~# cd edgeai-tidl-tools/ root@be331b938317:~/edgeai-tidl-tools# source setup.sh X64 Architecture Installing python packages... Requirement already satisfied: pybind11[global] in /usr/local/lib/python3.10/dist-packages (2.11.1) Requirement already satisfied: pybind11-global==2.11.1 in /usr/local/lib/python3.10/dist-packages (from pybind11[global]) (2.11.1) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv Collecting git+https://github.com/kumardesappan/caffe2onnx (from -r ./requirements_pc.txt (line 16)) Cloning https://github.com/kumardesappan/caffe2onnx to /tmp/pip-req-build-kceii7br Running command git clone --filter=blob:none --quiet https://github.com/kumardesappan/caffe2onnx /tmp/pip-req-build-kceii7br Resolved https://github.com/kumardesappan/caffe2onnx to commit b7e73feed3bbc5ddbdf25b87af93a2bae596055d Preparing metadata (setup.py) ... done Requirement already satisfied: numpy==1.23.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 1)) (1.23.0) Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 2)) (6.0.1) Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 3)) (3.20.3) Requirement already satisfied: onnx==1.13.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 4)) (1.13.0) Requirement already satisfied: torch in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 5)) (2.2.0) Requirement already satisfied: timm in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 6)) (0.9.16) Requirement already satisfied: tflite in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 7)) (2.10.0) Requirement already satisfied: pillow in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 8)) (10.2.0) Requirement already satisfied: flatbuffers==1.12.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 9)) (1.12) Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 10)) (2.31.0) Requirement already satisfied: opencv-python in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 11)) (4.9.0.80) Requirement already satisfied: pytest in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 12)) (8.0.1) Requirement already satisfied: graphviz in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 13)) (0.20.1) Requirement already satisfied: dataclasses in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 14)) (0.6) Requirement already satisfied: gluoncv in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 15)) (0.10.5.post0) Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx==1.13.0->-r ./requirements_pc.txt (line 4)) (4.9.0) Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (8.9.2.26) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105) Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (2.19.3) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105) Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.2.1) Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (1.12) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.3.1) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.0.106) Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.1.3) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (11.4.5.107) Requirement already satisfied: triton==2.2.0 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (2.2.0) Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (2024.2.0) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (11.0.2.54) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.13.1) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (10.3.2.106) Requirement already satisfied: nvidia-nvjitlink-cu12 in /usr/local/lib/python3.10/dist-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->-r ./requirements_pc.txt (line 5)) (12.3.101) Requirement already satisfied: torchvision in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.17.0) Requirement already satisfied: huggingface_hub in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.20.3) Requirement already satisfied: safetensors in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.4.2) Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (2.2.1) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (2024.2.2) Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (3.6) Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (3.3.2) Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (23.2) Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (1.2.0) Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (2.0.0) Requirement already satisfied: tomli>=1.0.0 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (2.0.1) Requirement already satisfied: pluggy<2.0,>=1.3.0 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (1.4.0) Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (2.2.0) Requirement already satisfied: matplotlib in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (3.8.3) Requirement already satisfied: yacs in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (0.1.8) Requirement already satisfied: scipy in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (1.12.0) Requirement already satisfied: autocfg in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (0.0.8) Requirement already satisfied: tqdm in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (4.66.2) Requirement already satisfied: portalocker in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (2.8.2) Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch->-r ./requirements_pc.txt (line 5)) (2.1.5) Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (4.49.0) Requirement already satisfied: python-dateutil>=2.7 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (2.8.2) Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (0.12.1) Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.2.0) Requirement already satisfied: kiwisolver>=1.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.4.5) Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (3.1.1) Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.10/dist-packages (from pandas->gluoncv->-r ./requirements_pc.txt (line 15)) (2024.1) Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->gluoncv->-r ./requirements_pc.txt (line 15)) (2024.1) Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy->torch->-r ./requirements_pc.txt (line 5)) (1.3.0) Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.7->matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.16.0) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv Requirement already satisfied: pybind11[global] in /usr/local/lib/python3.10/dist-packages (2.11.1) Requirement already satisfied: pybind11-global==2.11.1 in /usr/local/lib/python3.10/dist-packages (from pybind11[global]) (2.11.1) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv Installing python osrt packages... WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv Installing:onnxruntime Installing:tflite_2.8 Installing:opencv Installing:dlr root@be331b938317:~/edgeai-tidl-tools# cd .. root@be331b938317:~# cd HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2/ root@be331b938317:~/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2# python3 app_compile_model.py Traceback (most recent call last): File "/root/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2/app_compile_model.py", line 99, in tidl_delegate = [tflite.load_delegate(os.path.join(os.environ['TIDL_TOOLS_PATH'], 'tidl_model_import_tflite.so'), compile_options)] File "/usr/local/lib/python3.10/dist-packages/tflite_runtime/interpreter.py", line 175, in load_delegate delegate = Delegate(library, options) File "/usr/local/lib/python3.10/dist-packages/tflite_runtime/interpreter.py", line 83, in __init__ self._library = ctypes.pydll.LoadLibrary(library) File "/usr/lib/python3.10/ctypes/__init__.py", line 452, in LoadLibrary return self._dlltype(name) File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: /root/edgeai-tidl-tools/tidl_tools/tidl_model_import_tflite.so: cannot open shared object file: No such file or directory Exception ignored in: Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/tflite_runtime/interpreter.py", line 118, in __del__ if self._library is not None: AttributeError: 'Delegate' object has no attribute '_library' root@be331b938317:~/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2# ls /root/edgeai-tidl-tools/tidl_tools/ osrt_deps root@be331b938317:~/HelloWorld_PC_Cloud_TDA4VM_SK_EVM_v2# cd / root@be331b938317:/# find . -name *tflite.so -print