This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TDA4VE-Q1: [edgeai-tidl-tools] When execute "Compile and Validate on X86_PC" error

Part Number: TDA4VE-Q1
Other Parts Discussed in Thread: AM69A

Tool/software:

Hi experts,

edgeai-tidl-tools Tag: 09_02_09_00

I use docker to implement.

Due to network issues, I downloaded all the required libraries in advance and placed them in path edgeai-tidl-tools/downloads_for_edgeai,The edgeai-tidl-tools/setup.sh file has also been modified accordingly, 
Refer to the "setup.patch" file.

Another change is the installation of the Tensort code repository. I downloaded TensorRT-release-8.5zip in advance and renamed it to TensorRT. I placed it in the edgeai-tidl-tools/scripts/osmt_model_tools/onnx_tools/tidl-onnx-model-optizer path, and manually executed the pip3 install . in the TensorRT/tools/onnx-gradhsurgeon path.

The final installation was successful, but there was an error while executing “cmake  ../examples && make -j && cd ..“. I tried several times but it was the same error, missing the relevant dynamic library.
  

Can you help me check which package these libraries are in? Is it because which step did not execute successfully that these libraries are missing?

  • The Evn as follows:

    NVIDIA_VISIBLE_DEVICES=all
    HOSTNAME=cf0fbf77e453
    PWD=/home/root
    HOME=/root
    LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:
    LESSCLOSE=/usr/bin/lesspipe %s %s
    TERM=xterm
    LESSOPEN=| /usr/bin/lesspipe %s
    SHLVL=1
    LD_LIBRARY_PATH=:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/:/home/root/tidl_tools:/home/root/tidl_tools/osrt_deps:/home/root/tidl_tools/osrt_deps/opencv/
    ARM64_GCC_PATH=/home/root/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu
    TIDL_TOOLS_TYPE=GPU
    PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    SOC=am68a
    CGT7X_ROOT=/home/root/ti-cgt-c7000_3.1.0.LTS
    TIDL_TOOLS_PATH=/home/root/tidl_tools
    OLDPWD=/home/root/tidl_tools/osrt_deps
    _=/usr/bin/env
    


    And, setup.sh  patch file as follows:
    diff --git a/setup.sh b/setup.sh
    index 10af24b..2e487d2 100755
    --- a/setup.sh
    +++ b/setup.sh
    @@ -315,10 +315,15 @@ if [[ $arch == x86_64 ]]; then
             pip_install_local tflite_runtime-2.12.0-cp310-cp310-linux_x86_64.whl
         else
             echo 'Installing python osrt packages...'
    -        pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/dlr-1.13.0-py3-none-any.whl
    -        pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tvm-0.12.0-cp310-cp310-linux_x86_64.whl
    -        pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/onnxruntime_tidl-1.14.0-cp310-cp310-linux_x86_64.whl
    -        pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tflite_runtime-2.12.0-cp310-cp310-linux_x86_64.whl
    +        # pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/dlr-1.13.0-py3-none-any.whl
    +        # pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tvm-0.12.0-cp310-cp310-linux_x86_64.whl
    +        # pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/onnxruntime_tidl-1.14.0-cp310-cp310-linux_x86_64.whl
    +        # pip3 install --quiet https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tflite_runtime-2.12.0-cp310-cp310-linux_x86_64.whl
    +
    +        pip3 install $SCRIPTDIR/downloads_for_edgeai/dlr-1.13.0-py3-none-any.whl
    +        pip3 install $SCRIPTDIR/downloads_for_edgeai/tvm-0.12.0-cp310-cp310-linux_x86_64.whl
    +        pip3 install $SCRIPTDIR/downloads_for_edgeai/onnxruntime_tidl-1.14.0-cp310-cp310-linux_x86_64.whl
    +        pip3 install $SCRIPTDIR/downloads_for_edgeai/tflite_runtime-2.12.0-cp310-cp310-linux_x86_64.whl
         fi
     fi
     
    @@ -362,10 +367,12 @@ if [ -z "$TIDL_TOOLS_PATH" ]; then
             else
                 if [ $tidl_gpu_tools -eq 1 ];then
                     echo 'Downloading gpu tidl tools for AM68A SOC ...'
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/TIDL_TOOLS/AM68A/tidl_tools_gpu.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/TIDL_TOOLS/AM68A/tidl_tools_gpu.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/tidl_tools_gpu.tar.gz ./
                 else
                     echo 'Downloading tidl tools for AM68A SOC ...'
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/TIDL_TOOLS/AM68A/tidl_tools.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/TIDL_TOOLS/AM68A/tidl_tools.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/tidl_tools.tar.gz  ./
                 fi
             fi
         elif  [ $SOC == am69a ];then
    @@ -434,7 +441,8 @@ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$TIDL_TOOLS_PATH:$TIDL_TOOLS_PATH/osrt_d
     
     if [[ $arch == x86_64 && $skip_arm_gcc_download -eq 0 ]]; then
         if [ ! -d gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu ];then
    -        wget --quiet  https://developer.arm.com/-/media/Files/downloads/gnu-a/9.2-2019.12/binrel/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu.tar.xz
    +        # wget --quiet  https://developer.arm.com/-/media/Files/downloads/gnu-a/9.2-2019.12/binrel/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu.tar.xz
    +        cp $SCRIPTDIR/downloads_for_edgeai/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu.tar.xz ./
             tar -xf gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu.tar.xz
             export ARM64_GCC_PATH=$(pwd)/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu
         else
    @@ -448,7 +456,8 @@ if [[ $arch == x86_64 ]]; then
             echo "CGT7X_ROOT already set to $CGT7X_ROOT, skipping download"
         else
             if [ ! -d ti-cgt-c7000_3.1.0.LTS ];then
    -            wget --quiet https://dr-download.ti.com/software-development/ide-configuration-compiler-or-debugger/MD-707zYe3Rik/3.1.0.LTS/ti_cgt_c7000_3.1.0.LTS_linux-x64_installer.bin
    +            # wget --quiet https://dr-download.ti.com/software-development/ide-configuration-compiler-or-debugger/MD-707zYe3Rik/3.1.0.LTS/ti_cgt_c7000_3.1.0.LTS_linux-x64_installer.bin
    +            cp $SCRIPTDIR/downloads_for_edgeai/ti_cgt_c7000_3.1.0.LTS_linux-x64_installer.bin ./
                 chmod +x ti_cgt_c7000_3.1.0.LTS_linux-x64_installer.bin
                 ./ti_cgt_c7000_3.1.0.LTS_linux-x64_installer.bin --mode unattended --installdir $(pwd)
                 export CGT7X_ROOT=$(pwd)/ti-cgt-c7000_3.1.0.LTS
    @@ -475,7 +484,8 @@ if [ $skip_cpp_deps -eq 0 ]; then
                 if [[ $use_local == 1 ]];then
                     cp_osrt_lib onnx_1.14.0_x86_u22.tar.gz
                 else
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/onnx_1.14.0_x86_u22.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/onnx_1.14.0_x86_u22.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/onnx_1.14.0_x86_u22.tar.gz ./
                 fi
                 tar -xf onnx_1.14.0_x86_u22.tar.gz
                 cd onnx_1.14.0_x86_u22
    @@ -500,7 +510,8 @@ if [ $skip_cpp_deps -eq 0 ]; then
                 if [[ $use_local == 1 ]];then
                     cp_osrt_lib tflite_2.12_x86_u22.tar.gz
                 else
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tflite_2.12_x86_u22.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/tflite_2.12_x86_u22.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/tflite_2.12_x86_u22.tar.gz ./
                 fi
                 tar -xf tflite_2.12_x86_u22.tar.gz
                 rm tflite_2.12_x86_u22.tar.gz   -r
    @@ -518,7 +529,8 @@ if [ $skip_cpp_deps -eq 0 ]; then
                 if [[ $use_local == 1 ]];then
                     cp_osrt_lib opencv_4.2.0_x86_u22.tar.gz
                 else
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/opencv_4.2.0_x86_u22.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/opencv_4.2.0_x86_u22.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/opencv_4.2.0_x86_u22.tar.gz ./
                 fi
                 mkdir opencv_4.2.0_x86_u22 && tar xf opencv_4.2.0_x86_u22.tar.gz -C opencv_4.2.0_x86_u22 --strip-components 1
                 rm opencv_4.2.0_x86_u22.tar.gz
    @@ -536,7 +548,8 @@ if [ $skip_cpp_deps -eq 0 ]; then
                 if [[ $use_local == 1 ]];then
                     cp_osrt_lib dlr_1.10.0_x86_u22.tar.gz
                 else
    -                wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/dlr_1.10.0_x86_u22.tar.gz
    +                # wget --quiet   https://software-dl.ti.com/jacinto7/esd/tidl-tools/$REL/OSRT_TOOLS/X86_64_LINUX/UBUNTU_22_04/dlr_1.10.0_x86_u22.tar.gz
    +                cp $SCRIPTDIR/downloads_for_edgeai/dlr_1.10.0_x86_u22.tar.gz ./
                 fi
                 mkdir dlr_1.10.0_x86_u22 && tar xf dlr_1.10.0_x86_u22.tar.gz -C dlr_1.10.0_x86_u22 --strip-components 1
                 rm dlr_1.10.0_x86_u22.tar.gz   -r
    

  • The "source_history.log" is a record of executing  command "source ./setup.sh" .

    TIDL_TOOLS_TYPE set to :GPU
    X64 Architecture
    Installing python packages...
    Requirement already satisfied: pybind11[global] in /usr/local/lib/python3.10/dist-packages (2.13.6)
    Requirement already satisfied: pybind11-global==2.13.6 in /usr/local/lib/python3.10/dist-packages (from pybind11[global]) (2.13.6)
    Collecting https://github.com/TexasInstruments/edgeai-caffe2onnx/archive/refs/heads/tidl.zip (from -r ./requirements_pc.txt (line 16))
      Using cached https://github.com/TexasInstruments/edgeai-caffe2onnx/archive/refs/heads/tidl.zip
      Preparing metadata (setup.py): started
      Preparing metadata (setup.py): finished with status 'done'
    Requirement already satisfied: numpy==1.23.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 1)) (1.23.0)
    Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 2)) (6.0.2)
    Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 3)) (3.20.3)
    Requirement already satisfied: onnx==1.13.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 4)) (1.13.0)
    Requirement already satisfied: torch in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 5)) (2.4.1)
    Requirement already satisfied: timm in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 6)) (1.0.9)
    Requirement already satisfied: tflite in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 7)) (2.10.0)
    Requirement already satisfied: pillow in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 8)) (10.4.0)
    Requirement already satisfied: flatbuffers==1.12.0 in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 9)) (1.12)
    Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 10)) (2.32.3)
    Requirement already satisfied: opencv-python in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 11)) (4.10.0.84)
    Requirement already satisfied: pytest in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 12)) (8.3.3)
    Requirement already satisfied: graphviz in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 13)) (0.20.3)
    Requirement already satisfied: dataclasses in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 14)) (0.6)
    Requirement already satisfied: gluoncv in /usr/local/lib/python3.10/dist-packages (from -r ./requirements_pc.txt (line 15)) (0.10.5.post0)
    Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx==1.13.0->-r ./requirements_pc.txt (line 4)) (4.12.2)
    Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.16.1)
    Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (1.13.2)
    Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.3)
    Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.1.4)
    Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (2024.9.0)
    Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105)
    Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105)
    Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105)
    Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (9.1.0.70)
    Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.3.1)
    Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (11.0.2.54)
    Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (10.3.2.106)
    Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (11.4.5.107)
    Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.0.106)
    Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (2.20.5)
    Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (12.1.105)
    Requirement already satisfied: triton==3.0.0 in /usr/local/lib/python3.10/dist-packages (from torch->-r ./requirements_pc.txt (line 5)) (3.0.0)
    Requirement already satisfied: nvidia-nvjitlink-cu12 in /usr/local/lib/python3.10/dist-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->-r ./requirements_pc.txt (line 5)) (12.6.68)
    Requirement already satisfied: torchvision in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.19.1)
    Requirement already satisfied: huggingface_hub in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.25.0)
    Requirement already satisfied: safetensors in /usr/local/lib/python3.10/dist-packages (from timm->-r ./requirements_pc.txt (line 6)) (0.4.5)
    Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (3.3.2)
    Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (3.10)
    Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (2.2.3)
    Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->-r ./requirements_pc.txt (line 10)) (2024.8.30)
    Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (2.0.0)
    Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (24.1)
    Requirement already satisfied: pluggy<2,>=1.5 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (1.5.0)
    Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (1.2.2)
    Requirement already satisfied: tomli>=1 in /usr/local/lib/python3.10/dist-packages (from pytest->-r ./requirements_pc.txt (line 12)) (2.0.1)
    Requirement already satisfied: tqdm in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (4.66.5)
    Requirement already satisfied: matplotlib in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (3.9.2)
    Requirement already satisfied: portalocker in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (2.10.1)
    Requirement already satisfied: scipy in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (1.13.1)
    Requirement already satisfied: yacs in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (0.1.8)
    Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (2.2.2)
    Requirement already satisfied: autocfg in /usr/local/lib/python3.10/dist-packages (from gluoncv->-r ./requirements_pc.txt (line 15)) (0.0.8)
    Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2->torch->-r ./requirements_pc.txt (line 5)) (2.1.5)
    Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.3.0)
    Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (0.12.1)
    Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (4.53.1)
    Requirement already satisfied: kiwisolver>=1.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.4.7)
    Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (3.1.4)
    Requirement already satisfied: python-dateutil>=2.7 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (2.9.0.post0)
    Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->gluoncv->-r ./requirements_pc.txt (line 15)) (2024.2)
    Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.10/dist-packages (from pandas->gluoncv->-r ./requirements_pc.txt (line 15)) (2024.1)
    Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.10/dist-packages (from sympy->torch->-r ./requirements_pc.txt (line 5)) (1.3.0)
    Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.7->matplotlib->gluoncv->-r ./requirements_pc.txt (line 15)) (1.16.0)
    Requirement already satisfied: pybind11[global] in /usr/local/lib/python3.10/dist-packages (2.13.6)
    Requirement already satisfied: pybind11-global==2.13.6 in /usr/local/lib/python3.10/dist-packages (from pybind11[global]) (2.13.6)
    Installing python osrt packages...
    Processing ./downloads_for_edgeai/dlr-1.13.0-py3-none-any.whl
    Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from dlr==1.13.0) (1.23.0)
    Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from dlr==1.13.0) (2.32.3)
    Requirement already satisfied: distro in /usr/local/lib/python3.10/dist-packages (from dlr==1.13.0) (1.9.0)
    Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->dlr==1.13.0) (3.3.2)
    Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->dlr==1.13.0) (3.10)
    Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->dlr==1.13.0) (2.2.3)
    Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->dlr==1.13.0) (2024.8.30)
    dlr is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
    Processing ./downloads_for_edgeai/tvm-0.12.0-cp310-cp310-linux_x86_64.whl
    Requirement already satisfied: attrs in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (24.2.0)
    Requirement already satisfied: cloudpickle in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (3.0.0)
    Requirement already satisfied: decorator in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (5.1.1)
    Requirement already satisfied: numpy<=1.23 in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (1.23.0)
    Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (6.0.0)
    Requirement already satisfied: scipy in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (1.13.1)
    Requirement already satisfied: tornado in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (6.4.1)
    Requirement already satisfied: typing-extensions in /usr/local/lib/python3.10/dist-packages (from tvm==0.12.0) (4.12.2)
    tvm is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
    Processing ./downloads_for_edgeai/onnxruntime_tidl-1.14.0-cp310-cp310-linux_x86_64.whl
    Requirement already satisfied: coloredlogs in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (15.0.1)
    Requirement already satisfied: flatbuffers in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (1.12)
    Requirement already satisfied: numpy>=1.23.0 in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (1.23.0)
    Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (24.1)
    Requirement already satisfied: protobuf in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (3.20.3)
    Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from onnxruntime-tidl==1.14.0) (1.13.2)
    Requirement already satisfied: humanfriendly>=9.1 in /usr/local/lib/python3.10/dist-packages (from coloredlogs->onnxruntime-tidl==1.14.0) (10.0)
    Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.10/dist-packages (from sympy->onnxruntime-tidl==1.14.0) (1.3.0)
    onnxruntime-tidl is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
    Processing ./downloads_for_edgeai/tflite_runtime-2.12.0-cp310-cp310-linux_x86_64.whl
    Requirement already satisfied: numpy>=1.19.2 in /usr/local/lib/python3.10/dist-packages (from tflite-runtime==2.12.0) (1.23.0)
    tflite-runtime is already installed with the same version as the provided wheel. Use --force-reinstall to force an installation of the wheel.
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: pip in /usr/local/lib/python3.10/dist-packages (24.2)
    Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (75.1.0)
    Installing python packages...
    pip3 install --no-input wheel
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: wheel in /usr/lib/python3/dist-packages (0.37.1)
    pip3 install --no-input numpy==1.23.0
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: numpy==1.23.0 in /usr/local/lib/python3.10/dist-packages (1.23.0)
    pip3 install --no-input protobuf==3.20.3
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: protobuf==3.20.3 in /usr/local/lib/python3.10/dist-packages (3.20.3)
    pip3 install --no-input onnx==1.13.0
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: onnx==1.13.0 in /usr/local/lib/python3.10/dist-packages (1.13.0)
    Requirement already satisfied: numpy>=1.16.6 in /usr/local/lib/python3.10/dist-packages (from onnx==1.13.0) (1.23.0)
    Requirement already satisfied: protobuf<4,>=3.20.2 in /usr/local/lib/python3.10/dist-packages (from onnx==1.13.0) (3.20.3)
    Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx==1.13.0) (4.12.2)
    pip3 install --no-input onnxsim==0.4.35
    Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
    Requirement already satisfied: onnxsim==0.4.35 in /usr/local/lib/python3.10/dist-packages (0.4.35)
    Requirement already satisfied: onnx in /usr/local/lib/python3.10/dist-packages (from onnxsim==0.4.35) (1.13.0)
    Requirement already satisfied: rich in /usr/local/lib/python3.10/dist-packages (from onnxsim==0.4.35) (13.8.1)
    Requirement already satisfied: numpy>=1.16.6 in /usr/local/lib/python3.10/dist-packages (from onnx->onnxsim==0.4.35) (1.23.0)
    Requirement already satisfied: protobuf<4,>=3.20.2 in /usr/local/lib/python3.10/dist-packages (from onnx->onnxsim==0.4.35) (3.20.3)
    Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx->onnxsim==0.4.35) (4.12.2)
    Requirement already satisfied: markdown-it-py>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from rich->onnxsim==0.4.35) (3.0.0)
    Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.10/dist-packages (from rich->onnxsim==0.4.35) (2.18.0)
    Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py>=2.2.0->rich->onnxsim==0.4.35) (0.1.2)
    Processing /home/root/scripts/osrt_model_tools/onnx_tools/tidl-onnx-model-optimizer/TensorRT/tools/onnx-graphsurgeon
      Preparing metadata (setup.py): started
      Preparing metadata (setup.py): finished with status 'done'
    Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from onnx_graphsurgeon==0.3.26) (1.23.0)
    Requirement already satisfied: onnx in /usr/local/lib/python3.10/dist-packages (from onnx_graphsurgeon==0.3.26) (1.13.0)
    Requirement already satisfied: protobuf<4,>=3.20.2 in /usr/local/lib/python3.10/dist-packages (from onnx->onnx_graphsurgeon==0.3.26) (3.20.3)
    Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx->onnx_graphsurgeon==0.3.26) (4.12.2)
    Building wheels for collected packages: onnx_graphsurgeon
      Building wheel for onnx_graphsurgeon (setup.py): started
      Building wheel for onnx_graphsurgeon (setup.py): finished with status 'done'
      Created wheel for onnx_graphsurgeon: filename=onnx_graphsurgeon-0.3.26-py2.py3-none-any.whl size=40992 sha256=c7f0d82a99173259365cdc167675bb16bcb708daa62cc9035ce6ac13a0694d2d
      Stored in directory: /root/.cache/pip/wheels/87/8d/4d/56a9d8f4732eb62f11a54d2efb00921b88736c482ad84021bc
    Successfully built onnx_graphsurgeon
    Installing collected packages: onnx_graphsurgeon
      Attempting uninstall: onnx_graphsurgeon
        Found existing installation: onnx_graphsurgeon 0.3.26
        Uninstalling onnx_graphsurgeon-0.3.26:
          Successfully uninstalled onnx_graphsurgeon-0.3.26
    Successfully installed onnx_graphsurgeon-0.3.26
    /home/root/scripts/osrt_model_tools/onnx_tools/tidl-onnx-model-optimizer
    installing the onnx graph optimization toolkit...
    version_file=/home/root/scripts/osrt_model_tools/onnx_tools/tidl-onnx-model-optimizer/version.py
    running develop
    running egg_info
    writing tidl_onnx_model_optimizer.egg-info/PKG-INFO
    writing dependency_links to tidl_onnx_model_optimizer.egg-info/dependency_links.txt
    writing top-level names to tidl_onnx_model_optimizer.egg-info/top_level.txt
    reading manifest file 'tidl_onnx_model_optimizer.egg-info/SOURCES.txt'
    adding license file 'LICENSE.md'
    writing manifest file 'tidl_onnx_model_optimizer.egg-info/SOURCES.txt'
    running build_ext
    Creating /usr/local/lib/python3.10/dist-packages/tidl-onnx-model-optimizer.egg-link (link to .)
    tidl-onnx-model-optimizer 9.2.0 is already the active version in easy-install.pth
    
    Installed /home/root/scripts/osrt_model_tools/onnx_tools/tidl-onnx-model-optimizer
    Processing dependencies for tidl-onnx-model-optimizer==9.2.0
    Finished processing dependencies for tidl-onnx-model-optimizer==9.2.0
    skipping gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu download: found /home/root/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu
    CGT7X_ROOT already set to /home/root/ti-cgt-c7000_3.1.0.LTS, skipping download
    Installing:onnxruntime
    Installing:tflite_2.12
    Installing:opencv
    Installing:dlr
    

  • Hi,

    I found that TIDL_TOOLS_TYPE is not set. Using tidl_tools.tar.gz is okay, but using tidl_tools_gpu.tar.gz is not possible.

    Have you verified tidl_tools_gpu.tar.gz?

  • Please check tidl_tools.   If you only have osrt_deps/, then the setup has not installed all that is needed, and the script thinks it has already installed everything it needs.  The directory should have:

    rw-rw-r-- 1 a0194920local a0194920local 609 Jul 3 09:59 device_config.cfg
    -rw-rw-r-- 1 a0194920local a0194920local 13849 Jul 3 09:59 itidl_rt.h
    -rw-rw-r-- 1 a0194920local a0194920local 6248 Jul 3 09:59 itvm_rt.h
    -rwxrwxr-x 1 a0194920local a0194920local 78296 Jul 3 10:00 libtidl_onnxrt_EP.so
    -rwxrwxr-x 1 a0194920local a0194920local 46808 Jul 3 10:00 libtidl_tfl_delegate.so
    -rwxrwxr-x 2 a0194920local a0194920local 19119336 Jul 3 10:00 libvx_tidl_rt.so
    -rwxrwxr-x 2 a0194920local a0194920local 19119336 Jul 3 10:00 libvx_tidl_rt.so.1.0
    -rw-rw-r-- 1 a0194920local a0194920local 2896 Oct 2 17:08 nc_infofile.txt
    drwxrwxr-x 6 a0194920local a0194920local 4096 Sep 30 17:13 osrt_deps
    -rwxrwxr-x 1 a0194920local a0194920local 26918808 Jul 3 10:00 PC_dsp_test_dl_algo.out
    -rwxrwxr-x 1 a0194920local a0194920local 400656 Jul 3 09:59 ti_cnnperfsim.out
    -rwxrwxr-x 1 a0194920local a0194920local 194032 Jul 3 09:59 tidl_graphVisualiser.out
    -rwxrwxr-x 1 a0194920local a0194920local 62432 Jul 3 09:59 tidl_graphVisualiser_runtimes.out
    -rwxrwxr-x 1 a0194920local a0194920local 13396920 Jul 3 10:00 tidl_model_import_onnx.so
    -rwxrwxr-x 1 a0194920local a0194920local 96720 Jul 3 10:00 tidl_model_import.out
    -rwxrwxr-x 1 a0194920local a0194920local 13545392 Jul 3 10:00 tidl_model_import_relay.so
    -rwxrwxr-x 1 a0194920local a0194920local 13173784 Jul 3 10:00 tidl_model_import.so
    -rwxrwxr-x 1 a0194920local a0194920local 13463616 Jul 3 10:00 tidl_model_import_tflite.so
    -rwxrwxr-x 1 a0194920local a0194920local 16840 Jul 3 09:59 tidl_model_secure.out

    Or something close to work correctly.

     If you only have osrt_deps/ you can try to install the other dependencies by:  

     

    wget https://software-dl.ti.com/jacinto7/esd/tidl-tools/09_02_09_00/TIDL_TOOLS/AM69A/tidl_tools.tar.gz

     

    Then untar the above tar file in the directory above tidl_tools (in the edgeai-tidl-tools directory).   Please make sure your device ("AM69A" in the example wget string) and version (09_02_09_00) are correct for your installation.  

    A better approach is to run setup.sh in a clean environment, as it will install everything correctly.  It just hits the network for each file.