This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TDA4VM: TDA4VM: How to do the "TVM/Neo-AI-DLR + TIDL Heterogeneous Execution"

Part Number: TDA4VM
Other Parts Discussed in Thread: SYSBIOS

 if i have a tensorflow model, and there is an unspport op on C7x/MMA,

so ,i use tvm to optimize and generate the artifacts .

 the model could be split two partion,

a. ops are not supported by TIDL ---- neo-ai-dlr runtime load the deploy_lib.so ,deploy_graph.json, deploy_param.params  ,run on ARM core.

b. ops are supported by TIDL, using openVX load the subgraph0_net.bin , and run on the C7x/MMA

When I am confused, how to link the results of the two parts, do you need the customer to rewrite code by themselves?

example ,the data flow as below

input data --> subgraph0_net.bin --> deploy_lib.so -->out

  • look at the deploy_graph.json file ,seem it contains the tidl_0(subgraph0_net),  is right?

    in other words ,the neo-ai-dlr runtime could load and run the subgraph0_net subgraph0_net automatically

    input data--> deploy_lib.so  --->out

  • Yes.

    In deploy_graph.json, tidl_\* nodes will be dispatched to C7x/MMA automatically by the neo-ai-dlr runtime, other nodes will run on Arm with the TVM compiled code.  The linking of inputs/outputs between nodes on C7x and nodes on Arm are already taken care of by the neo-ai-dlr/tidl runtime.

    Please look at the ti-processor-sdk-rtos-j721e-evm-07_03_00_07/tidl_j7_02_00_00_07/ti_dl/test/tvm-dlr/dlr-inference-example.py as example how to deploy the inference on target/EVM.

  • thank you for your reply. it is very helpfull.

     when i rebuild the ti_dl/demo/dlr/classfication. it could not generate any execute file,would you give some help?thanks.

    j7@j7-VirtualBox:~/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11$ make
    .
    ======== MAKING IMPORT TOOL PROTOS LIB =================
    make -C ./ti_dl/utils/tidlModelImport -f makefile_lib
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/device_attributes.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/types.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/node_def.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/op_def.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/graph.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/cost_graph.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/tensor_shape.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/allocation_description.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/attr_value.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/kernel_def.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/function.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/log_memory.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/versions.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/tensor_description.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/tensor_slice.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/variable.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/step_stats.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/summary.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/resource_handle.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/proto_cc/tensorflow/core/framework/tensor.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../onnxImport/onnx_cc/onnx/onnx-operators-ml.proto3.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../onnxImport/onnx_cc/onnx/onnx-ml.proto3.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/faster_rcnn.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/square_box_coder.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/matcher.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/graph_rewriter.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/faster_rcnn_box_coder.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/bipartite_matcher.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/ssd_anchor_generator.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/keypoint_box_coder.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/anchor_generator.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/argmax_matcher.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/grid_anchor_generator.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/image_resizer.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/model.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/input_reader.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/box_predictor.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/post_processing.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/multiscale_anchor_generator.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/preprocessor.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/mean_stddev_box_coder.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/losses.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/ssd.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/region_similarity_calculator.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/optimizer.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/box_coder.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/pipeline.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/string_int_label_map.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/train.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/hyperparams.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tfImport/models_research_cc/object_detection/protos/eval.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../caffeImport/caffe.pb.obj
    r - /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/out/PC/dsp/algo/release/ti_dl/utils/tidlModelImport/../tidlMetaArch/tidl_meta_arch.pb.obj
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    .
    .
    ======== MAKING IMPORT LIBS =================
    make -C ./ti_dl/utils/tidlModelImport -f makefile_shared
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    compiling tidl_import_common_model_check.cpp
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    ======== MAKING TVM =================
    make -C ./ti_dl/utils/tidlModelImport -f makefile_shared tvm_relay
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    .
    ======== MAKING IMPORT TOOL =================
    make -C ./ti_dl/utils/tidlModelImport -f makefile_bin
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelImport'
    .
    ======== MAKING CUSTOM LIB =================
    make -C ./ti_dl/custom -f makefile
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/custom'
      ==>  new archive '../lib/dsp/algo/release/tidl_custom.lib'
      ==>  building archive '../lib/dsp/algo/release/tidl_custom.lib'
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/custom'
    .
    ======== MAKING TIDL ALGO =================
    make -C ./ti_dl/algo -f makefile
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/algo'
      ==>  new archive '../lib/dsp/algo/release/tidl_algo.lib'
      ==>  building archive '../lib/dsp/algo/release/tidl_algo.lib'
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/algo'
    .
    ======== MAKING TIDL TEST =================
    make -C ./ti_dl/test -f makefile final_install
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test'
    SHELL=/bin/sh
    TARGET_MAKEFILES=src/dsp_sdk/concerto.mak src/pc_linux/concerto.mak src/pc_windows/concerto.mak
    undefined TIARMCGT_ROOT=
    undefined GCC_SYSBIOS_ARM_ROOT=
    undefined CGT6X_ROOT=
    file CGT7X_ROOT="/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/ti-cgt-c7000_1.4.0.LTS"
    undefined GCC_WINDOWS_ROOT=
    file GCC_LINUX_ROOT=/usr
    undefined GCC_QNX_ROOT=
    #######################################################################
    TARGET_COMBO=J7_SDK:SYSBIOS:C71:1:release:CGT7X
    HOST_ROOT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test
    HOST_COMPILER=CGT7X
    HOST_PLATFORM=PC
    HOST_OS=LINUX
    HOST_CPU=x86_64
    HOST_ARCH=64
    HOST_FAMILY=x86_64
    HOST_NUM_CORES=4
    TARGET_OS=SYSBIOS
    TARGET_CPU=C71
    TARGET_ARCH=64
    TARGET_FAMILY=DSP
    TARGET_NUM_CORES=1
    TARGET_PLATFORM=J7_SDK
    TARGET_BUILD=release
    TARGET_OUT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/out/J7_SDK/C71/SYSBIOS/release
    TARGET_DOC=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/out/J7_SDK/C71/SYSBIOS/release/docs
    BUILD_DEFS =
    J7_SDK_SYSBIOS_C71_1_release_CGT7X_DEFS = SYSBIOS J7_SDK C71="C71" TARGET_NUM_CORES=1 TARGET_ARCH=64 ARCH_64 DSP TARGET_BUILD=1
    J7_SDK_SYSBIOS_C71_1_release_CGT7X_LDIRS =
    SCM_ROOT=
    SCM_VERSION=
    Running xdc configuro for src.dsp_sdk
    Linking /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/out/J7_SDK/C71/SYSBIOS/release/j7-c71_0-fw
    Copying built libraries: /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/out/J7_SDK/C71/SYSBIOS/release to /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/lib/J7_SDK/C71/SYSBIOS/release
    Copying built libraries: /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/out/J7_SDK/C71/SYSBIOS/release/j7-c71_0-fw to /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test/src/dsp_sdk/../..
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/test'
    .
    ======== MAKING GPRAPH VIZ TOOL =================
    make -C ./ti_dl/utils/tidlModelGraphviz -f makefile
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelGraphviz'
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/utils/tidlModelGraphviz'
    .
    ======== MAKING TIDL DEMOS =================
    make -C ./ti_dl/demos -f makefile all
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos'
    SHELL=/bin/sh
    TARGET_MAKEFILES=dlr/classification/a72/concerto.mak
    undefined TIARMCGT_ROOT=
    undefined GCC_SYSBIOS_ARM_ROOT=
    undefined CGT6X_ROOT=
    file CGT7X_ROOT="/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/ti-cgt-c7000_1.4.0.LTS"
    undefined GCC_WINDOWS_ROOT=
    file GCC_LINUX_ROOT=/usr
    undefined GCC_QNX_ROOT=
    #######################################################################
    TARGET_COMBO=J7:LINUX:A72:1:release:GCC_LINUX_ARM
    HOST_ROOT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos
    HOST_COMPILER=GCC_LINUX_ARM
    HOST_PLATFORM=PC
    HOST_OS=LINUX
    HOST_CPU=x86_64
    HOST_ARCH=64
    HOST_FAMILY=x86_64
    HOST_NUM_CORES=4
    TARGET_OS=LINUX
    TARGET_CPU=A72
    TARGET_ARCH=64
    TARGET_FAMILY=ARM
    TARGET_NUM_CORES=1
    TARGET_PLATFORM=J7
    TARGET_BUILD=release
    TARGET_OUT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release
    TARGET_DOC=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/docs
    BUILD_DEFS =
    J7_LINUX_A72_1_release_GCC_LINUX_ARM_DEFS = LINUX J7 A72="A72" TARGET_NUM_CORES=1 TARGET_ARCH=64 ARCH_64 ARM TARGET_BUILD=1
    J7_LINUX_A72_1_release_GCC_LINUX_ARM_LDIRS =
    SCM_ROOT=
    SCM_VERSION=
    Required system library libvx_kernels_hwa.a
    Required system library libapp_utils_draw2d.a
    Required system library libvx_framework.a
    Required system library libvx_platform_psdk_j7_linux.a
    Required system library libvx_kernels_host_utils.a
    Required system library libvx_kernels_tidl.a
    Required system library libvx_kernels_openvx_core.a
    Required system library libvx_utils.a
    Required system library libapp_utils_console_io.a
    Required system library libapp_utils_ipc.a
    Required system library libapp_tirtos_linux_mpu1_common.a
    Required system library libapp_utils_remote_service.a
    Required system library libapp_utils_mem.a
    Required system library libapp_utils_perf_stats.a
    Required system library libdl.so
    Required system library libpthread.so
    Required system library libti_rpmsg_char.so
    Required system library libdlr.so
    Linking /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_draw2d
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_draw2d
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_console_io
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_ipc
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_tirtos_linux_mpu1_common
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_remote_service
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_mem
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_perf_stats
    collect2: error: ld returned 1 exit status
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/vision_apps/concerto/finale.mak:208: recipe for target '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out' failed
    make[1]: [/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out] Error 1 (ignored)
    Copying built libraries: /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release to /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/lib/J7/A72/LINUX/release
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos'

  • Hi, a question, are you trying to build run NEO-AI-DLR C-API? if so, below are the instructions to follow.. In summary the command to build is:

     "make TARGET_BUILD=${PROFILE} demos DIRECTORIES=dlr". Where PROFILE is "debug" or "release"

    More details: TI Deep Learning Library User Guide: TVM/Neo-AI-DLR + TIDL Heterogeneous Execution

    Thank you,

    Paula

  • ...

    j7@j7-VirtualBox:~/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11$ make TARGET_BUILD=release demos DIRECTORIES=dlr
    .
    ======== MAKING TIDL DEMOS =================
    make -C ./ti_dl/demos -f makefile all
    make[1]: Entering directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos'
    SHELL=/bin/sh
    TARGET_MAKEFILES=dlr/classification/a72/concerto.mak
    Keep only release BUILDS in TARGET_COMBOS
    undefined TIARMCGT_ROOT=
    undefined GCC_SYSBIOS_ARM_ROOT=
    undefined CGT6X_ROOT=
    file CGT7X_ROOT="/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/ti-cgt-c7000_1.4.0.LTS"
    undefined GCC_WINDOWS_ROOT=
    file GCC_LINUX_ROOT=/usr
    undefined GCC_QNX_ROOT=
    #######################################################################
    TARGET_COMBO=J7:LINUX:A72:1:release:GCC_LINUX_ARM
    HOST_ROOT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos
    HOST_COMPILER=GCC_LINUX_ARM
    HOST_PLATFORM=PC
    HOST_OS=LINUX
    HOST_CPU=x86_64
    HOST_ARCH=64
    HOST_FAMILY=x86_64
    HOST_NUM_CORES=4
    TARGET_OS=LINUX
    TARGET_CPU=A72
    TARGET_ARCH=64
    TARGET_FAMILY=ARM
    TARGET_NUM_CORES=1
    TARGET_PLATFORM=J7
    TARGET_BUILD=release
    TARGET_OUT=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release
    TARGET_DOC=/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/docs
    BUILD_DEFS =
    J7_LINUX_A72_1_release_GCC_LINUX_ARM_DEFS = LINUX J7 A72="A72" TARGET_NUM_CORES=1 TARGET_ARCH=64 ARCH_64 ARM TARGET_BUILD=1
    J7_LINUX_A72_1_release_GCC_LINUX_ARM_LDIRS =
    SCM_ROOT=
    SCM_VERSION=
    Required system library libvx_kernels_hwa.a
    Required system library libapp_utils_draw2d.a
    Required system library libvx_framework.a
    Required system library libvx_platform_psdk_j7_linux.a
    Required system library libvx_kernels_host_utils.a
    Required system library libvx_kernels_tidl.a
    Required system library libvx_kernels_openvx_core.a
    Required system library libvx_utils.a
    Required system library libapp_utils_console_io.a
    Required system library libapp_utils_ipc.a
    Required system library libapp_tirtos_linux_mpu1_common.a
    Required system library libapp_utils_remote_service.a
    Required system library libapp_utils_mem.a
    Required system library libapp_utils_perf_stats.a
    Required system library libdl.so
    Required system library libpthread.so
    Required system library libti_rpmsg_char.so
    Required system library libdlr.so
    Linking /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_draw2d
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_draw2d
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_console_io
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_ipc
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_tirtos_linux_mpu1_common
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_remote_service
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_mem
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/gcc-arm-9.2-2019.12-x86_64-aarch64-none-linux-gnu/bin/../lib/gcc/aarch64-none-linux-gnu/9.2.1/../../../../aarch64-none-linux-gnu/bin/ld: cannot find -lapp_utils_perf_stats
    collect2: error: ld returned 1 exit status
    /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/vision_apps/concerto/finale.mak:208: recipe for target '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out' failed
    make[1]: [/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release/tidl_dlr_classification.out] Error 1 (ignored)
    Copying built libraries: /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/out/J7/A72/LINUX/release to /home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos/lib/J7/A72/LINUX/release
    make[1]: Leaving directory '/home/j7/j7_07_01_00/ti-processor-sdk-rtos-j721e-evm-07_01_00_11/tidl_j7_01_03_00_11/ti_dl/demos'

    ...

  • Hi as mentioned in user guide (TI Deep Learning Library User Guide: TVM/Neo-AI-DLR + TIDL Heterogeneous Execution) DLR demo needs some lib from vision apps. Could you please try below? 

    1. Additional TIOVX and vision_apps libraries
      • If you haven't already done so, you'll need to build some libraries inside vision_apps. For example: app_utils_draw2d. An easy way of taking care of this is by building "vx_app_tidl".
        • ${PSDK_INSTALL_PATH}/vision_apps$ make vx_app_tidl'

    thank you,

    Paula

  • thank you very much,helpfull