TDA4VH-Q1: Support for running custom model using OpenVx TIDL node

Part Number: TDA4VH-Q1


Hello Team,

I have compiled face detection model using edgeai-tidl-tools (version 11_01_06_00). The inference script on ONNX runtime is working fine.

As a next step, I need to run this compiled model artifacts in Vision Apps OpenVx pipeline. I am following /J784S4/ti-processor-sdk-rtos-j784s4-evm-11_01_00_04/vision_apps/apps/dl_demos/app_tidl/ as an example, did the required pre-processing, but I am not getting proper results after processing the graph.

Is there any thing that is different here that needs to be done with respect to preprocessing/postprocessing for making it work in OpenVx pipeline?

Best Regards,

Reshma

  • Hi Reshma,

    Could you share your logs from when you weren't getting proper results? Can you also share after running source ./vision_apps_init.sh (under vision_apps) to enable the remote core logs?

    cd /opt/vision_apps
    source ./vision_apps_init.sh

    Also, just to double check, were you able to build the SDK with the TIDL dependencies, as well as the vision apps with the following commands?

    make vision_apps
    make tidl_rt
    make tidl_pc_tools

    Warm regards,

    Christina

  • Hi Christina,

    PFA logs from the code. The model is getting loaded and also i am able to see output tensor data, but values are all wrong.
    APP: Init ... !!!
    1502.077259 s: MEM: Init ... !!!
    1502.077326 s: MEM: Initialized DMA HEAP (fd=5) !!!
    1502.077471 s: MEM: Init ... Done !!!
    1502.077487 s: IPC: Init ... !!!
    1502.102861 s: IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
    1502.110011 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
    1502.110115 s: VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
    1502.110128 s: VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
    1502.110137 s: VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
    1502.110736 s: VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-0
    1502.110847 s: VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-1
    1502.110952 s: VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-2
    1502.111067 s: VX_ZONE_INFO: [tivxPlatformCreateTargetId:169] Added target MPU-3
    1502.111080 s: VX_ZONE_INFO: [tivxInitLocal:202] Initialization Done !!!
    1502.111092 s: VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
    app_tidl: Reading config file test_data/tivx/tidl_models/subgraph_0_tidl_io_1.bin ...
    Opened IO file:test_data/tivx/tidl_models/subgraph_0_tidl_io_1.bin
    =======================TENSOR DETAILS======================
    Number of output tensors: 2; outDataName: scores boxes
    app_tidl: Reading config file test_data/tivx/tidl_models/subgraph_0_tidl_io_1.bin ... Done. 378392 bytes
    app_tidl: Tensors, input = 1, output = 2
    app_tidl: Reading network file test_data/tivx/tidl_models/subgraph_0_tidl_net.bin ...
    App init done!
    input_sizes 320 240 3
    output_sizes 2 4420 1
    output_sizes 4 4420 1
    Ctreate graph done
    1280, 720
    Image loaded test_data/psdkra/app_tidl/frame0.bmp
    imageparams: width: 1280, height: 960, stride: 3840,type: VX_DF_IMAGE_RGB
    Datatype: 10
    Data mapped
    0.203125 0.320312 0.500000 0.367188
    running tidl node
    Running Display Graph ... output_sizes: 2 4420 1
    output_sizes: 4 4420 1
    Done!
    run_graph done
    APP: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... Done !!!
    1503.585400 s: IPC: Deinit ... !!!
    1503.586343 s: IPC: DeInit ... Done !!!
    1503.586368 s: MEM: Deinit ... !!!
    1503.587036 s: DDR_SHARED_MEM: Alloc's: 17 alloc's of 25068308 bytes
    1503.587052 s: DDR_SHARED_MEM: Free's : 17 free's of 25068308 bytes
    1503.587062 s: DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes
    1503.587072 s: MEM: Deinit ... Done !!!
    APP: Deinit ... Done !!!

    Sorry, I am not able to upload remote core log here, files are not getting uploaded. Is there anything you want me to check explicitly in those?

    , just to double check, were you able to build the SDK with the TIDL dependencies, as well as the vision apps with the following commands?

    I am able to compile for vision_apps and tidl_rt. But I am not able to build for tidl_pc_tools. It's hanging my system. I guess it's for pc emulation only.

    Best Regards,

    Reshma