• State Resolved
  • Locked Locked
  • Replies 41 replies
  • Answers 2 answers
  • Subscribers 99 subscribers
  • Views 1785 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TDA4VM: How to control DL pre proc kernel to switch different channels for processing? Only one specified channel is processed at a time.

xiu xin
Intellectual 280 points

Part Number: TDA4VM
Other Parts Discussed in Thread: TDA2

Dear exprets,

My graph now accepts four camera inputs, but when doing deep learning processing, I want it to only process one selected channel. I know that the display kernel can select different channels for display. So I wonder if DL pre proc kernel can also select a certain channel for processing?

Regards,

Xin

  • 0
    TI__Mastermind 24041 points

    Hi,

    Could you please elaborate more on exact use case you are looking for ?

    What do you mean by 

    xiu xin said:
    I want it to only process one selected channel
  • 0 in reply to Pratik Kedar
    Intellectual 280 points

    Hi Pratik,

    My graph now has four cameras, which means four channels of input, but I only want the DL pre proc kernel to receive one channel as input, and I can choose one of the four channels as input.

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    With four cameras as input, the input to the node would be an object array out of which you would be sending the first element into the node right?

    May I know why are you opting for doing it one at a time rather than using vxReplicateNode and processing all the 4 images? 

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    Yes, just use the vxReplicateNode to process four data at the same time, which I saw in the demo and have practiced, but in the actual application, I only need to process the deep learning of two camera inputs, and do not need to process the two inputs at the same time. I just need to send a control command to switch these two inputs and select one of them. Moreover, the c7x kernel is very occupied by the DL node, and the four channels at the same time achieve 99% occupancy. I also need to run other nodes, so performance is a consideration.

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    Understood. The channel switch is not readily available in the SDK, however you could modify the target implementation of the node to achieve the same. You could refer the display node implementation for the control command "TIVX_DISPLAY_SELECT_CHANNEL" and do the same implementation for the DL preproc node.

    I see that there is no control function in the dl pre proc node. You could add the control function in the tivxAddTargetKernelDLPreProc() in vision_apps/kernels/img_proc/c66/vx_dl_pre_proc_target.c

    After this, you could use this control command API and then follow the implementation of the display node.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    Yes, I'm doing that, but I'm not sure if porting this functionality to DL preproc node will work correctly or achieve the same functionality. I've had a few issues along the way. For example, the display node uses the TIVX_DISPLAY_SELECT_CHANNEL macro when sending control commands, which is defined as follows: #define TIVX_DISPLAY_SELECT_CHANNEL (0x30000000u), I don't understand (0x30000000u) how this value is set, suppose I define a similar macro in DL preproc node, How should the value after the macro be set?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    This is just a unique number assigned as enum to identify this control command in the switch case inside the control function. 
    You could use the same 0x30000000u or use your own unique ENUM value.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    I added the switch channel function mimicking display node, but it failed when sending command control, causing the program to exit. Are you sure you can port this function?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    Could you please let me know your changes on the target side of this node?
    Did the call reach the control function?

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    These are the changes I made to three files, named main.c; kernels/img_proc/c66/vx_dl_pre_proc_target.c ;  kernels/img_proc/include/TI/tivx_img_proc_kernels.h

    Regards,

    Xin

    Fullscreen 2158.main.c.txt Download 
    +    //init 
+    obj->channel_params.active_channel_id = 2;
+    obj->switch_preproc_ch_obj = vxCreateUserDataObject(obj->context, "tivx_preproc_select_channel_params_t", sizeof(tivx_preproc_select_channel_params_t),&obj->channel_params); 
+    status = vxGetStatus((vx_reference)obj->switch_preproc_ch_obj);



+static vx_status SendCmdtoPreProc(AppObj *obj,PreProcObj *preProcObj)
+{
+    
+    if(obj->switch_preproc_ch_obj == NULL)
+        {
+            vx_status status = VX_FAILURE;
+            return status;
+        }
+    
+    
+    vx_reference refs[1];
+    vx_status status = VX_FAILURE;
+
+    obj->channel_params.active_channel_id = (obj->channel_params.active_channel_id + 1) % NUM_CAPT_CHANNELS_TOTAL;
+    APP_PRINTF("active_channel_id:%d\n",obj->channel_params.active_channel_id);
+    vxCopyUserDataObject(obj->switch_preproc_ch_obj, 0,
+                    sizeof(tivx_preproc_select_channel_params_t),
+                    &obj->channel_params, VX_WRITE_ONLY, VX_MEMORY_TYPE_HOST);
+    refs[0] = (vx_reference) obj->switch_preproc_ch_obj;
+    status = tivxNodeSendCommand(preProcObj->node, 0u, TIVX_PREPROC_SELECT_CHANNEL, refs, 1u);
+    APP_PRINTF("App Send Preproc Command Done!\n");
+
+    if(status != VX_SUCCESS)
+    {
+        APP_PRINTF("PreProc: Node send command failed!\n");
+    }
+
+    return status;
+}
+




+            if(status == VX_SUCCESS )
+            {
+                status = SendCmdtoPreProc(obj,&obj->preProcObj);
+            }

    Fullscreen 2158.vx_dl_pre_proc_target.c.txt Download 
    diff --git a/kernels/img_proc/c66/vx_dl_pre_proc_target.c b/kernels/img_proc/c66/vx_dl_pre_proc_target.c
index 9b9b892..4e64d79 100644
--- a/kernels/img_proc/c66/vx_dl_pre_proc_target.c
+++ b/kernels/img_proc/c66/vx_dl_pre_proc_target.c
@@ -111,8 +111,16 @@ typedef struct {
     uint64_t l2_global_base;
     uint32_t alloc_size;
 
+    /**< Id of active channel,duwei add*/
+    uint32_t active_channel;
+
 } tivxDLPreProcKernelParams;
 
+static vx_status VX_CALLBACK tivxKernelDLPreProcControl(
+       tivx_target_kernel_instance kernel,
+       uint32_t node_cmd_id, tivx_obj_desc_t *obj_desc[],
+       uint16_t num_params, void *priv_arg);
+
 static tivx_target_kernel vx_dl_pre_proc_target_kernel = NULL;
 
 static vx_status VX_CALLBACK tivxKernelDLPreProcCreate
@@ -485,6 +493,96 @@ static vx_status VX_CALLBACK tivxKernelDLPreProcDelete(
     return (status);
 }
 
+
+static vx_status tivxPreProcSwitchChannel(tivxDLPreProcKernelParams *preproc,
+    const tivx_obj_desc_user_data_object_t *usr_data_obj)
+{
+    vx_status                             status = (vx_status)VX_SUCCESS;
+    tivx_preproc_select_channel_params_t *ch_prms = NULL;
+    void                                 *target_ptr;
+
+    if (NULL != usr_data_obj)
+    {
+        target_ptr = tivxMemShared2TargetPtr(&usr_data_obj->mem_ptr);
+
+        tivxCheckStatus(&status, tivxMemBufferMap(target_ptr, usr_data_obj->mem_size,
+            (vx_enum)VX_MEMORY_TYPE_HOST, (vx_enum)VX_READ_ONLY));
+
+        if (sizeof(tivx_preproc_select_channel_params_t) ==
+                usr_data_obj->mem_size)
+        {
+            ch_prms = (tivx_preproc_select_channel_params_t *)target_ptr;
+            preproc->active_channel = ch_prms->active_channel_id;
+        }
+        else
+        {
+            VX_PRINT(VX_ZONE_ERROR, "Invalid Size \n");
+            status = (vx_status)VX_ERROR_INVALID_PARAMETERS;
+        }
+
+        tivxCheckStatus(&status, tivxMemBufferUnmap(target_ptr, usr_data_obj->mem_size,
+            (vx_enum)VX_MEMORY_TYPE_HOST, (vx_enum)VX_READ_ONLY));
+    }
+    else
+    {
+        VX_PRINT(VX_ZONE_ERROR, "User Data Object is NULL \n");
+        status = (vx_status)VX_ERROR_INVALID_PARAMETERS;
+    }
+
+    return (status);
+}
+
+static vx_status VX_CALLBACK tivxKernelDLPreProcControl(
+       tivx_target_kernel_instance kernel,
+       uint32_t node_cmd_id, tivx_obj_desc_t *obj_desc[],
+       uint16_t num_params, void *priv_arg)
+{
+    vx_status            status = (vx_status)VX_SUCCESS;
+    uint32_t             size;
+    tivxDLPreProcKernelParams   *preproc = NULL;
+
+    status = tivxGetTargetKernelInstanceContext(kernel,
+        (void **)&preproc, &size);
+
+    if ((vx_status)VX_SUCCESS != status)
+    {
+        VX_PRINT(VX_ZONE_ERROR, "Failed to Get Target Kernel Instance Context\n");
+    }
+    else if ((NULL == preproc) ||
+        (sizeof(tivxDLPreProcKernelParams) != size))
+    {
+        VX_PRINT(VX_ZONE_ERROR, "Invalid Object Size\n");
+        status = (vx_status)VX_FAILURE;
+    }
+    else
+    {
+        /* do nothing */
+    }
+
+    if ((vx_status)VX_SUCCESS == status)
+    {
+        switch (node_cmd_id)
+        {
+            case TIVX_PREPROC_SELECT_CHANNEL:
+            {
+                status = tivxPreProcSwitchChannel(preproc,
+                    (tivx_obj_desc_user_data_object_t *)obj_desc[0U]);
+                break;
+            }
+            default:
+            {
+                VX_PRINT(VX_ZONE_ERROR, "Invalid Command Id\n");
+                status = (vx_status)VX_FAILURE;
+                break;
+            }
+        }
+    }
+
+    return (status);
+}
+
+
 static inline void convertYCbCrToRGB(int32_t Y, int32_t Cb, int32_t Cr, float *R, float *G, float *B, float min_val, float max_val)
 {
     Y  = Y - 16;
@@ -2390,7 +2488,7 @@ void tivxAddTargetKernelDLPreProc()
                                             tivxKernelDLPreProcProcess,
                                             tivxKernelDLPreProcCreate,
                                             tivxKernelDLPreProcDelete,
-                                            NULL,
+                                            tivxKernelDLPreProcControl,
                                             NULL
                                         );
     }
(END)

    Fullscreen 2158.tivx_img_proc_kernels.h.txt Download 
    diff --git a/kernels/img_proc/include/TI/tivx_img_proc_kernels.h b/kernels/img_proc/include/TI/tivx_img_proc_kernels.h
index 2b4f206..3ed4ef8 100644
--- a/kernels/img_proc/include/TI/tivx_img_proc_kernels.h
+++ b/kernels/img_proc/include/TI/tivx_img_proc_kernels.h
@@ -227,6 +227,15 @@ extern "C" {
 #define TIVX_DL_COLOR_BLEND_MAX_CLASSES    (256U)
 #define TIVX_DL_COLOR_BLEND_MAX_COLORS     (3U)
 
+#define TIVX_PREPROC_SELECT_CHANNEL         (0x11100000u)
+
+typedef struct
+{
+    /*! Id of the active channel to be displayed */
+    uint32_t                   active_channel_id;
+} tivx_preproc_select_channel_params_t;
+
 /*!
  * \brief
  * \ingroup group_vision_apps_kernels_img_proc

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi,

    The implementation looks correct. May I know the error that you are facing?

    Nikhil Dasan said:
    Did the call reach the control function?

    Also are calling the node send command after vxVerifyGraph()?

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    I don't know how to verify this(Did the call reach the control function?),But I call the node send command after vxVerifyGraph().

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    You could verify with logs. Could you let me know what is the error that you are getting? 
    You could add some logs in the newly added control function and check if it is printing on the console.

    Did you make the change in the process function too? i.e. based on this active channel, you would extract the image from the object array. (refer display node process function for the same)

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    The following is the error message encountered, I added some print in the contral function, but it doesn't seem to print out, I didn't modify the process function, I don't quite understand what the display process function does, what else does it need in the display process function?

    Regards,

    Xin

    Fullscreen log (2).txt Download 
    REMOTE_SERVICE: Init ... Done !!!
APP: Init ... Done !!!
captureObj init done!
displayM2MObj init done!
app_init_scaler done!
OK to open file! /opt/vision_apps/test_data/psdkra/tidl_models/tidl_io_peele_300_1.bin
OK to open file! /opt/vision_apps/test_data/psdkra/tidl_models/tidl_net_peele_300.bin
Computing checksum at 0x0000FFFFA22D0FC0, size = 6853104
createOutputTensors: ioBufDesc->numOutputBuf=1
createOutputTensors: id = 0, input_width = 1024, input_height= 512
createOutputTensors: id = 0, output_width = W(1405) + L(0) + R(0)
createOutputTensors: id = 0, output_height = H(1) + T(0) + B(0)
createOutputTensors: id = 0, output_channels = outNumChannels(1)
app_init_tidl done!
OD Pre Proc Update Done!
OD Pre Proc init done!
Draw detections Update Done!
width=960, height=540, num_ch=4
Draw Detections Init Done!
app_init_display done!
is_enable_gui = 1
graph Set Reference Name  Success !!
Capture graph done !
DisplayM2M graph done !
replicate[0] = 1
scaler replicate[1] = 1, Scalre: W(960), H(540)
scaler replicate[2] = 1, Scalre: W(960), H(540)
scaler replicate[3] = 1, Scalre: W(1280), H(960)
scaler replicate[4] = 1, Scalre: W(1280), H(960)
scaler replicate[5] = 0, Scalre: W(1280), H(960)
Scaler graph done !
PreProcObj graph done!
odTIDLObj graph done!
drawDetectionsObj graph done!
Display graph done !
set node parameter done...
vx verify graph done...
App Send Scaler Command Done!
Export Graph To Dot Done...
vxSetGraphScheduleConfig done
app_create_graph exiting
success to start remote service!!!
    11.089220 s: CIO: Init ... Done !!!
    11.089292 s: ### CPU Frequency = 1000000000 Hz
    11.089334 s: CPU is running FreeRTOS
    11.089362 s: APP: Init ... !!!
    11.089386 s: SCICLIENT: Init ... !!!
    11.089651 s: SCICLIENT: DMSC FW version [8.5.2--v08.05.02 (Chill Capybar]
    11.089703 s: SCICLIENT: DMSC FW revision 0x8
    11.089736 s: SCICLIENT: DMSC FW ABI revision 3.1
    11.089771 s: SCICLIENT: Init ... Done !!!
    11.089797 s: UDMA: Init ... !!!
    11.091234 s: UDMA: Init ... Done !!!
    11.091297 s: MEM: Init ... !!!
    11.091342 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ db000000 of size 16777216 bytes !!!
    11.091419 s: MEM: Created heap (L3_MEM, id=1, flags=0x00000000) @ 3600000 of size 262144 bytes !!!
    11.091483 s: MEM: Init ... Done !!!
    11.091509 s: IPC: Init ... !!!
    11.091570 s: IPC: 6 CPUs participating in IPC !!!
    11.091618 s: IPC: Waiting for HLOS to be ready ... !!!
    11.091669 s: IPC: HLOS is ready !!!
    11.106884 s: IPC: Init ... Done !!!
    11.106951 s: APP: Syncing with 5 CPUs ... !!!
    11.963519 s: APP: Syncing with 5 CPUs ... Done !!!
    11.963704 s: REMOTE_SERVICE: Init ... !!!
    11.965377 s: REMOTE_SERVICE: Init ... Done !!!
    11.965441 s: FVID2: Init ... !!!
    11.965517 s: FVID2: Init ... Done !!!
    11.965577 s: DSS: Init ... !!!
    11.965608 s: DSS: Display type is HDMI !!!
    11.965649 s: DSS: M2M Path is enabled !!!
    11.965679 s: DSS: SoC init ... !!!
    11.965705 s: SCICLIENT: Sciclient_pmSetModuleState module=152 state=2
    11.965942 s: SCICLIENT: Sciclient_pmSetModuleState success
    11.965982 s: SCICLIENT: Sciclient_pmSetModuleClkParent module=152 clk=4 parent=6
    11.966136 s: SCICLIENT: Sciclient_pmSetModuleClkParent success
    11.966177 s: SCICLIENT: Sciclient_pmSetModuleClkFreq module=152 clk=4 freq=61875000
    11.968170 s: SCICLIENT: Sciclient_pmSetModuleClkFreq success
    11.968209 s: SCICLIENT: Sciclient_pmModuleClkRequest module=152 clk=4 state=2 flag=0
    11.968812 s: SCICLIENT: Sciclient_pmModuleClkRequest success
    11.968849 s: DSS: SoC init ... Done !!!
    11.968877 s: DSS: Board init ... !!!
    11.973652 s: DSS: Board init ... Done !!!
    11.976703 s: DSS: Init ... Done !!!
    11.976768 s: VHWA: VPAC Init ... !!!
    11.976798 s: SCICLIENT: Sciclient_pmSetModuleState module=290 state=2
    11.977110 s: SCICLIENT: Sciclient_pmSetModuleState success
    11.977150 s: VHWA: LDC Init ... !!!
    11.981945 s: VHWA: LDC Init ... Done !!!
    11.982007 s: VHWA: MSC Init ... !!!
    11.994348 s: VHWA: MSC Init ... Done !!!
    11.994413 s: VHWA: NF Init ... !!!
    11.996204 s: VHWA: NF Init ... Done !!!
    11.996260 s: VHWA: VISS Init ... !!!
    12.007223 s: VHWA: VISS Init ... Done !!!
    12.007287 s: VHWA: VPAC Init ... Done !!!
    12.007336 s:  VX_ZONE_INIT:Enabled
    12.007366 s:  VX_ZONE_ERROR:Enabled
    12.007393 s:  VX_ZONE_WARNING:Enabled
    12.008581 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target MCU2-0
    12.008847 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target VPAC_NF
    12.009081 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target VPAC_LDC1
    12.009317 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target VPAC_MSC1
    12.009537 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target VPAC_MSC2
    12.009840 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target VPAC_VISS1
    12.010114 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE1
    12.010385 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE2
    12.010661 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DISPLAY1
    12.010914 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DISPLAY2
    12.011150 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CSITX
    12.011412 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE3
    12.011678 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE4
    12.011960 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE5
    12.012228 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE6
    12.012489 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE7
    12.012773 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target CAPTURE8
    12.013041 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DSS_M2M1
    12.013287 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DSS_M2M2
    12.013531 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DSS_M2M3
    12.013785 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DSS_M2M4
    12.013844 s:  VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
    12.013882 s: APP: OpenVX Target kernel init ... !!!
    12.036380 s: APP: OpenVX Target kernel init ... Done !!!
    12.036440 s: CSI2RX: Init ... !!!
    12.036468 s: SCICLIENT: Sciclient_pmSetModuleState module=25 state=2
    12.036611 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.036660 s: SCICLIENT: Sciclient_pmSetModuleState module=26 state=2
    12.036838 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.036871 s: SCICLIENT: Sciclient_pmSetModuleState module=27 state=2
    12.037026 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.037058 s: SCICLIENT: Sciclient_pmSetModuleState module=147 state=2
    12.037166 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.037197 s: SCICLIENT: Sciclient_pmSetModuleState module=148 state=2
    12.037304 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.037507 s: CSI2RX: Init ... Done !!!
    12.037546 s: CSI2TX: Init ... !!!
    12.037570 s: SCICLIENT: Sciclient_pmSetModuleState module=25 state=2
    12.037676 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.037711 s: SCICLIENT: Sciclient_pmSetModuleState module=28 state=2
    12.037869 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.037901 s: SCICLIENT: Sciclient_pmSetModuleState module=296 state=2
    12.038036 s: SCICLIENT: Sciclient_pmSetModuleState success
    12.038111 s: CSI2TX: Init ... Done !!!
    12.038144 s: ISS: Init ... !!!
    12.038182 s: IssSensor_Init ... Done !!!
    12.038246 s: IttRemoteServer_Init ... Done !!!
    12.038282 s: VISS REMOTE SERVICE: Init ... !!!
    12.038344 s: VISS REMOTE SERVICE: Init ... Done !!!
    12.038380 s: UDMA Copy: Init ... !!!
    12.040242 s: UDMA Copy: Init ... Done !!!
    12.040341 s: APP: Init ... Done !!!
    12.040378 s: APP: Run ... !!!
    12.040403 s: IPC: Starting echo test ...
    12.043319 s: APP: Run ... Done !!!
    12.044890 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[P] C66X_1[.] C66X_2[.] C7X_1[.]
    12.045014 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[P] C66X_1[P] C66X_2[.] C7X_1[.]
    12.045111 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[P] C66X_1[P] C66X_2[P] C7X_1[.]
    12.045206 s: IPC: Echo status: mpu1_0[x] mcu2_0[s] mcu2_1[P] C66X_1[P] C66X_2[P] C7X_1[P]
    11.193050 s: CIO: Init ... Done !!!
    11.193118 s: ### CPU Frequency = 1000000000 Hz
    11.193159 s: CPU is running FreeRTOS
    11.193185 s: APP: Init ... !!!
    11.193208 s: SCICLIENT: Init ... !!!
    11.193470 s: SCICLIENT: DMSC FW version [8.5.2--v08.05.02 (Chill Capybar]
    11.193519 s: SCICLIENT: DMSC FW revision 0x8
    11.193553 s: SCICLIENT: DMSC FW ABI revision 3.1
    11.193605 s: SCICLIENT: Init ... Done !!!
    11.193634 s: UDMA: Init ... !!!
    11.195189 s: UDMA: Init ... Done !!!
    11.195250 s: MEM: Init ... !!!
    11.195292 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ dc000000 of size 16777216 bytes !!!
    11.195365 s: MEM: Created heap (L3_MEM, id=1, flags=0x00000001) @ 3640000 of size 262144 bytes !!!
    11.195425 s: MEM: Init ... Done !!!
    11.195451 s: IPC: Init ... !!!
    11.195512 s: IPC: 6 CPUs participating in IPC !!!
    11.195561 s: IPC: Waiting for HLOS to be ready ... !!!
    11.195615 s: IPC: HLOS is ready !!!
    11.210798 s: IPC: Init ... Done !!!
    11.210862 s: APP: Syncing with 5 CPUs ... !!!
    11.963517 s: APP: Syncing with 5 CPUs ... Done !!!
    11.963709 s: REMOTE_SERVICE: Init ... !!!
    11.965274 s: REMOTE_SERVICE: Init ... Done !!!
    11.965337 s: FVID2: Init ... !!!
    11.965407 s: FVID2: Init ... Done !!!
    11.965440 s: VHWA: DMPAC: Init ... !!!
    11.965466 s: SCICLIENT: Sciclient_pmSetModuleState module=48 state=2
    11.965691 s: SCICLIENT: Sciclient_pmSetModuleState success
    11.965734 s: SCICLIENT: Sciclient_pmSetModuleState module=305 state=2
    11.966040 s: SCICLIENT: Sciclient_pmSetModuleState success
    11.966076 s: VHWA: DOF Init ... !!!
    11.976997 s: VHWA: DOF Init ... Done !!!
    11.977064 s: VHWA: SDE Init ... !!!
    11.981002 s: VHWA: SDE Init ... Done !!!
    11.981062 s: VHWA: DMPAC: Init ... Done !!!
    11.981106 s:  VX_ZONE_INIT:Enabled
    11.981135 s:  VX_ZONE_ERROR:Enabled
    11.981161 s:  VX_ZONE_WARNING:Enabled
    11.982352 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target MCU2-1
    11.982600 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DMPAC_SDE
    11.982829 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:66] Added target DMPAC_DOF
    11.982886 s:  VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
    11.982924 s: APP: OpenVX Target kernel init ... !!!
    11.983200 s: APP: OpenVX Target kernel init ... Done !!!
    11.983241 s: UDMA Copy: Init ... !!!
    11.985280 s: UDMA Copy: Init ... Done !!!
    11.985347 s: APP: Init ... Done !!!
    11.985379 s: APP: Run ... !!!
    11.985405 s: IPC: Starting echo test ...
    11.987959 s: APP: Run ... Done !!!
    11.989197 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[s] C66X_1[P] C66X_2[.] C7X_1[.]
    11.989310 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[s] C66X_1[P] C66X_2[P] C7X_1[.]
    11.989403 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[s] C66X_1[P] C66X_2[P] C7X_1[P]
    12.044137 s: IPC: Echo status: mpu1_0[x] mcu2_0[P] mcu2_1[s] C66X_1[P] C66X_2[P] C7X_1[P]
    10.989483 s: CIO: Init ... Done !!!
    10.989508 s: ### CPU Frequency = 1350000000 Hz
    10.989519 s: CPU is running FreeRTOS
    10.989527 s: APP: Init ... !!!
    10.989534 s: SCICLIENT: Init ... !!!
    10.989762 s: SCICLIENT: DMSC FW version [8.5.2--v08.05.02 (Chill Capybar]
    10.989774 s: SCICLIENT: DMSC FW revision 0x8
    10.989783 s: SCICLIENT: DMSC FW ABI revision 3.1
    10.989793 s: SCICLIENT: Init ... Done !!!
    10.989802 s: UDMA: Init ... !!!
    10.991443 s: UDMA: Init ... Done !!!
    10.991462 s: MEM: Init ... !!!
    10.991476 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ de000000 of size 16777216 bytes !!!
    10.991494 s: MEM: Created heap (L2_MEM, id=2, flags=0x00000001) @ 800000 of size 229376 bytes !!!
    10.991509 s: MEM: Created heap (DDR_SCRATCH_MEM, id=4, flags=0x00000001) @ df000000 of size 50331648 bytes !!!
    10.991525 s: MEM: Init ... Done !!!
    10.991534 s: IPC: Init ... !!!
    10.991556 s: IPC: 6 CPUs participating in IPC !!!
    10.991571 s: IPC: Waiting for HLOS to be ready ... !!!
    10.991584 s: IPC: HLOS is ready !!!
    10.995336 s: IPC: Init ... Done !!!
    10.995360 s: APP: Syncing with 5 CPUs ... !!!
    11.963516 s: APP: Syncing with 5 CPUs ... Done !!!
    11.963529 s: REMOTE_SERVICE: Init ... !!!
    11.964187 s: REMOTE_SERVICE: Init ... Done !!!
    11.964223 s:  VX_ZONE_INIT:Enabled
    11.964236 s:  VX_ZONE_ERROR:Enabled
    11.964250 s:  VX_ZONE_WARNING:Enabled
    11.967545 s:  VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
    11.967560 s: APP: OpenVX Target kernel init ... !!!
    11.967877 s: APP: OpenVX Target kernel init ... Done !!!
    11.967891 s: UDMA Copy: Init ... !!!
    11.971873 s: UDMA Copy: Init ... Done !!!
    11.971892 s: APP: Init ... Done !!!
    11.971901 s: APP: Run ... !!!
    11.971910 s: IPC: Starting echo test ...
    11.972997 s: APP: Run ... Done !!!
    11.973378 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[s] C66X_2[.] C7X_1[P]
    11.973634 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[s] C66X_2[P] C7X_1[P]
    11.988523 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[P] C66X_1[s] C66X_2[P] C7X_1[P]
    12.043991 s: IPC: Echo status: mpu1_0[x] mcu2_0[P] mcu2_1[P] C66X_1[s] C66X_2[P] C7X_1[P]
    11.401160 s: CIO: Init ... Done !!!
    11.401195 s: ### CPU Frequency = 1350000000 Hz
    11.401208 s: CPU is running FreeRTOS
    11.401217 s: APP: Init ... !!!
    11.401226 s: SCICLIENT: Init ... !!!
    11.401466 s: SCICLIENT: DMSC FW version [8.5.2--v08.05.02 (Chill Capybar]
    11.401480 s: SCICLIENT: DMSC FW revision 0x8
    11.401491 s: SCICLIENT: DMSC FW ABI revision 3.1
    11.401503 s: SCICLIENT: Init ... Done !!!
    11.401512 s: UDMA: Init ... !!!
    11.403385 s: UDMA: Init ... Done !!!
    11.403411 s: MEM: Init ... !!!
    11.403430 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ e2000000 of size 16777216 bytes !!!
    11.403451 s: MEM: Created heap (L2_MEM, id=2, flags=0x00000001) @ 800000 of size 229376 bytes !!!
    11.403470 s: MEM: Created heap (DDR_SCRATCH_MEM, id=4, flags=0x00000001) @ e3000000 of size 50331648 bytes !!!
    11.403487 s: MEM: Init ... Done !!!
    11.403497 s: IPC: Init ... !!!
    11.403523 s: IPC: 6 CPUs participating in IPC !!!
    11.403539 s: IPC: Waiting for HLOS to be ready ... !!!
    11.403551 s: IPC: HLOS is ready !!!
    11.408221 s: IPC: Init ... Done !!!
    11.408249 s: APP: Syncing with 5 CPUs ... !!!
    11.963516 s: APP: Syncing with 5 CPUs ... Done !!!
    11.963529 s: REMOTE_SERVICE: Init ... !!!
    11.964208 s: REMOTE_SERVICE: Init ... Done !!!
    11.964245 s:  VX_ZONE_INIT:Enabled
    11.964256 s:  VX_ZONE_ERROR:Enabled
    11.964265 s:  VX_ZONE_WARNING:Enabled
    11.967556 s:  VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
    11.967571 s: APP: OpenVX Target kernel init ... !!!
    11.967896 s: APP: OpenVX Target kernel init ... Done !!!
    11.967912 s: UDMA Copy: Init ... !!!
    11.972037 s: UDMA Copy: Init ... Done !!!
    11.972057 s: APP: Init ... Done !!!
    11.972066 s: APP: Run ... !!!
    11.972076 s: IPC: Starting echo test ...
    11.973251 s: APP: Run ... Done !!!
    11.973572 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[P] C66X_2[s] C7X_1[.]
    11.973630 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[P] C66X_2[s] C7X_1[P]
    11.988550 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[P] C66X_1[P] C66X_2[s] C7X_1[P]
    12.044017 s: IPC: Echo status: mpu1_0[x] mcu2_0[P] mcu2_1[P] C66X_1[P] C66X_2[s] C7X_1[P]
    11.959732 s: CIO: Init ... Done !!!
    11.959747 s: ### CPU Frequency = 1000000000 Hz
    11.959758 s: CPU is running FreeRTOS
    11.959766 s: APP: Init ... !!!
    11.959773 s: SCICLIENT: Init ... !!!
    11.960004 s: SCICLIENT: DMSC FW version [8.5.2--v08.05.02 (Chill Capybar]
    11.960017 s: SCICLIENT: DMSC FW revision 0x8
    11.960027 s: SCICLIENT: DMSC FW ABI revision 3.1
    11.960038 s: SCICLIENT: Init ... Done !!!
    11.960047 s: UDMA: Init ... !!!
    11.961297 s: UDMA: Init ... Done !!!
    11.961309 s: MEM: Init ... !!!
    11.961320 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ 117000000 of size 268435456 bytes !!!
    11.961340 s: MEM: Created heap (L3_MEM, id=1, flags=0x00000001) @ 70020000 of size 8159232 bytes !!!
    11.961358 s: MEM: Created heap (L2_MEM, id=2, flags=0x00000001) @ 64800000 of size 458752 bytes !!!
    11.961375 s: MEM: Created heap (L1_MEM, id=3, flags=0x00000001) @ 64e00000 of size 16384 bytes !!!
    11.961392 s: MEM: Created heap (DDR_SCRATCH_MEM, id=4, flags=0x00000001) @ 100000000 of size 385875968 bytes !!!
    11.961411 s: MEM: Init ... Done !!!
    11.961419 s: IPC: Init ... !!!
    11.961433 s: IPC: 6 CPUs participating in IPC !!!
    11.961448 s: IPC: Waiting for HLOS to be ready ... !!!
    11.961459 s: IPC: HLOS is ready !!!
    11.963490 s: IPC: Init ... Done !!!
    11.963503 s: APP: Syncing with 5 CPUs ... !!!
    11.963517 s: APP: Syncing with 5 CPUs ... Done !!!
    11.963528 s: REMOTE_SERVICE: Init ... !!!
    11.963679 s: REMOTE_SERVICE: Init ... Done !!!
    11.963701 s:  VX_ZONE_INIT:Enabled
    11.963712 s:  VX_ZONE_ERROR:Enabled
    11.963722 s:  VX_ZONE_WARNING:Enabled
    11.963861 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1
    11.963957 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_2
    11.964020 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_3
    11.964125 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_4
    11.964190 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_5
    11.964254 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_6
    11.964365 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_7
    11.964432 s:  VX_ZONE_INIT:[tivxPlatformCreateTargetId:59] Added target DSP_C7-1_PRI_8
    11.964454 s:  VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
    11.964467 s: APP: OpenVX Target kernel init ... !!!
    11.964615 s: APP: OpenVX Target kernel init ... Done !!!
    11.964628 s: APP: Init ... Done !!!
    11.964637 s: APP: Run ... !!!
    11.964644 s: IPC: Starting echo test ...
    11.964802 s: APP: Run ... Done !!!
    11.973371 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[P] C66X_2[.] C7X_1[s]
    11.973628 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[x] C66X_1[P] C66X_2[P] C7X_1[s]
    11.988570 s: IPC: Echo status: mpu1_0[x] mcu2_0[x] mcu2_1[P] C66X_1[P] C66X_2[P] C7X_1[s]
    12.044067 s: IPC: Echo status: mpu1_0[x] mcu2_0[P] mcu2_1[P] C66X_1[P] C66X_2[P] C7X_1[s]
[2023-07-31 10:52:52.389906] [A72   ] [app_log_linux.c     ] [INF]  GTC Frequency = 200 MHz
[2023-07-31 10:52:52.389992] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_INIT:Enabled
[2023-07-31 10:52:52.389996] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:Enabled
[2023-07-31 10:52:52.389999] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_WARNING:Enabled
[2023-07-31 10:52:52.390693] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_INIT:[tivxInitLocal:145] Initialization Done !!!
[2023-07-31 10:52:52.391892] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    47.564514 s:  REMOTE_SERVICE_SENSOR: Received command 00001002 to configure 4 sensor(s) !!!
    47.564685 s:  REMOTE_SERVICE_SENSOR: IMX390: numSensors 4 portNum 1
    47.564749 s:  REMOTE_SERVICE_SENSOR: IMX390: Configuring MAX96722  portIdMap=0 ... !!!
    47.713267 s:  REMOTE_SERVICE_SENSOR: Sensor(s) configuration done !!!
active_channel_id:3
App Send Preproc Command Done!
PreProc: Node send command failed!
delete app...
Capture Node delete done!
DisplayM2M Node delete done!
Scaler Node delete done!
PreProcObj delete done!
odTIDLObj delete done!
drawDetectionsObj delete done!
MOSAIC Node delete done!
Display Node delete done!
Graph delete done!
deinit app...
app_deinit_capture done
app_deinit_displayM2M done
app_deinit_scaler done
PreProcObj deinit done!
odTIDLObj deinit done!
Draw detections deinit Done!
Mosaic deinit Done!
app_deinit_display done
app_deinit_switch_ch_obj done
app_deinit_switch_preproc_ch_obj done
[2023-07-31 10:52:57.500629] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownContextSendControlCmd:681] Command ack message returned failure cmd_status: -1
[2023-07-31 10:52:57.500672] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownContextSendControlCmd:718] tivxEventWait() failed.
    51.852575 s:  VX_ZONE_ERROR:[ownTargetKernelControl:430] Kernel control function is NULL
    51.852596 s:  VX_ZONE_ERROR:[ownTargetNodeDescNodeControl:1007] SendCommand Failed
    52.110696 s: ==========================================================
appGrpxDeInit done
tivxHwaUnLoadKernels done
tivxFileIOUnLoadKernels done
tivxTIDLUnLoadKernels done
tivxImgProcUnLoadKernels done
vxReleaseContext  done
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
DDR_SHARED_MEM: Alloc's: 143 alloc's of 158460844 bytes
DDR_SHARED_MEM: Free's : 143 free's  of 158460844 bytes
DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes
DDR_SHARED_MEM: Total size: 536870912 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!
root@Linux:~#     52.110798 s:  Capture Status: Instance|0
    52.110833 s: ==========================================================
    52.110880 s:  overflowCount: 0
    52.110918 s:  spuriousUdmaIntrCount: 0
    52.110956 s:  frontFIFOOvflCount: 0
    52.110991 s:  crcCount: 0
    52.111022 s:  eccCount: 0
    52.111057 s:  correctedEccCount: 0
    52.111091 s:  dataIdErrorCount: 0
    52.111127 s:  invalidAccessCount: 0
    52.111163 s:  invalidSpCount: 0
    52.111204 s:  strmFIFOOvflCount[0]: 0
    52.111248 s:  strmFIFOOvflCount[1]: 0
    52.111280 s:  Channel Num | Frame Queue Count | Frame De-queue Count | Frame Drop Count | Error Frame Count |
    52.111359 s:            0 |               104 |                  104 |                6 |                 0 |
    52.111437 s:            1 |               104 |                  104 |                6 |                 0 |
    52.111516 s:            2 |               104 |                  104 |                6 |                 0 |
    52.111593 s:            3 |               104 |                  104 |                6 |                 0 |
    52.145710 s: ==========================================================
    52.145811 s:  Display M2M Status: Instance|0
    52.145851 s: ==========================================================
    52.145900 s:  Queue Count: 102
    52.145936 s:  De-queue Count: 102
    52.145975 s:  Write-back Frames Count: 102
    52.146013 s:  Underflow Count: 0
    52.146111 s: ==========================================================
    52.146174 s:  Display M2M Status: Instance|0
    52.146209 s: ==========================================================
    52.146255 s:  Queue Count: 102
    52.146291 s:  De-queue Count: 102
    52.146329 s:  Write-back Frames Count: 102
    52.146367 s:  Underflow Count: 0
    52.146443 s: ==========================================================
    52.146502 s:  Display M2M Status: Instance|0
    52.146535 s: ==========================================================
    52.146580 s:  Queue Count: 102
    52.146614 s:  De-queue Count: 102
    52.146668 s:  Write-back Frames Count: 102
    52.146708 s:  Underflow Count: 0
    52.146786 s: ==========================================================
    52.146846 s:  Display M2M Status: Instance|0
    52.146880 s: ==========================================================
    52.146926 s:  Queue Count: 102
    52.146960 s:  De-queue Count: 102
    52.146997 s:  Write-back Frames Count: 102
    52.147036 s:  Underflow Count: 0
[2023-07-31 10:52:57.808632] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownReleaseReferenceInt:294] Invalid reference
[2023-07-31 10:52:57.808663] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownReleaseReferenceInt:294] Invalid reference
[2023-07-31 10:52:57.808666] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownReleaseReferenceInt:294] Invalid reference
[2023-07-31 10:52:57.808669] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownReleaseReferenceInt:294] Invalid reference
[2023-07-31 10:52:57.808672] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_ERROR:[ownReleaseReferenceInt:294] Invalid reference
[2023-07-31 10:52:58.305843] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_WARNING:[vxReleaseContext:1060] Found a reference 0xffffae9c08a8 of type 0000080f at external count 1, internal count 0, releasing it
[2023-07-31 10:52:58.305855] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_WARNING:[vxReleaseContext:1062] Releasing reference (name=image_104) now as a part of garbage collection
[2023-07-31 10:52:58.305886] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!!
[2023-07-31 10:52:58.310284] [A72   ] [tivx_platform.c     ] [INF]   VX_ZONE_INIT:[tivxDeInitLocal:223] De-Initialization Done !!!

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    The error log shows that the control command is not registered on the target.

    Could you please confirm if the tivxAddTargetKernelDLPreProc() is being called by putting some logs into it?

    May I know on which target are you running this node? Is it on C66 DSP itself?

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi NIkhil,

    I think tivxAddTargetKernelDLPreProc () is called, because I am during program execution to the 100th cycle for DL preproc node sends the control command, before sending the application can run normally. DL preproc node This node runs the target of TI default, I have not changed it, here is the definition I see:

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I am suspecting that the control function that you have added in the tivxAddTargetKernelDLPreProc() is not reflected in the build. 
    To confirm this, could you put a log in this function and see if it is getting printed (To ensure that the target file got built after your changes)

    51.852575 s: VX_ZONE_ERROR:[ownTargetKernelControl:430] Kernel control function is NULL
    51.852596 s: VX_ZONE_ERROR:[ownTargetNodeDescNodeControl:1007] SendCommand Failed

    The above logs states that the control function is still NULL in the kernel.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    I recompiled the SDK with these changes, but it still reported that the control functions were empty. What was the cause?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I tried inserting control command in the tivxImgPreProcNode ( As DL node was not readily used in the SDK demos) and I was able to reach and print the message in the control function. I included this in the vision_apps object detection demo.

    Please refer the below patch on vision_apps folder in SDK 8.6

    https://e2e.ti.com/cfs-file/__key/communityserver-discussions-components-files/791/vision_5F00_apps_5F00_preproc_5F00_controlCmd.patch

    The same should work for tivxDLPreProcNode

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi NIkhil,

    I refer to your patch add print log in the control function.but it still print "Kernel control function is NULL",I think the question now is why is the control function empty? Why didn't the changes I added take effect after compilation? How does the host side connect to the target side when the program is running? Do my host side and target side not correspond?

    Regards,

    Xin

  • 0 in reply to xiu xin
    Intellectual 280 points

    Hi NIkhil,

    I managed to send the control command, but it failed earlier because the target side of my DL preproc node was not vx_dl_pre_proc_target.c, but vx_image_preprocessing_target.c.

    The command was sent successfully, but it is not convenient for testing. I am not sure whether it works. I would like to know whether displayM2M node also supports selecting channels to facilitate testing

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I am assuming that now you could send a control command from the application to the control API of the target right?

    xiu xin said:
    I would like to know whether displayM2M node also supports selecting channels to facilitate testing

    Currently, in the SDK, only the display node has this active channel selection implementation.

    Since you already have the active channel implementation in place, all you have to do is to use it in the process function of the node.

    Please refer the implementation of "active_channel" in the process function of the display node. You could see that based on the active channel you have selected, tivxGetObjDescElement() would take only the object descriptor corresponding to the active channel and use it for processing.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi NIkhil,

    After I added "active_channel" functionality to the process function of vx_image_preprocessing_target.c via tivxGetObjDescElement(), the program stopped running. Taking the vision_apps object detection demo as an example, the input of DL preproc node comes from scaler node. When DL preproc node adds the selection channel function, Does DL preproc node need replicated node enabled and how is num_ch set? Here are the changes I made to vx_image_preprocessing_target.c:

    Regards,

    Xin

    Fullscreen vx_image_preprocessing_target.c.txt Download 
    diff --git a/kernels/img_proc/c66/vx_image_preprocessing_target.c b/kernels/img_proc/c66/vx_image_preprocessing_target.c
index 56d27ca..757b532 100644
--- a/kernels/img_proc/c66/vx_image_preprocessing_target.c
+++ b/kernels/img_proc/c66/vx_image_preprocessing_target.c
@@ -61,7 +61,7 @@
 */
 
 
-
+#include <stdio.h>
 #include <TI/tivx.h>
 #include <TI/tivx_img_proc.h>
 #include <TI/tivx_target_kernel.h>
@@ -129,6 +129,9 @@ typedef struct {
     uint32_t l2_heap_id;
     uint64_t l2_global_base;
 
+    /**< Id of active channel */
+    uint32_t active_channel;
+
 } tivxImgPreProcKernelParams;
 
 static vx_status img_proc_pipeline_blocks_nv12ToRgbp
@@ -192,6 +195,51 @@ static vx_status img_proc_execute_16bit_RgbiToRgbp
     void *out_tensor_target_ptr
 );
 
+static vx_status tivxPreProcSwitchChannel(tivxImgPreProcKernelParams *preproc,
+    const tivx_obj_desc_user_data_object_t *usr_data_obj)
+{
+    vx_status                             status = (vx_status)VX_SUCCESS;
+    tivx_preproc_select_channel_params_t *ch_prms = NULL;
+    void                                 *target_ptr;
+
+    // printf("-----start switch channel ----- \n");
+    if (NULL != usr_data_obj)
+    {
+        target_ptr = tivxMemShared2TargetPtr(&usr_data_obj->mem_ptr);
+
+        tivxCheckStatus(&status, tivxMemBufferMap(target_ptr, usr_data_obj->mem_size,
+            (vx_enum)VX_MEMORY_TYPE_HOST, (vx_enum)VX_READ_ONLY));
+
+        if (sizeof(tivx_preproc_select_channel_params_t) ==
+                usr_data_obj->mem_size)
+        {
+            ch_prms = (tivx_preproc_select_channel_params_t *)target_ptr;
+            preproc->active_channel = ch_prms->active_preproc_channel_id;
+        }
+        else
+        {
+            VX_PRINT(VX_ZONE_ERROR, "Invalid Size \n");
+            status = (vx_status)VX_ERROR_INVALID_PARAMETERS;
+        }
+
+        tivxCheckStatus(&status, tivxMemBufferUnmap(target_ptr, usr_data_obj->mem_size,
+            (vx_enum)VX_MEMORY_TYPE_HOST, (vx_enum)VX_READ_ONLY));
+    }
+    else
+    {
+        VX_PRINT(VX_ZONE_ERROR, "User Data Object is NULL \n");
+        status = (vx_status)VX_ERROR_INVALID_PARAMETERS;
+    }
+
+    return (status);
+}
+
+static vx_status VX_CALLBACK tivxKernelImgPreProcControl(
+       tivx_target_kernel_instance kernel,
+       uint32_t node_cmd_id, tivx_obj_desc_t *obj_desc[],
+       uint16_t num_params, void *priv_arg);
+
+
 static vx_status dma_create(DMAObj *dmaObj, vx_size transfer_type, vx_uint32 dma_ch)
 {
     vx_status status = VX_SUCCESS;
@@ -637,6 +685,58 @@ static vx_status VX_CALLBACK tivxKernelImgPreProcDelete(
     return (status);
 }
 
+static vx_status VX_CALLBACK tivxKernelImgPreProcControl(
+       tivx_target_kernel_instance kernel,
+       uint32_t node_cmd_id, tivx_obj_desc_t *obj_desc[],
+       uint16_t num_params, void *priv_arg)
+{
+    vx_status            status = (vx_status)VX_SUCCESS;
+    uint32_t             size;
+    tivxImgPreProcKernelParams   *preproc = NULL;
+
+    status = tivxGetTargetKernelInstanceContext(kernel,
+        (void **)&preproc, &size);
+
+    if ((vx_status)VX_SUCCESS != status)
+    {
+        VX_PRINT(VX_ZONE_ERROR, "Failed to Get Target Kernel Instance Context\n");
+    }
+    else if ((NULL == preproc) ||
+        (sizeof(tivxImgPreProcKernelParams) != size))
+    {
+        VX_PRINT(VX_ZONE_ERROR, "Invalid Object Size\n");
+        status = (vx_status)VX_FAILURE;
+    }
+    else
+    {
+        /* do nothing */
+        // printf("Success to Get PreProc Target Kernel Instance Context\n");
+    }
+
+    if ((vx_status)VX_SUCCESS == status)
+    {
+        switch (node_cmd_id)
+        {
+            case TIVX_PREPROC_SELECT_CHANNEL:
+            {
+                // printf("hahahahhahhahahahahhahahahahhahaha");
+                status = tivxPreProcSwitchChannel(preproc,
+                    (tivx_obj_desc_user_data_object_t *)obj_desc[0U]);
+                break;
+            }
+            default:
+            {
+                VX_PRINT(VX_ZONE_ERROR, "Invalid Command Id\n");
+                status = (vx_status)VX_FAILURE;
+                break;
+            }
+        }
+    }
+
+    return (status);
+}
+
+
 static vx_status VX_CALLBACK tivxKernelImgPreProcProcess
 (
     tivx_target_kernel_instance kernel,
@@ -691,6 +791,8 @@ static vx_status VX_CALLBACK tivxKernelImgPreProcProcess
 
         tivx_obj_desc_image_t *in_img_desc;
         void* in_image_target_ptr[2];
+        uint32_t active_channel;
+        active_channel = prms->active_channel;
 
         tivx_obj_desc_tensor_t *out_tensor_desc;
         void *out_tensor_target_ptr;
@@ -699,7 +801,14 @@ static vx_status VX_CALLBACK tivxKernelImgPreProcProcess
         configuration_target_ptr = tivxMemShared2TargetPtr(&configuration_desc->mem_ptr);
         tivxMemBufferMap(configuration_target_ptr, configuration_desc->mem_size, VX_MEMORY_TYPE_HOST,VX_READ_ONLY);
 
-        in_img_desc  = (tivx_obj_desc_image_t *)obj_desc[TIVX_KERNEL_IMG_PREPROCESS_INPUT_IMAGE_IDX];
+        // in_img_desc  = (tivx_obj_desc_image_t *)obj_desc[TIVX_KERNEL_IMG_PREPROCESS_INPUT_IMAGE_IDX];
+        in_img_desc = (tivx_obj_desc_image_t *)
+            tivxGetObjDescElement(obj_desc[TIVX_KERNEL_IMG_PREPROCESS_INPUT_IMAGE_IDX],
+                                  active_channel);
+        if (in_img_desc == NULL)
+        {
+            status = (vx_status)VX_FAILURE;
+        }
         in_image_target_ptr[0]  = tivxMemShared2TargetPtr(&in_img_desc->mem_ptr[0]);
         tivxMemBufferMap(in_image_target_ptr[0], in_img_desc->mem_size[0], TIVX_MEMORY_TYPE_DMA, VX_READ_ONLY);
         in_image_target_ptr[1]  = NULL;
@@ -790,7 +899,7 @@ void tivxAddTargetKernelImgPreProc()
                                             tivxKernelImgPreProcProcess,
                                             tivxKernelImgPreProcCreate,
                                             tivxKernelImgPreProcDelete,
-                                            NULL,
+                                            tivxKernelImgPreProcControl,
                                             NULL
                                         );
     }
(END)

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi,

    xiu xin said:
    Taking the vision_apps object detection demo as an example, the input of DL preproc node comes from scaler node. When DL preproc node adds the selection channel function

    I am not sure how your usecase would be similar to the object detection demo flow. 

    Here, the output from the preproc node would be object array of tensors which are generated at a time for multiple channels and fed to the TIDL node.

    As, you DL pre proc node would give only 1 channel output at a time, the TIDL node should also be aware of the same.

    xiu xin said:
    Does DL preproc node need replicated node enabled and how is num_ch set?

    Replicated node is not needed here if you are doing one channel at a time. 

    The object array from which the image is extracted would have the num_ch information.

    The changes that you have done to the process function looks correct. Please check if your application is ready to accept this flow.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    I modified the graph according to the above changes, but the program does not work properly. Can you add the function of DL Preproc node switching channels with app_tidl_od_cam as an example? Looking forward to your reply.

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    app_tidl_od_cam demo is for processing multiple camera input at a time and display the same using a mosaic node so that all camera inputs are visible on the display at a time.

    However, your usecase would be to receive 2 camera input and then process and display only 1 camera at a time right? 

    This would require major changes in the code like removal of replicate nodes, removal of mosaic node etc. 
    I would suggest you share the application source code you have developed as per your usecase which I could review at my end.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    My graph also accepts four cameras, but the images of one channel are randomly selected for deep learning processing. They can also be displayed on the same screen through mosaic node. One image is processed, and the remaining three are original images, which does not affect the addition of switching channel function. Alternatively, you can use the display node to display the post-processed image without creating a mosaic node during the create graph phase. The test case I wrote now is the same as the app_tidl_od_cam demo, but due to the different camera sensor used, the program is slightly different in some places, such as the register configuration, etc. If I send you my demo, it won't actually work well on your computer, it will consume more time. Thank you for your help.

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I shall try to modify the application. I would require some time though as there would be a lot of modifications.

    I shall get back to you with an application by next week. 

    I shall do this with the imgPreProc itself instead of dlPreproc as they should be same.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    Thank you for your patient help and I will look forward to your reply next week.

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Sure, Thank you

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    Is there any good news?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I just realized while planning for the implementation. 
    The active channel selection using control command should be for preproc, tidl and postproc node because you would be doing the full deep learning processing only for one channel right?

    Have you also done the same? Initially I thought the control command was required only for pre-proc.

    May I know what have you done at your end?

    Sorry for the delay in the implementation because of festival holidays here in India this week.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    Celebrate your wonderful holiday.

    What I'm doing so far is just sending a control command to the preprocessor node, using tivxGetObjDescElement() in the corresponding target, and I didn't succeed, and then I realized that I might need to enable replication on the preprocessor node before sending the control command, but when I enabled replication, it didn't work either, I am also currently learning the use of select link in the Tda2 sdk and want to port its functionality to Tda4 for use as a node, if successful this will be a perfect solution as I have seen on the forum that someone has successfully ported it. But I'm not familiar with Tda2 and I'm still working on it.

    Regards,

    Xin

  • 0 in reply to xiu xin
    Intellectual 280 points

    Hi Nikhil,

    Have you implemented switching channels? Do you have any further ideas?

    Regards,

    xin

  • +1 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I have a patch to switch channels in preproc on app_tidl_od_cam application.

    This patch is on SDK 8.6 and has to be applied on vision_apps folder.

    /cfs-file/__key/communityserver-discussions-components-files/791/pre_2D00_proc_5F00_switch.patch

    Here I had to add channel switch to post proc (drawBoxDetection) as well because this was taking reference image from input and that also should be changed when the channel is switched.

    To change the channel, press "c" after running the application in interactive mode.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    According to your patch, I have successfully implemented the switch channel, do you have any suggestions for porting TDA2 select link to TDA4? Is it convenient for the TDA4 SDK to create a select node?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    TDA2 has Link framework and TDA4 supports OpenVX framework. In this the select link and select nodes are not supported. 
    I would suggest using the switch channel itself.

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil,

    TDA4 platform, if from four input channels select the specified two or three channels, how to achieve?

    Regards,

    Xin

  • 0 in reply to xiu xin
    TI__Guru* 89681 points

    Hi Xin,

    I thought your usecase was to process each channel individually which was the reason for the switch channel right?

    xiu xin said:
    select the specified two or three channels

    Do you mean to select 2 or 3 channels in parallel?

    Regards,

    Nikhil

  • 0 in reply to Nikhil Dasan
    Intellectual 280 points

    Hi Nikhil，

    Some post-processing needs to specify one channel, some post-processing needs to specify two or three channels at the same time, how to select two or three channels at the same time?

    Regards

    Xin

  • 0 in reply to xiu xin
    Intellectual 280 points

    Hi Nikhil,

    Since this thread is too long, I have started a new one, if you have any suggestions, please share them in the thread below.

    TDA4VM: How can multiple specified channels be selected simultaneously? - Processors forum - Processors - TI E2E support forums

    Regards,

    Xin