TDA4VEN-Q1: Does TDA4VEN csitx support yuv input？

Ling ling

Intellectual 485 points

Part Number: TDA4VEN-Q1

Tool/software:

Dear experts，

I modify the vision apps（app_multi_cam） to support csitx show.

I have some problems, What input formats does csitx support ?Does csitx supports yuv format input?

If not support, does there are some node to change the format from yuv to rgb?

SDK 10.0 for j722s.

Thanks,

5 months ago

0 Brijesh Jadav 5 months ago

TI__Guru**** 452065 points

Hi Ling,

What issue are you facing for CSITX output? Yes, it does support YUV422 as output format and also as input format.

Regards,

Brijesh

0 Ling ling 5 months ago in reply to Brijesh Jadav

Intellectual 485 points

I read a image in nv12 format and sent it to CSITX. It keep reporting format errors. I don't know what the reason is?

Fullscreen

1
2
3
4
5
6
7
8
9
App Init Done! 
App Create Graph Done! 
 11645.068562 s:  VX_ZONE_ERROR:[tivxAddKernelCsitxValidate:163] image format is invalid 
11645.068588 s:  VX_ZONE_ERROR:[ownGraphNodeKernelValidate:568] node kernel validate failed for kernel com.ti.csitx at index 0
 11645.068601 s:  VX_ZONE_ERROR:[vxVerifyGraph:2132] Node kernel Validate failed
 11645.068613 s:  VX_ZONE_ERROR:[vxVerifyGraph:2311] Graph verify failed
 App Verify Graph Done! 
App Delete Graph Done! 
App De-init Done! 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

App Init Done! 
App Create Graph Done! 
 11645.068562 s:  VX_ZONE_ERROR:[tivxAddKernelCsitxValidate:163] image format is invalid 
11645.068588 s:  VX_ZONE_ERROR:[ownGraphNodeKernelValidate:568] node kernel validate failed for kernel com.ti.csitx at index 0
 11645.068601 s:  VX_ZONE_ERROR:[vxVerifyGraph:2132] Node kernel Validate failed
 11645.068613 s:  VX_ZONE_ERROR:[vxVerifyGraph:2311] Graph verify failed
 App Verify Graph Done! 
App Delete Graph Done! 
App De-init Done!

This is my read image function and sent it to csitx.

Fullscreen

1
2
readInputImageArr(inputFileName, 0, 1280, 720, obj->csitxObj.input_arr[0]);
status = app_create_graph_csitx(obj->graph, &obj->csitxObj, obj->csitxObj.input_arr[0]);
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

readInputImageArr(inputFileName, 0, 1280, 720, obj->csitxObj.input_arr[0]);
status = app_create_graph_csitx(obj->graph, &obj->csitxObj, obj->csitxObj.input_arr[0]);

This is my csitx init and create function.

app_csitx_module.c

Fullscreen

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
#include "app_csitx_module.h"
vx_status app_init_csitx(vx_context context, CsitxObj *csitxObj, char *objName)
{
    vx_status status = VX_SUCCESS;
    uint32_t loopCnt;
  vx_uint32 i = 0;
    vx_image input_image;
    if (vx_true_e == tivxIsTargetEnabled(TIVX_TARGET_CSITX))
    {
        status = VX_SUCCESS;
    }
    else
    {
        printf("app_init_capture failed!! line:%d\n", __LINE__);
        status = VX_FAILURE;
    }
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

#include "app_csitx_module.h"

vx_status app_init_csitx(vx_context context, CsitxObj *csitxObj, char *objName)
{
	vx_status status = VX_SUCCESS;
	uint32_t loopCnt;
  vx_uint32 i = 0;
	vx_image input_image;

	if (vx_true_e == tivxIsTargetEnabled(TIVX_TARGET_CSITX))
	{
		status = VX_SUCCESS;
	}
	else
	{
		printf("app_init_capture failed!! line:%d\n", __LINE__);
		status = VX_FAILURE;
	}

  csitxObj->width 		= DISPLAY_WIDTH;
  csitxObj->height 		= DISPLAY_HEIGHT;
  /*csitxObj->format 		= VX_DF_IMAGE_RGBX;*/
  csitxObj->format 		= VX_DF_IMAGE_NV12;

  /* CSITX Config initialization */
  tivx_csitx_params_init(&csitxObj->cstix_params);
  csitxObj->cstix_params.numInst                          = 1U;
  csitxObj->cstix_params.numCh                            = 0; //1
  csitxObj->cstix_params.instId[0U]                       = CSITX_INST_ID;
  csitxObj->cstix_params.instCfg[0U].rxCompEnable         = (uint32_t)vx_true_e;
  csitxObj->cstix_params.instCfg[0U].rxv1p3MapEnable      = (uint32_t)vx_true_e;
  csitxObj->cstix_params.instCfg[0U].laneBandSpeed        = CSITX_LANE_BAND_SPEED;
  csitxObj->cstix_params.instCfg[0U].laneSpeedMbps        = CSITX_LANE_SPEED_MBPS;
  csitxObj->cstix_params.instCfg[0U].numDataLanes         = 5U;//2u
  csitxObj->cstix_params.instCfg[0U].fifoDepth         = 192;

  for (loopCnt = 0U ;
      loopCnt < csitxObj->cstix_params.instCfg[0U].numDataLanes ;
      loopCnt++)
  {
      csitxObj->cstix_params.instCfg[0U].lanePolarityCtrl[loopCnt] = 0u;
  }
  for (loopCnt = 0U; loopCnt < NUM_CHANNELS; loopCnt++)
  {
      csitxObj->cstix_params.chVcNum[loopCnt]   = loopCnt;
      csitxObj->cstix_params.chInstMap[loopCnt] = CSITX_INST_ID;
  }

  printf("csitx ins %d %d %d\n",csitxObj->cstix_params.instId[0U],csitxObj->cstix_params.instCfg[0U].laneSpeedMbps,csitxObj->cstix_params.instCfg[0U].numDataLanes);

  csitxObj->csitx_params_obj = vxCreateUserDataObject(context, "tivx_csitx_params_t", sizeof(tivx_csitx_params_t), &csitxObj->cstix_params);

	input_image = vxCreateImage(context, csitxObj->width, csitxObj->height, csitxObj->format);
	for (i = 0; i < APP_MAX_BUFQ_DEPTH ; i++)
	{
  	csitxObj->input_arr[i] = vxCreateObjectArray(context, (vx_reference)input_image, 1);
		csitxObj->input_image[i] = (vx_image)vxGetObjectArrayItem((vx_object_array)csitxObj->input_arr[i], 0);
	}
	vxReleaseImage(&input_image);

	status = vxGetStatus((vx_reference)csitxObj->csitx_params_obj);

  return status;
}

vx_status app_create_graph_csitx(vx_graph graph, CsitxObj *csitxObj, vx_object_array input_arr)
{
	vx_status status = VX_SUCCESS;

	csitxObj->node = tivxCsitxNode(graph, csitxObj->csitx_params_obj, input_arr);
	vxSetNodeTarget(csitxObj->node, VX_TARGET_STRING, TIVX_TARGET_CSITX);
	status = vxGetStatus((vx_reference)csitxObj->node);

	return status;
}

void app_delete_csitx(CsitxObj *csitxObj)
{
  if(csitxObj->node != NULL)
  {
    vxReleaseNode(&csitxObj->node);
  }
}

void app_deinit_csitx(CsitxObj *csitxObj)
{
  vx_uint32 i = 0;
	vxReleaseUserDataObject(&csitxObj->csitx_params_obj);

	for (i = 0; i < APP_MAX_BUFQ_DEPTH; i++)
	{
		vxReleaseImage(&csitxObj->input_image[i]);
		vxReleaseObjectArray(&csitxObj->input_arr[i]);
	}
}

0 Brijesh Jadav 5 months ago in reply to Ling ling

TI__Guru**** 452065 points

Hi Ling ling,

There are few issues i am seeing in the app_csitx_module.c file. Can you please correct them?

csitxObj->format = VX_DF_IMAGE_NV12; // NV12 image format is not supported in the CSITX.

csitxObj->cstix_params.instCfg[0U].numDataLanes = 5U;//at max 4 data lanes are supported.

csitxObj->cstix_params.numCh = 0; // This should be set to atleast one.

Regards,

Brijesh

0 Ling ling 5 months ago in reply to Brijesh Jadav

Intellectual 485 points

Hi Brijesh,

I have change it, and read a yuv422 formate picture(out.uyvy) to csitx.

Fullscreen

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
    vx_image  tx_frame_array_item = NULL;
    printf("Initializing Transmit yuv pictures...\n");
    tx_frame_array_item = (vx_image)vxGetObjectArrayItem(obj->csitxObj.input_arr[0], 0);
    if (tx_frame_array_item == NULL)
    {
        printf("%s[%d]vx_frame_array_item create failed\n", __FUNCTION__, __LINE__);
    }
    else
    {
        printf("vxGetObjectArrayItem success\n");
    }
    
    csitx_load_yuvfile(tx_frame_array_item,"output.uyvy");
    
    status = vxReleaseImage(&tx_frame_array_item);
    if(status != VX_SUCCESS)
    {
        printf("%s[%d] tx_frame_array_item Release failed\n", __FUNCTION__, __LINE__);
    }
        printf("Initializing YUV Buffers Done.\n");
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

    vx_image  tx_frame_array_item = NULL;
    printf("Initializing Transmit yuv pictures...\n");
    tx_frame_array_item = (vx_image)vxGetObjectArrayItem(obj->csitxObj.input_arr[0], 0);
    if (tx_frame_array_item == NULL)
    {
        printf("%s[%d]vx_frame_array_item create failed\n", __FUNCTION__, __LINE__);
    }
    else
    {
        printf("vxGetObjectArrayItem success\n");
    }
    
	csitx_load_yuvfile(tx_frame_array_item,"output.uyvy");
	
    status = vxReleaseImage(&tx_frame_array_item);
    if(status != VX_SUCCESS)
    {
        printf("%s[%d] tx_frame_array_item Release failed\n", __FUNCTION__, __LINE__);
    }
        printf("Initializing YUV Buffers Done.\n");

When i run it, It get some failure.

Fullscreen

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
opened the file [output.uyvy]
img_width = 1920        img_height = 1080       img_format = UYVY
dim_x = 1920    dim_y = 1080    stride_x = 2    stride_y = 3840
Initializing Transmit Buffers Done.
App Create Graph Done! 
  1809.705845 s:  VX_ZONE_ERROR:[ownContextSendCmd:885] Command ack message returned failure cmd_status: -1
  1809.705886 s:  VX_ZONE_ERROR:[ownNodeKernelInit:592] Target kernel, TIVX_CMD_NODE_CREATE failed for node node_101
  1809.705899 s:  VX_ZONE_ERROR:[ownNodeKernelInit:593] Please be sure the target callbacks have been registered for this core
  1809.705912 s:  VX_ZONE_ERROR:[ownNodeKernelInit:594] If the target callbacks have been registered, please ensure no errors are occurring within the create callback of this kernel
  1809.705929 s:  VX_ZONE_ERROR:[ownGraphNodeKernelInit:620] kernel init for node 0, kernel com.ti.csitx ... failed !!!
  1809.705952 s:  VX_ZONE_ERROR:[vxVerifyGraph:2254] Node kernel init failed
  1809.705964 s:  VX_ZONE_ERROR:[vxVerifyGraph:2311] Graph verify failed
App Verify Graph Done! 
App Delete Graph Done! 
App De-init Done! 
  1809.709678 s:  VX_ZONE_INIT:[tivxHostDeInitLocal:120] De-Initialization Done for HOST !!!
  1809.714228 s:  VX_ZONE_INIT:[tivxDeInitLocal:206] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
  1809.714864 s: IPC: Deinit ... !!!
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

opened the file [output.uyvy]
img_width = 1920        img_height = 1080       img_format = UYVY
dim_x = 1920    dim_y = 1080    stride_x = 2    stride_y = 3840
Initializing Transmit Buffers Done.
App Create Graph Done! 
  1809.705845 s:  VX_ZONE_ERROR:[ownContextSendCmd:885] Command ack message returned failure cmd_status: -1
  1809.705886 s:  VX_ZONE_ERROR:[ownNodeKernelInit:592] Target kernel, TIVX_CMD_NODE_CREATE failed for node node_101
  1809.705899 s:  VX_ZONE_ERROR:[ownNodeKernelInit:593] Please be sure the target callbacks have been registered for this core
  1809.705912 s:  VX_ZONE_ERROR:[ownNodeKernelInit:594] If the target callbacks have been registered, please ensure no errors are occurring within the create callback of this kernel
  1809.705929 s:  VX_ZONE_ERROR:[ownGraphNodeKernelInit:620] kernel init for node 0, kernel com.ti.csitx ... failed !!!
  1809.705952 s:  VX_ZONE_ERROR:[vxVerifyGraph:2254] Node kernel init failed
  1809.705964 s:  VX_ZONE_ERROR:[vxVerifyGraph:2311] Graph verify failed
App Verify Graph Done! 
App Delete Graph Done! 
App De-init Done! 
  1809.709678 s:  VX_ZONE_INIT:[tivxHostDeInitLocal:120] De-Initialization Done for HOST !!!
  1809.714228 s:  VX_ZONE_INIT:[tivxDeInitLocal:206] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
  1809.714864 s: IPC: Deinit ... !!!
  1809.716626 s: IPC: DeInit ... Done !!!
  1809.716688 s: MEM: Deinit ... !!!
  1809.716702 s: DDR_SHARED_MEM: Alloc's: 7 alloc's of 24883300 bytes 
  1809.716714 s: DDR_SHARED_MEM: Free's : 7 free's  of 24883300 bytes 
  1809.716724 s: DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes 
  1809.716741 s: MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

Is there any configuration missing, thanks

0 Brijesh Jadav 5 months ago in reply to Ling ling

TI__Guru**** 452065 points

Do you see any error from mcu2_0? It seems CREATE itself is failing, but there is no error log from MCU2_0. Have you enabled CSITX in the OpenVX header file?

Regards,

Brijesh

0 Ling ling 5 months ago in reply to Brijesh Jadav

Intellectual 485 points

HI,

Yes,I enable csitx. It's running well.

I have a few more questions to ask.

1.csitxObj->format = VX_DF_IMAGE_NV12; // NV12 image format is not supported in the CSITX.

What formats does CSITX support in total?

2.csitxObj->cstix_params.instCfg[0U].numDataLanes = 5U;//at max 4 data lanes are supported.

csitxObj->cstix_params.numCh = 0; // This should be set to atleast one.

In the file:

video_io/kernels/video_io/host/vx_csitx_host.c Shows that numDataLanes is 5 and numch is 0;

What's the meaning of that?

Fullscreen

1
2
3
prms->instCfg[loopCnt].numDataLanes = 5u;
prms->numCh = 0u;
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

prms->instCfg[loopCnt].numDataLanes = 5u;

prms->numCh = 0u;

Thanks a lot

0 Brijesh Jadav 5 months ago in reply to Ling ling

TI__Guru**** 452065 points

Ling ling said:
1.csitxObj->format = VX_DF_IMAGE_NV12; // NV12 image format is not supported in the CSITX.

What formats does CSITX support in total?

NV12 cannot be supported, because its not linear MIPI format. Most of the other standard formats are supported in the CSITX.

Ling ling said:
video_io/kernels/video_io/host/vx_csitx_host.c Shows that numDataLanes is 5 and numch is 0;

What's the meaning of that?

NumDataLanes can be at max 4, because CSITX support upto 4 data lanes, we cannot set it to 5. The check in CSITX host is missing, but valid value is upto 4 only.

Also the number of channels you are setting is 0, it should be atleast 1. This is the number of camera/virtual channels you want to send it out. It must not be 0, even though check is missing in the host file.

Regards,

Brijesh

Processors

Processors forum

TDA4VEN-Q1: Does TDA4VEN csitx support yuv input？