TDA4VM: J721S2 V4L2 H264 encoder issue

Joe Hsien

Prodigy 240 points

Part Number: TDA4VM
Other Parts Discussed in Thread: TDA4VL,

We use J721S2 and SDK8.4

We use encoder sample code.

We set driver_name ="wave5-enc".

We want to encode NV12 video to H264.

But check frame rate function will fail.(VIDIOC_ENUM_FRAMEINTERVALS failed )

How can i solve the issue?

This is fail log:

./tienc.out -i /run/media/sda1/2022_11_08_15_35_55_Data_0_ch6.yuv -h 1920 -w 1080 -f NV12 -c H264
tienc: main Enter
tienc: Found format NV12
tienc: Found format H264
tienc: Opened input file: /run/media/sda1/2022_11_08_15_35_55_Data_0_ch6.yuv
tienc: Discovering number of frames in file
tienc: Found 141 frames in input file
tienc: Found 141 frames
FD = 5
VIDIOC_QUERYCAP start
VIDIOC_QUERYCAP End
strcmp start wave5-enc
tienc: No device specified, using /dev/video1
tienc: query_device Enter
tienc: Querycaps: fd=0x5 driver=wave5-enc card=wave5-enc bus_info=platform:wave5-enc
tienc: Querycaps: device_caps=0x4204000 capabilities=0x84204000
tienc: Calling VIDIOC_ENUM_FMT on CAPTURE
tienc: desc.index = 0, pixelformat = HEVC, desciption = HEVC
tienc: desc.index = 1, pixelformat = H264, desciption = H.264
tienc: Calling VIDIOC_ENUM_FMT on OUTPUT
tienc: desc.index = 0, pixelformat = YU12, desciption = Planar YUV 4:2:0
tienc: desc.index = 1, pixelformat = NV12, desciption = Y/CbCr 4:2:0
tienc: desc.index = 2, pixelformat = NV21, desciption = Y/CrCb 4:2:0
tienc: desc.index = 3, pixelformat = YM12, desciption = Planar YUV 4:2:0 (N-C)
tienc: desc.index = 4, pixelformat = NM12, desciption = Y/CbCr 4:2:0 (N-C)
tienc: desc.index = 5, pixelformat = NM21, desciption = Y/CrCb 4:2:0 (N-C)
tienc: Calling VIDIOC_ENUM_FRAMESIZES
tienc: VIDIOC_ENUM_FRAMESIZES got CONTINUOUS
tienc: frmsizes min_width=0 max_width=0 step_width=1
tienc: frmsizes min_height=0 max_height=0 step_height=1
tienc: Calling VIDIOC_ENUM_FRAMEINTERVALS
VIDIOC_ENUM_FRAMEINTERVALS failed 25 Inappropriate ioctl for device
Requested frame interval not found, exiting

over 2 years ago

0 Karthik Ramanan over 2 years ago

TI__Guru** 113810 points

We are working on this issue, and will have an update early next week.

0 James Austrial over 2 years ago in reply to Karthik Ramanan

TI__Expert 4140 points

Karthik, Nikshith,

Do you have any investigation result?

0 Nikshith Reddy Kolan over 2 years ago in reply to James Austrial

TI__Intellectual 1465 points

Hi James,

The ioctl VIDIOC_ENUM_FRAMEINTERVALS is currently not supported on J721S2.

Below is the V4L2 compliance of ioctls on J721e(TDA4VM), J721S2(TDA4VL) with respect to SDK 8.4

'YES' denotes, V4L2 Compliance.

ioctl Category	IOCTL	TDA4VM (vxe-vxd)	TDA4VL (Wave5)
Required ioctls	VIDIOC_QUERYCAP	YES	YES
Allow for multiple opens	VIDIOC_QUERYCAP	YES	YES
	VIDIOC_G/S_PRIORITY	YES	YES
Debug ioctls	VIDIOC_DBG_G/S_REGISTER	Not Supported	Not supported
	VIDIOC_LOG_STATUS	YES	Not supported
Input ioctls	VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS	Not Supported	Not supported
	VIDIOC_G/S_FREQUENCY	Not Supported	Not supported
	VIDIOC_S_HW_FREQ_SEEK	Not Supported	Not supported
	VIDIOC_ENUMAUDIO	Not Supported	Not supported
	VIDIOC_G/S/ENUMINPUT	Not Supported	Not supported
	VIDIOC_G/S_AUDIO	Not Supported	Not supported
Output ioctls	VIDIOC_G/S_MODULATOR	Not Supported	Not supported
	VIDIOC_G/S_FREQUENCY	Not Supported	Not supported
	VIDIOC_ENUMAUDOUT	Not Supported	Not supported
	VIDIOC_G/S/ENUMOUTPUT	Not Supported	Not supported
	VIDIOC_G/S_AUDOUT	Not Supported	Not supported
Input/Output configuration ioctls	VIDIOC_ENUM/G/S/QUERY_STD	Not Supported	Not supported
	VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS	Not Supported	Not supported
	VIDIOC_DV_TIMINGS_CAP	Not Supported	Not supported
	VIDIOC_G/S_EDID	Not Supported	Not supported
Control ioctls	VIDIOC_QUERY_EXT_CTRL	YES	YES
	VIDIOC_QUERYCTRL	YES	YES
	VIDIOC_QUERYMENU	Not supported	Not supported
	VIDIOC_G/S_CTRL	Implementation not v4l2 compliant	YES
	VIDIOC_G/S/TRY_EXT_CTRLS	Implementation not v4l2 compliant	YES
	VIDIOC_(UN)SUBSCRIBE_EVENT	Implementation not v4l2 compliant	YES
	VIDIOC_DQEVENT	Not Supported	Not Supported
	VIDIOC_G/S_JPEGCOMP	Not Supported	Not supported
Format ioctl	VIDIOC_ENUM_FMT/FRAMESIZES	YES	YES
	VIDIOC_ENUM_FRAMEINTERVALS	YES	Not Supported
	VIDIOC_G/S_PARM	YES	Not supported
	VIDIOC_G_FBUF	Not Supported	Not supported
	VIDIOC_G_FMT	YES	YES
	VIDIOC_TRY_FMT	YES	YES
	VIDIOC_S_FMT	YES	YES
	VIDIOC_G_SLICED_VBI_CAP	Not Supported	Not supported
Codec ioctl	VIDIOC_(TRY_)ENCODER_CMD	Not Supported	Not supported
	VIDIOC_G_ENC_INDEX	Not Supported	Not Supported
	VIDIOC_(TRY_)DECODER_CMD	Not Supported	Not Supported
Buffer ioctl	VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF	Implementation not v4l2 compliant	YES
	VIDIOC_EXPBUF	Implementation not v4l2 compliant	YES

Regards

Nikshith

0 Joe Hsien over 2 years ago in reply to Nikshith Reddy Kolan

Prodigy 240 points

Hi Nikshith:

Not Support ioctl VIDIOC_(TRY)_ENCODER_CMD on J721S2 SDK8.4

But we want to do NV12 H264 encoder.

Do you have NV12 H264 encoder example on J721S2 SDK8.4

0 Nikshith Reddy Kolan over 2 years ago in reply to Joe Hsien

TI__Intellectual 1465 points

Hi Joe,

You can use the below gstreamer example to convert an Nv12 frame to H264.

gst-launch-1.0 videotestsrc pattern=ball num-buffers=100 ! video/x-raw, format=NV12, width=852, height=480, framerate=30/1 ! v4l2h264enc ! h264parse ! filesink location=./demo.264

Regards

Nikshith

0 Joe Hsien over 2 years ago in reply to Nikshith Reddy Kolan

Prodigy 240 points

Hi Nikshith:

We can use the script to encode pattern to demo.h264 successfully.

But we want to encode OPENVX capture node 8ch data(1920x1080) at the same time.

How can we do?

0 Nikshith Reddy Kolan over 2 years ago in reply to Joe Hsien

TI__Intellectual 1465 points

Hi Joe,

There is a vision apps demo for multi channel OpenVX based encode using the HW accelerator. You can check demo at the following link.

https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/latest/exports/docs/vision_apps/docs/user_guide/group_apps_basic_demos_app_multi_cam_codec.html

regards

Nikshith

0 Joe Hsien over 2 years ago in reply to Nikshith Reddy Kolan

Prodigy 240 points

We use multi_cam_codec sample code

We can encode 2CH 1920x1080 camera source 30 FPS.

But A72 CPU loading will 100%.

This encode use hardware or software encode?

Joe

0 James Austrial over 2 years ago in reply to Joe Hsien

TI__Expert 4140 points

Hi Nikshith,

A72 loading is 100% when doing 2CH 1920x1080@30FPS encoding.

Could you share with how to improve this?

0 Nikshith Reddy Kolan over 2 years ago in reply to James Austrial

TI__Intellectual 1465 points

Hi James

Joe Hsien said:
But A72 CPU loading will 100%.

We could replicate the issue on our side and currently working on it.

For TI internal reference: https://jira.itg.ti.com/browse/LCPD-29781

Regards

Nikshith

0 James Austrial over 2 years ago in reply to Nikshith Reddy Kolan

TI__Expert 4140 points

Hi Nikshith,

Any progress? I didn't see any update on LCPD-29781.

0 Nikshith Reddy Kolan over 2 years ago in reply to James Austrial

TI__Intellectual 1465 points

Hi James,

The Jira was updated. Please use: https://jira.itg.ti.com/browse/ADASVISION-5726

Regards

Nikshith

0 Karthik Ramanan over 2 years ago in reply to Nikshith Reddy Kolan

TI__Guru** 113810 points

The issue is not related to the codec or the multimedia plugin. We have been able to replicate this issue with appsrc or appsink or videotestsrc.

Joe,

Can you please share the details of your final usecase that doesn't use the appsrc/appsink/videotestsrc?

Regards

Karthik

0 Joe Hsien over 2 years ago in reply to Karthik Ramanan

Prodigy 240 points

Hi Karthik:

Our final usecase:

p_gst_pipe_obj->params.m_cmdString = appsrc format=GST_FORMAT_TIME is-live=true do-timestamp=true block=false name=myAppSrc0 ! queue
! video/x-raw, width=(int)1280, height=(int)800, framerate=(fraction)30/1, format=(string)NV12, interlace-mode=(string)progressive, colorimetry=(string)bt601
! v4l2h264enc bitrate=10000000 iperiod=1
! h264parse
! appsink name=myAppSink0 max-buffers=50 drop=true

A72 loading : 10%

0 Ethan Hsu over 2 years ago in reply to Joe Hsien

Prodigy 110 points

Hi, Karthik and James,

We tested the below command to check the i-period configuration.

gst-launch-1.0 -vv videotestsrc pattern=ball num-buffers=100 ! video/x-raw, format=NV12, width=852, height=480, framerate=30/1 ! v4l2h264enc gop-size=10 ! h264parse ! filesink location=./demo.264

gst-launch-1.0 -vv videotestsrc pattern=ball num-buffers=100 ! video/x-raw, format=NV12, width=852, height=480, framerate=30/1 ! v4l2h264enc i-period=10 ! h264parse ! filesink location=./demo.264

Here is how to check the frame type.

ffprobe -v error -show_streams -select_streams v:0 -show_frames demo.264 | grep pict_type

We only saw one I-frame in the demo.264 file which shall be every 10 frames has one I-frame.

--Ethan

0 Nikshith Reddy Kolan over 2 years ago in reply to Ethan Hsu

TI__Intellectual 1465 points

Hi Ethan,

i-period and gop-size are not supported yet. It will be a part of SDK 8.6.

Please use the below command to know the supported controls.

v4l2-ctl -d 1 -l

Regards

Nikshith

Processors

Processors forum

TDA4VM: J721S2 V4L2 H264 encoder issue