Forums

Frank,

Please provide the stream resolution for the sample streams and EZSDK version used in your test setup

Ansari,

the EZSDK version is 05_04_00_11

The stream resolution is 1280x720@24

FYI Each 720p H.264 decoder instance needs approx 7.5 MB internal memory which is allocated from the memory segment VIDEO_M3_INT_HEAP_CACHED (pls refer to the firmware loader file $(EXSDK)/board-support/media-controller-utils_2_05_00_17/src/firmware_loader/memsegdef_default.c). The default size of this segment is 24 MB, which can support upto three 720p decoder instances. With the default memory setup you will be able to run upto three 720p instances.You have to increase the memory VIDEO_M3_INT_HEAP_CACHED to approx 30 MB to run 4 channel 720p h264 streams

 You need to modify the memsegdef_default.c. The default EZSDK memory map is given in this wiki http://processors.wiki.ti.com/index.php/EZSDK_Memory_Map . The memory sections given in green colour in the wiki can be modified via firmware loader module and the pre-built firmware binaries can be used as it is. I've attached a sample modified firmware loader memsegdef_default.c file where I've reduced the CMEM and DSP_ALG_HEAP segment sizes and increased the VIDEO_M3_INT_HEAP_CACHED size from 24 MB to 30 MB.  Following are the steps

1. Re-build the firmware loader after modifying the memsegdef_default.c with the command  "make media-controller-utils" from the top level EZSDK directory
2. firmware loader binary firmware_loader_a8host_debug.xv5T will be generated at board-support/media-controller-utils_2_05_00_17/lib/firmware_loader/bin/ti814x-evm
3. Rename the firmware loader binary to firmware_loader
4. Replace the existing firmware_loader with the new firmware_loader binary in the target filesystem at /usr/bin
5. Re boot the board and test the usecase
   
   

Regards

Ansari

Ansari,

thanks for your answer.

After doing all your steps there is another error message.

gst-launch omx_videomixer port-index=0 name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=sample_2.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=sample_3.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=sample_4.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix.
request pad!!
creating pad with name:sink_00
pad class init!!
Setting sink pad:0
request pad done ret!!
request pad!!
creating pad with name:sink_01
Setting sink pad:1
request pad done ret!!
request pad!!
creating pad with name:sink_02
Setting sink pad:2
request pad done ret!!
request pad!!
creating pad with name:sink_03
Setting sink pad:3
request pad done ret!!
Setting pipeline to PAUSED ...
ERROR: Pipeline doesn't want to pause.
ERROR: from element /GstPipeline:pipeline0/GstV4l2Sink:v4l2sink0: Cannot identify device '/dev/video1'.
Additional debug info:
v4l2_calls.c(493): gst_v4l2_open (): /GstPipeline:pipeline0/GstV4l2Sink:v4l2sink0:
system error: No such file or directory
Setting pipeline to NULL ...
Freeing pipeline ...

Br
Frank

Huber,

Are you able to run a single channel with the command

"gst-launch omx_videomixer port-index=0 name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix."

Huber,

Looks like V4l2 in not enabled in your setup. Please try the following commands

1. Boot the board and log in as "root"
2. cd /usr/share/ti/ti-media-controller-utils
3. cp load-hd-v4l2-firmware.sh /etc/init.d/load-hd-firmware.sh ( load-hd-v4l2-firmware.sh enables v4l2)
4. type "sync"
5. Restart the board
6. Type "echo 0 > /sys/devices/platform/vpss/graphics0/enabled"
7. Run the gstpipe line

The detailed steps are available in DM816x_EZ_Software_Developers_Guide.pdf under "docs" section Look for the sections "How to change from OMX to V4L2 firmware for capture/display"

Ansari,

thanks for your answer.

After your recommended steps there is a mosaic visible.
But only the first frame of the videos. The videos are not playing (looks like paused).

Same when I start one video only.

the printouts are now:

gst-launch omx_videomixer port-index=0 name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h2
64 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc lo
cation=sample_2.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec
 ! mix. filesrc location=sample_3.h264 ! 'video/x-h264' ! h264parse access-unit=
true ! omx_h264dec ! mix. filesrc location=sample_4.h264 ! 'video/x-h264' ! h264
parse access-unit=true ! omx_h264dec ! mix.
request pad!!
creating pad with name:sink_00
pad class init!!
Setting sink pad:0
request pad done ret!!
request pad!!
creating pad with name:sink_01
Setting sink pad:1
request pad done ret!!
request pad!!
creating pad with name:sink_02
Setting sink pad:2
request pad done ret!!
request pad!!
creating pad with name:sink_03
Setting sink pad:3
request pad done ret!!
Setting pipeline to PAUSED ...

** (gst-launch-0.10:1395): CRITICAL **: gst_v4l2sink_sync_rotation: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed

** (gst-launch-0.10:1395): CRITICAL **: gst_v4l2sink_sync_rotation: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed

** (gst-launch-0.10:1395): CRITICAL **: gst_v4l2sink_sync_flip: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed
Video mixer activate push!!
Pipeline is PREROLLING ...
In sink set caps:video/x-raw-yuv-strided, width=(int)1280, height=(int)720, format=(fourcc)NV12, rowstride=(int)1408, framerate=(fraction)240
00/1001, interlaced=(boolean)false
ip width:1280, ip height: 720, ip stride:1408
Starting input thread...num sink pads:4
ip zorder - starting from lowest: 0, 1, 2, 3
In sink set caps:video/x-raw-yuv-strided, width=(int)1280, height=(int)720, format=(fourcc)NV12, rowstride=(int)1408, framerate=(fraction)240
00/1001, interlaced=(boolean)false
ip width:1280, ip height: 720, ip stride:1408
In sink set caps:video/x-raw-yuv-strided, width=(int)1280, height=(int)720, format=(fourcc)NV12, rowstride=(int)1408, framerate=(fraction)240
00/1001, interlaced=(boolean)false
ip width:1280, ip height: 720, ip stride:1408
In sink set caps:video/x-raw-yuv-strided, width=(int)1280, height=(int)720, format=(fourcc)NV12, rowstride=(int)1408, framerate=(fraction)240
00/1001, interlaced=(boolean)false
ip width:1280, ip height: 720, ip stride:1408
created output caps:video/x-raw-yuv, width=(int)1280, height=(int)720, format=(fourcc)YUY2, framerate=(fraction)15/1
In src set caps:video/x-raw-yuv, width=(int)1280, height=(int)720, format=(fourcc)YUY2, framerate=(fraction)15/1
set src_setcaps  height:720, width:1280
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock

Br

Frank

Frank,

I've tried a sample 720 H.264 stream with the above pipe line and the play quality looked fine. It could be a stream specific issue.Please let me know the stream name and its online availability. Also try with a different stream

Ansari

Ansari,

the stream is available in my dropbox.

https://www.dropbox.com/sh/ukd1py4htgb3wb6/qURx8oiNvX

Let me know when you downloaded it.

Br

Frank

Ansari,

one more question.

During boot there are two i2c messages:

Usage : firmware_loader <Processor Id> <Location of Firmware> <start|stop> [-mmap <memory_map_file>] [-i2c <0|1>]

Are this messages a normal behavior?

See attached log.

5127.netra-boot-log.txt

Br
Frank

Hello Ansari,

I do get the same messages when starting the load-hd-v4l2-firmware.sh at startup.

I tried to add the -mmap /usr/share/ti/ti-media-controller-utils/mm_dm81xxbm.bin, the the firmware loader will load but the load fails (tvp7002 i2c error messages cause the system to loop forever).

The default /etc/init.d/load-hd-firmware.sh specifies a mmap file that is not present (missing underscore) and the load-hd-v4l2-firmware.sh (in /usr/share/ti/ti-media-controller-utils/) does not work when copied to /etc/init.d/load-hd-firmware.

Regards,

Lo

Frank,

I've downloaded the stream.

The i2c message is normal, the firmwares are getting loaded into two cores one after another

Regards

Ansari

Ansari,

are there any news?

Could you test the downloaded stream?

Here the situation is still the same. Starting one or four streams, the first frame is showed only.

Here are the printouts when I start one stream. Maybe you can see a hint....

gst-launch omx_videomixer port-index=0 name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h2
64 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix.
request pad!!
creating pad with name:sink_00
pad class init!!
Setting sink pad:0
request pad done ret!!
Setting pipeline to PAUSED ...

** (gst-launch-0.10:1388): CRITICAL **: gst_v4l2sink_sync_rotation: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed

** (gst-launch-0.10:1388): CRITICAL **: gst_v4l2sink_sync_rotation: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed

** (gst-launch-0.10:1388): CRITICAL **: gst_v4l2sink_sync_flip: assertion `v4l2_ioctl (fd, VIDIOC_S_CTRL, &control) >= 0' failed
Video mixer activate push!!
Pipeline is PREROLLING ...
In sink set caps:video/x-raw-yuv-strided, width=(int)1280, height=(int)720, format=(fourcc)NV12, rowstride=(int)1408, framerate=(fraction)240
00/1001, interlaced=(boolean)false
ip width:1280, ip height: 720, ip stride:1408
Starting input thread...num sink pads:1
ip zorder - starting from lowest: 0
created output caps:video/x-raw-yuv, width=(int)1280, height=(int)720, format=(fourcc)YUY2, framerate=(fraction)15/1
In src set caps:video/x-raw-yuv, width=(int)1280, height=(int)720, format=(fourcc)YUY2, framerate=(fraction)15/1
set src_setcaps  height:720, width:1280
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Caught interrupt -- handling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 1599904096963 ns.
Setting pipeline to PAUSED ...
Setting pipeline to READY ...


---------------------------
pressing control C after some minutes
---------------------------

!!!!!!!!!unreference all the remaining buffers!!!!!!!!!Video mixer activate push!!
paused to ready!!
setting EOS to true
Waiting for ip thread to exit..semup!!
goto leave!!
paused to ready...done!!
Setting pipelinet81xx_vidout t81xx_vidout: VIDOUT0: invalid dequeue
 to NULL ...
calling g_omx_core_deinit
Freeing pipeline ...
root@dm816x-evm:~/karnww01/frhu/netra/gst/ex80-play264#

Br

Frank

Frank,

I've downloaded the stream and able to recreate the hang issue with single stream. The stream profile shows its main profile 5.1 stream with num_ref_frame is set to 5.

The decoder needs 2*num_ref_frames + 1 to decode the stream. So if the number of output buffers for omx_h264dec is set to 11, then the pipeline is working. We are still looking into this issue.

Regards

Ansari

Frank,

In the mosaic chain, the h264dec optimal buffer requirements is 11 ( 2*num_ref_frames + 1). num_ref_frames value can be obtained from the stream SPS param. For 720p streams, the out buffer requirement ranges from 8 to 15, depending on the profile. I've made the changes to support different h264 output buffer count and attached the patch. The following chain is verified with this patch

gst-launch -v omx_videomixer name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h264 ! gstperf! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec output-buffers=8 ! mix. filesrc location=sample_2.h264   ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix. filesrc location=sample_3.h264   ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec ! mix.

It is suggested always to check the "num_ref_frames" for the test streams, if its more than 5, then the h264dec output buffer count has to be updated. For ex if the num_ref_frames for a given stream is 6, then the h264dec output buffer can be updated to 12 with the following command

gst-launch -v omx_videomixer port-index=0 name=mix ! v4l2sink userpointer=true filesrc location=sample_1.h264 ! 'video/x-h264' ! h264parse access-unit=true ! omx_h264dec output-buffers=12 ! gstperf ! mix.

Note : We are able to run upto 3 channels, there are further omx level changes required to enable four channel decode, pls let me know if this is your requirement. I'll go ahead and send you the steps required to enabled 4 channel decoding.   The following are the steps to test the patch

1. Copy the attached patch to $(EZSDK)/component-sources/gst-openmax_GST_DM81XX_00_05_00_00/patches/

2. cd to $(EZSDK)/component-sources/gst-openmax_GST_DM81XX_00_05_00_00

3. Type the command patch -p1 < patches/h264dec_outbuffer_update.patch

4. After the patch update, cd to the $(EZSDK) and type "make gstomx"

5. Copy the generated libgstomx.so ( component-sources/gst-openmax_GST_DM81XX_00_05_00_00/omx/.libs/libgstomx.so) to the target file system (target/usr/lib/gstreamer-0.10)

6. Test the mosaic usecase

Regards

Ansari