Linux/AM5728: Display overlay problems

user4092317

Part Number: AM5728

Tool/software: Linux

Hello，

I am trying to overlay PNG images and text messege in real-time video stream, I'm testing with the following pipeline

gst-launch-1.0 -v v4l2src device=/dev/video1 num-buffers=5000 io-mode=4 ! \
'video/x-raw, format=(string)YUY2, width=(int)1920, height=(int)1080' ! \
vpe num-input-buffers=8 ! queue ! \
textoverlay text="TEXT1:ABC" halignment=4 valignment=3 deltax=100 deltay=100 ! \
gdkpixbufoverlay location=test.png offset-x=200 offset-y=200 overlay-width=240 overlay-height=320 alpha=0.8 ! \
waylandsink

The pipeline is running successfully .However, the CPU usage is about 115% and video frame rate dropped significantly.

I wonder if I missing some caps, or what can I do to resolve the issue,like using GPU?

Thanks,

Lex

over 7 years ago

0 Margarita Gashova over 7 years ago

TI__Guru* 80190 points

Hello,

What is the PSDK and gstreamer version that you are using?
I can not allocate element dkpixbufoverlay.
However you could try to add more queue elements.
The load that I am observing when execute pipeline like:
gst-launch-1.0 -v v4l2src device=/dev/video1 num-buffers=5000 io-mode=4 ! 'video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)720' ! vpe num-input-buffers=8 ! waylandsink &

is 1.7% - 2 %. So I guess the high CPU load is cause by textoverlay and dkpixbufoverlay since these are software elements.

BR
Margarita

0 Margarita Gashova over 7 years ago in reply to Margarita Gashova

TI__Guru* 80190 points

I am sorry I forgot to ask what is the fps ?

BR
Margarita

0 user4092317 over 7 years ago in reply to Margarita Gashova

Prodigy 40 points

Thanks，Margarita
The video is 1080P 30fps. When I just use textoverlay CPU usage is 30%,and 90% for just gdkpixbufoverlay. My SDK version is 04.02.00.09
Gst plugin version is 1.8.3.
I had tried to add more queue elements, but CPU usage is still high.
I wonder if I can use other ways to achieve the same effect with less resource usage？

Thanks a lot,
Lex

0 Margarita Gashova over 7 years ago in reply to user4092317

TI__Guru* 80190 points

Hello,

Unfortunately these elements are not a TI elements.
Have you checked this element too:
gstreamer.freedesktop.org/.../gst-plugins-good-plugins-cairooverlay.html

Probably the CPU load will be high again.

BR
Margarita

0 Thomas Yang55737 over 7 years ago in reply to Margarita Gashova

TI__Expert 5526 points

Hi Margarita

Is it possible to use GPU to offload part of work to decrease the CPU loading?

-Thomas

0 Margarita Gashova over 7 years ago in reply to Thomas Yang55737

TI__Guru* 80190 points

Hello,

Currently no gst HW compositor plugin available.
You could try gstreamer compositor element instead of dkpixbufoverlay also.

BR
Margarita

0 Manisha Agrawal over 7 years ago in reply to Margarita Gashova

TI__Mastermind 22946 points

Hardware composition is possible using DSS, GC320 and SGX IP but they aren't wrapped in gstreamer plugin. Please refer to dual-camera-demo for composition using DSS. To enable composition using GC320, you can refer to multi-blit or other blending examples available for reference here.

Processors

Processors forum

Linux/AM5728: Display overlay problems