PROCESSOR-SDK-AM437X: Using xvimagesink

Rajat Rao

Part Number: PROCESSOR-SDK-AM437X
Other Parts Discussed in Thread: AM4378

Hello,

We've been using AM4378 in quite a few projects. A new requirement we have is to be able to capture and display video using gstreamer.

The standard SDK ships with Weston windows manager and rendering the video output using the fbdevsink needs the windows manager to be stopped. All this works fine but, is obviously no good - along with the video output, we should also be able to have some Qt developed GUI running on the screen.

We're wondering if there's any benefit of using the X11 build for the Processor SDK. On the X11 build as well, xorg needs to be stopped to use the DRM with fbdevsink. But, what if xvimagesink plugin was installed? WIll that work? Or is there actually a problem with the OMAP DRM driver that may not allow us to use xvimagesink?

over 5 years ago

0 Nick Saulnier over 5 years ago

TI__Guru** 101700 points

Hello Rajat,

Our graphics expert is on vacation for the rest of the week. I am not very familiar with X11, but I can look into it if you cannot wait until next week for a reply.

Regards,

Nick

0 Rajat Rao over 5 years ago in reply to Nick Saulnier

Intellectual 760 points

Hi Nick,

Thanks. I can wait for another week.

There's been an update in our requirements. Turns out we also need to do video encoding/decoding. So, we've decided to go for one of the AM57x devices. The question still holds: Will xvimagesink work on AM57x? If not, we'll have to rewrite our application on similar lines as the video-graphics-test example...and that would take a bit of effort.

0 Nick Saulnier over 5 years ago in reply to Rajat Rao

TI__Guru** 101700 points

Hello Rajat,

Sounds good. I'll add a note to make sure the graphics expert gets to this next week.

Regards,

Nick

0 Krunal Bhargav34 over 5 years ago in reply to Nick Saulnier

TI__Mastermind 44705 points

Hello Rajat,

Unfortunately, we do not support X11 on the our devices. AM57x is a good option because of the HW accelerator for video encode/decode. Is there a reason why you cannot use waylandsink or kmssink (Ref. Pipeline: http://software-dl.ti.com/processor-sdk-linux/esd/docs/latest/linux/Foundational_Components_Multimedia_IVAHD.html)?

Regards,
Krunal

0 Rajat Rao over 5 years ago in reply to Krunal Bhargav34

Intellectual 760 points

Thanks Krunal.

Our application in Qt uses gst_video_overlay and that won't work with kmssink without a major overhaul.

The link you provided has all the information I need and waylandsink looks promising. It isn't an option on AM437x but, I see that it is expected to work on AM57x,

Another question related to porting: xvimagesink automatically handles resizing the video and maps that to the graphics processor on x86. Do you know if waylandsink will also do that automatically on AM57x? If it runs scaling on the CPU, it would be really intensive.

0 Krunal Bhargav34 over 5 years ago in reply to Rajat Rao

TI__Mastermind 44705 points

Hello Rajat,

Wayland sink will work on AM437x and I recommended AM57x because of hardware based encode/decode. If you are okay with using SW acceleration, please feel free to use AM437x. Also, instead of using Wayland, I recommend using VPE for scaling as shown by the following example:

 1. Decode-> Scale->Display
    target # gst-launch-1.0 -v filesrc location=example_h264.mp4 ! qtdemux ! h264parse ! \
ducatih264dec ! vpe ! 'video/x-raw, format=(string)NV12, width=(int)720, height=(int)480' ! kmssink (Replace kmssink with waylandsink)

Regards,
Krunal

Processors

Processors forum

PROCESSOR-SDK-AM437X: Using xvimagesink