Video Capture-Display Integration with Codec Engine framework for DM8168/DM8148

Srikanta Mondal12

Hi Dear All,

I am using DM8168 and ezsdk_dm816x-evm_5_05_02_00.
Presently I am able to run Codec Engine examples without stopping the load-hd-firmware.sh after modifying the the memory map in .../servers/all_codecs/package.bld file.
I am not getting any example which includes capture-display and Codec Engine.
Actually I want to Process the Captured Video Frame in DSP and Then diaplay the processed frame.

For Data processing I want to use DSP through Codec Engine. I have gone through the universal_copy example of Codec Engine and I understood where the DSP copies the input file to output file.

I have written a cpature-display code using GStreamer and which is working properly. So, now I want to integrate the GStreamer capture-display code with any example of Codec Engine.

Please let me know what should I do to develop the same.

Thanks & Regards

Srikanta

over 7 years ago

Margarita Gashova over 7 years ago

TI__Guru* 80190 points

Hello,

You could check this guides about CE:
processors.wiki.ti.com/.../Codec_Engine_GroupIds
processors.wiki.ti.com/.../Codec_Engine

BR
Margarita

Srikanta Mondal12 over 7 years ago in reply to Margarita Gashova

Intellectual 560 points

Hi Margarita,

Please don't throw this type of document which is not related to capture-display with codec Engine framework. I have seen that you always throw this type of docs and links of unresolved threads.
Is there anyone else who can give me a valuable suggestion on this matter ?

Thanks & Regards
Srikanta

Karthick Kumaran A S V over 7 years ago

Intellectual 875 points

Hi Srikanta,

Could you please explain more about your requirement?

Regards,
Karthick

Srikanta Mondal12 over 7 years ago in reply to Karthick Kumaran A S V

Intellectual 560 points

Hi Karthick,

I want to capture the video frame and then process it in DSP using Codec Engine Framework and finally display the processed video frame.
That's why I want to integrate the capture and display code in Codec Engine Framework.
It will be very helpful for me If you have any example code related to this problem.
Your suggestion is highly appreciable.

Thanks & Regards
Srikanta

Ramprasad over 7 years ago in reply to Srikanta Mondal12

TI__Mastermind 30480 points

Hi Srikanta,
What is the framework for Capture and display? Is it V4L2 or OMX?
Video/Audio Encode/Decode components use internally codec-engine to remotely invoke DSP/IVA. You can refer capture-encode example.
First of all you will have to make your DSP algorithm xDAIS/xDM compliant to integrate with CE/FC.
If you don't want to use OMX for your DSP algorithm, you can go with RPE framework which is very simple to integrate and here there is no dependency
on codec-engine.
Refer rpe package and examples on how DSP is being used for audio encode/decode.

Srikanta Mondal12 over 7 years ago in reply to Ramprasad

Intellectual 560 points

Hi Ramprasad,

I have used the OMX framework for Capture and V4L2 framework for display.

I have studied the universal_copy example of Codec Engine and I understood where the DSP copies (memcpy() fn in .../ezsdk_Install_Dir/component-sources/codec_engine_3_22_01_06/examples/ti/xdais/dm/examples/universal_copy/universal_copy.c) the input file to output file. That's why I want to integrate my Capture-display code into that example.

Thanks & Regards

Srikanta

Srikanta Mondal12 over 7 years ago in reply to Srikanta Mondal12

Intellectual 560 points

Hi Ramprasad,

I have seen that there is an application demo "Using Adapters to Run Existing xDAIS Algorithms
with Codec Engine" for DM6446 with DVEVM/DVSDK.
So, please let me know how to migrate this application for DM8168 with EZSDK_5_05.

Thanks
Srikanta

Karthick Kumaran A S V over 7 years ago in reply to Srikanta Mondal12

Intellectual 875 points

DM816x EZSDK would have lot of OMX ilclient with which you can fulfill your requirements. You can write your own ilclient with the necessary components in the pipeline (capture, DSP and display) and can get things done.

There are examples for capture-encode, capture-display. You can just modify one of them based on your needs.

Ramprasad over 7 years ago in reply to Karthick Kumaran A S V

TI__Mastermind 30480 points

Hi Srikanta,

You have mentioned, you want to integrate gstreamer capture-display to dsp algorithm.

For this you need to develop gstreamer plugin for dsp algorithm. I don't know if any other way

Srikanta Mondal12 over 7 years ago in reply to Ramprasad

Intellectual 560 points

Hi Ramprasad,

Thanks a lot for your reply.
I have already developed the Gstreamer capture-display code for ARM side application and which is working properly.
I want to integrate this application with codec engine framework so that I can use DSP for video frame processing.

Thanks
Srikanta

Karthick Kumaran A S V over 7 years ago in reply to Srikanta Mondal12

Intellectual 875 points

In that case, you have to develop a gstreamer plugin which talks to openmax components (which in turn talks to Codec Engine) or directly talking to codec Engine for your DSP programming

Processors

Processors forum

Video Capture-Display Integration with Codec Engine framework for DM8168/DM8148