AM62A7: [AM62A7] About video pipeline solution.

Hello Songqing Lin,

LIN SONGQING said:

1, About video pipeline solution, Gstream or TIOVX, which solution are recommended?

Good questions. For the initial evaluation of the processor, including new models, cameras, post-processing, and visualization techniques, gstreamer is recommended due to a lower barrier to entry (more command line tools, python bindings as well as CPP, more examples).

Production grade systems, especially if there are safety requirements, should migrate to TIOVX once functional correctness has been established with gstreamer. You can get at least 80-90% of SoC performance with gstreamer.

LIN SONGQING said:

2, On TI SDk demo app, we see there have an app based on Gstream. But We are not seen the demo app which based on TIOVX.

    If we want to use TIOVX to develop video pipeline, Does there have some demo use cases can provide to us to refer?

You have correctly seen that we currently have more gstreamer demos than TIOVX. We are working on a similar demos with TIOVX only, but those are not released yet. You may also find some TIOVX demos on the following page: https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-jacinto7/latest/exports/docs/vision_apps/docs/user_guide/DEMOS.html. Note that these are made for a different device from AM62A, so some nodes in those demos may use cores that are not available on the AM62A SoC. Some our gstreamer plugins also use TIOVX under the hood, so you can look in the source code to see more examples.

Best,
Reese

Hello Reese,

Thanks for your reply!

The product we are developing is safety requirements. So we need to use TIOVX to develop.

Best Regards,

Songqing Lin

Hello Reese,

Reese Grimsley said:

You have correctly seen that we currently have more gstreamer demos than TIOVX. We are working on a similar demos with TIOVX only, but those are not released yet.

Is there a development schedule for the similar demos with TIOVX?

Best regards

Chunfu

Hello!

LIN SONGQING said:

The product we are developing is safety requirements. So we need to use TIOVX to develop.

Yes, you will want to have your end product on TIOVX. Gstreamer is intended to help accelerate some of the development -- the edgeai-gst-apps was made for this purpose, in case you want to do basic eval for new sensors or models. There is very little development effort required to use this tool

chunfu lin said:

Is there a development schedule for the similar demos with TIOVX?

This is subject to change, but planned to come in the 9.2 SDK release in mid-late March.

Please let me know if you need any help finding TIOVX content, documentation, etc.!

-Reese

Hello Reese,

If we want to use SDK 9.1 for our eMirror project which is based on Gstreamer as I know,

do you have any demo source code or quick tips in SDK for eMirror features, such as video cropping and customized ISP integration compared to TIOVX framework? (we have many experiences on TDV4M/L based on TIOVX)

Thank you

Chen

Hello,

The edgeai-gst-apps demos in the SDK use gstreamer to build applications. These will print the GST configurations that result from YAML configuration files. These demos run a neural network, which may not be important to you now.

edgeai-gst-plugins is the set of plugins these demos use. There is a wiki on that repo with documentation for each plugin. There is an ISP plugin. You should be able to do cropping with the multiscaler (MSC accelerator in VPAC) using the ROI parameters or with a generic plugin like videocrop. I don't think we have a reference code for cropping. If you need dynamic crop settings, then you would need to modify the plugin or perhaps use TIOVX.

There are some examples featuring ISP integration in the edgeai-tiovx-apps repo. These are still under active development, but I believe they are partly functional in 9.1:

• https://github.com/TexasInstruments/edgeai-tiovx-apps/tree/2.0/tests (edited; please use this branch 2.0)

• ISP
  • https://github.com/TexasInstruments/edgeai-tiovx-apps/blob/2.0/tests/app_tiovx_viss_module_test.c
  • In general, ISP is referenced as "VISS" in many examples since that is the name of that IP block.
• video crop
  • Perhaps the MSC component is useful here. I believe this is an ROI / Crop feature
  • https://github.com/TexasInstruments/edgeai-tiovx-apps/blob/2.0/tests/app_tiovx_multi_scaler_module_test.c

(Edited to fix a few links that pointed to a different branch)

Best,
Reese