Processors

Processors forum

State TI Thinks Resolved
Replies 31 replies
Answers 1 answer
Subscribers 99 subscribers
Views 371 views
Users 0 members are here

Support feedback

Options

Options

Related

TDA4VEN-Q1: TDA4VEN-Q1: J722S: Edge Enhance (EE) Startup Failure Issue

aurora gao

Prodigy 70 points

Part Number: TDA4VEN-Q1
Other Parts Discussed in Thread: AM67A

Dear TI Team,

We are using the J722S paired with the OX03C10 sensor.

Edgeai SDK version: 11.00
Resolution: 1920x1080
Format: RAW12

I am currently tuning the EE (Edge Enhancement) module and have encountered the following issues:

When ee-mode is set to EE_MODE_Y8, the application launched by the .sh script gets stuck during startup and the pipeline cannot run successfully.
When ee-mode is changed to EE_MODE_Y12, the application starts normally. During EE tuning in the DCC tool, parameter changes produce obvious visual differences in the tuning preview. However, after applying the parameters, the live video output shows no visible change. I don't think EE is enabled properly right now.

Could you tell me what might be causing this issue, or if I made a mistake in the settings?

Our GStreamer pipeline is configured as follows:

media-ctl -d 0 -V '"max96722 1-0029":0 [fmt:SBGGR12_1X12/1920x1080 field: none]'

gst-launch-1.0 -v \

v4l2src device=/dev/video0 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb12 \

! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX390_UB953_D3 dcc-isp-file=/opt/edgeai-gst-apps/dcc_bins/dcc_viss_wdr_26.6.2_rev_prcpt_lut0.bin sink_0::dcc-2a-file=/opt/edgeai-gst-apps/dcc_bins/dcc_2a_wdr_26.6.2_rev_prcpt_lut0.bin \

ee-mode=EE_MODE_Y12 \

format-msb=11 \

wdr-enabled=true \

! video/x-raw, format=NV12, width=1920, height=1080 ! kmssink sync=false driver-name=tidss

Previously, I tried versions ti-processor-sdk-rtos-j722s-evm-11_00_00_06 and 11_01_00_04, and also rolled back the version of `kernels/hwa/vpac_viss/vx_vpac_viss_target_drv.c`, but none of these resolved the issue.

0 Gang Hua 1 month ago

TI__Guru 67050 points

Hi aurora,

This looks like a duplicate of the thread below.

https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1651825/tda4ven-q1-am62a-tda4vm-edge-enhance-ee-startup-failure-issue/6381932?tisearch=e2e-sitesearch&keymatch=%252520user%25253A692191#

0 aurora gao 1 month ago in reply to Gang Hua

Prodigy 70 points

Yes, because the model numbers in my previous post were a bit confusing. This might cause some confusion and affect how the post is categorized, so I thought it might be better to start a new thread. I’m very sorry—I explained the reason in a reply to the previous post, but it may not have been posted.

0 Gang Hua 1 month ago in reply to aurora gao

TI__Guru 67050 points

J722s RTOS SDK does not really have the support for VPAC gstreamer.
I don't think j722s RTOS SDK has the right building process for updating the firmware for gstreamer even though most code for AM62A and J722s are shared.

To be clear, I don't really know much about these details of the SDK building process, but if you use the AM62A firmware builder to update your j722s RTOS SD card, you may be able to get it to work.
If you would like to use gstreamer for VPAC, you may have to use AM67A SDK and firmware builder.

I don't know if there is any plan for future j722s RTOS SDK to support gstreamer.

0 Gang Hua 1 month ago in reply to Gang Hua

TI__Guru 67050 points

Hi aurora,

I might have figured it out.
The correct way of building j722s RTOS SDK and SD card might be different from AM67A.

You may have to do normal j722s RTOS build and SD card update so that everything can work properly after you unroll that commit.

use adas in "build_flags.mak" instead of edgeai: export TISDK_IMAGE?=adas
run "./make_sdk.sh" rather than "./make_firmware.sh"
run "make linux_fs_install_sd" to update SD card

0 Gang Hua 1 month ago in reply to Gang Hua

TI__Guru 67050 points

Gang Hua said:
The correct way of building j722s RTOS SDK and SD card might be different from AM67A.

To be clear, I used "ti-processor-sdk-rtos-j722s-evm-11_01_00_04" in my testing above.

0 Gang Hua 1 month ago in reply to Gang Hua

TI__Guru 67050 points

Gang Hua said:
To be clear, I used "ti-processor-sdk-rtos-j722s-evm-11_01_00_04" in my testing above.

It looks like "ti-processor-sdk-rtos-j722s-evm-11_00_00_06" has the same behavior on my j722s evm.

0 Gang Hua 1 month ago in reply to Gang Hua

TI__Guru 67050 points

One question for you, how do you get display to work on j722s RTOS SDK with "! kmssink sync=false driver-name=tidss"?

I got error for both 11.0 and 11.1 and only tested by writing to a file instead.

ERROR: from element /GstPipeline:pipeline0/GstKMSSink:kmssink0: Could not open DRM module tidss
Additional debug info:
/usr/src/debug/gstreamer1.0-plugins-bad/1.22.12/sys/kms/gstkmssink.c(1160): gst_kms_sink_start (): /GstPipeline:pipeline0/GstKMSSink:kmssink0:
reason: No such file or directory (2)
ERROR: pipeline doesn't want to preroll.
ERROR: from element /GstPipeline:pipeline0/GstKMSSink:kmssink0: GStreamer error: state change failed and some element failed to post a proper error message with the reason for the failure.
Additional debug info:
/usr/src/debug/gstreamer1.0/1.22.12/libs/gst/base/gstbasesink.c(5885): gst_base_sink_change_state (): /GstPipeline:pipeline0/GstKMSSink:kmssink0:
Failed to start
ERROR: pipeline doesn't want to preroll.
Failed to set pipeline to PAUSED.
Setting pipeline to NULL ...
Freeing pipeline ...
   459.146929 s:  VX_ZONE_ERROR: [vxGetStatus:1250] Reference is NULL
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!

0 aurora gao 1 month ago

Prodigy 70 points

Gang Hua said:
You may have to do normal j722s RTOS build and SD card update so that everything can work properly after you unroll that commit.

Okay, I'll try it your way. I'm not very familiar with this area, so it might take some time to verify.

0 aurora gao 1 month ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
One question for you, how do you get display to work on j722s RTOS SDK with "! kmssink sync=false driver-name=tidss"?

Actually, I just followed the manual; I haven't made any adjustments to this section, and no errors have occurred.

0 Gang Hua 1 month ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
Actually, I just followed the manual; I haven't made any adjustments to this section, and no errors have occurred.

What manual and SDK do you actually use?

0 aurora gao 1 month ago in reply to Gang Hua

Prodigy 70 points

I'm using this manual: AM6xA ISP Tuning Guide.pdf

0 Gang Hua 1 month ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
We are using the J722S paired with the OX03C10 sensor.

Edgeai SDK version: 11.00

Which SDK are you using exactly?

0 aurora gao 30 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
Which SDK are you using exactly?

It’s the ti-processor-sdk-rtos-j722s-evm-11_01_00_04, but the tuning manual my colleague gave me is for the AM6xA. He meant that it’s feasible to debug using the AM6xA manual; aside from that, I’m using the debugging documentation that comes with the DCC software. Of course, when I wanted to learn more about the J722S algorithm, I referred to the “j722s-tda4ven-tda4aen-am67-manual.pdf” document, but it did not contain any debugging-related information.

0 Gang Hua 30 days ago in reply to aurora gao

TI__Guru 67050 points

Thanks!

aurora gao said:
It’s the ti-processor-sdk-rtos-j722s-evm-11_01_00_04,

This is what I was looking for.

What did you do to get around the gstreamer/tidss error I saw?

ERROR: from element /GstPipeline:pipeline0/GstKMSSink:kmssink0: Could not open DRM module tidss

0 aurora gao 30 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
What did you do to get around the gstreamer/tidss error I saw?

Actually, aside from some stuttering in GStreamer after enabling `ee-mode=2`, I haven't experienced other issues with GStreamer. I'm still testing the compilation solution you provided earlier, and I'm not sure if this problem will occur after the compilation is successful, but at least GStreamer is working fine for now. Therefore, I might not be able to help you with this issue, since I haven’t encountered it myself.

0 Gang Hua 29 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
I'm not sure if this problem will occur after the compilation is successful, but at least GStreamer is working fine for now.

ti-processor-sdk-rtos-j722s-evm-11_01_00_04 does not seem to have "kmssink sync=false driver-name=tidss" working out of box.

aurora gao said:
I might not be able to help you with this issue, since I haven’t encountered it myself.

No problem.
I just would like to know if that is working out of box.
I don't expect that to work.

0 aurora gao 24 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
One question for you, how do you get display to work on j722s RTOS SDK with "! kmssink sync=false driver-name=tidss"?

I think I know what the problem might be. Are you running GStreamer without a monitor connected? This issue occurs when the development board is running GStreamer without a monitor connected.

0 Gang Hua 23 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
Are you running GStreamer without a monitor connected?

I have the same monitor connected for AM67A SDK and J722S RTOS SDK.
The gstreamer pipeline with display only works on AM67A SDK.

My understanding is that J722S SDK should not support gstreamer tiovxisp out of box.
I am not sure why it is available in the releases we tested earlier.
Probably, it will be removed in the upcoming SDK 11.2.1.

0 aurora gao 23 days ago in reply to Gang Hua

Prodigy 70 points

In that case, maybe my board is an exception.

0 Gang Hua 22 days ago in reply to aurora gao

TI__Guru 67050 points

No problem.

Close this thread for now if you don't have any further questions.

0 aurora gao 22 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
Close this thread for now if you don't have any further questions.

Actually, I'm still testing the previous method, but it still doesn't work.

Gang Hua said:
You may have to do normal j722s RTOS build and SD card update so that everything can work properly after you unroll that commit.

After modifying TISDK_IMAGE and the vx_vpac_viss_target_drv.c file, I ran these instructions:

make -C sdk_builder sdk -j4
make -C sdk_builder linux_fs_install LINUX_FS_PATH=./out

Next, I imported the generated file `sdk_builder/out/usr/lib/firmware/vision_apps_eaik/vx_app_rtos_linux_mcu2_0.out` onto the board.

I then imported the generated file `sdk_builder/out/usr/lib/firmware/vision_apps_eaik/vx_app_rtos_linux_mcu2_0.out` onto the board.

I tested both ti-processor-sdk-rtos-j722s-evm-11_01_00_04 and ti-processor-sdk-rtos-j722s-evm-11_00_00_06, as well as the original and reverted versions of vx_vpac_viss_target_drv.c, but the EE still failed to run correctly. Is there a problem with my procedure? After modifying the .out file, even commands that previously ran successfully now hang during initialization, just like EE does.

0 aurora gao 22 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
Close this thread for now if you don't have any further questions.

I'm sorry if I gave you the wrong impression. Since a problem came up, I wanted to try all the possible combinations myself first, so it took me quite a while.

0 Gang Hua 21 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
Actually, I'm still testing the previous method, but it still doesn't work.

J722S RTOS SDK 11.0 and 11.1 may have gstreamer tiovxisp working.
But, I don't expect that to work in future J722S RTOS SDK releases out of box.
Please be aware of the additional work you may have on your side for future J722S RTOS releases.

AM67A edgeai SDK should support gstreamer tiovxisp out of box.

0 Gang Hua 21 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
Is there a problem with my procedure?

The way I did previously on J722S RTOS SDK 11.0 and 11.1 was following the build process of RTOS SDK as we discussed earlier.

https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-j722s/latest/exports/docs/vision_apps/docs/user_guide/BUILD_INSTRUCTIONS.html#QUICK_SETUP_STEPS_LINUX_TI_RTOS

https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-j722s/latest/exports/docs/vision_apps/docs/user_guide/RUN_INSTRUCTIONS.html#run_step_copy_files_linux

cd ${PSDKR_PATH}/sdk_builder
./make_sdk.sh
make linux_fs_install_sd

This process may break in other and future releases.

0 aurora gao 21 days ago in reply to Gang Hua

Prodigy 70 points

After talking with my colleagues on the embedded systems team, I learned that our cameras run on Linux, so we can only use GStreamer. In that case, is the build process for the RTOS SDK still applicable?

0 Gang Hua 20 days ago in reply to aurora gao

TI__Guru 67050 points

At this moment for you on j722s RTOS SDK 11.0 and 11.1, you seem to have everything working.
The above build process works for me on these releases downloaded from ti.com.
I don't see any camera driver or display driver there, but I can get VISS driver updated correctly for EE.

Your system should be different from mine since you have both Linux camera driver and display driver.

0 aurora gao 18 days ago in reply to Gang Hua

Prodigy 70 points

Okay, thanks for the confirmation. This part has taken quite a while, and I still don't have any idea how to solve it. I have other projects to work on, so I'll tackle the other modules first.

0 Gang Hua 17 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
I have other projects to work on, so I'll tackle the other modules first.

No problem.
I will put this thread to waiting state.

0 Gang Hua 17 days ago in reply to aurora gao

TI__Guru 67050 points

aurora gao said:
This part has taken quite a while, and I still don't have any idea how to solve it.

For J722S RTOS SDK 11.0 and 11.1 downloaded from ti.com, reverting the commit and following the RTOS build/update process work correctly on my J722S EVM.

Your system is somehow different.

0 aurora gao 17 days ago in reply to Gang Hua

Prodigy 70 points

Gang Hua said:
For J722S RTOS SDK 11.0 and 11.1 downloaded from ti.com, reverting the commit and following the RTOS build/update process work correctly on my J722S EVM.

Your system is somehow different.

Okay, thanks. I'll look into the system issue further.

0 Gang Hua 16 days ago in reply to aurora gao

TI__Guru 67050 points

When you do that, I would suggest building j722s RTOS SDK 11.x source code package from ti.com and running it on j722s evm.
Theoretically, you should get exactly what I observed.