SK-AM62A-LP: CSI2RX width mismatch on cold boot with direct 640x640 preproc path

Part Number: SK-AM62A-LP

Hi team,

I’m seeing an issue with the OD application on AM62A during cold boot.

The OD app is based on apps_python, and on application startup it prints the following dmesg error:

j721e-csi2rx 30102000.ticsi2rx: Width does not match (source 1920, sink 640)

The OD application input pipeline is:

v4l2src device=/dev/video-imx219-cam1 io-mode=5 pixel-aspect-ratio=None ! queue leaky=2 ! capsfilter caps="video/x-bayer, width=(int)1920, height=(int)1080, format=(string)rggb" ! tiovxisp dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin sensor-name=SENSOR_SONY_IMX219_RPI ! capsfilter caps="video/x-raw, format=(string)NV12" ! tiovxmultiscaler name=split_01
split_01. ! queue max-size-buffers=4 leaky=2 ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)720" ! tiovxdlcolorconvert out-pool-size=4 ! capsfilter caps="video/x-raw, format=(string)RGB" ! appsink max-buffers=2 drop=True name=sen_0
split_01. ! queue ! capsfilter caps="video/x-raw, width=(int)640, height=(int)640" ! tiovxdlpreproc out-pool-size=4 data-type=3 tensor-format=1 ! capsfilter caps="application/x-tensor-tiovx" ! appsink max-buffers=2 drop=True name=pre_0


However, the CL application works correctly with the following pipeline: 

v4l2src device=/dev/video-imx219-cam0 io-mode=5 pixel-aspect-ratio=None ! queue leaky=2 ! capsfilter caps="video/x-bayer, width=(int)1920, height=(int)1080, format=(string)rggb;" ! tiovxisp dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin sensor-name=SENSOR_SONY_IMX219_RPI ! capsfilter caps="video/x-raw, format=(string)NV12;" ! tiovxmultiscaler name=split_01
split_01. ! queue max-size-buffers=4 leaky=2 ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)720;" ! tiovxdlcolorconvert out-pool-size=4 ! capsfilter caps="video/x-raw, format=(string)RGB;" ! appsink max-buffers=2 drop=True name=sen_0
split_01. ! queue ! capsfilter caps="video/x-raw, width=(int)1188, height=(int)668;" ! tiovxmultiscaler target=1 ! capsfilter caps="video/x-raw, width=(int)454, height=(int)256;" ! tiovxdlcolorconvert out-pool-size=4 ! capsfilter caps="video/x-raw, format=(string)RGB;" ! videobox qos=True left=115 right=115 top=16 bottom=16 ! tiovxdlpreproc out-pool-size=4 data-type=3 ! capsfilter caps="application/x-tensor-tiovx;" ! appsink max-buffers=2 drop=True name=pre_0

Important observation:

  • The OD application works correctly without the width mismatch error if the CL application is executed once after every boot.

  • But when after running the CL application says: [ERROR] Error pulling tensor from GST Pipeline

This issue is noticed after I created a base image by removing some edgeai recipes.

```

SUMMARY = "base image"
DESCRIPTION = "base image."
LICENSE = "CLOSED"

require recipes-core/images/tisdk-default-image.bb

COMPATIBLE_MACHINE = "am62axx"

EDGEAI_STACK = " \
ti-vision-apps-dev \
ti-edgeai-firmware \
ti-tidl-dev \
edgeai-tiovx-kernels-dev \
edgeai-tiovx-apps-dev \
"

EDGEAI_STACK:append:edgeai = " \
ti-tidl-osrt-dev \
ti-tidl-osrt-staticdev \
edgeai-init \
edgeai-tiovx-modules-dev \
edgeai-gst-plugins-dev \
edgeai-dl-inferer-staticdev \
ti-gpio-cpp-dev \
ti-gpio-py \
"

IMAGE_INSTALL:append = " \
${EDGEAI_STACK} \
init-scripts \
python3-opencv \
python3-numpy \
bc \
net-tools \
procps \
"

IMAGE_INSTALL:remove = " \
packagegroup-arago-tisdk-matrix \
packagegroup-arago-tisdk-matrix-extra \
ti-test \
ltp-ddt \
"

WKS_FILE = "image.wks"
WIC_CREATE_EXTRA_ARGS += " --no-fstab-update"
EXTRA_IMAGECMD:ext4 += " -E lazy_itable_init=0,lazy_journal_init=0"

IMAGE_FSTYPES = "wic.xz tar.xz"

IMAGE_BASENAME = "base-image${ARAGO_IMAGE_SUFFIX}"
export IMAGE_BASENAME


```

Could you please advise and help fix this issue?

Best Regards,
Sajan

  • Hi Sajan,

    A few questions. Have you managed to recreate this issue on the EVM? Or with the default SDK?

    To confirm the application behavior:

    1. Directly running OD results in the width issue
    2. CL -> OD -> CL causes the CL pipeline to fail with the GST Tensor issue.

    Can you please run the pipelines with GST_DEBUG variable set to 4? This should give decently verbose logs and help understand the issue.
    Also, please switch out appsink with fakesink in the pipeline and see if the pipeline still causes the issue with the 720p part of the pipeline removed(with fakesink). This should help remove the dependency on the inference application and isolate it to the GStreamer pipeline.

    Regards,
    Jay

  • Hello Jay,

    Seems error while did replying. I can't add detailed log here, because of error says contact your administator.
    Also I think that the issue occured because of I removed ltp-ddt and ti-test.

    Warm Regards,
    Sajan

  • Hi Sajan, 

    That GST error seems like v4l2src is asking for 1920x1080 input but the camera was not configured for that resolution. 

    Can you show the output for `media-ctl -p` and `v4l2-ctl --list-devices`?

    I notice that you have "v4l2src device=/dev/video-imx219-cam1" in the OD pipeline's start and "v4l2src device=/dev/video-imx219-cam0" in the CL pipeline. Are these cameras both configured the same way?

    When you login to a terminal sessoin, there is script under /root/.profile, which will run a /opt/edgeai-gst-apps/init_script.sh --> runs a /opt/edgeai-gst-apps/scripts/setup_cameras.sh script. This runs several commands to prepare the cameras, like setting input format/resolution with media-ctl commands. Perhaps this did not run or did not recognize your camera. Please assert this type of command/script is being run, either manually or at login-time.

    This issue is noticed after I created a base image by removing some edgeai recipes.

    Can you tell which recipes were removed? They might have been responsible for some of this setup behavior. If you removed edgeai-gst-apps, then I would estimate that's the source here, since the setup_cameras.sh script would not be present.

    BR,
    Reese

  • Hello Reese,

    I removed the edgeai-gst-apps and added the required scripts in the /opt. That is working fine with individual CL and OD applications. Problem is only with two application at one image.

    Best Regards,
    Sajan

  • Hello Reese,

    I added the camera init script in /etc/init.d/edgeai-launcher.sh should remove that and source the script from the init_script.sh in the /opt directory.

    Best Regards,
    Sajan

  • Hi Sajan,

    The original error is from the driver. Can you share the script that sets up the media graph and share the output of media-ctl -p command?

    If file upload is still not working for you, please share a text dump on whichever external platform your organization allows(Google Drive/One Drive etc)

    Regards,
    Jay

  • Hi Sajan,

    In the kmssink.txt file, I see that the TIDL node create is failing. Can you please run /opt/vx_app_arm_remote_log.out in the background and run the pipeline which is causing the error? Feel free to upload the logs in the same GDrive.

    j721e-csi2rx 30102000.ticsi2rx: Width does not match (source 1920, sink 640)

    Another thing. With the media-ctl output you shared, the pipeline doesn't work and you get this error?

    Regards,
    Jay

  • Hello Jay,

    Tried running /opt/vx_app_arm_remote_log.out . Shared the log in drive. Look at misc pipeline fail file also. If you need GST_DEBUG log I will provide that also.

    With the media-ctl output you shared, the pipeline doesn't work and you get this error?

    Yes.

    Warm Regards,
    Sajan

  • Hi Sajan,

    Please run the .out file before running your application in the background, and ensure that it is running while running the application in the same terminal. This is for the case described in kmssink.txt, where you are getting TIOVX node create failure. The use of this is that it will print error logs while the application is running from the remote cores.

    Also, in the case you have shared in the updated log, please provide with GST_DEBUG variable as well.

    Please provide a description of the different pipelines that you share, as in the execution order as well.

    Regards,
    Jay

  • Please run the .out file before running your application in the background, and ensure that it is running while running the application in the same terminal. This is for the case described in kmssink.txt, where you are getting TIOVX node create failure. The use of this is that it will print error logs while the application is running from the remote cores.

    Shared log is the same. I did opened an ssh then run the .out file and at the same time runned application in another terminal. Also tried in same terminal also. No change in vx_app_arm_remote_log.out log. Added GST_DEBUG log also

    Best Regards,
    Sajan

  • Hi Sajan,

    What I meant in the first case is that when you get the following logs:

       751.132143 s:  VX_ZONE_ERROR: [ TIDL subgraph dets ] Node kernel init failed
       751.132156 s:  VX_ZONE_ERROR: [ TIDL subgraph dets ] Graph verify failed

    I also expected to see some logs beginning with [C7x] that let me know what issue is causing this. Those come from this script. What I wanted to run was:

    /opt/vx_app_arm_remote_log.out &
    ./application.out

    Where application.out is your binary. This would print more logs in this. Both need to be run in the same terminal. If you press enter a couple of times after running the remote_log binary with the & at the end, you should see a linux prompt.

    As for the GStreamer logs, it will take me a little time to analyze it. I'll try to get back to you tomorrow.

    Regards,
    Jay

  • Hello Jay,

    # ./vx_app_arm_remote_log.out & ./app/main.py -n
    [1] 2482
    [MCU1_0]      0.033608 s: CIO: Init ... Done !!!
    [MCU1_0]      0.033665 s: APP: Init ... !!!
    [MCU1_0]      0.033685 s: MEM: Init ... !!!
    [MCU1_0]      0.033701 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ af000000 of size 16777216 bytes !!!
    [MCU1_0]      0.033753 s: MEM: Init ... Done !!!
    [MCU1_0]      0.033769 s: IPC: Init ... !!!
    [MCU1_0]      0.033786 s: IPC: 3 CPUs participating in IPC !!!
    [MCU1_0]      0.034090 s: IPC: Waiting for HLOS to be ready ... !!!
    [MCU1_0]      0.038418 s: Sciserver Version: v2023.11.0.0REL.MCUSDK.MM.NN.PP.bb
    [MCU1_0]      0.041191 s: ##RM_PM_HAL Version: vMM.NN.PP
    [MCU1_0]      0.044137 s: ##Starting Sciserver..... PASSED
    [MCU1_0]     14.691725 s: IPC: HLOS is ready !!!
    [MCU1_0]     14.691808 s: IPC: Init ... Done !!!
    [MCU1_0]     14.691833 s: APP: Syncing with 2 CPUs ... !!!
    [MCU1_0]     14.691855 s: APP: Syncing with 2 CPUs ... Done !!!
    [MCU1_0]     14.691874 s: REMOTE_SERVICE: Init ... !!!
    [MCU1_0]     14.691956 s: REMOTE_SERVICE: Init ... Done !!!
    [MCU1_0]     14.691981 s: FVID2: Init ... !!!
    [MCU1_0]     14.692010 s: FVID2: Init ... Done !!!
    [MCU1_0]     14.692027 s: VHWA: VPAC Init ... !!!
    [MCU1_0]     14.692042 s: SCICLIENT: Sciclient_pmSetModuleState module=219 state=2
    [MCU1_0]     14.692127 s: SCICLIENT: Sciclient_pmSetModuleState success
    [MCU1_0]     14.692335 s: VHWA: LDC Init ... !!!
    [MCU1_0]     14.692439 s: VHWA: LDC Init ... Done !!!
    [MCU1_0]     14.692460 s: VHWA: MSC Init ... !!!
    [MCU1_0]     14.693030 s: VHWA: MSC Init ... Done !!!
    [MCU1_0]     14.693051 s: VHWA: VISS Init ... !!!
    [MCU1_0]     14.693736 s: VHWA: VISS Init ... Done !!!
    [MCU1_0]     14.693764 s: VHWA: VPAC Init ... Done !!!
    [MCU1_0]     14.693790 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
    [MCU1_0]     14.693814 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
    [MCU1_0]     14.693836 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
    [MCU1_0]     14.694350 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_sink on target MCU1-0
    [MCU1_0]     14.694421 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_source on target MCU1-0
    [MCU1_0]     14.694514 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_sink2 on target MCU1-0
    [MCU1_0]     14.694602 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_source2 on target MCU1-0
    [MCU1_0]     14.694692 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_intermediate on target MCU1-0
    [MCU1_0]     14.694786 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_intermediate_2 on target MCU1-0
    [MCU1_0]     14.694878 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_source_error on target MCU1-0
    [MCU1_0]     14.694960 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_source_obj_array on target MCU1-0
    [MCU1_0]     14.695021 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_sink_obj_array on target MCU1-0
    [MCU1_0]     14.695106 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_intermediate on target MCU1-0
    [MCU1_0]     14.695199 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_source on target MCU1-0
    [MCU1_0]     14.695254 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_sink on target MCU1-0
    [MCU1_0]     14.695307 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.test_target on target MCU1-0
    [MCU1_0]     14.695360 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.image_intermediate on target MCU1-0
    [MCU1_0]     14.695414 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.cmd_timeout_test on target MCU1-0
    [MCU1_0]     14.695467 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.tiovx_overhead on target MCU1-0
    [MCU1_0]     14.695649 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MCU1-0 
    [MCU1_0]     14.695736 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target VPAC_LDC1 
    [MCU1_0]     14.695815 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target VPAC_MSC1 
    [MCU1_0]     14.695888 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target VPAC_MSC2 
    [MCU1_0]     14.695961 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target VPAC_VISS1 
    [MCU1_0]     14.695992 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
    [MCU1_0]     14.696017 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
    [MCU1_0]     14.696036 s: APP: OpenVX Target kernel init ... !!!
    [MCU1_0]     14.700543 s: APP: OpenVX Target kernel init ... Done !!!
    [MCU1_0]     14.700569 s: VISS REMOTE SERVICE: Init ... !!!
    [MCU1_0]     14.700615 s: VISS REMOTE SERVICE: Init ... Done !!!
    [MCU1_0]     14.700635 s: APP: Init ... Done !!!
    [MCU1_0]     14.700651 s: APP: Run ... !!!
    [MCU1_0]     14.700665 s: IPC: Starting echo test ...
    [MCU1_0]     14.700791 s: APP: Run ... Done !!!
    [MCU1_0]     14.700975 s: IPC: Echo status: a530-0[.] r5f0-0[s] c75ss0[P] 
    [C7x_1 ]      5.836806 s: CIO: Init ... Done !!!
    [C7x_1 ]      5.836825 s: APP: Init ... !!!
    [C7x_1 ]      5.836837 s: SCICLIENT: Init ... !!!
    [C7x_1 ]      5.836900 s: SCICLIENT: DMSC FW version [10.1.8--v10.01.08 (Fiery Fox)]
    [C7x_1 ]      5.836918 s: SCICLIENT: DMSC FW revision 0xa  
    [C7x_1 ]      5.836933 s: SCICLIENT: DMSC FW ABI revision 4.0
    [C7x_1 ]      5.836949 s: SCICLIENT: Init ... Done !!!
    [C7x_1 ]      5.836961 s: UDMA: Init ... !!!
    [C7x_1 ]      5.837006 s: UDMA: Init ... Done !!!
    [C7x_1 ]      5.837021 s: MEM: Init ... !!!
    [C7x_1 ]      5.837035 s: MEM: Created heap (DDR_LOCAL_MEM, id=0, flags=0x00000004) @ b2000000 of size 117440512 bytes !!!
    [C7x_1 ]      5.837064 s: MEM: Init ... Done !!!
    [C7x_1 ]      5.837076 s: IPC: Init ... !!!
    [C7x_1 ]      5.837088 s: IPC: 3 CPUs participating in IPC !!!
    [C7x_1 ]      5.837291 s: IPC: Waiting for HLOS to be ready ... !!!
    [C7x_1 ]     14.350880 s: IPC: HLOS is ready !!!
    [C7x_1 ]     14.350956 s: IPC: Init ... Done !!!
    [C7x_1 ]     14.350971 s: APP: Syncing with 2 CPUs ... !!!
    [C7x_1 ]     14.691856 s: APP: Syncing with 2 CPUs ... Done !!!
    [C7x_1 ]     14.691873 s: REMOTE_SERVICE: Init ... !!!
    [C7x_1 ]     14.692913 s: REMOTE_SERVICE: Init ... Done !!!
    [C7x_1 ]     14.692938 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
    [C7x_1 ]     14.692960 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
    [C7x_1 ]     14.692980 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
    [C7x_1 ]     14.693613 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel vx_tutorial_graph.phase_rgb on target DSP_C7-1
    [C7x_1 ]     14.693663 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_sink on target DSP_C7-1
    [C7x_1 ]     14.693710 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_source on target DSP_C7-1
    [C7x_1 ]     14.693757 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_sink2 on target DSP_C7-1
    [C7x_1 ]     14.693804 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_source2 on target DSP_C7-1
    [C7x_1 ]     14.693862 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.scalar_intermediate on target DSP_C7-1
    [C7x_1 ]     14.693911 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_intermediate_2 on target DSP_C7-1
    [C7x_1 ]     14.693958 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_source_error on target DSP_C7-1
    [C7x_1 ]     14.694006 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_source_obj_array on target DSP_C7-1
    [C7x_1 ]     14.694055 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.scalar_sink_obj_array on target DSP_C7-1
    [C7x_1 ]     14.694104 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_intermediate on target DSP_C7-1
    [C7x_1 ]     14.694152 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_source on target DSP_C7-1
    [C7x_1 ]     14.694198 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.pyramid_sink on target DSP_C7-1
    [C7x_1 ]     14.694245 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.test_target on target DSP_C7-1
    [C7x_1 ]     14.694291 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.capture.image_intermediate on target DSP_C7-1
    [C7x_1 ]     14.694339 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.test_target on target DSP_C7-1
    [C7x_1 ]     14.694387 s:  VX_ZONE_INFO: [ownAddTargetKernelInternal:162] registered kernel com.ti.test_kernels.tiovx_overhead on target DSP_C7-1
    [C7x_1 ]     14.694511 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1 
    [C7x_1 ]     14.694602 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_2 
    [C7x_1 ]     14.694695 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_3 
    [C7x_1 ]     14.694789 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_4 
    [C7x_1 ]     14.694888 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_5 
    [C7x_1 ]     14.694983 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_6 
    [C7x_1 ]     14.695080 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_7 
    [C7x_1 ]     14.695174 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target DSP_C7-1_PRI_8 
    [C7x_1 ]     14.695201 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
    [C7x_1 ]     14.695222 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
    [C7x_1 ]     14.695237 s: APP: OpenVX Target kernel init ... !!!
    [C7x_1 ]     14.695457 s: APP: OpenVX Target kernel init ... Done !!!
    [C7x_1 ]     14.695473 s: APP: Init ... Done !!!
    [C7x_1 ]     14.695487 s: APP: Run ... !!!
    [C7x_1 ]     14.695498 s: IPC: Starting echo test ...
    [C7x_1 ]     14.695595 s: APP: Run ... Done !!!
    [C7x_1 ]     14.701067 s: IPC: Echo status: a530-0[.] r5f0-0[P] c75ss0[s] 
    libtidl_onnxrt_EP loaded 0x1f831d70 
    Final number of subgraphs created are : 1, - Offloaded Nodes - 283, Total Nodes - 283 
    APP: Init ... !!!
        58.142048 s: MEM: Init ... !!!
        58.142140 s: MEM: Initialized DMA HEAP (fd=5) !!!
        58.142372 s: MEM: Init ... Done !!!
        58.142413 s: IPC: Init ... !!!
        58.159920 s: IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
        58.171324 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
        58.177455 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_ERROR
        58.177498 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_WARNING
        58.177517 s:  VX_ZONE_INFO: Globally Enabled VX_ZONE_INFO
        58.180335 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-0 
        58.180532 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-1 
        58.180690 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-2 
        58.180972 s:  VX_ZONE_INFO: [tivxPlatformCreateTargetId:134] Added target MPU-3 
        58.181006 s:  VX_ZONE_INFO: [tivxInitLocal:126] Initialization Done !!!
        58.181041 s:  VX_ZONE_INFO: Globally Disabled VX_ZONE_INFO
    ==========[INPUT PIPELINE(S)]==========
    
    [PIPE-0]
    
    v4l2src device=/dev/video-imx219-cam1 io-mode=5 pixel-aspect-ratio=None ! queue leaky=2 ! capsfilter caps="video/x-bayer, width=(int)1920, height=(int)1080, format=(string)rggb;" ! tiovxisp dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin sensor-name=SENSOR_SONY_IMX219_RPI ! capsfilter caps="video/x-raw, format=(string)NV12;" ! tiovxmultiscaler name=split_01
    split_01. ! queue max-size-buffers=4 leaky=2 ! capsfilter caps="video/x-raw, width=(int)1280, height=(int)720;" ! tiovxdlcolorconvert out-pool-size=4 ! capsfilter caps="video/x-raw, format=(string)RGB;" ! appsink max-buffers=2 drop=True name=sen_0
    split_01. ! queue ! capsfilter caps="video/x-raw, width=(int)640, height=(int)640;" ! tiovxdlpreproc out-pool-size=4 data-type=3 tensor-format=1 ! capsfilter caps="application/x-tensor-tiovx;" ! appsink max-buffers=2 drop=True name=pre_0
    
    
    ==========[OUTPUT PIPELINE]==========
    
    appsrc do-timestamp=True format=3 block=True name=post_0 ! tiovxdlcolorconvert ! capsfilter caps="video/x-raw, format=(string)NV12, width=(int)1280, height=(int)720;" ! v4l2h264enc extra-controls="controls, frame_level_rate_control_enable=(int)1, video_bitrate=(int)4000000, video_gop_size=(int)10;" ! h264parse ! rtph264pay config-interval=1 ! udpsink sync=False clients=127.0.0.1:8082 host=127.0.0.1 port=8082
    
    [DEBUG] data_receiver started
    [DEBUG] data_receiver listening on 0.0.0.0:5005
        58.823520 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa95b7cf0 of type 00000817 at external count 1, internal count 0, releasing it
        58.823583 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=raw_image_98) now as a part of garbage collection
        58.823604 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965af70 of type 00000813 at external count 1, internal count 0, releasing it
        58.823620 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_99) now as a part of garbage collection
        58.823906 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965b120 of type 00000813 at external count 1, internal count 0, releasing it
        58.823930 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_101) now as a part of garbage collection
        58.824169 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965b2d0 of type 00000813 at external count 1, internal count 0, releasing it
        58.824186 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_103) now as a part of garbage collection
        58.824469 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965b480 of type 00000813 at external count 1, internal count 0, releasing it
        58.824489 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_105) now as a part of garbage collection
        58.824721 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965b7e0 of type 00000813 at external count 1, internal count 0, releasing it
        58.824738 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_108) now as a part of garbage collection
        58.825036 s:  VX_ZONE_WARNING: [vxReleaseContext:1275] Found a reference 0xffffa965bb40 of type 00000813 at external count 1, internal count 0, releasing it
        58.825058 s:  VX_ZONE_WARNING: [vxReleaseContext:1277] Releasing reference (name=object_array_112) now as a part of garbage collection
    APP: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... Done !!!
        58.830753 s: IPC: Deinit ... !!!
        58.831312 s: IPC: DeInit ... Done !!!
        58.831370 s: MEM: Deinit ... !!!
        58.831492 s: DDR_SHARED_MEM: Alloc's: 61 alloc's of 77421063 bytes 
        58.831524 s: DDR_SHARED_MEM: Free's : 61 free's  of 77421063 bytes 
        58.831533 s: DDR_SHARED_MEM: Open's : 0 allocs  of 0 bytes 
        58.831549 s: MEM: Deinit ... Done !!!
    APP: Deinit ... Done !!!
    


    Here is the log.


    Regards,
    Sajan

  • Hello Jay,

    As for the GStreamer logs, it will take me a little time to analyze it. I'll try to get back to you tomorrow.

    Could you please provide the instructions

    Best Regards,
    Sajan

  • Hi Sajan,

    I am extremely sorry for this delay. I got caught up in some escalations. This seems like buffer allocation failure at the v4l2 level. The media graph seems correct though. This leads me to the following questions:

    Can you please share the exact pipelines that this is trying to run and the order of the pipelines?
    Are you able to capture from the sensors using yavta?
    Have you made modifications to the sensor driver? If yes, please share them.

    A sample yavta command:

    yavta -c -s 1920x1080 -f SRGGB8 /dev/video-imx219-cam0 -F

    This will save the data in frame-#.bin where # is the frame number which will be recorded. If this works, we can rule out CSI completely.

    Please test out yavta capture in the same order you would test out GStreamer capture.

    Regards,
    Jay

  • Hello Jay,

    Sorry for the delay. 

    A sample yavta command:

    # yavta -c -s 1920x1080 -f SRGGB8 /dev/video-imx219-cam0 -F
    Device /dev/video-imx219-cam0 opened.
    Device `j721e-csi2rx' on `platform:30102000.ticsi2rx' (driver 'j721e-csi2rx') supports video, capture, without mplanes.
    Video f[  347.919655] j721e-csi2rx 30102000.ticsi2rx: Width does not match (source 1920, sink 640)
    ormat set: SRGGB8 (42474752) 1920x1080 (stride 1920) field none buffer size 2073600
    Video format: SRGGB8 (42474752) 1920x1080 (stride 1920) field none buffer size 2073600
    8 buffers requested.
    length: 2073600 offset: 0 timestamp type/source: mono/EoF
    Buffer 0/0 mapped at address 0xffff98b45000.
    length: 2073600 offset: 2076672 timestamp type/source: mono/EoF
    Buffer 1/0 mapped at address 0xffff9894a000.
    length: 2073600 offset: 4153344 timestamp type/source: mono/EoF
    Buffer 2/0 mapped at address 0xffff9874f000.
    length: 2073600 offset: 6230016 timestamp type/source: mono/EoF
    Buffer 3/0 mapped at address 0xffff98554000.
    length: 2073600 offset: 8306688 timestamp type/source: mono/EoF
    Buffer 4/0 mapped at address 0xffff98359000.
    length: 2073600 offset: 10383360 timestamp type/source: mono/EoF
    Buffer 5/0 mapped at address 0xffff9815e000.
    length: 2073600 offset: 12460032 timestamp type/source: mono/EoF
    Buffer 6/0 mapped at address 0xffff97f63000.
    length: 2073600 offset: 14536704 timestamp type/source: mono/EoF
    Buffer 7/0 mapped at address 0xffff97d68000.
    Unable to start streaming: Broken pipe (32).
    8 buffers released.
    


    Could you please help on the same.

    Warm Regards,
    Sajan

  • Hi Sajan,

    So this is most likely an issue with the media graph. Can you please share the media-ctl -p output that you have before you run the gstreamer/yavta commands but after any media graph settings that you do? I could find out from there.

    Also, I am in the middle of some critical escalations, so my responses may be delayed by a day or two this week. Apologies in advance.

    Regards,
    Jay

  • Hello Jay,

    I thought that the issue occurred because of configuration mismatch issue like input and output.

    Now I think it is solved, when I modify the config files.

    Thanks for your help.

    Warm Regards,
    Sajan

  • Hi Sajan,

    Thanks for this update. I will close this thread.

    Regards,
    Jay