This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

PROCESSOR-SDK-AM68A: Issue with AM69A and V3Link Camera Kit

Part Number: PROCESSOR-SDK-AM69A
Other Parts Discussed in Thread: AM69A

Tool/software:

Hello,

I am using the V3Link Camera Kit with the AM69A.

Following the instructions in the document linked below, I was able to recognize four cameras: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-am69a/09_02_00/exports/edgeai-docs/devices/AM69A/linux/getting_started.html#mini-fusion

When I ran the sample app from app_python using the following command, I encountered an issue where the video from the first camera (camera 0) becomes distorted when more than two cameras are recognized. There is no issue when I use cameras 1, 2, and 3.

root@am69a-sk:/opt/edgeai-gst-apps# ./apps_python/app_edgeai.py configs/imx219_cam_example.yaml

image from the 0th camera

image from the 1st, 2nd, and 3rd cameras

Do you have any insights into this phenomenon?

Thank you.

  • Hi,

    Is this issue consistent or does it flicker around as you move the sensor? Could you try swapping the FPDLink cable for the imx219 sensor that has the issue with one of the working ones to determine whether this is a cable or sensor problem?

    For your convenience, I recommend using this configuration file to see all 4 streams at once:

    title: "IMX219 V3Link - Multi Input, Multi Inference"
    log_level: 2
    inputs:
        input0:
            source: /dev/video-imx219-cam0
            subdev-id: /dev/v4l-imx219-subdev0
            width: 1920
            height: 1080
            format: rggb
            framerate: 30
        input1:
            source: /dev/video-imx219-cam1
            subdev-id: /dev/v4l-imx219-subdev1
            width: 1920
            height: 1080
            format: rggb
            framerate: 30
        input2:
            source: /dev/video-imx219-cam2
            subdev-id: /dev/v4l-imx219-subdev2
            width: 1920
            height: 1080
            format: rggb
            framerate: 30
        input3:
            source: /dev/video-imx219-cam3
            subdev-id: /dev/v4l-imx219-subdev3
            width: 1920
            height: 1080
            format: rggb
            framerate: 30
    models:
        model0:
            model_path: /opt/model_zoo/TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320
            viz_threshold: 0.6
        model1:
            model_path: /opt/model_zoo/ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416
            viz_threshold: 0.6
        model2:
            model_path: /opt/model_zoo/ONR-CL-6360-regNetx-200mf
            topN: 5
        model3:
            model_path: /opt/model_zoo/ONR-SS-8610-deeplabv3lite-mobv2-ade20k32-512x512
            alpha: 0.4
    outputs:
        output0:
            sink: kmssink
            width: 1920
            height: 1080
            overlay-perf-type: graph
        output1:
            sink: /opt/edgeai-test-data/output/output_video.mkv
            width: 1920
            height: 1080
        output2:
            sink: /opt/edgeai-test-data/output/output_image_%04d.jpg
            width: 1920
            height: 1080
        output3:
            sink: remote
            width: 1920
            height: 1080
            port: 8081
            host: 127.0.0.1
            encoding: jpeg
            overlay-perf-type: graph
    
    flows:
        flow0: [input0,model0,output0,[320,150,640,360]]
        flow1: [input1,model1,output0,[960,150,640,360]]
        flow2: [input2,model2,output0,[320,530,640,360]]
        flow3: [input3,model3,output0,[960,530,640,360]]

    Thank you,

    Fabiana

  • Hi Fabiana,

    Thank you for your response.

    I ran the program using the configuration file you provided, and the video from all four cameras displayed correctly. However, when I reduce the number of flows in the configuration file, the video from the 0th camera becomes distorted. This issue can be reproduced when only flow0 is enabled. I also tried swapping the cameras and cables, but the issue persisted.

    Thank you,

    Shotaro

  • Hi Shotaro,

    Could you provide more details about your testing? When you are swapping the cameras and cables around, are the inputs in your flows remaining the same? Does the issue seem to be coming from a single sensor? If so, I suggest you get in contact with Arducam about this issue as it appears that this may be a hardware issue.

    Thank you,

    Fabiana

  • Hi Fabiana,

    Thank you for your response.

    We are keeping the inputs in the flows the same, only enabling flow0 while swapping the sensor devices and cables. This suggests that the issue is not related to the sensor or cable hardware. Additionally, when the video output is abnormal, the frame rate shows as 60, although it should be set to 30, which indicates a peculiar phenomenon.

    Best regards,

    Shotaro

  • Hi Shotaro,

    Thank you for the additional information. Please allow me some time to run some tests on my end and discuss the issue with our dev team.

    Best Regards,

    Fabiana

  • Hi Shotaro,

    This is a known issue where we see the CSI2RX SHIM DMA context channel 0 accepts all handled data. Due to the driver implementation, all of the other sensors are still streaming so when one (or a subset) of cameras in a multi-camera system is streaming, DMA context 0 accepts frames from different virtual channels.

    This issue is being addressed internally but for the time being, streaming from one or a subset of cameras in a multi-camera system is not supported.

    Thank you,

    Fabiana

  • Fabiana,

    Thank you for investigating this issue. I will wait for the resolution.

    Best regards,

    Shotaro

  • Hi Shotaro,

    I will come back and update once changes are made. Closing this thread for now.

    Thank you,

    Fabiana

  • Hi Shotaro,

    This the fix for this issue is planned to be implemented in the upcoming 11.0 SDK release, but the patch is available here: https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1438530/j722sxh01evm-the-csi2rx-kernel-module-fails-at-probe-spontaneously/5631188#5631188

    Thank you,

    Fabiana