TDA4VM: edge ai object detection

Hi

Which SDK version you are using ?

Can you check if any std object detection demo with cam input is running ? (webcam based etc)

Can you run the demo as mentioned here : 

https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-edgeai/TDA4VM/09_00_01/exports/docs/common/sample_apps.html#python-c-apps

Here is my sdk version : imaging-REL.PSDK.JACINTO.09.00.00.02

furthermore, it worked with demo video.

but when I run it with usb cam, it dies or gets stuck there all the time..

with csi cam, just get error there (doesn't work)

Hi,

I believe you have downloaded and flashed the sdk from https://www.ti.com/tool/PROCESSOR-SDK-J721E for your current exp.

Can you share the log of USB cam demo run ?

Please make sure you run the demo as mentioned here :

Pratik Kedar said:

Can you run the demo as mentioned here : 

https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-edgeai/TDA4VM/09_00_01/exports/docs/common/sample_apps.html#python-c-apps

Make sure you run command is visible in logs.

Also can you share the config file that you are using for object detection ? Have you made correct change to take accept cam based input ?

Also can you share which USB cam you are using ? Here is the info about supported cam : https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-edgeai/TDA4VM/09_00_01/exports/docs/devices/TDA4VM/linux/getting_started.html

Thank you for your help.

I followed your steps and I got the below result.

But I would like to know why there are 3 input videos and what does it mean?

title: "Object Detection Demo"
log_level: 2
inputs:
    input0:
        source: /dev/video2
        format: rggb
        width: 1920
        height: 1080
        sen_id: imx219
        framerate: 30
    input1:
        source: /opt/edge_ai_apps/data/videos/video_0000_h264.mp4
        format: h264_sw
        width: 1280
        height: 720
        framerate: 30
        loop: True
    input2:
        source: /opt/edge_ai_apps/data/images/%04d.jpg
        width: 1280
        height: 720
        index: 0
        framerate: 1
        loop: True
models:
    model0:
        model_path: /opt/model_zoo/TVM-OD-5020-yolov3-mobv1-gluon-mxnet-416x416
        viz_threshold: 0.6
    model1:
        model_path: /opt/model_zoo/TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320
        viz_threshold: 0.6
    model2:
        model_path: /opt/model_zoo/ONR-OD-8050-ssd-lite-regNetX-800mf-fpn-bgr-mmdet-coco-512x512
        viz_threshold: 0.6
    model3:
        model_path: /opt/model_zoo/ONR-OD-8120-yolov5-m6-ti-lite-coco-640x640
        viz_threshold: 0.6
        
outputs:
    output0:
        sink: kmssink
        width: 1920
        height: 1080
    output1:
        sink: /opt/edge_ai_apps/data/output/videos/output_video.mkv
        width: 1920
        height: 1080
    output2:
        sink: /opt/edge_ai_apps/data/output/images/output_image_%04d.jpg
        width: 1920
        height: 1080

flows:
    flow0:
        input: input0
        models: [model3]
        outputs: [output0]
        mosaic:
            mosaic0:
                width:  1920
                height: 1080
                pos_x: 0
                pos_y: 0

+ one more problem, it only work with 1920x1080 resolution.

how to make 640x480 resolution work?

I could find dcc_2a_640x480.bin & dcc_viss_640x480.bin on imaging-REL.PSDK.JACINTO.09.00.00.02. and put it on /opt/imaging/imx219, but didn't work.

Image result is not clear, can you re share the same

this is only for 1920x1080, how to run object_detection.yaml in edge_ai with 640x480 resolution?

Can you confirm underlying issue of this thread, now able to run the edgai demo using camera sensor is resolved ?

Can you set output0 to 640x480 and change the same in mosaic0 as well.

My goal is running the edge ai using camera with 640x480.

I changed resolution on object_detection.yaml to 640x480 and mosaic0 as well, but didn't work..

do you know how to run command like this? but with 640x480

Just wanted to check, if you still need any support on this?