• State TI Thinks Resolved
  • Locked Locked
  • Replies 14 replies
  • Answers 4 answers
  • Subscribers 98 subscribers
  • Views 906 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

Original question:

Reading video or feed from imx 219 using gstreamer and opencv in a python code

SK-TDA4VM: J721EXSKG01EVM TDA4VM evaluation board CSI camera IMX219 getting detected but get error while trying to open.

Aditya Varadaraj
Prodigy 100 points
Part Number: SK-TDA4VM

When I ssh into the board via ethernet, I get the following:

CSI Camera 1 detected
device = /dev/video2
name = imx219
format = [fmt:SRGGB10_1X10/1920x1080]
subdev_id = /dev/v4l-subdev2
isp_required = yes

When I do v4l2-ctl --list-devices --list-formats-ext, I get:

TI-CSI2RX (platform:4500000.ticsi2rx):
/dev/media0

j721e-csi2rx (platform:4510000.ticsi2rx):
/dev/video2
/dev/video3
/dev/video4
/dev/video5
/dev/video6
/dev/video7
/dev/video8
/dev/video9
/dev/video10
/dev/video11
/dev/video12
/dev/video13
/dev/video14
/dev/video15
/dev/video16
/dev/video17
/dev/media1

vxd-dec (platform:vxd-dec):
/dev/video1

vxe-enc (platform:vxe-enc):
/dev/video0

ioctl: VIDIOC_ENUM_FMT
Type: Video Capture Multiplanar

[0]: 'H264' (H.264, compressed)
Size: Continuous 1x1 - 1920x1080

When I run the following command:

gst-launch-1.0 v4l2src device=/dev/video-rpi-cam0 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a.bin sink_0::device=/dev/v4l-rpi-subdev0 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

I get:

APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
1208.476466 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
1208.476737 s: VX_ZONE_INIT:Enabled
1208.476805 s: VX_ZONE_ERROR:Enabled
1208.476854 s: VX_ZONE_WARNING:Enabled
1208.477583 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
1208.477944 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
Setting pipeline to PAUSED ...
ERROR: Pipeline doesn't want to pause.
ERROR: from element /GstPipeline:pipeline0/GstKMSSink:kmssink0: Could not get allowed GstCaps of device
Additional debug info:
../gst-plugins-bad-1.16.3/sys/kms/gstkmssink.c(892): gst_kms_sink_start (): /GstPipeline:pipeline0/GstKMSSink:kmssink0:
driver does not provide mode settings configuration
Setting pipeline to NULL ...
Freeing pipeline ...
1208.484944 s: VX_ZONE_ERROR:[vxGetStatus:700] Reference is NULL
1208.485143 s: VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!!
1208.489755 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
DDR_SHARED_MEM: Alloc's: 0 alloc's of 0 bytes
DDR_SHARED_MEM: Free's : 0 free's of 0 bytes
DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes
DDR_SHARED_MEM: Total size: 536870912 bytes
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

How do I solve this error? How do I open the camera using gst-launch-1.0? And how do I open it using OpenCV?

All the above is outside docker. Just plain ssh. 

Also, How do I access the camera inside the Ubuntu 20.04 ROS noetic Docker container?

  • 0
    TI__Mastermind 47923 points

    Hello, 

    The topic expert looking into this topic  is currently out-of-office and is expected to be back in 1-2 days. So please expect delay in response to this query.

    Thanks.

  • 0
    TI__Mastermind 19680 points

    Hi Aditya,

    Could you try running the following command?

    gst-launch-1.0 v4l2src device=/dev/video-rpi-cam0 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a.bin sink_0::device=/dev/v4l-rpi-subdev0 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

    Thank you,

    Fabiana Jaimes

  • 0 in reply to Fabiana Jaimes
    Prodigy 100 points

    Sorry for the delay in my response. Here's the output when HDMI display is not connected:

    root@tda4vm-sk:/opt/edgeai-gst-apps# gst-launch-1.0 v4l2src device=/dev/video-rpi-cam0 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a.bin sink_0::device=/dev/v4l-rpi-subdev0 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false
    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=5) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
    1170.909378 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
    1170.912588 s: VX_ZONE_INIT:Enabled
    1170.912604 s: VX_ZONE_ERROR:Enabled
    1170.912615 s: VX_ZONE_WARNING:Enabled
    1170.913422 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
    1170.913570 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    Setting pipeline to PAUSED ...
    ERROR: Pipeline doesn't want to pause.
    ERROR: from element /GstPipeline:pipeline0/GstKMSSink:kmssink0: Could not get allowed GstCaps of device
    Additional debug info:
    ../gst-plugins-bad-1.16.3/sys/kms/gstkmssink.c(892): gst_kms_sink_start (): /GstPipeline:pipeline0/GstKMSSink:kmssink0:
    driver does not provide mode settings configuration
    Setting pipeline to NULL ...
    Freeing pipeline ...
    1170.917236 s: VX_ZONE_ERROR:[vxGetStatus:700] Reference is NULL
    1170.917259 s: VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!!
    1170.921665 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
    APP: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... Done !!!
    IPC: Deinit ... !!!
    IPC: DeInit ... Done !!!
    MEM: Deinit ... !!!
    DDR_SHARED_MEM: Alloc's: 0 alloc's of 0 bytes
    DDR_SHARED_MEM: Free's : 0 free's of 0 bytes
    DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes
    DDR_SHARED_MEM: Total size: 536870912 bytes
    MEM: Deinit ... Done !!!
    APP: Deinit ... Done !!!

    Here's the output if HDMI connected:

    root@tda4vm-sk:/opt/edgeai-gst-apps# gst-launch-1.0 v4l2src device=/dev/video-rpi-cam0 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a.bin sink_0::device=/dev/v4l-rpi-subdev0 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false
    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=5) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
    244.102921 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
    244.102987 s: VX_ZONE_INIT:Enabled
    244.102997 s: VX_ZONE_ERROR:Enabled
    244.103006 s: VX_ZONE_WARNING:Enabled
    244.103659 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
    244.105988 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    Setting pipeline to PAUSED ...
    ERROR: Pipeline doesn't want to pause.
    ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Cannot identify device '/dev/video-rpi-cam0'.
    Additional debug info:
    ../gst-plugins-good-1.16.3/sys/v4l2/v4l2_calls.c(607): gst_v4l2_open (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
    system error: No such file or directory
    Setting pipeline to NULL ...
    Freeing pipeline ...
    244.193084 s: VX_ZONE_ERROR:[vxGetStatus:700] Reference is NULL
    244.193113 s: VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!!
    244.196564 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
    APP: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... Done !!!
    IPC: Deinit ... !!!
    IPC: DeInit ... Done !!!
    MEM: Deinit ... !!!
    DDR_SHARED_MEM: Alloc's: 0 alloc's of 0 bytes
    DDR_SHARED_MEM: Free's : 0 free's of 0 bytes
    DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes
    DDR_SHARED_MEM: Total size: 536870912 bytes
    MEM: Deinit ... Done !!!
    APP: Deinit ... Done !!!

    If I do /dev/video2 instead, with same command:

    /opt/edgeai-gst-apps# gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/linear/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/linear/dcc_2a.bin sink_0::device=/dev/v4l-rpi-subdev0 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false
    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=5) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
    376.792798 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
    376.792860 s: VX_ZONE_INIT:Enabled
    376.792869 s: VX_ZONE_ERROR:Enabled
    376.792882 s: VX_ZONE_WARNING:Enabled
    376.793697 s: VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
    376.794916 s: VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    Setting pipeline to PAUSED ...
    Pipeline is live and does not need PREROLL ...
    Setting pipeline to PLAYING ...
    New clock: GstSystemClock
    [ERROR] 176: tiovx_viss_module_configure_dcc_params: Unable to open DCC config file /opt/imaging/imx219/linear/dcc_viss.bin!
    ERROR: from element /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp0: Unable to init TIOVX module
    Additional debug info:
    ../git/gst-libs/gst/tiovx/gsttiovxmiso.c(1511): gst_tiovx_miso_negotiated_src_caps (): /GstPipeline:pipeline0/GstTIOVXISP:tiovxisp0
    Execution ended after 0:00:00.083284754
    Setting pipeline to NULL ...
    Freeing pipeline ...
    377.027494 s: VX_ZONE_WARNING:[vxReleaseContext:1055] Found a reference 0xffff9f1ac968 of type 00000816 at external count 1, internal count 0, releasing it
    377.027520 s: VX_ZONE_WARNING:[vxReleaseContext:1057] Releasing reference (name=user_data_object_111) now as a part of garbage collection
    377.027646 s: VX_ZONE_INIT:[tivxHostDeInitLocal:107] De-Initialization Done for HOST !!!
    377.032024 s: VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
    APP: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... !!!
    REMOTE_SERVICE: Deinit ... Done !!!
    IPC: Deinit ... !!!
    IPC: DeInit ... Done !!!
    MEM: Deinit ... !!!
    DDR_SHARED_MEM: Alloc's: 5 alloc's of 16588892 bytes
    DDR_SHARED_MEM: Free's : 5 free's of 16588892 bytes
    DDR_SHARED_MEM: Open's : 0 allocs of 0 bytes
    DDR_SHARED_MEM: Total size: 536870912 bytes
    MEM: Deinit ... Done !!!
    APP: Deinit ... Done !!!

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Hi Aditya,

    I believe the issue is that you are attempting to run commands that are compatible with our latest SDK release on an older version. To avoid any confusion, please follow the documentation for the SDK version you are using by selecting the version on the left-hand side of this page: https://www.ti.com/tool/download/PROCESSOR-SDK-LINUX-SK-TDA4VM

    Assuming you are on SDK v08x, please try running the following command:

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

    Ensure that the device name and subdev id matches what you see upon boot or when running init_script.sh.

    Thank you,

    Fabiana Jaimes

  • 0 in reply to Fabiana Jaimes
    Prodigy 100 points

    Hi. No errors. But nothing is shown. Neither on HDMI nor on the PC from where I ssh into it.

     

    root@tda4vm-sk:/opt/edgeai-gst-apps# gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false
    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=5) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
       183.175063 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
       183.175126 s:  VX_ZONE_INIT:Enabled
       183.175136 s:  VX_ZONE_ERROR:Enabled
       183.175144 s:  VX_ZONE_WARNING:Enabled
       183.175820 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
       183.175969 s:  VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
    Setting pipeline to PAUSED ...
    Pipeline is live and does not need PREROLL ...
    Setting pipeline to PLAYING ...
    New clock: GstSystemClock

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Hi Aditya,

    Do you see the Edge AI gallery application on your HDMI display upon boot?

    Thank you,

    Fabiana Jaimes

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Could you try the following:

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

    Thank you,

    Fabiana

  • 0 in reply to Fabiana Jaimes
    Prodigy 100 points

    I am getting output on the HDMI but color scheme seems a bit off. Also, 1) how do I do this for 2 IMX219 cameras, 2) how do I open the display on the machine from where I SSH, and 3) how do I open it from within the ROS 1/Ubuntu 20.04 docker container?

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Hi Aditya,

    The color issue would come from a mismatch between the color format and the ISP files used. The following command should correct this:

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss_10.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a_10b.bin sink_0::device=/dev/v4l-subdev2 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

    Below is an example pipeline for two IMX219 cameras. Make sure /dev/video and subdev numbers match what is detected upon boot.

    gst-launch-1.0 \
v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss_10b.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a_10b.bin sink_0::device=/dev/v4l-subdev2 ! \
"video/x-raw,format=NV12" ! tiovxmultiscaler target=0 ! video/x-raw, width=640, height=360 ! mosaic.sink_0 \
v4l2src device=/dev/video10 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss_10b.bin format-msb=7 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a_10b.bin sink_1::device=/dev/v4l-subdev5 ! \
"video/x-raw,format=NV12" ! tiovxmultiscaler target=1 ! video/x-raw, width=640, height=360 ! mosaic.sink_1 \
tiovxmosaic name=mosaic \
sink_0::startx="<0>" sink_0::starty="<200>" \
sink_1::startx="<640>" sink_1::starty="<200>" ! \
tiperfoverlay ! video/x-raw, format=NV12, width=1280, height=800 ! queue ! kmssink sync=false driver-name=tidss

    To open from anywhere else besides the connected DP/HDMI display, you can specify the sink as remote in your pipeline. Add the following to the end of your pipeline running on target:

    ! udpsink sync=False clients=127.0.0.1:8081 host=127.0.0.1 port=8081

    The display can be viewed by running the following pipeline on the remote PC:

    gst-launch-1.0 udpsrc port=8081 ! application/x-rtp,encoding=H264 ! rtph264depay ! h264parse ! avdec_h264 ! autovideosink

    The SDK documentation has sections on remote sinks under Configuring Applications and some example pipelines under Edge AI dataflows.

    I hope this helps.

    Thanks,

    Fabiana

  • 0 in reply to Fabiana Jaimes
    Prodigy 100 points

    Ok. So it was a problem with format-msb setting not the bin files. This is the command that worked.

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=6 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2 ! video/x-raw,format=NV12, width=1920, height=1080 ! queue ! kmssink driver-name=tidss sync=false

    But the 2 camera case gives some error with the problem.

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=6 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2! video/x-raw,format=NV12 ! tiovxmultiscaler target=0 ! video/x-raw, width=640, height=360 ! mosaic.sink_0 v4l2src device=/dev/video18 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=6 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_1::device=/dev/v4l-subdev5 ! video/x-raw,format=NV12 ! tiovxmultiscaler target=1 ! video/x-raw, width=640, height=360 ! mosaic.sink_1 tiovxmosaic name=mosaic sink_0::start_x="<0>" sink_0::starty="<200>" sink_1::startx="<640>" sink_1::starty="<200>" ! perfoverlay ! video/x-raw, format=NV12, widh=1280, height=800 ! queue ! kmssink sync=false driver-name=tidss

    APP: Init ... !!!
    MEM: Init ... !!!
    MEM: Initialized DMA HEAP (fd=5) !!!
    MEM: Init ... Done !!!
    IPC: Init ... !!!
    IPC: Init ... Done !!!
    REMOTE_SERVICE: Init ... !!!
    REMOTE_SERVICE: Init ... Done !!!
      2083.312201 s: GTC Frequency = 200 MHz
    APP: Init ... Done !!!
      2083.312289 s:  VX_ZONE_INIT:Enabled
      2083.312299 s:  VX_ZONE_ERROR:Enabled
      2083.312324 s:  VX_ZONE_WARNING:Enabled
      2083.313030 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
      2083.315331 s:  VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!

    (gst-launch-1.0:1997): GStreamer-CRITICAL **: 18:55:02.358: gst_element_make_from_uri: assertion 'gst_uri_is_valid (uri)' failed
    WARNING: erroneous pipeline: no element "video"

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Hi Aditya,

    I see you have some typos and syntax errors in the pipeline you shared. Could you try the following:

    gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=6 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_0::device=/dev/v4l-subdev2 ! "video/x-raw,format=NV12" ! tiovxmultiscaler target=0 ! video/x-raw, width=640, height=360 ! mosaic.sink_0 v4l2src device=/dev/video10 io-mode=5 ! queue leaky=2 ! video/x-bayer, width=1920, height=1080, format=rggb10 ! tiovxisp sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin format-msb=6 sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a.bin sink_1::device=/dev/v4l-subdev5 ! "video/x-raw,format=NV12" ! tiovxmultiscaler target=1 ! video/x-raw, width=640, height=360 ! mosaic.sink_1 tiovxmosaic name=mosaic sink_0::start_x="<0>" sink_0::starty="<200>" sink_1::startx="<640>" sink_1::starty="<200>" ! tiperfoverlay ! video/x-raw, format=NV12, width=1280, height=800 ! queue ! kmssink sync=false driver-name=tidss

    Again, be sure to change /dev/video and subdev numbers match what is detected upon boot.

    Hope that helps.

    Thank you,

    Fabiana

  • 0 in reply to Fabiana Jaimes
    Prodigy 100 points

    Hi Fabiana. Thanks a lot. This works although it shows one cameras output darker than the other.

    I am also trying to do stereo depth estimation with the 2 cameras. I want to use the SDE. However most resources I found instruct on using it on pre-recorded videos. How do I use it real-time on video stream from 2 Arducam IMX219 cameras?

  • 0 in reply to Aditya Varadaraj
    TI__Mastermind 19680 points

    Hi Aditya,

    Please look at the format for both cameras and ensure that they match what is defined in the pipeline. You could also define saturation in the pipeline. We do not have any examples for this in our documentation, but you can find more about this on GStreamer tutorial pages on the web.

    I believe this initial question has been resolved, for your other query, could you please create a new E2E post? I suggest getting started by looking at this page if you haven't already.

    Thank you,

    Fabiana