SK-TDA4VM: Camera view is not visible using GStreamer

Tarun Rajput

Part Number: SK-TDA4VM
Other Parts Discussed in Thread: TDA4VM

Hi,

I am trying to integrate IMX217 camera sensor to TDA4VM.

CSI Camera 0 detected
    device = /dev/video2
    name = imx219
    format = [fmt:SRGGB8_1X8/1920x1080]
    subdev_id = /dev/v4l-subdev2
    isp_required = yes

I am running following commands:

1. gst-launch-1.0 v4l2src device=/dev/video2 ! autovideosink -v

Using this command, I am not able to see camera video but it's output is :

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstKMSSink:autovideosink0-actual-sink-kms: display-width = 1920
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstKMSSink:autovideosink0-actual-sink-kms: display-height = 1080
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstKMSSink:autovideosink0-actual-sink-kms.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive

2. gst-launch-1.0 v4l2src device=/dev/video2 ! kmssink -v

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
/GstPipeline:pipeline0/GstKMSSink:kmssink0: display-width = 1920
/GstPipeline:pipeline0/GstKMSSink:kmssink0: display-height = 1080
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstKMSSink:kmssink0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)3840, height=(int)2160, framerate=(fraction)120/1, colorimetry=(string)2:6:5:1, interlace-mode=(string)progressive
Setting pipeline to PLAYING ...
New clock: GstSystemClock

Getting no error but camera view is not visible on monitor.

Please help what is missing in the command that I am not able to see camera view.

over 2 years ago

+1 Fabiana Jaimes over 2 years ago

TI__Mastermind 19670 points

Hi Tarun,

Could you share which SDK version you are using?

Assuming you are using v8.x based on the device name (/dev/video2), try running the following:

gst-launch-1.0 v4l2src device=/dev/video2 io-mode=5 ! queue leaky=2 ! \
video/x-bayer, width=1920, height=1080, framerate=30/1, format=rggb ! \
tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name="SENSOR_SONY_IMX219_RPI" \
dcc-isp-file=/opt/imaging/imx219/dcc_viss_1920x1080.bin \
sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a_1920x1080.bin format-msb=7 ! \
tiovxmultiscaler ! \
video/x-raw, format=NV12, width=1920, height=1080, framerate=30/1 ! \
kmssink driver-name=tidss sync=false

To better understand why the GStreamer pipeline is constructed this way for IMX219 input, see: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-edgeai/TDA4VM/08_06_01/exports/docs/common/edgeai_dataflows.html#rpiv2-camera-sensor-imx219

I hope this helps.

Thank you,

Fabiana

0 Tarun Rajput over 2 years ago in reply to Fabiana Jaimes

Prodigy 70 points

Hi Fabiana,

Thanks for the prompt help. Now I am able to open the camera and see its view on monitor.

I am using SDK v8.6.

Just one more think I need to know that what change in above command is required to click the .jpg pictures. One picture at one command.

Thanks.

0 Fabiana Jaimes over 2 years ago in reply to Tarun Rajput

TI__Mastermind 19670 points

Hi Tarun,

Could you clarify which .jpg pictures you are referring to? Do you mean the .jpg images under /opt/edgeai-test-data/images?

Thank you,

Fabiana

0 Fabiana Jaimes over 2 years ago in reply to Fabiana Jaimes

TI__Mastermind 19670 points

Hi Tarun,

I see you have created a new thread for this new question here: https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1331716/sk-tda4vm-sdk-v8-6

I will close this thread and continue the discussion there.

Thank you,

Fabiana

Processors

Processors forum

SK-TDA4VM: Camera view is not visible using GStreamer