TDA4VM: [TDA4VM-SK] Integrating camera module 3 to Linux SDK (11.00.00.08)

Soorya Prakash Sakthivel

Part Number: TDA4VM

Hi Team,

We have downloaded the linux processor sdk 11.00.00.08 and were able to flash the target and view the edge ai gallery. The SDK supports Raspberry camer module 2 (imx219) but we wanted to integrate Raspberry camera module 3 (imx708). Are there any application notes or how to guide to integrate into the linux SDK ?

Please guide us on the same.

Thanks & Regards,

Soorya

8 months ago

0 Jared McArthur 8 months ago

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

There's an application note for getting a new sensor up and running: https://www.ti.com/lit/an/spradh2a/spradh2a.pdf

Best,
Jared

0 Soorya Prakash Sakthivel 8 months ago in reply to Jared McArthur

Prodigy 80 points

Hi Jared McArthur

Thanks for sharing the application note. I followed the procedure and flashed into SD card.

But imx708 sensor is not detected properly, relevant boot log

[ 10.931317] /bus@100000/i2c@2030000/i2c-mux@70/i2c@1/imx708-1@10: Fixed dependency cycle(s) with /bus@100000/ticsi2rx@4510000/csi-bridge@4514000
[ 10.947100] /bus@100000/ticsi2rx@4510000/csi-bridge@4514000: Fixed dependency cycle(s) with /bus@100000/i2c@2030000/i2c-mux@70/i2c@1/imx708-1@10
[ 10.962547] k3-dsp-rproc 64800000.dsp: assigned reserved memory node vision-apps-c71-dma-memory@b2000000
[ 10.969017] cdns-csi2rx 4514000.csi-bridge: Probed CSI2RX with 2/4 lanes, 4 streams, external D-PHY
[ 10.981133] k3-dsp-rproc 64800000.dsp: configured DSP for IPC-only mode
[ 10.987991] remoteproc remoteproc4: 64800000.dsp is available
[ 10.994270] remoteproc remoteproc4: attaching to 64800000.dsp

PFA dtso file I used for imx708 in zip
imx708.zip

Thanks & Regards,

Soorya

0 Jared McArthur 8 months ago in reply to Soorya Prakash Sakthivel

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

Soorya Prakash Sakthivel said:
[ 10.931317] /bus@100000/i2c@2030000/i2c-mux@70/i2c@1/imx708-1@10: Fixed dependency cycle(s) with /bus@100000/ticsi2rx@4510000/csi-bridge@4514000
[ 10.947100] /bus@100000/ticsi2rx@4510000/csi-bridge@4514000: Fixed dependency cycle(s) with /bus@100000/i2c@2030000/i2c-mux@70/i2c@1/imx708-1@10
[ 10.962547] k3-dsp-rproc 64800000.dsp: assigned reserved memory node vision-apps-c71-dma-memory@b2000000
[ 10.969017] cdns-csi2rx 4514000.csi-bridge: Probed CSI2RX with 2/4 lanes, 4 streams, external D-PHY
[ 10.981133] k3-dsp-rproc 64800000.dsp: configured DSP for IPC-only mode
[ 10.987991] remoteproc remoteproc4: 64800000.dsp is available
[ 10.994270] remoteproc remoteproc4: attaching to 64800000.dsp

These logs don't seem like an issue.

If you run i2cdetect -y -r <i2c-bus> do you see a "U" where the imx708 should be?

If you run lsmod, does imx708 appear?

What is the output of media-ctl -p?

Best,
Jared

0 Soorya Prakash Sakthivel 8 months ago in reply to Jared McArthur

Prodigy 80 points

i2cdetect -y -r 5 (I have configured imx708 reg as 1a, I can see it is not claimed by the kernel driver)

root@tda4vm-sk:/opt/edgeai-gst-apps# i2cdetect -y -r 7
     0  1  2  3  4  5  6  7  8  9  a  b  c  d  e  f
00:                         -- -- -- -- 0c -- -- --
10: -- -- -- -- -- -- -- -- -- -- 1a -- -- -- -- --
20: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
30: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
40: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
50: 50 -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
60: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
70: UU -- -- -- -- -- -- --

lsmod does not detect imx708 as shown below

root@tda4vm-sk:/opt/edgeai-gst-apps# lsmod
Module                  Size  Used by
onboard_usb_dev        20480  0
rpmsg_ctrl             12288  0
rpmsg_char     im        20480  1 rpmsg_ctrl
cdns3                  40960  0
pru_rproc              20480  0
irq_pruss_intc         12288  0
cdns_usb_common        20480  1 cdns3
crct10dif_ce           12288  1
mux_gpio               12288  0
ti_tfp410              12288  0
display_connector      12288  0
phy_can_transceiver    12288  4
omap_mailbox           12288  9
omap_hwspinlock        12288  0
ti_k3_r5_remoteproc    24576  0
overlay               139264  0
j721e_csi2rx           24576  0
cdns_csi2rx            16384  3 j721e_csi2rx
videobuf2_dma_contig    16384  1 j721e_csi2rx
videobuf2_v4l2         28672  1 j721e_csi2rx
tidss                  65536  0
cdns_mhdp8546          36864  0
videobuf2_memops       12288  1 videobuf2_dma_contig
videobuf2_common       57344  4 j721e_csi2rx,videobuf2_dma_contig,videobuf2_v4l2,videobuf2_memops
drm_dma_helper         20480  1 tidss
at24                   24576  0
drm_display_helper    172032  2 cdns_mhdp8546,tidss
v4l2_fwnode            20480  1 cdns_csi2rx
pci_endpoint_test      16384  0
drm_kms_helper        180224  6 drm_dma_helper,display_connector,cdns_mhdp8546,drm_display_helper,tidss,ti_tfp410
v4l2_async             20480  3 v4l2_fwnode,j721e_csi2rx,cdns_csi2rx
k3_j72xx_bandgap       12288  0
pruss                  16384  1 pru_rproc
videodev              253952  5 v4l2_async,v4l2_fwnode,j721e_csi2rx,videobuf2_v4l2,cdns_csi2rx
ti_k3_dsp_remoteproc    12288  0
cdns_dphy_rx           12288  0
mc                     57344  6 v4l2_async,videodev,j721e_csi2rx,videobuf2_v4l2,cdns_csi2rx,videobuf2_common
ti_k3_common           20480  1 ti_k3_dsp_remoteproc
m_can_platform         12288  0
sa2ul                  32768  0
bluetooth             516096  2
m_can                  32768  1 m_can_platform
cdns3_ti               12288  0
can_dev                40960  1 m_can
ecdh_generic           16384  1 bluetooth
cfg80211              413696  0
ecc                    36864  1 ecdh_generic
rfkill                 28672  3 bluetooth,cfg80211
rti_wdt                12288  0
fuse                  139264  1
drm                   552960  8 drm_kms_helper,drm_dma_helper,display_connector,cdns_mhdp8546,drm_display_helper,tidss,ti_tfp410
drm_panel_orientation_quirks    28672  1 drm
backlight              20480  2 drm_display_helper,drm
ipv6                  475136  34

media-ctl -p log

root@tda4vm-sk:/opt/edgeai-gst-apps# media-ctl -p
Media controller API version 6.12.17

Media device information
------------------------
driver          j721e-csi2rx
model           TI-CSI2RX
serial
bus info        platform:4500000.ticsi2rx
hw revision     0x1
driver version  6.12.17

Device topology
- entity 1: 4500000.ticsi2rx (17 pads, 0 link, 0 routes)
            type V4L2 subdev subtype Unknown flags 0
        pad0: SINK
        pad1: SOURCE
        pad2: SOURCE
        pad3: SOURCE
        pad4: SOURCE
        pad5: SOURCE
        pad6: SOURCE
        pad7: SOURCE
        pad8: SOURCE
        pad9: SOURCE
        pad10: SOURCE
        pad11: SOURCE
        pad12: SOURCE
        pad13: SOURCE
        pad14: SOURCE
        pad15: SOURCE
        pad16: SOURCE

- entity 19: cdns_csi2rx.4504000.csi-bridge (5 pads, 0 link, 0 routes)
             type V4L2 subdev subtype Unknown flags 0
        pad0: SINK
        pad1: SOURCE
        pad2: SOURCE
        pad3: SOURCE
        pad4: SOURCE

Is there a possibility that there is a mistake in dtso file ? I have attached the dtso file for reference

k3-j721e-sk-csi2-imx708.zip

0 Jared McArthur 8 months ago in reply to Soorya Prakash Sakthivel

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

Did you add the device tree overlay to the uEnv.txt?

You need to add it to the name_overlays variable:

name_overlays=ti/k3-j721e-sk-csi2-imx708.dtbo

You can also check whether the imx708 appears in /proc/device-tree:

$ cd /proc/device-tree/
$ find -name *imx*

Best,
Jared

0 Soorya Prakash Sakthivel 8 months ago in reply to Jared McArthur

Prodigy 80 points

Hi Jared McArthur ,

The driver file imx708.c file was not properly included earlier for compilation, fixed that but still unable to view camera in custom camera option of edge ai gallery

Slave address 1a is properly bounded to the kernel driver

root@tda4vm-sk:/opt/edgeai-gst-apps# i2cdetect -y -r 7
     0  1  2  3  4  5  6  7  8  9  a  b  c  d  e  f
00:                         -- -- -- -- 0c -- -- --
10: -- -- -- -- -- -- -- -- -- -- UU -- -- -- -- --
20: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
30: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
40: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
50: 50 -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
60: -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
70: UU -- -- -- -- -- -- --

lsmod properly detects imx708

root@tda4vm-sk:/opt/edgeai-gst-apps# lsmod
Module                  Size  Used by
onboard_usb_dev        20480  0
rpmsg_ctrl             12288  0
rpmsg_char             20480  1 rpmsg_ctrl
irq_pruss_intc         12288  0
pru_rproc              20480  0
cdns3                  40960  0
cdns_usb_common        20480  1 cdns3
crct10dif_ce           12288  1
mux_gpio               12288  0
ti_tfp410              12288  0
display_connector      12288  0
phy_can_transceiver    12288  4
omap_mailbox           12288  9
omap_hwspinlock        12288  0
ti_k3_r5_remoteproc    24576  0
overlay               139264  0
tidss                  65536  1
cdns_mhdp8546          36864  0
at24                   24576  0
drm_dma_helper         20480  3 tidss
j721e_csi2rx           24576  0
k3_j72xx_bandgap       12288  0
pruss                  16384  1 pru_rproc
cdns_csi2rx            16384  3 j721e_csi2rx
drm_display_helper    172032  2 cdns_mhdp8546,tidss
videobuf2_dma_contig    16384  1 j721e_csi2rx
cfg80211              413696  0
videobuf2_v4l2         28672  1 j721e_csi2rx
drm_kms_helper        180224  6 drm_dma_helper,display_connector,cdns_mhdp8546,drm_display_helper,tidss,ti_tfp410
m_can_platform         12288  0
videobuf2_memops       12288  1 videobuf2_dma_contig
imx708                 28672  0
sa2ul                  32768  0
videobuf2_common       57344  4 j721e_csi2rx,videobuf2_dma_contig,videobuf2_v4l2,videobuf2_memops
ti_k3_dsp_remoteproc    12288  0
m_can                  32768  1 m_can_platform
pci_endpoint_test      16384  0
ti_k3_common           20480  1 ti_k3_dsp_remoteproc
v4l2_fwnode            20480  3 imx708,cdns_csi2rx
can_dev                40960  1 m_can
v4l2_async             20480  4 v4l2_fwnode,j721e_csi2rx,imx708,cdns_csi2rx
cdns_dphy_rx           12288  0
cdns3_ti               12288  0
videodev              253952  6 v4l2_async,v4l2_fwnode,j721e_csi2rx,imx708,videobuf2_v4l2,cdns_csi2rx
bluetooth             516096  2
mc                     57344  7 v4l2_async,videodev,j721e_csi2rx,imx708,videobuf2_v4l2,cdns_csi2rx,videobuf2_common
ecdh_generic           16384  1 bluetooth
rti_wdt                12288  0
ecc                    36864  1 ecdh_generic
rfkill                 28672  3 bluetooth,cfg80211
fuse                  139264  1
drm                   552960  8 drm_kms_helper,drm_dma_helper,display_connector,cdns_mhdp8546,drm_display_helper,tidss,ti_tfp410
drm_panel_orientation_quirks    28672  1 drm
backlight              20480  2 drm_display_helper,drm
ipv6                  475136  34

media-ctl -p log

root@tda4vm-sk:/opt/edgeai-gst-apps# media-ctl -p
Media controller API version 6.12.17

Media device information
------------------------
driver          j721e-csi2rx
model           TI-CSI2RX
serial
bus info        platform:4500000.ticsi2rx
hw revision     0x1
driver version  6.12.17

Device topology
- entity 1: 4500000.ticsi2rx (17 pads, 0 link, 0 routes)
            type V4L2 subdev subtype Unknown flags 0
  pad0: SINK
  pad1: SOURCE
  pad2: SOURCE
  pad3: SOURCE
  pad4: SOURCE
  pad5: SOURCE
  pad6: SOURCE
  pad7: SOURCE
  pad8: SOURCE
  pad9: SOURCE
  pad10: SOURCE
  pad11: SOURCE
  pad12: SOURCE
  pad13: SOURCE
  pad14: SOURCE
  pad15: SOURCE
  pad16: SOURCE

- entity 19: cdns_csi2rx.4504000.csi-bridge (5 pads, 0 link, 0 routes)
             type V4L2 subdev subtype Unknown flags 0
  pad0: SINK
  pad1: SOURCE
  pad2: SOURCE
  pad3: SOURCE
  pad4: SOURCE

imx708 visible under device tree
root@tda4vm-sk:/proc/device-tree# find -name "*imx*"
./regulator-imx708-vana1-2v8
./imx708-inclk
./bus@100000/i2c@2030000/i2c-mux@70/i2c@0/imx708-0@1a
./bus@100000/i2c@2030000/i2c-mux@70/i2c@1/imx708-1@1a
./regulator-imx708-vdig-1v1
./regulator-imx708-vana2-1v8
./regulator-imx708-vddl-1v8
./__symbols__/clk_imx708_fixed
./__symbols__/imx708_1
./__symbols__/imx708_vana2_1v8
./__symbols__/imx708_vdig_1v1
./__symbols__/imx708_vddl_1v8
./__symbols__/imx708_0
./__symbols__/imx708_vana1_2v8

Please guide if I am missing something. I need to be able to use this in custom camera view in Edge AI GUI

Thanks & Regards,

Soorya

0 Soorya Prakash Sakthivel 8 months ago in reply to Soorya Prakash Sakthivel

Prodigy 80 points

Jared McArthur , One correction to my previous comment related to media-ctl -p, camera imx708 is connected to /dev/media1, here is the corresponding media-ctl log for /dev/media1

As per log, I can see imx708 to csi bridge connection properly

root@tda4vm-sk:/opt/edgeai-gst-apps# media-ctl -d /dev/media1 -p
Media controller API version 6.12.17

Media device information
------------------------
driver          j721e-csi2rx
model           TI-CSI2RX
serial          
bus info        platform:4510000.ticsi2rx
hw revision     0x1
driver version  6.12.17

Device topology
- entity 1: 4510000.ticsi2rx (17 pads, 17 links, 1 route)
            type V4L2 subdev subtype Unknown flags 0
            device node name /dev/v4l-subdev0
	routes:
		0/0 -> 1/0 [ACTIVE]
	pad0: SINK
		[stream:0 fmt:SRGGB10_1X10/2304x1296 field:none]
		<- "cdns_csi2rx.4514000.csi-bridge":1 [ENABLED,IMMUTABLE]
	pad1: SOURCE
		[stream:0 fmt:SRGGB10_1X10/2304x1296 field:none]
		-> "4510000.ticsi2rx context 0":0 [ENABLED,IMMUTABLE]
	pad2: SOURCE
		-> "4510000.ticsi2rx context 1":0 [ENABLED,IMMUTABLE]
	pad3: SOURCE
		-> "4510000.ticsi2rx context 2":0 [ENABLED,IMMUTABLE]
	pad4: SOURCE
		-> "4510000.ticsi2rx context 3":0 [ENABLED,IMMUTABLE]
	pad5: SOURCE
		-> "4510000.ticsi2rx context 4":0 [ENABLED,IMMUTABLE]
	pad6: SOURCE
		-> "4510000.ticsi2rx context 5":0 [ENABLED,IMMUTABLE]
	pad7: SOURCE
		-> "4510000.ticsi2rx context 6":0 [ENABLED,IMMUTABLE]
	pad8: SOURCE
		-> "4510000.ticsi2rx context 7":0 [ENABLED,IMMUTABLE]
	pad9: SOURCE
		-> "4510000.ticsi2rx context 8":0 [ENABLED,IMMUTABLE]
	pad10: SOURCE
		-> "4510000.ticsi2rx context 9":0 [ENABLED,IMMUTABLE]
	pad11: SOURCE
		-> "4510000.ticsi2rx context 10":0 [ENABLED,IMMUTABLE]
	pad12: SOURCE
		-> "4510000.ticsi2rx context 11":0 [ENABLED,IMMUTABLE]
	pad13: SOURCE
		-> "4510000.ticsi2rx context 12":0 [ENABLED,IMMUTABLE]
	pad14: SOURCE
		-> "4510000.ticsi2rx context 13":0 [ENABLED,IMMUTABLE]
	pad15: SOURCE
		-> "4510000.ticsi2rx context 14":0 [ENABLED,IMMUTABLE]
	pad16: SOURCE
		-> "4510000.ticsi2rx context 15":0 [ENABLED,IMMUTABLE]

- entity 19: cdns_csi2rx.4514000.csi-bridge (5 pads, 2 links, 1 route)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev1
	routes:
		0/0 -> 1/0 [ACTIVE]
	pad0: SINK
		[stream:0 fmt:SRGGB10_1X10/2304x1296 field:none]
		<- "imx708":0 [ENABLED,IMMUTABLE]
	pad1: SOURCE
		[stream:0 fmt:SRGGB10_1X10/2304x1296 field:none]
		-> "4510000.ticsi2rx":0 [ENABLED,IMMUTABLE]
	pad2: SOURCE
	pad3: SOURCE
	pad4: SOURCE

- entity 25: imx708 (2 pads, 1 link, 0 routes)
             type V4L2 subdev subtype Sensor flags 0
             device node name /dev/v4l-subdev2
	pad0: SOURCE
		[stream:0 fmt:SRGGB10_1X10/2304x1296 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range
		 crop.bounds:(16,24)/4608x2592
		 crop:(16,24)/4608x2592]
		-> "cdns_csi2rx.4514000.csi-bridge":0 [ENABLED,IMMUTABLE]
	pad1: SOURCE
		[stream:0 fmt:META_14/28800x1 field:none
		 crop.bounds:(16,24)/4608x2592
		 crop:(16,24)/4608x2592]

- entity 32: 4510000.ticsi2rx context 0 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video0
	pad0: SINK
		<- "4510000.ticsi2rx":1 [ENABLED,IMMUTABLE]

- entity 38: 4510000.ticsi2rx context 1 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video1
	pad0: SINK
		<- "4510000.ticsi2rx":2 [ENABLED,IMMUTABLE]

- entity 44: 4510000.ticsi2rx context 2 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video2
	pad0: SINK
		<- "4510000.ticsi2rx":3 [ENABLED,IMMUTABLE]

- entity 50: 4510000.ticsi2rx context 3 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video3
	pad0: SINK
		<- "4510000.ticsi2rx":4 [ENABLED,IMMUTABLE]

- entity 56: 4510000.ticsi2rx context 4 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video4
	pad0: SINK
		<- "4510000.ticsi2rx":5 [ENABLED,IMMUTABLE]

- entity 62: 4510000.ticsi2rx context 5 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video5
	pad0: SINK
		<- "4510000.ticsi2rx":6 [ENABLED,IMMUTABLE]

- entity 68: 4510000.ticsi2rx context 6 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video6
	pad0: SINK
		<- "4510000.ticsi2rx":7 [ENABLED,IMMUTABLE]

- entity 74: 4510000.ticsi2rx context 7 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video7
	pad0: SINK
		<- "4510000.ticsi2rx":8 [ENABLED,IMMUTABLE]

- entity 80: 4510000.ticsi2rx context 8 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video8
	pad0: SINK
		<- "4510000.ticsi2rx":9 [ENABLED,IMMUTABLE]

- entity 86: 4510000.ticsi2rx context 9 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video9
	pad0: SINK
		<- "4510000.ticsi2rx":10 [ENABLED,IMMUTABLE]

- entity 92: 4510000.ticsi2rx context 10 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video10
	pad0: SINK
		<- "4510000.ticsi2rx":11 [ENABLED,IMMUTABLE]

- entity 98: 4510000.ticsi2rx context 11 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video11
	pad0: SINK
		<- "4510000.ticsi2rx":12 [ENABLED,IMMUTABLE]

- entity 104: 4510000.ticsi2rx context 12 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video12
	pad0: SINK
		<- "4510000.ticsi2rx":13 [ENABLED,IMMUTABLE]

- entity 110: 4510000.ticsi2rx context 13 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video13
	pad0: SINK
		<- "4510000.ticsi2rx":14 [ENABLED,IMMUTABLE]

- entity 116: 4510000.ticsi2rx context 14 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video14
	pad0: SINK
		<- "4510000.ticsi2rx":15 [ENABLED,IMMUTABLE]

- entity 122: 4510000.ticsi2rx context 15 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video15
	pad0: SINK
		<- "4510000.ticsi2rx":16 [ENABLED,IMMUTABLE]

0 Jared McArthur 8 months ago in reply to Soorya Prakash Sakthivel

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

Soorya Prakash Sakthivel said:
The driver file imx708.c file was not properly included earlier for compilation, fixed that but still unable to view camera in custom camera option of edge ai gallery

Have you added the IMX708 to the setup_cameras.sh script?

Best,
Jared

0 Soorya Prakash Sakthivel 8 months ago in reply to Jared McArthur

Prodigy 80 points

Hi Jared McArthur ,

Thanks for the suggestion, now I modified setup_cameras.sh to include imx708.

I get this log as part of startup now

IMX708 Camera 1 detected
    device = /dev/video-imx708-cam0
    name = imx708
    format = [fmt:SRGGB10_1X10/1536x864 field:none]
    subdev_id = /dev/v4l-imx708-subdev0
    isp_required = yes

Also as part of custom camera option, I can see IMX708 Camera 1 listed, but when I click on start, I dont see the camera preview at all.

I tried to capture raw image, I get broken pipeline

root@tda4vm-sk:/opt/edgeai-gst-apps# v4l2-ctl -d /dev/video0 \
>          --set-fmt-video=width=1536,height=864,pixelformat=RG10 \
>          --stream-mmap \
>          --stream-count=30 \
>          --stream-to=imx708.raw
        VIDIOC_STREAMON returned -1 (Broken pipe)

I faced the same problem with 4608x2592 resolution as well.

Please guide on how to proceed further.

Thanks & Regards,

Soorya

0 Jared McArthur 8 months ago in reply to Soorya Prakash Sakthivel

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

Can you try yavta?

$ yavta -c1 -s1536x864 -fSRGGB10 -Fimage-#.raw /dev/video-imx708-cam0

Best,
Jared

+1 Soorya Prakash Sakthivel 8 months ago in reply to Jared McArthur

Prodigy 80 points

Hi Jared McArthur

The problem was with mismatched format and resolution of imx708, CSI2 bridge and CSI2RX.

After correcting all to match the same format and spec, using following commands, I can capture the raw image using both v4l2-ctl and yavta

media-ctl -d /dev/media1 -r

media-ctl -d /dev/media1 \
    --set-v4l2 '"imx708":0[fmt:SRGGB10_1X10/1536x864]'
	
media-ctl -d /dev/media1 \
    --set-v4l2 '"cdns_csi2rx.4514000.csi-bridge":1[fmt:SRGGB10_1X10/1536x864]'

media-ctl -d /dev/media1 \
    --set-v4l2 '"4510000.ticsi2rx":0[fmt:SRGGB10_1X10/1536x864]'

But I am unable to view the image since it is raw format. Also wanted to know how to start the live streaming of imx708 camera feed in HDMI.

Thanks & Regards,

Soorya

+1 Jared McArthur 8 months ago in reply to Soorya Prakash Sakthivel

TI__Mastermind 28970 points

Hi Soorya Prakash Sakthivel,

Glad that the issue is resolved.

Soorya Prakash Sakthivel said:
But I am unable to view the image since it is raw format.

You can view/check the image using an application called PixelViewer.

Soorya Prakash Sakthivel said:
Also wanted to know how to start the live streaming of imx708 camera feed in HDMI.

This will require either the RTOS SDK or EdgeAI SDK. We have an application to guide through those steps: https://www.ti.com/lit/an/sprad86a/sprad86a.pdf

Please open a new ticket if you have further questions as the original issue has been resolved.

Best,
Jared

Processors

Processors forum

TDA4VM: [TDA4VM-SK] Integrating camera module 3 to Linux SDK (11.00.00.08)