TDA4VEN-Q1: Keep hanging when capturing frame

Meng-Hung Chen

Part Number: TDA4VEN-Q1
Other Parts Discussed in Thread: AM67

Tool/software:

Hi TI,

We have TDA4VEN - DS90UB960 - IMX390 (builtin DS90UB953), and the device tree relay is set. Now, we want to test the sensor powering on and working or not using the following code:

Fullscreen

1
2
3
4
5
6
# after boot and login, config code provided by manutacturer
$ i2cset -y 7 0x3d 0x4c 0x01
$ i2cset -y 7 0x3d 0x58 0x5e
$ i2cset -y 7 0x3d 0x1f 0x02
$ i2cset -y 7 0x3d 0x20 0x20
$ i2cset -y 7 0x3d 0x33 0x03
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

# after boot and login, config code provided by manutacturer
$ i2cset -y 7 0x3d 0x4c 0x01
$ i2cset -y 7 0x3d 0x58 0x5e
$ i2cset -y 7 0x3d 0x1f 0x02
$ i2cset -y 7 0x3d 0x20 0x20
$ i2cset -y 7 0x3d 0x33 0x03

Fullscreen

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
#include <stdio.h>
#include <stdlib.h>
#include <fcntl.h>
#include <unistd.h>
#include <sys/ioctl.h>
#include <sys/mman.h>
#include <linux/videodev2.h>
#include <string.h>
#include <errno.h>
#define DEVICE "/dev/video4"
#define WIDTH  1936
#define HEIGHT 1100
int main() {
    int fd = open(DEVICE, O_RDWR);
    if (fd == -1) {
        perror("Error opening video device");
        return 1;
    }
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

#include <stdio.h>
#include <stdlib.h>
#include <fcntl.h>
#include <unistd.h>
#include <sys/ioctl.h>
#include <sys/mman.h>
#include <linux/videodev2.h>
#include <string.h>
#include <errno.h>

#define DEVICE "/dev/video4"
#define WIDTH  1936
#define HEIGHT 1100

int main() {
	int fd = open(DEVICE, O_RDWR);
	if (fd == -1) {
    	perror("Error opening video device");
    	return 1;
	}

	// Set video format
	struct v4l2_format fmt;
	memset(&fmt, 0, sizeof(fmt));
	fmt.type = V4L2_BUF_TYPE_VIDEO_CAPTURE;
	fmt.fmt.pix.width = WIDTH;
	fmt.fmt.pix.height = HEIGHT;
	fmt.fmt.pix.pixelformat = V4L2_PIX_FMT_SRGGB12;  // 10-bit Bayer Packed
	fmt.fmt.pix.field = V4L2_FIELD_NONE;

	if (ioctl(fd, VIDIOC_S_FMT, &fmt) == -1) {
    	perror("VIDIOC_S_FMT failed");
    	printf("Error: %d\n", errno);
    	close(fd);
    	return 1;
	}

	// Request buffers
	struct v4l2_requestbuffers req;
	memset(&req, 0, sizeof(req));
	req.count = 1;  // Request 1 buffer
	req.type = V4L2_BUF_TYPE_VIDEO_CAPTURE;
	req.memory = V4L2_MEMORY_MMAP;

	if (ioctl(fd, VIDIOC_REQBUFS, &req) == -1) {
    	perror("VIDIOC_REQBUFS failed");
    	close(fd);
    	return 1;
	}

	// Query buffer
	struct v4l2_buffer buf;
	memset(&buf, 0, sizeof(buf));
	buf.type = V4L2_BUF_TYPE_VIDEO_CAPTURE;
	buf.memory = V4L2_MEMORY_MMAP;
	buf.index = 0;

	if (ioctl(fd, VIDIOC_QUERYBUF, &buf) == -1) {
    	perror("VIDIOC_QUERYBUF failed");
    	close(fd);
    	return 1;
	}

   // Map buffer to user space             	 
	void* buffer = mmap(NULL, buf.length, PROT_READ | PROT_WRITE, MAP_SHARED, fd, buf.m.offset);
	if (buffer == MAP_FAILED) {                                                            	 
    	perror("Memory mapping failed");                                                   	 
    	close(fd);                                                                         	 
    	return 1;                                                                          	 
	}                                                                                      	 
                                                                                           	 
	// Queue buffer                                                                        	 
	if (ioctl(fd, VIDIOC_QBUF, &buf) == -1) {                                              	 
    	perror("VIDIOC_QBUF failed");                                                      	 
    	close(fd);                                                                         	 
    	return 1;                                                                          	 
	}                                                                                      	 
                                                                                           	 
	// Start streaming                                                                     	 
	int type = V4L2_BUF_TYPE_VIDEO_CAPTURE;                                                	 
	if (ioctl(fd, VIDIOC_STREAMON, &type) == -1) {                                         	 
    	perror("VIDIOC_STREAMON failed");                                                  	 
    	close(fd);                                                                         	 
    	return 1;                                                                          	 
	}                                                                                      	 
                                                                      	 
	// Dequeue buffer (capture frame)        	 
	if (ioctl(fd, VIDIOC_DQBUF, &buf) == -1) {    
    	perror("VIDIOC_DQBUF failed");       	 
    	close(fd);                                                                         	 
    	return 1;                                                                          	 
	}                                                                                      	 
                                                                                           	 
	// Save raw Bayer frame                  	 
	FILE* file = fopen("frame.raw", "wb");                                                 	 
	if (file) {                              	 
    	fwrite(buffer, buf.length, 1, file);    
    	fclose(file);                       	 
    	printf("Frame captured and saved as frame.raw\n");
	} else {                                         	 
    	perror("Error saving frame");                	 
	}                                                	 
                                                     	 

	// Stop streaming                                                                      	 
	if (ioctl(fd, VIDIOC_STREAMOFF, &type) == -1) {  	 
    	perror("VIDIOC_STREAMOFF failed");           	 
	}                                                	 
                                                     	 
	// Cleanup                                       	 
	munmap(buffer, buf.length);                      	 
	close(fd);                                       	 
	return 0;                                        	 
}

The execution hangs at line 88, and if we interrupt with ctrl + c and check the 0x20 and 0x33 registers of 954, the value was modified back to 0xf0, 0x02, respectively. The values seem to be modified after line 81 executed.

We also tried `v4l2-ctl --device /dev/video4 --stream-mmap --stream-count=1 --stream-to=frame.raw` and hanged too.

Regards

3 days ago

0 Fabiana Jaimes 2 days ago

TI__Genius 17620 points

Hello,

Could you share which specific IMX390 module you are using? If it is not D3RCM-IMX390-953, I recommend going through the FAQ list linked below to help you debug.

https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1403223/faq-most-common-problems-encountered-when-developing-camera-applications-on-the-am6x

AM67 Academy: Use Camera

Please let me know if you have any further questions.

Thank you,

Fabiana

0 Meng-Hung Chen 2 days ago in reply to Fabiana Jaimes

Prodigy 60 points

Hi, we are using this imx390 module. Our vendor does not have / give us the configuration about 953 <-> sensor in Linux (they said this is done in firmware). The module is only under developed and tested in RTOS.

Does D3RCM-IMX390-953 need configuration too? I don't see any step on their website. We consider buying a new one if it is a plug-and-play module (to also reduce the works of integrating the camera).

Thank you.

0 Fabiana Jaimes 1 day ago in reply to Meng-Hung Chen

TI__Genius 17620 points

Hi,

When you say configuration, are you referring to the device tree overlay? D3RCM-IMX390-953 is supported on both TDA4VEN Linux and RTOS platforms. The Discovery IMX390 module is supported on RTOS only. The sensor you have linked has not been validated by us. Please take a look at the following pages for more information.

FAQ: https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1452909/faq-am67a-enabling-csi2-sensors-via-fusion-board-on-am6x

J722S Linux SDK Documentation: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-j722s/10_01_00_04/exports/docs/linux/Foundational_Components/Kernel/Kernel_Drivers/Camera/CSI2RX.html#enabling-camera-sensors

List of sensors supported out-of-box: https://software-dl.ti.com/jacinto7/esd/processor-sdk-rtos-j722s/10_01_00_04/exports/docs/imaging/imaging_release_notes.html

Thank you,

Fabiana

0 Meng-Hung Chen 1 day ago in reply to Fabiana Jaimes

Prodigy 60 points

Hi, the mentioned "configuration" means the i2c settings. Our vendor gives us a few lines of commands to setup the register of ub960. It looks like:

Fullscreen

1
2
3
4
5
0x4C,0x01 // set TI954 config
0x58,0x5E
0x1F,0x02
0x20,0x20
0x33,0x03 // stream on
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

0x4C,0x01 // set TI954 config
0x58,0x5E
0x1F,0x02
0x20,0x20
0x33,0x03 // stream on

I believe these are RTOS settings. If we have not the corresponding i2c settings on the Linux (edgeai sdk), we could not receive the data from sensor, right (the dtbo has setup)?

Does the D3RCM-IMX390-953 need the extra i2c settings? or does it work directly after being plugged onto the deserializer?

Regards

0 Brijesh Jadav 1 day ago in reply to Meng-Hung Chen

TI__Guru**** 449585 points

Hi,

It seems you are using UB954 deserialzier, is it? Then this is not supported by default in the SDK. you would need to update imaging component to support this deserializer.

Regards,

Brijesh

0 Meng-Hung Chen 1 day ago in reply to Brijesh Jadav

Prodigy 60 points

Hi, we have both ub954 and ub960, and their configurations provided by sensor manufacturer are same (as above). We finally use ub960 to avoid some unexpected error.

Sorry for pasting the misleading code.

Regards

0 Meng-Hung Chen 22 hours ago in reply to Meng-Hung Chen

Prodigy 60 points

So, does D3RCM-IMX390-953 with FOV70 work without any extra steps on Linux after booting from the sd card? We want to simply demo the edgeai gallery in TI's prebuilt Linux tarball using this.

Regards

Processors

Processors forum

TDA4VEN-Q1: Keep hanging when capturing frame