J784S4XEVM：Fisheye camera use with vpac

Hi,

Could you please post the question in English?

As i understand you are looking for usage of VPAC for fisheye camera, can you please confirm? Yes, LDC module in VPAC can be used for fisheye camera. Please refer to multi-camera usecase, it uses LDC for fisheye correction.

Regards,

Brijesh

Hello, can you tell me specifically, I found that my fisheye camera did not recognize me when running multiple camera use cases, what is the reason?

Regards，

lin

What do you mean by no recognized camera? Is the camera already brought up? is it outputting some valid images? Can you share the output of performance stats?

Brijesh

I was trying to run the fisheye camera with a multi-camera use case, but I couldn't recognize the fisheye camera while running the multi-camera use case

APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  1914.063823 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  1914.063943 s:  VX_ZONE_INIT:Enabled
  1914.063956 s:  VX_ZONE_ERROR:Enabled
  1914.063965 s:  VX_ZONE_WARNING:Enabled
  1914.064764 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  1914.065521 s:  VX_ZONE_INIT:[tivxHostInitLocal:93] Initialization Done for HOST !!!
  1914.066473 s: ISS: Enumerating sensors ... !!!
[MCU2_0]   1914.466812 s: Error writing 0x2 to UB960 register 0x1 
[MCU2_0]   1914.466864 s:  UB960 Error: Reg Write Failed for regAddr 1, cnt = 0
[MCU2_0]   1914.466910 s: Error : ub960_cfgScript returned -1 while configuring DES 0 
[MCU2_0]   1914.466995 s: Error writing 0x2 to UB960 register 0x1 
  1914.467246 s: ISS: Enumerating sensors ... found 0 : IMX390-UB953_D3
  1914.467262 s: ISS: Enumerating sensors ... found 1 : AR0233-UB953_MARS
  1914.467271 s: ISS: Enumerating sensors ... found 2 : AR0820-UB953_LI
  1914.467280 s: ISS: Enumerating sensors ... found 3 : UB9xxx_RAW12_TESTPATTERN
  1914.467289 s: ISS: Enumerating sensors ... found 4 : UB96x_UYVY_TESTPATTERN
  1914.467298 s: ISS: Enumerating sensors ... found 5 : GW_AR0233_UYVY
6 sensor(s) found 
Supported sensor list: 
a : IMX390-UB953_D3 
b : AR0233-UB953_MARS 
c : AR0820-UB953_LI 
d : UB9xxx_RAW12_TESTPATTERN 
e : UB96x_UYVY_TESTPATTERN 
f : GW_AR0233_UYVY 
Select a sensor above or press '0' to autodetect the sensor 
[MCU2_0]   1914.467041 s:  UB960 Error: Reg Write Failed for regAddr 1, cnt = 0
[MCU2_0]   1914.467081 s: Error :  returned -1 while configuring DES 1 
0
sensor detected at channel 0 = None 
sensor detected at channel 1 = None 
sensor detected at channel 2 = None 
sensor detected at channel 3 = None 
sensor detected at channel 4 = None 
sensor detected at channel 5 = None 
sensor detected at channel 6 = None 
sensor detected at channel 7 = None 
sensor detected at channel 8 = None 
sensor detected at channel 9 = None 
sensor detected at channel 10 = None 
sensor detected at channel 11 = None 
Invalid selection 255. Try again 
6 sensor(s) found 
Supported sensor list: 
a : IMX390-UB953_D3 
b : AR0233-UB953_MARS 
c : AR0820-UB953_LI 
d : UB9xxx_RAW12_TESTPATTERN 
e : UB96x_UYVY_TESTPATTERN 
f : GW_AR0233_UYVY 
Select a sensor above or press '0' to autodetect the sensor 
Invalid selection 169. Try again 
6 sensor(s) found 
Supported sensor list: 
a : IMX390-UB953_D3 
b : AR0233-UB953_MARS 
c : AR0820-UB953_LI 
d : UB9xxx_RAW12_TESTPATTERN 
e : UB96x_UYVY_TESTPATTERN 
f : GW_AR0233_UYVY 
Select a sensor above or press '0' to autodetect the sensor 
[MCU2_0]   1930.620034 s: Error reading from UB960 register 0x4c 
[MCU2_0]   1930.620118 s: Error reading from UB960 register 0x4c 
[MCU2_0]   1930.620197 s: Error reading from UB960 register 0x4c 

lin

Hi lin,

It seems you are trying to auto-detect the input sensor. Have you enabled this logic in the imaging component? Please note this logic is currently supported only for the sensors supported in the SDK. For any new sensor, you would require to add this logic.

Instead of auto-detecting the sensor, can you just select the sensor from the above menu and see if it is able to configure sensor?

Has this sensor been brought up already? or are you trying to bring it up now? 

Regards,

Brijesh 

Hi Brijesh，

I need it to detect the new sensor. How do I do that? Or how to add logic about a new sensor?

Lin

Hi Lin,

The detection of sensor is implemented in the sensor driver, lets say by reading some register of the sensor. So you can do the same in your new sensor driver. You can try reading some known sensor register and it matches with the known value, you can say sensor is detected. 

You can refer to probe function, IMX390_Probe, for the imx390 sensor. it reads chip id register to detect the sensor. 

Regards,

Brijesh

Hi Brijesh

Fisheye cameras can be recognized as video devices by the development board, but do they need to be implemented in sensor drivers?

root@j784s4-evm:~# ls /dev/video
video0  video1  video2  video3  video4  video5 

The connection between the camera and the end of the board is shown in the figure

Hi,

Sorry, are you using USB based input camera? In that case, what is the output format from this camera? 

Regards,

Brijesh

Hi，

I use a USB-based input camera.

Lin

LDC supports only YUV420/NV12 input format, So please check if this USB camera can output in YUV420 format. 

Regards,

Brijesh

Hi，

The fisheye camera I use supports YUV420 format output.

Hi,

At present, I want to use the vpac module for the fisheye camera to run the fisheye camera with multiple camera use cases. The board end can recognize the video device, but the fisheye camera cannot be detected when running multiple camera use cases. The fisheye camera is connected via USB and also supports the YUV420 format.

Hi，

How do I update the existing examples? Are you gonna write your own code?

I am not sure how capture from USB camera.. You would require to figure it out and change multi-camera application accordingly.