SK-TDA4VM: J721EXSKG01EVM: DRIVERS: Use a stereo camera arducam with TDA4VM evaluation bord

update : I think the problem is that you can't install the imx477 driver or Arducam v4l2 driver. A similar nvidia driver is installed the imx219. So I can't detect the stereo camera on the csi port of the card : www.arducam.com/.../

Hi Pierre,

You are right, we dont support IMX477 sensor yet and we are in the process of bring up drivers, reference applications/demos around stereo. As of 8.2 SDK we support only IMX219 and IMX390 (FPD link based) sensors. 

Regards,
Shyam

Hi Shyam,

Thank you very much for your reply.

Do you have an estimate for the implementation of the stereo demos and under which release it will be released?

If not, is it possible to develop our own support? If so, do you have any leads to do so?

I thank you very much for your help =)

Pierre

Hi Pierre,

For the next upcoming release we are considering a file based input to our stereo accelerator. This will be an input post epipolar rectification of the left and right images and the stereo accelerator will compute the disparity map. We might attempt validating the same using USB based Intel RealSense or ZED camera from Stereo Labs. But IMX477 is not planned for August release.

Regards,
Shyam

Thank you for this information.

Is it possible to create a specific driver on this board ? And do you think it is quite easy ? do you have some advice to do so ?

Regards,

Pierre

Hi Pierre,

The camera driver will be a linux device driver that one can either write from scratch if they have sensor datasheet or take it from upstream. The TDA4VM-SK Linux is based on the Yocto project running Dunfell so one can pull in drivers from upstream and rebuild a kernel image with the new camera driver.

However if the camera produces only raw RGB or RGBD images it will require further ISP processing which can be handled by our Vision Imaging Sub System (VISS) hardware accelerator. But this will involve ISP/sensor tuning activity to produce artifacts that can be understood by the VISS hardware.

In summary, its quite some effort to add a new camera sensor and use on-board ISP. If you require further help or support on this, I recommend that you get in touch with TI FAE in your region to take the discussions forward.

Regards,
Shyam

Hi Shyam,

Thank you for you're answer.

Just one last question : if we have a usb stereo camera that supports UVC. Logically it should work like a ZED camera, right ?

Regards,

Pierre

Hi Pierre, Yes ZED and RealSense should work, but honestly we are yet to try it as well.

Might have it up and running by 8.4 (August)

Regards,
Shyam

Hi Shyam,

So any usb camera with UVC working like the ZED cam should work ?

Yes we have tested ZED camera in Robotics SDK which is on top of EdgeAI SDK

I don't speak about zed camera but a similar camera like this: http://www.webcamerausb.com/elp-synchronous-usb-stereo-camera-module-double-undistortion-lens-960p-ov9750-usb20-otg-webcam-compatible-with-windows-linux-android-mac-p-285.html =) 

Because if the board accept UVC logically any usb camera with UVC should work right ?