CMOS select for 8127

Hi Jacky,

           The xp2 FPGA(lattice) on MN34041 sensor board is used to convert lvds data to parallel data,then connect to the parallel interface of DM8127

            By the way,which version are you using with IPNC812x?

Regards,

Xiang,

Hi, Xiang

We used RDK V2.0.0.

I see in ISS package, there are four sensor device: ar0331, mn34041, mt9j003, mt9p031, and only ar0331 and mn34041 has FPGA binary file.

But 8127 used mt9j003, does it use the FPGA?

If only those four CMOS are support by 8127?

and how if we use other CMOS except those two(ar0331 mn34041)?

Thanks,

Pei Jacky.

Hi Jacky,

              mt9j003 also use lattice FPGA,from Hispi  to parallel(AR0331 also use Hispi mode)

              The current GA V2.0 release only support these 4 sensors(however,i didn't try mt9p031)

               Do you mean adding new sensor driver in GA V2.0  for other sensors?

Best Regards,

Xiang

Hi, Xiang

yes, I mean add other sensor driver.

1. Can we get a list of CMOS that 8127 support smoothly, and is there some limitation of that?

2. What exactly the FPGA does(the exact data format before and after the FPGA)?

3. Where can we get the FPGA code and document? That would help us to deal with the situation of using other CMOS.

Thanks,

Pei Jacky.

Hi Jacky,

            Contact with the people who provide you RDK V2.0.

Regards,

Xiang

Any other suggestion?

We got no help from them, so we come here.

B.R.

Jacky.

Hi Jacky,

             if your new sensor board have parallel output,then connect with parallel interface of DM812X directly,for Hispi and lvds,basiclly we use lattice xp2 to do the conversion to parallel.

            For  MIPI interface ,the hardware did have this port,but current release don't support this driver.

Best Regards,

Xiang,

Hi Pei Jacky,

(1) 8127 device has 16-bit parallel interface and 4-lane CSI2 MIPI interface. The maximum clock rating for parllel interface is 162Mhz and for MIPI (CSI2) its 1Gbps/lane. Any CMOS sensor that adheres to the above limits can be integrated to the soc. In our RDK we provide with reference drivers for only few sensors but, you should be able to use the reference to create drivers for any sensor that you want to integrate.

(2) MT9J003 or AR331 sensors have a HiSPI interface. Since 8127 does not support HiSPI interface the FPGA is put to convert from HiSPI to parallel bus. We are also planning to offer HiSPI to parallel converter chip as option. Please sync up with a local FAE at your end for more details.

(3) You need to check with local FAE at your end to get the NDA in place before we can share more information on this.

Regards

Rajat Sagar

Hi, Pei jacky,

Let me add some more information,

we provided CMOS sensor driver of Mt9j003 AR0331 and MN34041,  these code shows you typical way to control

sensor registers through I2C bus, or SPI(now is simulated by GIO) bus,  you could take these codes for reference if

you want to add new CMOS sensor support.

For AR0331,MN34041 sensor,We'll provide improved tuned 2A than GA2.0.in next RDK Release

YUV sensor support will be provided in this release too .

Regards,

Christian.

Hi, Sagar

Besides parallel convert, does the FPGA do other things, for example, convert RGB to YUV?

That is to say, If the CMOS has parallel interface but out data is RGB, needed FPGA to convert it to YUV?

and which YUVs does the 8127 support？

Thanks

Jacky.

Hi Jacky,

FPGA is only for HiSPI interface protocol to parallel 16-bit video port interface protocol. It does not do any color conversion.

8127 is capable of capturing RGB, YUV, BAYER formats. In case of DM8127 IPNC example the MT9J003 outputs BAYER format (HiSPI) which is converted into BAYER (parallel port) format - which is captured by parallel port on ISS and then given to ISP for color conversion to YUV.

Regards,

Rajat

Hi, Rajat

Thanks for reply.

We saw that 8127 use Vcam but not Vcap, and in MCFW defined

VCAM_MODE_E

{VCAM_MODE_YUV422,

VCAM_MODE_YUV420}; //16-bit Embedded sync YUV422/420 mode.

If we use Vcam, the CMOS should give above format data, others we should use FPGA to do a convert, right?

What's the difference between Vcam and Vcap?

and, What is the data format the MT9J003 gives(If FPGA Do not convert RGB to YUV, the MT9J003 gives YUV?)?

Best Regards.

Pei Jacky.

Hello PeiJinkai,

MT9J003 gives our RAW (BAYER RGGB) format of data. The FPGA does not do any data (color) conversion, it simply changes the HiSPI (MIPI) protocol to video port parallel bus.

THe ISS port captures the RAW data and does the color conversion (BAYER to YUV) int he ISP.

Regards

Rajat Sagar

Hi, Rajat

I found few information about the ISS and ISP in the RDK.

Where can we find some detailed documents about it?

We need to know the exact data forma that the ISS captured from the 16-bit parallel port and how the ISP convert it.

Thank you very much for help.

Best Regards.

Pei Jacky.

Thanks for your time and help.

Pei Jacky.

Hi Pei Jacky,

Sorry for the delay in answering your question. We missed this message.

The function of the FPGA is to convert from differential HiSPI signalling to digital parallel port (upto 16-bits). The sensors AR0331, MT9J003... which are integrated into the IPNC RDK give the image data in HiSPI (differential LVDS) signalling format but the DM8127 SOC only accepts digital parallel in or CSI in formats - thus the need for FPGA.

These were the currently supported sensors on the reference design platform - however you could integrate any CMOS sensor compatible with the supported interfaces.

Regards

Rajat Sagar