• State TI Thinks Resolved
  • Locked Locked
  • Replies 17 replies
  • Answers 9 answers
  • Subscribers 98 subscribers
  • Views 2157 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

Linux/TDA2SX: OV2311 support for TDA2x

ARUN KUMAR1
Intellectual 820 points

Part Number: TDA2SX
Other Parts Discussed in Thread: DS90UB933-Q1, DS90UB934-Q1,

Tool/software: Linux

Hi,

I saw OV2311 support in Processor Vision SDK 3.07 release notes.

Right now, I am using Processor Vision SDK 3.04 on TDA2x. I am working for OV2311 driver to bring-up in TDA2x.

I want to know, whether this OV2311 driver implementation in VSDK 3.07 can be reffered to enable OV2311 support with TDA2x.
If yes,
a) what parts of this driver can be used to support OV2311 with TDA2x.
b) Will it require to port to VSDK v3.07 on TDA2x or is it workable with VSDK v3.04.

Regards,

ARUNKUMAR V N

  • 0
    TI__Guru 55685 points

    Hi Arun,

    You need an ISP for OV2311(output format is 10 bit raw) which is not there on TDA2x.

    Hence this sensor can be used with TDA2Px or TDA3xx.

    You should be able to port this sensor to VSDK 3.4.

    Please see folder apps/src/rtos/iss/src/sensor/.

    Regards,

    Rishabh

  • 0 in reply to Rishabh Garg
    TI__Guru 55685 points

    Hi Arun,

    What kind of processing do you want to do with raw data?

    Regards,

    Rishabh

  • 0 in reply to Rishabh Garg
    Intellectual 820 points

    Thanks Rishabh  for the reply.

    As you can see in the previous post, I am not using any separate ISP. 

    I am using OV2311 Sensor (8-bit raw) + DS90UB933-Q1 Serializer + DS90UB934-Q1 Deserializer.

    1) Please confirm, if i really need ISP to use this OV2311 Camera ? If yes, please suggest the supported ISP for this sensor.

    2) Without ISP, Can I bringup the OV2311 in TDA2sx ?

    3) what are the major things has to look up to bring up OV2311 + SerDeser driver in TDA2sx ?

    Regards,

    ARUNKUMAR V N

  • 0 in reply to ARUN KUMAR1
    TI__Guru 55685 points

    Hi Arun,

    Can you please answer the question on processing that needs to be done for the raw data.

    Do you need to convert it to YUV or only luma data is fine?

    Regards,

    Rishabh

  • 0 in reply to Rishabh Garg
    Intellectual 820 points

    Hi Rishabh,

    As OV2311 is monochrome sensor. ISP does not play any important role in converting RGB bayer to RGB and RGB to YUV conversion like color sensor.

    So, OVT person suggested that we can use OV2311 without any ISP as it can directly give Y8 output.

    We want to convert this 8 bit raw data to YUV format or RGB format. So that we can visualize it on HDMI display using display link.

    Here is my algorithm flow:

    8 bit Raw data  -> Y8 component -> Dummy U and V  -> YUV (Gray) -> YUV2RGB -> Object Detection Algo -> Display 

    another approach will be,

    8 bit Raw data  -> Y8 Component-> Replicate Y8 Component 3 times -> RGB (Gray) -> Object Detection Algo -> Display 

    Where we can process this data (A15 / IPU /EVE) ?

    Regards,

    ARUNKUMAR

  • 0 in reply to ARUN KUMAR1
    TI__Guru**** 490335 points

    Arun,

    There are multiple option, You could A15, DSP or VPE to convert from the YUV to RGB, select the option, which best suits your application. 

    Also i would prefer first data flow, with the dummy U and V buffer filled with 0x80, then duplicating luma buffer, as it will give perfect grey scale output in display..

    Rgds,

    Brijesh

  • 0 in reply to Brijesh Jadav
    Intellectual 820 points

    Thanks Brijesh  for the reply.

    As you can see in the previous posts, I am not using any separate ISP. 

    My question is does VPE accepts raw data as an input ?

    So, that we can follow your above steps of dummy U and V buffer on VPE itself.

    Please clarify for this below also,

    I am using OV2311 Sensor (8-bit raw) + DS90UB933-Q1 Serializer + DS90UB934-Q1 Deserializer.

    1) Please confirm, if i really need ISP to use this OV2311 Camera ? If yes, please suggest the supported ISP for this sensor.

    2) Without ISP, Can I bringup the OV2311 in TDA2sx ?

    3) what are the major things has to look up to bring up OV2311 + SerDeser driver in TDA2sx ?

    Regards,

    ARUNKUMAR V N

  • 0 in reply to ARUN KUMAR1
    TI__Guru 55685 points

    Hi Arun,

    With dummy UV buffer the data becomes YUV and you do not need ISP.

    The same YUV data can be taken as input by VPE.

    Regards,

    Rishabh

  • 0 in reply to ARUN KUMAR1
    TI__Guru**** 490335 points

    Arun,

    It really depends on your requirement. For example, if you require exposure control, you may need to pass monochrome data from isp. If sensor support auto exposure, then it may not be required.

    Your dataflow from the earlier post does not seem to indicate requirement for the ISP.

    8 bit Raw data  -> Y8 component -> Dummy U and V  -> YUV (Gray) -> YUV2RGB -> Object Detection Algo -> Display 

    VPE does not support RAW data, but for VPE, the input data is in YUV422 or YUV420 format, as you have added dummy U and V component to 8bit luma..

    Rgds,

    Brijesh

  • 0 in reply to Brijesh Jadav
    Intellectual 820 points

    Thanks Brijesh and Rishabh for the reply.

    As of now, my doubts are cleared in data format. But,  i want to know the changes to port sensor for my custom board.

    1) what are the major things has to look up to bring up OV2311 present in Vision SDK 3.07 to utilize for my requirement.

    2) Which dts reads the sensor, serialiser (omap / uboot ) ?

    3) From where VIP initialize (uboot dts / omap dts / pin_mux) ?

    since VIP disabled in dra7-infoadas.dts

    DISABLE_COMPLETE(vip1);

    DISABLE_COMPLETE(vip2);

    DISABLE_COMPLETE(vip3);

    4) From where VIP starts reading data (A15 / IPU) ?

    5) what and all changes required to include 933 serializer and 934 deserializer and ov2311 sensor. ( Port from EVM to Custom Board)

    Regards,

    ARUNKUMAR V N

  • 0 in reply to ARUN KUMAR1
    TI__Guru**** 490335 points

    Arun,

    I would suggest to go through one of the existing usecase, supporting 913/914 serdes combo with the ov10635 sensor and add the new sensor accordingly. 

    Rgds,

    Brijesh 

  • 0 in reply to Brijesh Jadav
    TI__Guru 55685 points

    Hi,

    I haven't heard back from you, I'm assuming you were able to resolve your issue.
    If not, just post a reply below (or create a new thread if the thread has locked due to time-out).

    Regards,
    Rishabh

  • 0 in reply to Rishabh Garg
    Intellectual 820 points

    Hi Rishabh Garg,

    I need testcases for camera to check, each module is working or not.

    After changes in Serialiser, Deserialiser and Sensor. how can i test the modules / devices ?

    is there any test applications to check the serdeser and sensor completely.

    regards,

    ARUNKUMAR V N

  • 0 in reply to ARUN KUMAR1
    TI__Guru**** 490335 points

    Probably, if it is connected to VIP, you need to enable VIP and check if you are able to receive data..

    Rgds,

    Brijesh

  • 0 in reply to Brijesh Jadav
    Intellectual 820 points

    Hi Brijesh & Risabh,

    In my custom board, I am using TDA2Sx SOC and OV2311 and other 2 Camera's connected to VIN1A, VIN2A, VIN5A in my custom board.

    I did pinmux in uboot mux_data and device tree also changed.

    Q1) As per the board, what are the changed need to do in PDK ??

    Q2) what and all changes have to do in Bsp_boardSetPinMuxTda2xx() ?

    VIP/DSS/I2C/UART pinmuxing did in bspboardTDA2xx.  For this, i comment the DSS, UART, I2C except VIP and tried. Capture and Display working fine.

    Q3) whether mux_data will take care ?? no need of remuxing here ??

    Could you please let me know,

    why is that mentioned ? was it useful anywhere ? any other changes needed ?

    Regards,

    ARUNKUMAR V N

  • 0 in reply to Brijesh Jadav
    TI__Mastermind 24525 points

    OV2311 is a monochrome sensor. This means that the sensor output data can be treated as 10-bit Y. You do not need an ISP if you don't need to render this on an 8-bit display. If using for machine vision algorithms, you should be able to send 10-bit monochrome data directly.

    However you may need ISP if you want to run things like AutoExposure, LSC, ToneMapping etc.

    Having said that, TI's driver is based on UB960->CSI2. TDA2x does not have CSI2 and therefore the driver will need to be modified.