This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TDA4VM: About ensuring the consistency of sensor data

Part Number: TDA4VM

Hi,

    Because we need to make sure that deep learning algorithms are used.

   So I would like to ask how to ensure the consistency of sensor data (video data and radar data)?

   Is it possible to correlate data from sensor entry?

   Or do you have to timestamp the data itself at the system level after it enters the SOC?

   If there is a better scheme, please advise!

    Thank you very much!

   Regards,

   Kong

  • Hi Kong,

    Do you mean the consistency at the signal level? This is taken care by the CSI2. CSI2 includes CRC checked for the long packets. CSIRX module in TDA4 device will calculate the CRC and check against this included CRC. If there is a mismatch, it generates the error interrupt. 

    Current driver and OpenVX node registers the callback for this error interrupt, but the callback is empty. You could take appropriate action in this callback function, as per your requirement.

    Regards,

    Brijesh 

  • Hi,

       Thank you very much for your reply and guidance, but we still don't know how to deal with it.

        Here is a scenario: Camera data goes to the primary domain, radar data goes to the MCU domain, and data from both sides goes to the SOC. Then, in the deep learning algorithm, how should we ensure that the data frame obtained is the data at the same time when we conduct the algorithm data fusion of the two sides?

       Thank you!

       Regards,

       Kong

  • Hi Kong,

    Did not get it, what do you mean by "how should we ensure that the data frame obtained is the data"? do you mean how to sync two data one from capture and other from radar input? or do you want to check data integrity? 

    In OpenVX, only data pointer is passed around, so once data is captured, only pointer of it is passed from one core to another. If you want to check integrity of this data, you need to run CRC checker on this data at CSIRX output and also when you are going to consume this data.. But please note CRC checker will add additional delay and also DDR BW. 

    Regards,

    Brijesh

  • Hi,

        Please have a look at this picture.

        The current situation is that the camera data goes into the Primary domain (the left Primary domain) and the radar data goes into the MCU domain (the right MCU domain). Since the rate and time of data frame transmission to SOC (bottom square in the figure) are different, our algorithm is affected.

         We now want to know, in the SOC (bottom square in the figure), how to ensure that we get the data at the same time?

         That means I need to get the camera data and the radar data at the same time.

         Please provide us with a feasible solution to enable us to achieve this.

        Thank you!

        Regards,

        Kong

  • Hi,

       Sorry, here's the picture.

       Regards,

       Kong

  • Hi Kong,

    There is no existing solution in the SDK to sync the data. You would have to develop it, probably using capture timestamp. Driver and OpenVX node provide timestamp at which which the data is captured. 

    Regards,

    Brijesh