This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

RTOS: Error while adding Alg_ImagePreProcess link

Tool/software: TI-RTOS

Hello,

We are trying to run tidl_OD usecase using TDA2x board. Input is capture from HDMI RX 1920x1080 @ 60fps - VIP, YUV422.

Usecase:

UseCase: chains_capture_tidl_OD

Capture ->Alg_ImagePreProcess(EVE1) -> VPE -> Dup

Dup -> Merge

Dup -> Alg_tidlpreproc (A15)

Alg_tidlpreproc (A15) -> Alg_tidl_Eve1 (EVE1)
Alg_tidlpreproc (A15) -> Alg_tidl_Eve2 (EVE2)
Alg_tidlpreproc (A15) -> Alg_tidl_Eve3 (EVE3)
Alg_tidlpreproc (A15) -> Alg_tidl_Eve4 (EVE4)

Alg_tidl_Eve1 (EVE1) -> Merge_OD (DSP1)
Alg_tidl_Eve2 (EVE2) -> Merge_OD (DSP1)
Alg_tidl_Eve3 (EVE3) -> Merge_OD (DSP1)
Alg_tidl_Eve4 (EVE4) -> Merge_OD (DSP1)
Merge_OD (DSP1) -> Alg_tidl_Dsp (DSP1) -> Merge

Merge -> Sync -> Alg_ObjectDraw -> Display_Video

GrpxSrc -> Display

When I add Alg_ImagePreProcess(EVE1) , I am facing below error:

[IPU1-0] 283.227780 s: CAPTURE: Create in progress !!!
[IPU1-0] 283.228024 s: CAPTURE: VIP1 Slice0 PortA capture mode is [16-bit] !!!
[IPU1-0] 283.415665 s: CAPTURE: Create Done !!!
[IPU1-0] 283.416000 s: IPC_OUT_0 : Create in progress !!!
[IPU1-0] 283.416336 s: IPC_OUT_0 : Create Done !!!
[EVE1 ] 283.416763 s: IPC_IN_0 : Create in progress !!!
[EVE1 ] 283.417952 s: IPC_IN_0 : Create Done !!!
[EVE1 ] 283.418593 s: ALGORITHM: Create in progress (algId = 10) !!!
[EVE1 ] 283.499877 s: ALGORITHM: Create Done (algId = 10) !!!
[EVE1 ] 283.500915 s: IPC_OUT_0 : Create in progress !!!
[EVE1 ] 283.501433 s: IPC_OUT_0 : Create Done !!!
[EVE4 ] 283.612365 s: IPC_IN_0 : Create in progress !!!
[EVE4 ] 283.613402 s: IPC_IN_0 : Create Done !!!
[EVE4 ] 283.614225 s: ALGORITHM: Create in progress (algId = 14) !!!
[IPU1-0] 283.501860 s: IPC_IN_0 : Create in progress !!!
[IPU1-0] 283.503141 s: IPC_IN_0 : Create Done !!!
[IPU1-0] 283.503294 s: VPE: Create in progress !!!
[IPU1-0] 283.601781 s: VPE: Loading Down-scaling Co-effs
[IPU1-0] 283.602025 s: VPE: Co-effs Loading ... DONE !!!
[IPU1-0] 283.602238 s: VPE: Create Done !!!
[IPU1-0] 283.603397 s: IPC_OUT_1 : Create in progress !!!
[IPU1-0] 283.603733 s: IPC_OUT_1 : Create Done !!!
[HOST ] 283.603916 s: IPC_IN_0 : Create in progress !!!
[HOST ] 283.604221 s: IPC_IN_0 : Create Done !!!
[HOST ] 283.604373 s: ALGORITHM: Create in progress (algId = 12) !!!
[HOST ] 283.611907 s: UTILS: DMA: Allocated CH (TCC) = 0 (0)
[HOST ] 283.611907 s: UTILS: DMA: 0 of 1: Allocated PaRAM = 0 (0x43305600)
[HOST ] 283.611938 s: ALGORITHM: Create Done (algId = 12) !!!
[HOST ] 283.612029 s: IPC_OUT_3 : Create in progress !!!
[HOST ] 283.612090 s: IPC_OUT_3 : Create Done !!!
[HOST ] 285.622369 s: IPC_OUT_2 : Create in progress !!!
[HOST ] 285.622399 s: IPC_OUT_2 : Create Done !!!
[DSP1 ] 285.621667 s: IPC_IN_3 : Create in progress !!!
[DSP1 ] 285.622247 s: IPC_IN_3 : Create Done !!!
[EVE3 ] 285.622918 s: IPC_IN_0 : Create in progress !!!
[EVE3 ] 285.623863 s: IPC_IN_0 : Create Done !!!
[EVE3 ] 285.624687 s: ALGORITHM: Create in progress (algId = 14) !!!
[EVE4 ] 285.620051 s: ALGORITHM: Create Done (algId = 14) !!!
[EVE4 ] 285.620691 s: IPC_OUT_0 : Create in progress !!!
[EVE4 ] 285.621179 s: IPC_OUT_0 : Create Done !!!
[HOST ] 287.633044 s: IPC_OUT_1 : Create in progress !!!
[HOST ] 287.633075 s: IPC_OUT_1 : Create Done !!!
[DSP1 ] 287.632251 s: IPC_IN_2 : Create in progress !!!
[DSP1 ] 287.632892 s: IPC_IN_2 : Create Done !!!
[EVE2 ] 287.633349 s: IPC_IN_0 : Create in progress !!!
[EVE2 ] 287.634325 s: IPC_IN_0 : Create Done !!!
[EVE2 ] 287.634935 s: ALGORITHM: Create in progress (algId = 14) !!!
[EVE3 ] 287.630665 s: ALGORITHM: Create Done (algId = 14) !!!
[EVE3 ] 287.631306 s: IPC_OUT_0 : Create in progress !!!
[EVE3 ] 287.631824 s: IPC_OUT_0 : Create Done !!!
[HOST ] 289.664307 s: IPC_OUT_0 : Create in progress !!!
[HOST ] 289.664338 s: IPC_OUT_0 : Create Done !!!
[DSP1 ] 289.663606 s: IPC_IN_1 : Create in progress !!!
[DSP1 ] 289.664185 s: IPC_IN_1 : Create Done !!!
[EVE1 ] 289.664612 s: IPC_IN_1 : Create in progress !!!
[EVE1 ] 289.665588 s: IPC_IN_1 : Create Done !!!
[EVE1 ] 289.666198 s: ALGORITHM: Create in progress (algId = 14) !!!
[EVE1 ] 289.670926 s: Assertion @ Line: 160 in tidl/tidlLink_algPlugin.c: NULL != pAlgObj->memRec[cnt].base : failed !!!
[EVE1 ] 289.673214 s: Assertion @ Line: 160 in tidl/tidlLink_algPlugin.c: NULL != pAlgObj->memRec[cnt].base : failed !!!
[EVE2 ] 289.661837 s: ALGORITHM: Create Done (algId = 14) !!!
[EVE2 ] 289.662508 s: IPC_OUT_0 : Create in progress !!!
[EVE2 ] 289.663087 s: IPC_OUT_0 : Create Done !!!

Vision SDK version is 03.03.00.00. Please guide me to resolve this.

Regards,

Sayali V.

  • Hi,

    Which usecase are you trying to run?
    Can you share the exact Path for that?

    Regards,
    Anuj
  • Hello Anuj,

    As per mentioned above, I am trying to run tidl_OD usecase. In that base usecase , I have added Capture from HDMI and Alg_ImagePreProcess link on input.

    Path for base usecase : C:\PROCESSOR_SDK_VISION_03_03_00_00\vision_sdk\apps\src\rtos\usecases\tidl_OD

    Regards,
    Sayali V.
  • Hi,

    The assert is coming while memory allocation from local heap.
    As your Alg_ImagePreProcess is also running on EVE1 so when TIDL tries to allocate memory , it does not have that much of free space.
    Increase the data memory of EVE1 core.
    Note that EVE memories should be 16 MB aligned.

    Regards,
    Anuj
  • Hello Anuj,

    Thanks for the help. As you say :

    Increase the data memory of EVE1 core.

    >>  As I am new to this, I need to explore the memory segment concept. For that I am referring below document:

    C:\PROCESSOR_SDK_VISION_03_03_00_00\vision_sdk\docs\FeatureSpecificUserGuides\VisionSDK_UserGuide_MemoryMap.pdf

    Instead of this Do you have any other reference document? Please suggest.

    Beside this I tried one approach like, I changed the usecase as below:

    UseCase: chains_capture_tidl_OD

    Capture ->Alg_ImagePreProcess(EVE1) -> VPE -> Dup

    Dup -> Merge

    Dup -> Alg_tidlpreproc (A15)

    Alg_tidlpreproc (A15) -> Alg_tidl_Eve2 (EVE2)

    Alg_tidlpreproc (A15) -> Alg_tidl_Eve3 (EVE3)

    Alg_tidlpreproc (A15) -> Alg_tidl_Eve4 (EVE4)

    Alg_tidl_Eve2 (EVE2) -> Merge_OD (DSP1)

    Alg_tidl_Eve3 (EVE3) -> Merge_OD (DSP1)

    Alg_tidl_Eve4 (EVE4) -> Merge_OD (DSP1)

    Merge_OD (DSP1) -> Alg_tidl_Dsp (DSP1) -> Merge

    Merge -> Sync -> Alg_ObjectDraw -> Display_Video

    GrpxSrc -> Display

    Removed the Alg_tidl_Eve1 (EVE1) and changed the .c file accordingly.

    It's running without error, but showing output like this:

    Is this approach is right? Please guide me to resolve this.

    Please find attached statistics for your reference.  

    Statistics_3eve_tidl.txt

    Regards,

    Sayali V.

  • Hi,

    TIDL_OD is not tested using capture link.
    Its been tested on file read.
    You need to train your model for the input.

    Regards,
    Anuj
  • Hello Anuj,

    I have modified tidl_OD use case for taking input from HDMI and it's working, but when I have added Alg_ImagePreProcess link after capture it's displaying output like previously attached image.

    Regards,
    Sayali V.
  • Hi,

    Why you want to use Alg_ImagePreProcess link.
    The kink is used when you want use ti developed object detection algorithm not with TIDL.

    Regards,
    Anuj
  • Hello Anuj,

    I want to try and observe effect of pre processing on TIDL inference. I think pre processing may improve the detection results that's why I need to try that.

    Regards,
    Sayali V.
  • Hi,

    The issue is coming due to format of Alg_ImagePreProcess and tidl is not matching.
    And the both of the link has been tesed in a single usecase flow as both of them are used with 2 separate algos.

    Still if you want to check you can coneect with CCS and debug where the format is going wrong.

    Regards,
    Anuj
  • Hi,

    Is the issue solved?

    Regards,
    Anuj