TDA2P-ACD: ISP Link drops Frames despite not running on Full Load

Tobias Schulze

Part Number: TDA2P-ACD

Hello Experts,

I created a usecase (see related post or attached image) that looks like this:

capture frames from 2 cameras/channels
processing in ISP (2 channels)
duplicate one channel with dup link (-> total of 3 channels)
processing in SIMCOP (3 channels)
merging with DMA_SWMS link
output

Inputs are 1080p@60fps. ISP runs in Linear Mode. The SIMCOP does LDC and internally crops the frames to fit on one 1080p frame. I am running this usecase on a custom TDA2P board and I use PSDK 3.5. Also I set the OPP mode to PLUS/HIGH already.

Even though the Statistics Display (on screen graphic) shows that the ISP load is approx. 60%, the UART statistics show that the ISP link drops about 10 fps. Is the ISP not able to handle two 1080p channels at 60fps? I attached my statistics as well, maybe you find the error there..

Regards,

Tobias

Fullscreen usecase_statistics.txt Download

[IPU1-0]   5108.084792 s:  [ ISSCAPTURE ] Link Statistics,
[IPU1-0]   5108.084883 s:  ******************************
[IPU1-0]   5108.084975 s:
[IPU1-0]   5108.085097 s:  Elapsed time       = 115198 msec
[IPU1-0]   5108.085371 s:
[IPU1-0]   5108.085432 s:  Get Full Buf Cb    = 120.12 fps
[IPU1-0]   5108.085554 s:  Put Empty Buf Cb   = 120.12 fps
[IPU1-0]   5108.085646 s:  Driver/Notify Cb   = 120.13 fps
[IPU1-0]   5108.085737 s:
[IPU1-0]   5108.085798 s:  Input Statistics,
[IPU1-0]   5108.085859 s:
[IPU1-0]   5108.085920 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.086073 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.086195 s:  --------------------------------------------------
[IPU1-0]   5108.086317 s:   0 |  60. 6      0. 0      0. 0          60. 6
[IPU1-0]   5108.086469 s:   1 |  60. 6      0. 0      0. 0          60. 6
[IPU1-0]   5108.086591 s:
[IPU1-0]   5108.086652 s:  Output Statistics,
[IPU1-0]   5108.086713 s:
[IPU1-0]   5108.086744 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.086835 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.086896 s:  ---------------------------------------------
[IPU1-0]   5108.086988 s:   0 |  0     60. 6     0. 0      0. 0
[IPU1-0]   5108.087140 s:   1 |  0     60. 6     0. 0      0. 0
[IPU1-0]   5108.093180 s:
[IPU1-0]   5108.093271 s:  [ ISSM2MISP ] Link Statistics,
[IPU1-0]   5108.093363 s:  ******************************
[IPU1-0]   5108.093454 s:
[IPU1-0]   5108.093515 s:  Elapsed time       = 115203 msec
[IPU1-0]   5108.093607 s:
[IPU1-0]   5108.093668 s:  New data Recv      = 120.11 fps
[IPU1-0]   5108.093759 s:  Get Full Buf Cb    = 182.58 fps
[IPU1-0]   5108.093851 s:  Driver/Notify Cb   = 100.37 fps
[IPU1-0]   5108.093973 s:
[IPU1-0]   5108.094003 s:  Input Statistics,
[IPU1-0]   5108.094125 s:
[IPU1-0]   5108.094186 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.094278 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.094400 s:  --------------------------------------------------
[IPU1-0]   5108.094522 s:   0 |  60. 5      9.86      0. 0          50.18
[IPU1-0]   5108.094705 s:   1 |  60. 5      9.86      0. 0          50.18
[IPU1-0]   5108.094857 s:
[IPU1-0]   5108.094888 s:  Output Statistics,
[IPU1-0]   5108.094949 s:
[IPU1-0]   5108.094979 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.095101 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.095162 s:  ---------------------------------------------
[IPU1-0]   5108.095254 s:   0 |  0     50.18     9.86      0. 0
[IPU1-0]   5108.095376 s:   0 |  1     50.18     9.86      0. 0
[IPU1-0]   5108.095498 s:   0 |  2      0. 0    60. 5      0. 0
[IPU1-0]   5108.095620 s:   0 |  3      0. 0    60. 5      0. 0
[IPU1-0]   5108.095742 s:   1 |  0     50.18     9.86      0. 0
[IPU1-0]   5108.095894 s:   1 |  1     50.18     9.86      0. 0
[IPU1-0]   5108.096016 s:   1 |  2      0. 0    60. 5      0. 0
[IPU1-0]   5108.096138 s:   1 |  3      0. 0    60. 5      0. 0
[IPU1-0]   5108.096291 s:
[IPU1-0]   5108.096352 s:  [ ISSM2MISP ] LATENCY,
[IPU1-0]   5108.096413 s:  ********************
[IPU1-0]   5108.096626 s:  Local Link Latency     : Avg =   4908 us, Min =   4666 us, Max =   6100 us,
[IPU1-0]   5108.096748 s:  Source to Link Latency : Avg =   5031 us, Min =   4788 us, Max =   6222 us,
[IPU1-0]   5108.096870 s:
[IPU1-0]   5108.103184 s:
[IPU1-0]   5108.103428 s:  [ ALG_ISS_AEWB ] Link Statistics,
[IPU1-0]   5108.103550 s:  ******************************
[IPU1-0]   5108.103641 s:
[IPU1-0]   5108.103702 s:  Elapsed time       = 115209 msec
[IPU1-0]   5108.103794 s:
[IPU1-0]   5108.103855 s:  New data Recv      =  82.20 fps
[IPU1-0]   5108.103946 s:
[IPU1-0]   5108.104007 s:  Input Statistics,
[IPU1-0]   5108.104099 s:
[IPU1-0]   5108.104160 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.104282 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.104404 s:  --------------------------------------------------
[IPU1-0]   5108.104526 s:   0 |  50.18      0. 0      0. 0          50.18
[IPU1-0]   5108.104709 s:
[IPU1-0]   5108.104739 s:  Output Statistics,
[IPU1-0]   5108.104831 s:
[IPU1-0]   5108.104861 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.104983 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.105105 s:  ---------------------------------------------
[IPU1-0]   5108.105776 s:   0 |  0     50.18     0. 0      0. 0
[IPU1-0]   5108.106020 s:
[IPU1-0]   5108.106142 s:  [ ALG_ISS_AEWB ] LATENCY,
[IPU1-0]   5108.106234 s:  ********************
[IPU1-0]   5108.106295 s:  Local Link Latency     : Avg =   4472 us, Min =     61 us, Max =  29555 us,
[IPU1-0]   5108.106478 s:  Source to Link Latency : Avg =  14403 us, Min =   5276 us, Max =  56975 us,
[IPU1-0]   5108.106630 s:
[IPU1-0]   5108.163484 s:
[IPU1-0]   5108.163545 s:  [ ISSM2MSIMCOP ] Link Statistics,
[IPU1-0]   5108.163606 s:  ******************************
[IPU1-0]   5108.163667 s:
[IPU1-0]   5108.163728 s:  Elapsed time       = 115233 msec
[IPU1-0]   5108.163789 s:
[IPU1-0]   5108.163819 s:  New data Recv      =  25.25 fps
[IPU1-0]   5108.163911 s:  Get Full Buf Cb    =  55.50 fps
[IPU1-0]   5108.164002 s:
[IPU1-0]   5108.164063 s:  Input Statistics,
[IPU1-0]   5108.164124 s:
[IPU1-0]   5108.164155 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.164246 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.164368 s:  --------------------------------------------------
[IPU1-0]   5108.164460 s:   0 |  50.19      0. 0      0. 0          50.19
[IPU1-0]   5108.164582 s:   1 |  50.18      0. 0      0. 0          50.18
[IPU1-0]   5108.164734 s:   2 |  50.18      0. 0      0. 0          50.18
[IPU1-0]   5108.164856 s:
[IPU1-0]   5108.164887 s:  Output Statistics,
[IPU1-0]   5108.164948 s:
[IPU1-0]   5108.164978 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.165070 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.165161 s:  ---------------------------------------------
[IPU1-0]   5108.165222 s:   0 |  0     50.19     0. 0      0. 0
[IPU1-0]   5108.165344 s:   1 |  0     50.18     0. 0      0. 0
[IPU1-0]   5108.165466 s:   2 |  0     50.18     0. 0      0. 0
[IPU1-0]   5108.165588 s:
[IPU1-0]   5108.165649 s:  [ ISSM2MSIMCOP ] LATENCY,
[IPU1-0]   5108.165710 s:  ********************
[IPU1-0]   5108.165771 s:  Local Link Latency     : Avg =   6553 us, Min =   3507 us, Max =  16593 us,
[IPU1-0]   5108.165893 s:  Source to Link Latency : Avg =  48412 us, Min =  23394 us, Max =  62740 us,
[IPU1-0]   5108.165985 s:
[IPU1-0]   5108.166656 s:
[IPU1-0]   5108.166748 s:  [ SYNC_LINK_0 ] Link Statistics,
[IPU1-0]   5108.166809 s:  ******************************
[IPU1-0]   5108.166900 s:
[IPU1-0]   5108.166961 s:  Elapsed time       = 115232 msec
[IPU1-0]   5108.167114 s:
[IPU1-0]   5108.167175 s:  New data Recv      =  55.50 fps
[IPU1-0]   5108.167266 s:  Get Full Buf Cb    =  36.60 fps
[IPU1-0]   5108.167388 s:  Put Empty Buf Cb   =  36.60 fps
[IPU1-0]   5108.167480 s:  Driver/Notify Cb   =  30.30 fps
[IPU1-0]   5108.167571 s:
[IPU1-0]   5108.167632 s:  Input Statistics,
[IPU1-0]   5108.167693 s:
[IPU1-0]   5108.167724 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.167846 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.167937 s:  --------------------------------------------------
[IPU1-0]   5108.168090 s:   0 |  50.19      0. 0      0. 0          50.19
[IPU1-0]   5108.168242 s:   1 |  50.18      0. 0      0. 0          50.19
[IPU1-0]   5108.168608 s:   2 |  50.18      0. 0      0. 0          50.19
[IPU1-0]   5108.168791 s:
[IPU1-0]   5108.168822 s:  Output Statistics,
[IPU1-0]   5108.168883 s:
[IPU1-0]   5108.168944 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.169096 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.169279 s:  ---------------------------------------------
[IPU1-0]   5108.169401 s:   0 |  0     50.19     0. 0      0. 0
[IPU1-0]   5108.169584 s:
[IPU1-0]   5108.169645 s:  [ SYNC_LINK_0 ] LATENCY,
[IPU1-0]   5108.169706 s:  ********************
[IPU1-0]   5108.169798 s:  Local Link Latency     : Avg =   7847 us, Min =      0 us, Max =  66065 us,
[IPU1-0]   5108.169950 s:  Source to Link Latency : Avg =  65890 us, Min =  37079 us, Max = 100805 us,
[IPU1-0]   5108.170103 s:
[IPU1-0]   5108.171597 s:
[IPU1-0]   5108.171719 s:  [ ALG_DMA_SWMS ] Link Statistics,
[IPU1-0]   5108.171811 s:  ******************************
[IPU1-0]   5108.171902 s:
[IPU1-0]   5108.171933 s:  Elapsed time       = 115233 msec
[IPU1-0]   5108.172085 s:
[IPU1-0]   5108.172146 s:  New data Recv      =  36.60 fps
[IPU1-0]   5108.172238 s:
[IPU1-0]   5108.172299 s:  Input Statistics,
[IPU1-0]   5108.172360 s:
[IPU1-0]   5108.172421 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.172543 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.172878 s:  --------------------------------------------------
[IPU1-0]   5108.173061 s:   0 |  50.19      0. 0      0. 0          50.19
[IPU1-0]   5108.173244 s:
[IPU1-0]   5108.173305 s:  Output Statistics,
[IPU1-0]   5108.173366 s:
[IPU1-0]   5108.173427 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   5108.173519 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   5108.173610 s:  ---------------------------------------------
[IPU1-0]   5108.173732 s:   0 |  0     50.19     0. 0      0. 0
[IPU1-0]   5108.173915 s:
[IPU1-0]   5108.173976 s:  [ ALG_DMA_SWMS ] LATENCY,
[IPU1-0]   5108.174037 s:  ********************
[IPU1-0]   5108.174129 s:
[IPU1-0]   5108.174251 s:
[IPU1-0]   5108.174312 s:  [ DISPLAY ] Link Statistics,
[IPU1-0]   5108.174403 s:  ******************************
[IPU1-0]   5108.174800 s:
[IPU1-0]   5108.174861 s:  Elapsed time       = 115234 msec
[IPU1-0]   5108.176325 s:
[IPU1-0]   5108.176447 s:  New data Recv      =  50.19 fps
[IPU1-0]   5108.176569 s:  Driver/Notify Cb   =  59.62 fps
[IPU1-0]   5108.176660 s:
[IPU1-0]   5108.176691 s:  Input Statistics,
[IPU1-0]   5108.176782 s:
[IPU1-0]   5108.176813 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.176935 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.177087 s:  --------------------------------------------------
[IPU1-0]   5108.177240 s:   0 |  50.19      0. 0      0. 0          50.19
[IPU1-0]   5108.177423 s:
[IPU1-0]   5108.177484 s:  [ DISPLAY ] LATENCY,
[IPU1-0]   5108.177545 s:  ********************
[IPU1-0]   5108.177636 s:  Local Link Latency     : Avg =     80 us, Min =      0 us, Max =   1281 us,
[IPU1-0]   5108.177789 s:  Source to Link Latency : Avg =  75951 us, Min =  47053 us, Max = 120479 us,
[IPU1-0]   5108.177972 s:
[IPU1-0]   5108.178063 s:
[IPU1-0]   5108.178124 s:  [ DISPLAY  VID1 ] Additional Statistics,
[IPU1-0]   5108.178216 s:  ************************************
[IPU1-0]   5108.178307 s:  Driver Queued    = 176344 frames
[IPU1-0]   5108.178399 s:  Driver De-Queued = 176342 frames
[IPU1-0]   5108.178521 s:  Driver Displayed = 209631 frames
[IPU1-0]   5108.178612 s:  Driver Repeated  =  33289 frames
[IPU1-0]   5108.178704 s:
[IPU1-0]   5108.178734 s:  ##### DSS DISPC Underflow Count  =      0 #####
[IPU1-0]   5108.178856 s:
[IPU1-0]   5108.180076 s:
[IPU1-0]   5108.180137 s:  [ DISPLAY ] Link Statistics,
[IPU1-0]   5108.180625 s:  ******************************
[IPU1-0]   5108.180717 s:
[IPU1-0]   5108.180747 s:  Elapsed time       = 114922 msec
[IPU1-0]   5108.180839 s:
[IPU1-0]   5108.180900 s:  Driver/Notify Cb   =  59.62 fps
[IPU1-0]   5108.180961 s:
[IPU1-0]   5108.181022 s:  Input Statistics,
[IPU1-0]   5108.181113 s:
[IPU1-0]   5108.181144 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   5108.181235 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   5108.181327 s:  --------------------------------------------------
[IPU1-0]   5108.181418 s:
[IPU1-0]   5108.181479 s:  [ DISPLAY ] LATENCY,
[IPU1-0]   5108.181540 s:  ********************
[IPU1-0]   5108.181601 s:
[IPU1-0]   5108.181662 s:
[IPU1-0]   5108.181693 s:  [ DISPLAY GRPX1 ] Additional Statistics,
[IPU1-0]   5108.181784 s:  ************************************
[IPU1-0]   5108.181845 s:  Driver Queued    =      1 frames
[IPU1-0]   5108.181937 s:  Driver De-Queued =      0 frames
[IPU1-0]   5108.181998 s:  Driver Displayed = 209636 frames
[IPU1-0]   5108.182089 s:  Driver Repeated  = 209636 frames
[IPU1-0]   5108.182455 s:
[IPU1-0]   5108.182516 s:  ##### DSS DISPC Underflow Count  =      0 #####
[IPU1-0]   5108.182608 s:
[IPU1-0]   5108.693649 s:

over 6 years ago

0 Brijesh Jadav over 6 years ago

TI__Guru**** 475545 points

Hi Tobias,

From the statistics, ISP takes around 4.9ms for processing a frame, which means it can process 2 channels of 1080p streams, without any issue. It does not look like frame drop is because of ISP processing.. All other down stream modules seems to be running in real time for 2 channels, AEWB = 4.4ms, Simcop 6.5ms, sync link=7.8ms.

I think it might be dropping because of less number of output buffers. The default number of output buffers in ISP is just 2. Could you please check if you are using default number of output buffers? Can you try increasing number of output buffers?

Also one thing missing in the stats is CPU load.. how is IPU loaded? could you please check if it is not heavily loaded?

Rgds,

Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I looked at some other usecases and set the number of ISP buffers to 4 and SIMCOP buffers to 6. I also tried to increase these numbers even further but that didn't bring any improvement. IPU1 load is just around 52%.

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

Could you please share the sync parameters, threshold and delta?
If they are set to high value, it might be possible that these buffers are held in the sync link.

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

pPrm->syncDelta = 0x7FFFFFFF;
pPrm->syncThreshold = 0x7FFFFFFF;

They're indeed set pretty high.. do you know any suitable values for my 60 fps chain?

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

In this case, syncDelta should be set to 17ms and syncThreshold to 34ms.
Since you have two camera input at 60fps, two frames from the two cameras can be at max 17ms apart, which is what the syncDelta used for, it synchronizes frames whose time stamp difference is within syncDelta limit.
Sync Threshold is used when time stamp difference is more than syncDelta. In this case, this tell how long this frame should be kept with the sync link. If it goes beyond that syncThreshold, it will be returned to the previous link.. I think frame time period * 2 should be sufficient for syncThreshold, which is 34ms in your case..

Rgds,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I tried your values but ISP link still drops around 8 fps. Additionally SYNC link now drops around 18 fps which result in a total frame rate of 34. Does that mean one link cant handle some frames in real time? Maybe SIMCOP, because in the statistics there was a "Max" local latency of 15,3 ms?

Also Sync link comapares the srcTimestamp values of each frame. But the one duplicated frame (via dup link) gets the same srcTimestamp assigned like its origin frame, doesn't it? So we cant really compare the three timestamps, because two of them are always the same..?

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

Which means, some one is blocking/holding the the frames for more than 34ms..
Yes, it could be simcop if you have enabled LDC, as LDC table is not tuned for the 2MP camera..
For the time being, can you please remove the simcop from the chains and see if it works real time?

I see min time for simcop is 6.5ms, so for two channels, it should be able to finish in 13ms.. So there is still bit head room for scheduling.. But we are seeing max time as 16.5ms, it should not be so high, may be task is not getting chance to run.. we can bump up the priority of simcop task, but lets first see if it works without simcop..

Even if you have dupped the frame, it would have same time stamp and since the difference is 0, which is lower than 16ms, it would try to synchronize them.. There should not be any problem because of dup..
We kept sync delta to 17ms, because out of three inputs, two are real asynchronous inputs.

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

Simcop actually hast to run three times in our usecase. We got three different mesh tables from our customer and all of them have to be applied to one channel each, so three in total.

I also removed the Simcop link as you suggested. Now only the SWMS link drops about 0.5 fps. The rest of the chain runs at approx. 60 fps (see attached statistics). So Simcop is the weak link here. That also makes sense because it has to process the most data since ISP just has to process two 1080p frames (Dup happens after ISP but before Simcop).

We also tried to remove the SWMS link and change the layout of the usecase (see attached picture). This way we reduced the frame drops to 6.8 fps. Maybe we can get even nearer to 60 fps...

Is it technically possible for the Simcop to process three 1080p frames @ 60fps?
Where can I increase the Simcop task priority as you mentioned?
Do you have any more tips how we could bring the usecase closer to 60 fps?

Regards,

Tobias

Statistics without Simcop:

Fullscreen usecase_statistics_noSimcop.txt Download

IPU1-0]   1553.339687 s:  [ ISSCAPTURE ] Link Statistics,
[IPU1-0]   1553.339809 s:  ******************************
[IPU1-0]   1553.339901 s:
[IPU1-0]   1553.339962 s:  Elapsed time       = 21424 msec
[IPU1-0]   1553.340053 s:
[IPU1-0]   1553.340114 s:  Get Full Buf Cb    = 120.14 fps
[IPU1-0]   1553.340206 s:  Put Empty Buf Cb   = 120.14 fps
[IPU1-0]   1553.340328 s:  Driver/Notify Cb   = 120.14 fps
[IPU1-0]   1553.340419 s:
[IPU1-0]   1553.340480 s:  Input Statistics,
[IPU1-0]   1553.340541 s:
[IPU1-0]   1553.340572 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.340633 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.340724 s:  --------------------------------------------------
[IPU1-0]   1553.340816 s:   0 |  60. 7      0. 0      0. 0          60. 7
[IPU1-0]   1553.340938 s:   1 |  60. 7      0. 0      0. 0          60. 7
[IPU1-0]   1553.341060 s:
[IPU1-0]   1553.341121 s:  Output Statistics,
[IPU1-0]   1553.341151 s:
[IPU1-0]   1553.341212 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   1553.341273 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   1553.341365 s:  ---------------------------------------------
[IPU1-0]   1553.341456 s:   0 |  0     60. 7     0. 0      0. 0
[IPU1-0]   1553.341578 s:   1 |  0     60. 7     0. 0      0. 0
[IPU1-0]   1553.342005 s:
[IPU1-0]   1553.342066 s:  [ ISSM2MISP ] Link Statistics,
[IPU1-0]   1553.342127 s:  ******************************
[IPU1-0]   1553.342188 s:
[IPU1-0]   1553.342249 s:  Elapsed time       = 21419 msec
[IPU1-0]   1553.342310 s:
[IPU1-0]   1553.342341 s:  New data Recv      = 120.12 fps
[IPU1-0]   1553.342463 s:  Get Full Buf Cb    = 220.31 fps
[IPU1-0]   1553.342524 s:  Driver/Notify Cb   = 120.12 fps
[IPU1-0]   1553.342615 s:
[IPU1-0]   1553.342646 s:  Input Statistics,
[IPU1-0]   1553.342707 s:
[IPU1-0]   1553.342737 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.342829 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.342890 s:  --------------------------------------------------
[IPU1-0]   1553.342981 s:   0 |  60. 4      0. 0      0. 0          60. 4
[IPU1-0]   1553.343103 s:   1 |  60. 8      0. 0      0. 0          60. 8
[IPU1-0]   1553.343256 s:
[IPU1-0]   1553.343286 s:  Output Statistics,
[IPU1-0]   1553.343347 s:
[IPU1-0]   1553.343408 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   1553.343469 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   1553.343530 s:  ---------------------------------------------
[IPU1-0]   1553.343622 s:   0 |  0     60. 4     0. 0      0. 0
[IPU1-0]   1553.343744 s:   0 |  1     60. 4     0. 0      0. 0
[IPU1-0]   1553.343957 s:   0 |  2      0. 0    60. 4      0. 0
[IPU1-0]   1553.344079 s:   0 |  3      0. 0    60. 4      0. 0
[IPU1-0]   1553.344201 s:   1 |  0     60. 8     0. 0      0. 0
[IPU1-0]   1553.344323 s:   1 |  1     60. 8     0. 0      0. 0
[IPU1-0]   1553.344445 s:   1 |  2      0. 0    60. 8      0. 0
[IPU1-0]   1553.344567 s:   1 |  3      0. 0    60. 8      0. 0
[IPU1-0]   1553.344720 s:
[IPU1-0]   1553.344750 s:  [ ISSM2MISP ] LATENCY,
[IPU1-0]   1553.344811 s:  ********************
[IPU1-0]   1553.344872 s:  Local Link Latency     : Avg =   4701 us, Min =   4636 us, Max =   5246 us,
[IPU1-0]   1553.344964 s:  Source to Link Latency : Avg =   5884 us, Min =   4727 us, Max =   9944 us,
[IPU1-0]   1553.345086 s:
[IPU1-0]   1553.345940 s:
[IPU1-0]   1553.346001 s:  [ ALG_ISS_AEWB ] Link Statistics,
[IPU1-0]   1553.346092 s:  ******************************
[IPU1-0]   1553.346153 s:
[IPU1-0]   1553.346184 s:  Elapsed time       = 21412 msec
[IPU1-0]   1553.346275 s:
[IPU1-0]   1553.346306 s:  New data Recv      = 100.17 fps
[IPU1-0]   1553.346428 s:
[IPU1-0]   1553.346489 s:  Input Statistics,
[IPU1-0]   1553.346519 s:
[IPU1-0]   1553.346580 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.346641 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.346946 s:  --------------------------------------------------
[IPU1-0]   1553.347038 s:   0 |  60. 5      0. 0      0. 0          60. 5
[IPU1-0]   1553.347190 s:
[IPU1-0]   1553.347221 s:  Output Statistics,
[IPU1-0]   1553.347282 s:
[IPU1-0]   1553.347312 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   1553.347434 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   1553.347495 s:  ---------------------------------------------
[IPU1-0]   1553.347587 s:   0 |  0     60. 5     0. 0      0. 0
[IPU1-0]   1553.347739 s:
[IPU1-0]   1553.347770 s:  [ ALG_ISS_AEWB ] LATENCY,
[IPU1-0]   1553.347831 s:  ********************
[IPU1-0]   1553.347892 s:  Local Link Latency     : Avg =   4536 us, Min =     92 us, Max =  16105 us,
[IPU1-0]   1553.348044 s:  Source to Link Latency : Avg =  14961 us, Min =   6954 us, Max =  34527 us,
[IPU1-0]   1553.348166 s:
[IPU1-0]   1553.348471 s:
[IPU1-0]   1553.348532 s:  [ SYNC_LINK_0 ] Link Statistics,
[IPU1-0]   1553.348593 s:  ******************************
[IPU1-0]   1553.348654 s:
[IPU1-0]   1553.348685 s:  Elapsed time       = 21411 msec
[IPU1-0]   1553.348776 s:
[IPU1-0]   1553.348807 s:  New data Recv      = 210.12 fps
[IPU1-0]   1553.348898 s:  Get Full Buf Cb    =  60.6 fps
[IPU1-0]   1553.348959 s:  Put Empty Buf Cb   =  60.6 fps
[IPU1-0]   1553.349051 s:  Driver/Notify Cb   =  30.26 fps
[IPU1-0]   1553.349142 s:
[IPU1-0]   1553.349173 s:  Input Statistics,
[IPU1-0]   1553.349234 s:
[IPU1-0]   1553.349264 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.349356 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.349447 s:  --------------------------------------------------
[IPU1-0]   1553.349539 s:   0 |  60. 6      0. 0      0. 0          60. 6
[IPU1-0]   1553.349691 s:   1 |  60. 6      0. 0      0. 0          60. 6
[IPU1-0]   1553.349813 s:   2 |  60. 6      0. 0      0. 0          60. 6
[IPU1-0]   1553.349996 s:
[IPU1-0]   1553.350057 s:  Output Statistics,
[IPU1-0]   1553.350118 s:
[IPU1-0]   1553.350149 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   1553.350210 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   1553.350301 s:  ---------------------------------------------
[IPU1-0]   1553.350362 s:   0 |  0     60. 6     0. 0      0. 0
[IPU1-0]   1553.350515 s:
[IPU1-0]   1553.350576 s:  [ SYNC_LINK_0 ] LATENCY,
[IPU1-0]   1553.350637 s:  ********************
[IPU1-0]   1553.350667 s:  Local Link Latency     : Avg =   1790 us, Min =     30 us, Max =   5399 us,
[IPU1-0]   1553.350789 s:  Source to Link Latency : Avg =   8347 us, Min =   7280 us, Max =   8988 us,
[IPU1-0]   1553.350911 s:
[IPU1-0]   1553.352132 s:
[IPU1-0]   1553.352193 s:  [ ALG_DMA_SWMS ] Link Statistics,
[IPU1-0]   1553.352254 s:  ******************************
[IPU1-0]   1553.352345 s:
[IPU1-0]   1553.352437 s:  Elapsed time       = 21412 msec
[IPU1-0]   1553.352498 s:
[IPU1-0]   1553.352559 s:  Out Buf Error Count = 9 frames
[IPU1-0]   1553.352620 s:  New data Recv      =  60.5 fps
[IPU1-0]   1553.352711 s:
[IPU1-0]   1553.352742 s:  Input Statistics,
[IPU1-0]   1553.352803 s:
[IPU1-0]   1553.352833 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.352925 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.353016 s:  --------------------------------------------------
[IPU1-0]   1553.353108 s:   0 |  60. 5      0.42      0. 0          59.63
[IPU1-0]   1553.353230 s:
[IPU1-0]   1553.353291 s:  Output Statistics,
[IPU1-0]   1553.353352 s:
[IPU1-0]   1553.353413 s:  CH | Out | Out     | Out Drop | Out User Drop
[IPU1-0]   1553.353474 s:     | ID  | FPS     | FPS      | FPS
[IPU1-0]   1553.353565 s:  ---------------------------------------------
[IPU1-0]   1553.353657 s:   0 |  0     59.63     0.42      0. 0
[IPU1-0]   1553.353779 s:
[IPU1-0]   1553.353840 s:  [ ALG_DMA_SWMS ] LATENCY,
[IPU1-0]   1553.353901 s:  ********************
[IPU1-0]   1553.353962 s:
[IPU1-0]   1553.354236 s:
[IPU1-0]   1553.354297 s:  [ DISPLAY ] Link Statistics,
[IPU1-0]   1553.354480 s:  ******************************
[IPU1-0]   1553.354541 s:
[IPU1-0]   1553.354602 s:  Elapsed time       = 21412 msec
[IPU1-0]   1553.354663 s:
[IPU1-0]   1553.354694 s:  New data Recv      =  59.63 fps
[IPU1-0]   1553.354785 s:  Driver/Notify Cb   =  59.63 fps
[IPU1-0]   1553.354877 s:
[IPU1-0]   1553.354907 s:  Input Statistics,
[IPU1-0]   1553.354968 s:
[IPU1-0]   1553.354999 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.355090 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.355182 s:  --------------------------------------------------
[IPU1-0]   1553.355273 s:   0 |  59.63      0. 0      0. 0          59.63
[IPU1-0]   1553.355426 s:
[IPU1-0]   1553.355487 s:  [ DISPLAY ] LATENCY,
[IPU1-0]   1553.355548 s:  ********************
[IPU1-0]   1553.355609 s:  Local Link Latency     : Avg =     41 us, Min =      0 us, Max =    793 us,
[IPU1-0]   1553.355731 s:  Source to Link Latency : Avg =  12542 us, Min =  10817 us, Max =  16379 us,
[IPU1-0]   1553.355853 s:
[IPU1-0]   1553.356554 s:
[IPU1-0]   1553.356646 s:  [ DISPLAY  VID1 ] Additional Statistics,
[IPU1-0]   1553.356707 s:  ************************************
[IPU1-0]   1553.356768 s:  Driver Queued    =   2257 frames
[IPU1-0]   1553.356829 s:  Driver De-Queued =   2254 frames
[IPU1-0]   1553.356920 s:  Driver Displayed =   2255 frames
[IPU1-0]   1553.356981 s:  Driver Repeated  =      1 frames
[IPU1-0]   1553.357042 s:
[IPU1-0]   1553.357073 s:  ##### DSS DISPC Underflow Count  =      0 #####
[IPU1-0]   1553.357164 s:
[IPU1-0]   1553.358689 s:
[IPU1-0]   1553.358781 s:  [ DISPLAY ] Link Statistics,
[IPU1-0]   1553.358872 s:  ******************************
[IPU1-0]   1553.358964 s:
[IPU1-0]   1553.359025 s:  Elapsed time       = 21412 msec
[IPU1-0]   1553.359116 s:
[IPU1-0]   1553.359177 s:  Driver/Notify Cb   =  59.63 fps
[IPU1-0]   1553.359299 s:
[IPU1-0]   1553.359360 s:  Input Statistics,
[IPU1-0]   1553.359452 s:
[IPU1-0]   1553.359513 s:  CH | In Recv | In Drop | In User Drop | In Process
[IPU1-0]   1553.359635 s:     | FPS     | FPS     | FPS          | FPS
[IPU1-0]   1553.359757 s:  --------------------------------------------------
[IPU1-0]   1553.359909 s:
[IPU1-0]   1553.359970 s:  [ DISPLAY ] LATENCY,
[IPU1-0]   1553.360062 s:  ********************
[IPU1-0]   1553.360123 s:
[IPU1-0]   1553.360214 s:
[IPU1-0]   1553.360275 s:  [ DISPLAY GRPX1 ] Additional Statistics,
[IPU1-0]   1553.360336 s:  ************************************
[IPU1-0]   1553.360397 s:  Driver Queued    =      1 frames
[IPU1-0]   1553.360489 s:  Driver De-Queued =      0 frames
[IPU1-0]   1553.361190 s:  Driver Displayed =   2258 frames
[IPU1-0]   1553.361282 s:  Driver Repeated  =   2258 frames
[IPU1-0]   1553.361343 s:
[IPU1-0]   1553.361434 s:  ##### DSS DISPC Underflow Count  =      0 #####
[IPU1-0]   1553.361526 s:

New usecase layout we tried:

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Tobias,

Well, which TDA part that you are using?
On TDA3x, it is not possible to process 2MP 3Ch @60fps.. This requires close to 400MHz pixel rate.. This is just too high.
Now i know why we were seeing 6.5ms as average time and 3.5 as min time in simcop. Since you are three loopup table, it is varying..
Can you please first check all three loopup table in standalone example or in simple single channel example and check the processing time required?

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I'm using a TDA2P on a custom board. Is a TDA2P generally able to handle 3CH@60fps?

The three tables also generate different sized output images but all use 1080p frames as an input. The sizes of the output areas are:
- 1408 x 696
- 1408 x 384
- 512 x 1080
I'm guessing the first table takes the longest time to be processed since its the largest, but I can check them individually.

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

It might possible in opp_high..
output resolution is smaller, but it also depends on the look up table..
so better to check them individually first.

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I changed the usecase so that it is
IssCapture -> IssM2mIsp -> IssM2mSimcop -> Display
and measured the SIMCOP latencies of the individual channels/tables:

CH0 (1408x696): Avg = 5366 us, Min = 5215 us, Max = 6740 us
CH1 (1408x384): Avg = 4339 us, Min = 4239 us, Max = 4576 us
CH2 (512x1080): Avg = 4594 us, Min = 4544 us, Max = 4728 us

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

If we add all max values, it comes very close to 16ms, which is very tight to run 60fps..

May be you could try running in opp_high..

Regards,

Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I'm already running in opp_plus. The latency values were also taken while in opp_plus.. So I'm already at max. settings here.
You mentioned increasing the simcop task priority.. maybe this would help?

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

Can you try with the changes, i suggested at below link?

e2e.ti.com/.../2847509

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I changed the M2 divider to 1 and I also had to change the ISS_CLK_MUX register to 0x0. It was set to 0x3 at default and so DPLL_CORE clock is chosen as the reference clock for the ISS. Now it should take EVE3_GFCLK/2 as a reference..

After that I also noticed a change in the ISP load (Graphics Display) and the frame drops went down to just 0.5 fps per channel.

One thing I was wondering: In data sheets it is stated that 532 MHz is the max. frequency for ISS/ISP. We now increase it to (20 x 260 / 4) / 2 = 650 Mhz. Is it safe to increase the ISS frequency?

Regards,

Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Tobias,

No, it is not recommended to use frequency, higher than mentioned in TRM.

Regards,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

Understood. Do you have any other ideas on how I could remove those last frame drops?

Also I notived something strange. When I set the OPP mode back to OPP_NOM the drops went actually down compared to OPP_HIGH (without any manual frequency changes). On HIGH, drops were about 7 fps per channel, on NOM they're only about 2 fps..

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Tobias,

You could try changing ISSM2MSIMCOP_LINK_TSK_PRI task priority in links_fw\src\rtos\links_common\system\system_priv_common.h file.

This is surprising. Are you sure opp value is the only change between two runs?

Rgds,
Brijesh

0 Tobias Schulze over 6 years ago in reply to Brijesh Jadav

Intellectual 900 points

Hi Brijesh,

I increased the priority but it I just noticed a small increase in fps (like 1-2). And the only thing I changed between two runs was the gel file entry that specified the OPP mode config that should be used.. That seemed also strange to me.

Anyway, I managed to decrease the frame drops by adjusting our LDC parameters i.e. increasing OutputBlockWidth and OutputBlockHeight of LDC. They were set to small values which apparently made SIMCOP processing quite long.. I am now to 59.7 fps in total and SIMCOP only drops about 0.5 frames.

Regards,
Tobias

0 Brijesh Jadav over 6 years ago in reply to Tobias Schulze

TI__Guru**** 475545 points

Hi Tobias,

That's good. Yes, output block size and pixel pad can reduce the LDC processing time and can improve overall throughput.
You could run this lookup table in DCC tool and get the optimal block size..

Rgds,
Brijesh

Processors

Processors forum

TDA2P-ACD: ISP Link drops Frames despite not running on Full Load