• State
  • Locked Locked
  • Replies 16 replies
  • Subscribers 100 subscribers
  • Views 557 views
  • Users 0 members are here
Support feedback
Options
Options
Related

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

Original question:

Compiler/PROCESSOR-SDK-DRA7X: Processors forum

Compiler/PROCESSOR-SDK-DRA7X: apps.out running on A15 side is hogging CPU

Raghu Kadari
Expert 1380 points
Part Number: PROCESSOR-SDK-DRA7X

Tool/software: TI C/C++ Compiler

Hello TI team,

When ever we are running Navigation, we see apps.out is complete hogging one of the CPU, we suspect  IPC threads. Below are the logs (VSDKAPPS -> apps.out)

Line 110: 1019 1 root S 467m 24% 47% /sbin/vsdkapps
Line 191: 1019 1 root S 467m 24% 50% /sbin/vsdkapps
Line 272: 1019 1 root S 467m 24% 49% /sbin/vsdkapps
Line 353: 1019 1 root S 467m 24% 51% /sbin/vsdkapps
Line 434: 1019 1 root S 467m 24% 51% /sbin/vsdkapps
Line 515: 1019 1 root S 467m 24% 51% /sbin/vsdkapps
Line 596: 1019 1 root S 467m 24% 50% /sbin/vsdkapps
Line 677: 1019 1 root S 467m 24% 50% /sbin/vsdkapps
Line 758: 1019 1 root S 467m 24% 50% /sbin/vsdkapps
Line 839: 1019 1 root S 467m 24% 45% /sbin/vsdkapps
Line 920: 1019 1 root S 467m 24% 54% /sbin/vsdkapps

Regards,

Raghu

  • 0
    TI__Mastermind 30480 points

    Hi Raghu,

    Can you please provide more information?  What are the chain usecases running?

    What will be the impact of this?

    Thanks

    RamPrasad

  • 0 in reply to Ramprasad
    Expert 1380 points

    Hi Ram,

    Please find below usecase and this is not always an issue.  We are seeing whenever Navigation route guidance is running  sometimes we see VSDKAPPS

    completely hogging one core. 

    UseCase: early_capture_lateweston_2s_2c_dsswb

    Capture -> Display_Video
    DispDistSrc_weston -> Display_m4
    DispDistSrc_vid3 -> Display_vid3
    Capture_dsswb -> Alg_SwCrc

    Impact : 

    1. Over all system behavior is Slow and Sluggish, recovery is Restart

    Also would like to rename threads for different IPCS so that next time we can accurately confirm which thread  is hogging cpu. Can you please share info on  which file changes needs to be done. 

    Regards,

    Raghu

  • 0 in reply to Ramprasad
    Intellectual 450 points

    Hi Ram, 

    In addition to details shared by Raghu on the usecases, below are certain observations

    Below logs were seen in dmesg when vsdkapps was hogging 50% of the cpu, what does these logs mean ? Attached complete dmesg for your reference

    6378.dmesg.log

    Line 3196: [Tue Feb 25 12:52:26.436 2020] [ 8122.806064] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 3862: [Tue Feb 25 12:52:38.555 2020] [ 8536.592739] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4129: [Tue Feb 25 12:52:42.536 2020] [ 8850.979878] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4131: [Tue Feb 25 12:52:43.392 2020] [ 8851.981400] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4868: [Tue Feb 25 12:52:54.615 2020] [10414.983943] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4905: [Tue Feb 25 12:52:55.497 2020] [10577.973716] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4952: [Tue Feb 25 12:52:55.681 2020] [10963.973367] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5011: [Tue Feb 25 12:52:56.423 2020] [11399.967252] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5019: [Tue Feb 25 12:52:56.423 2020] [11426.967266] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5065: [Tue Feb 25 12:52:57.404 2020] [11669.967253] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5066: [Tue Feb 25 12:52:57.404 2020] [11669.967308] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5067: [Tue Feb 25 12:52:57.404 2020] [11669.967353] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 5118: [Tue Feb 25 12:52:57.439 2020] [11889.967271] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Also we see 59 threads of vsdkapps, last spawned thread seems to be hogging 50% CPU

    Need to understand below

    • Why and when are the new threads spawned
    • What is functionality of each thread
    • Once Job is done are the thread exited properly
    • Is there a limit on the number of threads

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1093 vsdkapps             1093 cfs           0     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1095 vsdkapps             1093 rr           50     0.06 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1096 vsdkapps             1093 rr           99     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1098 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1099 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1100 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1101 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1102 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1103 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1104 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1105 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1106 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1107 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1108 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1109 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1110 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1111 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1112 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1113 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1114 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1115 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1116 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1117 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1118 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1119 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1120 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1121 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1122 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1123 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1124 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1125 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1126 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.544 2020]     1 vsdkapps             1127 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.020 2020]     1 vsdkapps             1128 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1129 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1130 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1131 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1132 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1133 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1134 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1135 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1136 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.367 2020]     1 vsdkapps             1137 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1138 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1139 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1140 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1141 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1142 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1143 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1144 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1145 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1146 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1147 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1148 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1149 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1150 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1151 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1152 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.430 2020]     1 vsdkapps             1153 vsdkapps             1093 rr           50   47.70 n/a             n/a

     

    Can you please check this on priority and bring in the needed experts to weekly call.

     

    Best Regards,

    Pradeep

  • 0 in reply to Ramprasad
    Intellectual 450 points

    Hi Ram, 

    In addition to details of the usecase shared by Raghu, below are further observations

    1. Below vdrm logs are seen when vsdkapps was hogging 50% CPU , what does below logs mean ? Attached complete dmesg for your reference.

    3201.dmesg.log

    Line 3196: [Tue Feb 25 12:52:26.436 2020] [ 8122.806064] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 3862: [Tue Feb 25 12:52:38.555 2020] [ 8536.592739] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4129: [Tue Feb 25 12:52:42.536 2020] [ 8850.979878] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4131: [Tue Feb 25 12:52:43.392 2020] [ 8851.981400] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4868: [Tue Feb 25 12:52:54.615 2020] [10414.983943] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    Line 4905: [Tue Feb 25 12:52:55.497 2020] [10577.973716] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    2.Overall 59 vsdkapp threads were spawned. The last spawned thread was hogging 50% of the CPU. 

    • Need to understand
    • Why and when are the new threads spawned
    • What is functionality of each thread
    • Once Job is done are the thread exited properly
    • Is there a limit on the number of thread

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1093 vsdkapps             1093 cfs           0     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1095 vsdkapps             1093 rr           50     0.06 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1096 vsdkapps             1093 rr           99     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1098 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1099 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1100 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1101 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.407 2020]     1 vsdkapps             1102 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1103 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1104 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1105 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1106 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1107 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1108 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1109 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.443 2020]     1 vsdkapps             1110 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1111 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1112 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1113 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1114 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1115 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1116 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1117 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.478 2020]     1 vsdkapps             1118 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1119 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1120 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1121 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1122 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1123 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1124 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1125 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.516 2020]     1 vsdkapps             1126 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:30.544 2020]     1 vsdkapps             1127 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.020 2020]     1 vsdkapps             1128 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1129 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1130 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1131 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1132 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1133 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1134 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1135 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.333 2020]     1 vsdkapps             1136 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.367 2020]     1 vsdkapps             1137 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1138 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1139 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1140 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1141 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1142 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1143 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.368 2020]     1 vsdkapps             1144 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1145 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1146 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1147 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1148 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1149 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1150 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1151 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.404 2020]     1 vsdkapps             1152 vsdkapps             1093 rr           50     0.00 n/a             n/a                    

    [Tue Feb 25 13:11:31.430 2020]     1 vsdkapps             1153 vsdkapps             1093 rr           50   47.70 n/a             n/a

    Can you please check help checking these points with the experts, we can further discuss this in weekly call.

    Thanks 

    Best Regards,

    Pradeep 

  • 0 in reply to Raghu Kadari
    Expert 1380 points

    Hi Ram,

    We have some additional logs from our Test team. 

    Vsdkapps(RR 50) 



    Vsdkapps hogging issue:
    1. Below logs to be checked once with TI if it is an issue, already thread is created for same : https://e2e.ti.com/support/processors/f/791/t/883664


    Line 3196: [Tue Feb 25 12:52:26.436 2020] [ 8122.806064] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 3862: [Tue Feb 25 12:52:38.555 2020] [ 8536.592739] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 4129: [Tue Feb 25 12:52:42.536 2020] [ 8850.979878] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 4131: [Tue Feb 25 12:52:43.392 2020] [ 8851.981400] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 4868: [Tue Feb 25 12:52:54.615 2020] [10414.983943] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 4905: [Tue Feb 25 12:52:55.497 2020] [10577.973716] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 4952: [Tue Feb 25 12:52:55.681 2020] [10963.973367] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5011: [Tue Feb 25 12:52:56.423 2020] [11399.967252] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5019: [Tue Feb 25 12:52:56.423 2020] [11426.967266] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5065: [Tue Feb 25 12:52:57.404 2020] [11669.967253] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5066: [Tue Feb 25 12:52:57.404 2020] [11669.967308] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5067: [Tue Feb 25 12:52:57.404 2020] [11669.967353] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!
    Line 5118: [Tue Feb 25 12:52:57.439 2020] [11889.967271] vdrm 44000000.ocp:vdrm@0: atomic complete timeout (pipe 0)!

    2. Need to understand the below. Looks like last spawned thread of vsdkapps is hogging the CPU
    ○ Why and when are the new threads spawned
    ○ What is functionality of each thread
    ○ Once Job is done are the thread exited properly
    ○ Is there a limit on the number of threads

    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1093 vsdkapps 1093 cfs 0 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1095 vsdkapps 1093 rr 50 0.06 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1096 vsdkapps 1093 rr 99 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1098 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1099 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1100 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1101 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.407 2020] 1 vsdkapps 1102 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1103 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1104 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1105 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1106 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1107 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1108 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1109 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.443 2020] 1 vsdkapps 1110 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1111 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1112 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1113 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1114 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1115 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1116 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1117 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.478 2020] 1 vsdkapps 1118 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1119 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1120 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1121 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1122 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1123 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1124 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1125 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.516 2020] 1 vsdkapps 1126 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:30.544 2020] 1 vsdkapps 1127 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.020 2020] 1 vsdkapps 1128 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1129 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1130 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1131 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1132 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1133 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1134 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1135 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.333 2020] 1 vsdkapps 1136 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.367 2020] 1 vsdkapps 1137 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1138 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1139 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1140 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1141 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1142 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1143 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.368 2020] 1 vsdkapps 1144 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1145 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1146 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1147 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1148 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1149 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1150 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1151 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.404 2020] 1 vsdkapps 1152 vsdkapps 1093 rr 50 0.00 n/a n/a
    [Tue Feb 25 13:11:31.430 2020] 1 vsdkapps 1153 vsdkapps 1093 rr 50 47.70 n/a n/a

    Regards,

    Raghu

  • 0 in reply to Raghu Kadari
    TI__Mastermind 30480 points

    Hi RAghu,

    Can you get the performance statistics before and after launching navigation application?

    Need to understand from the DDR bandwidth from each IP in the chain.

    Thanks

    RamPrasad

  • 0 in reply to Ramprasad
    Expert 1380 points

    Hi Ram,

    When the issue  happens I dont think we can take this log because VSDKAPPS continously hogg's CPU.

    Regards.
    Raghu

  • 0 in reply to Raghu Kadari
    TI__Mastermind 30480 points

    Hi Raghu,

    https://e2e.ti.com/support/processors/f/791/t/870753

    In this thread, you have mentioned cputop as the binary to get the thread information of visionSDK, but I don't see this in our default filesystem.

    Can you please share some information on this? I will follow Stanley's recommendation to get the thread names and check if it prints the name of the threads.

    Thanks

    RamPrasad

  • 0 in reply to Ramprasad
    Expert 1380 points

    Hi Ram,

    You can use TOP command instead of cputop. It has also options to list  threads per process.

    https://linux.die.net/man/1/top

    Regards,
    Raghu

  • 0 in reply to Raghu Kadari
    TI__Mastermind 30480 points

    Hi Raghu,
    I am guessing "vsdkapps" is nothing but the name of the application launched which is "apps.out" in default vision-sdk.
    Please confirm this.

    top -H doesn't work on the target.

    Can you make this change inn vision-sdk and rebuild?

    --- a/links_fw/src/hlos/osa/src/osa_tsk.c
    +++ b/links_fw/src/hlos/osa/src/osa_tsk.c
    @@ -71,9 +71,7 @@ void *OSA_tskThrMain(void *pPrm)
    pPrc = (OSA_TskHndl *)pPrm;
    OSA_assert(pPrc!=NULL);

    -#ifdef QNX_BUILD
    pthread_setname_np(pthread_self(), pPrc->fncName);
    -#endif

    while(1) {

    i,e pthread_setname_np is enabled only for QNS build now, enable it for linux.

    Here for every pthread created which uses OSA_tskThrMain() as thread-entry function, it prints now task-name with "ps -T" command as shown in the attached text.
    Currently I am seeing the names for all threads which are created from link_init function as task name is set as thread name.

    Fullscreen thread_names_from ps.txt Download 
    root@dra7xx-evm:~# ps -T
  PID USER       VSZ STAT COMMAND
    1 root      7128 S    {systemd} /sbin/init
    2 root         0 SW   [kthreadd]
    3 root         0 IW<  [rcu_gp]
    4 root         0 IW<  [rcu_par_gp]
    5 root         0 IW   [kworker/0:0-cgr]
    6 root         0 IW<  [kworker/0:0H-mm]
    7 root         0 IW   [kworker/u4:0-ev]
    8 root         0 IW<  [mm_percpu_wq]
    9 root         0 SW   [ksoftirqd/0]
   10 root         0 IW   [rcu_preempt]
   11 root         0 IW   [rcu_sched]
   12 root         0 IW   [rcu_bh]
   13 root         0 SW   [migration/0]
   14 root         0 SW   [cpuhp/0]
   15 root         0 SW   [cpuhp/1]
   16 root         0 SW   [migration/1]
   17 root         0 SW   [ksoftirqd/1]
   18 root         0 IW   [kworker/1:0-cgr]
   19 root         0 IW<  [kworker/1:0H-kb]
   20 root         0 SW   [kdevtmpfs]
   21 root         0 IW<  [netns]
   22 root         0 SW   [rcu_tasks_kthre]
   23 root         0 IW   [kworker/0:1-pvr]
   24 root         0 SW   [oom_reaper]
   25 root         0 IW<  [writeback]
   26 root         0 SW   [kcompactd0]
   27 root         0 IW<  [crypto]
   28 root         0 IW<  [kblockd]
   29 root         0 SW   [irq/72-48070000]
   30 root         0 SW   [irq/174-0-0020]
   31 root         0 SW   [irq/174-0-0021]
   32 root         0 SW   [irq/73-48060000]
   33 root         0 IW<  [edac-poller]
   34 root         0 IW<  [devfreq_wq]
   35 root         0 SW   [watchdogd]
   36 root         0 IW   [kworker/1:1-pm]
   37 root         0 IW<  [rpciod]
   38 root         0 IW<  [kworker/u5:0]
   39 root         0 IW<  [xprtiod]
   40 root         0 SW   [kswapd0]
   41 root         0 IW<  [nfsiod]
   54 root         0 IW<  [kpcitest]
   55 root         0 IW<  [kpcintb]
   56 root         0 SW   [hwrng]
   57 root         0 IW   [kworker/u4:1-ev]
   58 root         0 IW<  [nvme-wq]
   59 root         0 IW<  [nvme-reset-wq]
   60 root         0 IW<  [nvme-delete-wq]
   61 root         0 SW   [spi1]
   62 root         0 SW   [spi2]
   63 root         0 SW   [spi0]
   66 root         0 SW   [irq/27-talert]
   67 root         0 SW   [irq/76-mmc0]
   68 root         0 IW   [kworker/0:2-eve]
   69 root         0 SW   [irq/77-mmc1]
   70 root         0 IW   [kworker/0:3-mm_]
   71 root         0 SW   [ion_system_heap]
   72 root         0 SW   [irq/91-48468000]
   73 root         0 SW   [irq/90-48468000]
   74 root         0 SW   [irq/93-4847c000]
   75 root         0 SW   [irq/92-4847c000]
   76 root         0 IW<  [ipv6_addrconf]
   77 root         0 IW   [kworker/0:4-mm_]
   78 root         0 IW<  [mmc_complete]
   79 root         0 SW   [irq/74-mmc2]
   80 root         0 IW<  [kworker/0:1H-kb]
   81 root         0 SW   [irq/178-4809c00]
   83 root         0 IW<  [mmc_complete]
   84 root         0 IW<  [kworker/0:2H-mm]
   85 root         0 SW   [jbd2/mmcblk2p2-]
   86 root         0 IW<  [ext4-rsv-conver]
   88 root         0 IW<  [kworker/1:1H-kb]
   97 root         0 IW<  [kworker/1:2H-kb]
  109 root     12980 S    /lib/systemd/systemd-journald
  112 root         0 IW   [kworker/1:2-eve]
  120 root     14440 S    /lib/systemd/systemd-udevd
  132 root         0 IW   [kworker/u4:2-ev]
  168 systemd- 14756 S    /lib/systemd/systemd-timesyncd
  268 systemd- 14756 S    {sd-resolve} /lib/systemd/systemd-timesyncd
  174 systemd- 13244 S    /lib/systemd/systemd-networkd
  186 root         0 IW   [kworker/u4:3]
  187 root         0 IW   [kworker/1:3-mm_]
  201 root         0 IW   [kworker/1:4-rcu]
  274 root         0 SW   [ptp0]
  275 root         0 IW<  [ata_sff]
  296 root         0 SW   [w1_bus_master1]
  302 root         0 SW   [480a5000.des-en]
  303 root      4796 S    /lib/systemd/systemd-logind
  327 messageb  4328 S    /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
  334 root         0 SW   [scsi_eh_0]
  335 root         0 IW<  [scsi_tmf_0]
  337 root     10212 S    /usr/bin/lad_dra7xx -g -l lad.txt
  338 root     10212 S    /usr/bin/lad_dra7xx -g -l lad.txt
  391 root         0 IW<  [kworker/0:3H-mm]
  392 root         0 IW<  [kworker/1:3H-kb]
  399 root         0 IW<  [kworker/1:4H-kb]
  400 root         0 IW<  [pvr_timer]
  404 root         0 IW<  [PVR Linux Fence]
  458 root         0 IW<  [pvr_workqueue]
  746 root         0 SW   [4b500000.aes-en]
  765 root         0 SW   [4b700000.aes-en]
  774 root         0 SW   [irq/87-dwc3-oma]
  776 root         0 SW   [irq/88-dwc3-oma]
 1113 root      4576 S    /lib/systemd/systemd-hostnamed
 1120 systemd-  5404 S    /lib/systemd/systemd-resolved
 1129 root      2732 S    {runWeston} /bin/sh /usr/bin/runWeston
 1133 root      2452 S    /usr/sbin/telnetd
 1136 root     66080 S    weston --idle-time=0
 1139 root         0 SW   [jbd2/mmcblk0p6-]
 1140 root         0 IW<  [ext4-rsv-conver]
 1142 avahi     4632 S    avahi-daemon: running [dra7xx-evm.local]
 1143 avahi     4632 S    avahi-daemon: chroot helper
 1144 root      1852 S    /sbin/agetty -o -p -- \u --noclear tty1 linux
 1145 root     10000 S    /usr/libexec/weston-keyboard
 1146 root     17784 S    /usr/libexec/weston-desktop-shell
 1147 root      4688 S    /bin/login --
 1150 root      4688 S    /bin/login
 1151 root         0 SW   [irq/177-4806a00]
 1153 root      6740 S    /lib/systemd/systemd --user
 1154 root      8260 S    (sd-pam)
 1159 root      2732 S    -sh
 1163 root      2860 S    -sh
 1205 root      703m S    ./apps.out
 1206 root      703m S    ./apps.out
 1207 root      703m S    ./apps.out
 1208 root      703m S    ./apps.out
 1209 root      703m S    {IPC_OUT_0} ./apps.out
 1210 root      703m S    {IPC_OUT_1} ./apps.out
 1211 root      703m S    {IPC_OUT_2} ./apps.out
 1212 root      703m S    {IPC_OUT_3} ./apps.out
 1213 root      703m S    {IPC_OUT_4} ./apps.out
 1214 root      703m S    {IPC_IN_0} ./apps.out
 1215 root      703m S    {IPC_IN_1} ./apps.out
 1216 root      703m S    {IPC_IN_2} ./apps.out
 1217 root      703m S    {IPC_IN_3} ./apps.out
 1218 root      703m S    {IPC_IN_4} ./apps.out
 1219 root      703m S    {IPC_IN_5} ./apps.out
 1220 root      703m S    {IPC_IN_6} ./apps.out
 1221 root      703m S    {NULL_0} ./apps.out
 1222 root      703m S    {NULL_1} ./apps.out
 1223 root      703m S    {NULL_SRC_0} ./apps.out
 1224 root      703m S    {DISP_DIST_SRC_0} ./apps.out
 1225 root      703m S    {DISP_DIST_SRC_1} ./apps.out
 1226 root      703m S    {DISP_DIST_SRC_2} ./apps.out
 1227 root      703m S    {DISP_DIST_SRC_3} ./apps.out
 1228 root      703m S    {SGX3DSRV_0} ./apps.out
 1229 root      703m S    {ALGORITHM_0} ./apps.out
 1230 root      703m S    {ALGORITHM_1} ./apps.out
 1231 root      703m S    {ALGORITHM_2} ./apps.out
 1232 root      703m S    {ALGORITHM_3} ./apps.out
 1233 root      703m S    {ALGORITHM_4} ./apps.out
 1234 root      703m S    {ALGORITHM_5} ./apps.out
 1235 root      703m S    {ALGORITHM_6} ./apps.out
 1236 root      703m S    {ALGORITHM_7} ./apps.out
 1237 root      703m S    {DUP0} ./apps.out
 1238 root      703m S    {DUP1} ./apps.out
 1239 root      703m S    {DUP2} ./apps.out
 1240 root      703m S    {DUP3} ./apps.out
 1241 root      703m S    {DUP4} ./apps.out
 1242 root      703m S    {SYNC_0} ./apps.out
 1243 root      703m S    {SYNC_1} ./apps.out
 1244 root      703m S    {SYNC_2} ./apps.out
 1245 root      703m S    {SYNC_3} ./apps.out
 1246 root      703m S    {MERGE_0} ./apps.out
 1247 root      703m S    {MERGE_1} ./apps.out
 1248 root      703m S    {MERGE_2} ./apps.out
 1249 root      703m S    {MERGE_3} ./apps.out
 1250 root      703m S    {MERGE_4} ./apps.out
 1251 root      703m S    {SELECT_0} ./apps.out
 1252 root      703m S    {SELECT_1} ./apps.out
 1253 root      703m S    {GATE_0} ./apps.out
 1254 root      703m S    {GATE_1} ./apps.out
 1255 root      703m S    {GATE_2} ./apps.out
 1256 root      703m S    {GATE_3} ./apps.out
 1257 root      703m S    {SGXFRMCPY_0} ./apps.out
 1258 root      703m S    {SGX3DSFM_0} ./apps.out
 1259 root      703m S    ./apps.out
 1260 root      703m S    {DataCollect} ./apps.out
 1261 root      703m S    {DataCollect} ./apps.out
 1262 root      703m S    {DataCollect} ./apps.out
 1263 root      703m S    {DataCollect} ./apps.out
 1264 root      2452 R    ps -T

    Can you please make this change first and check which links are still present at A15?

    There are some threads with no names, as these are not called from init_links. I will try to find out a way to get the names.

    Thanks
    Ram

  • 0 in reply to Ramprasad
    TI__Mastermind 30480 points

    Hi Raghu,

    Please make this change in
    links_fw/src/hlos/system/system_ipc_msgq.c
    links_fw/src/hlos/system/system_rpmsg_notify.c
    links_fw/src/hlos/osa/src/osa_remote_log_client.c
    also.

    Thanks
    RamPrasad

  • 0 in reply to Ramprasad
    Expert 1380 points

    Hi Ram,

    We have made the changes as suggested. we are getting as below. But some of the thread names is still VSDKAPPS(5 threads). We will give for testing to check if the issue is coming from other threads for which name is  changed.  

    root@mmt2020-a880:~# cputop -l4 now | grep -i "vsdkapps"
    1 vsdkapps 1029 vsdkapps 1029 cfs 0 0.00 n/a n/a
    1 vsdkapps 1030 vsdkapps 1029 rr 50 0.07 n/a n/a
    1 vsdkapps 1032 vsdkapps 1029 rr 99 0.00 n/a n/a
    1 vsdkapps 1033 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_OUT_0 1034 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_OUT_1 1035 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_OUT_2 1036 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_OUT_3 1037 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_OUT_4 1038 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_0 1039 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_1 1040 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_2 1041 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_3 1042 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_4 1043 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_5 1044 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 IPC_IN_6 1045 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_0 1046 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_1 1047 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_2 1048 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_3 1049 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_4 1050 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_5 1051 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_6 1052 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_7 1053 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 vsdkapps 1054 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_1 1055 vsdkapps 1029 rr 50 0.00 n/a n/a
    1 DISP_DIST_SRC_0 1056 vsdkapps 1029 rr 50 0.00 n/a n/a

    Regards,

    Raghu

  • 0 in reply to Raghu Kadari
    TI__Mastermind 30480 points

    Hi Raghu,

    Thanks for sharing the results. With default visionSDK also first 3 threads did not show any name. I found out that these are spawned from main() function.

    I added this change

    --- a/apps/src/hlos/adas/src/common/chains_main.c
    +++ b/apps/src/hlos/adas/src/common/chains_main.c
    @@ -257,6 +257,8 @@ Int32 main (Int32 argc, Char ** argv)
    Int32 status;
    Bool shutdownRemoteCores = FALSE;

    + pthread_setname_np(pthread_self(), "main_loop");
    +
    System_init();

    then I am seeing "main_loop" as the name of first three threads but I am not able to get why 3 threads are spawned here. You can make this change in your main() also to confirm if first 4 threads are created from main().

    Rest threads are named as expected and are created during each link creation.

    For your usecase, it looks like you need maximum two DISP_DIST_SRC links and DISP_DIST_SRC_2 to DISP_DIST_SRC_7 can be avoided.

    If you set DISP_DIST_SRC_LINK_OBJ_MAX to 2, you should get rid of these 6 threads.

    I am trying to find out last unnamed thread. 

    Thanks

    Ram

  • 0 in reply to Ramprasad
    Expert 1380 points

    HI Ram,

    I have set name as "VSDKAPPS_MAIN",  and made other changes as well. please find attached file.

    Fullscreen vsdkapps_hog.txt Download 
    root@mmt2020-a880:~# cputop -l4 now | grep -i "vsdkapps"
    1 VSDKAPPS_MAIN        1041 VSDKAPPS_MAIN        1041 cfs           0     0.00 n/a              n/a
    1 VSDKAPPS_MAIN        1044 VSDKAPPS_MAIN        1041 rr           50     0.08 n/a              n/a
    1 VSDKAPPS_MAIN        1045 VSDKAPPS_MAIN        1041 rr           99     0.00 n/a              n/a
    1 VSDKAPPS_MAIN        1047 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_OUT_0            1048 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_OUT_1            1049 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_OUT_2            1050 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_OUT_3            1051 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_OUT_4            1052 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_0             1053 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_1             1054 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_2             1055 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_3             1056 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_4             1057 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_5             1058 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 IPC_IN_6             1059 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 DISP_DIST_SRC_0      1060 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 DISP_DIST_SRC_1      1061 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 VSDKAPPS_MAIN        1062 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 DISP_DIST_SRC_0      1063 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a
    1 DISP_DIST_SRC_1      1064 VSDKAPPS_MAIN        1041 rr           50     0.00 n/a              n/a

    Regards,

    Raghu

  • 0 in reply to Raghu Kadari
    Expert 1380 points

    HI Ram,

    But I am not seeing in the list which are named as below. 

    -- a/links_fw/src/hlos/osa/src/osa_remote_log_client.c

    +++ b/links_fw/src/hlos/osa/src/osa_remote_log_client.c
    @@ -214,9 +214,9 @@ static void *RemoteLog_clientRun(void *pPrm)
    UInt32 numBytes, strSize;
    char procName[16];

    -#ifdef QNX_BUILD
    - pthread_setname_np(pthread_self(), "Remote log client thread");
    -#endif
    +//#ifdef QNX_BUILD
    + pthread_setname_np(pthread_self(), "VSDKAPPS_RemoteLogClientThread");
    +//#endif

    while (1)
    {
    diff --git a/links_fw/src/hlos/system/system_ipc_msgq.c b/links_fw/src/hlos/system/system_ipc_msgq.c
    index 96603a9..f3ecc76 100644
    --- a/links_fw/src/hlos/system/system_ipc_msgq.c
    +++ b/links_fw/src/hlos/system/system_ipc_msgq.c
    @@ -129,9 +129,9 @@ Void* System_ipcMsgQTskMain(Void * prm)
    Int32 status;
    Void *pPrm;

    -#ifdef QNX_BUILD
    - pthread_setname_np(pthread_self(), "Ipc msgQ thread");
    -#endif
    +//#ifdef QNX_BUILD
    + pthread_setname_np(pthread_self(), "VSDKAPPS_IpcmsgQthread");
    +//#endif

    while(1)
    {
    diff --git a/links_fw/src/hlos/system/system_rpmsg_notify.c b/links_fw/src/hlos/system/system_rpmsg_notify.c
    index 9363aeb..1f4054b 100644
    --- a/links_fw/src/hlos/system/system_rpmsg_notify.c
    +++ b/links_fw/src/hlos/system/system_rpmsg_notify.c
    @@ -231,9 +231,9 @@ Void* System_ipcNotifyRecvFxn(Void * prm)
    Int32 status;
    Int32 done;

    -#ifdef QNX_BUILD
    - pthread_setname_np(pthread_self(), "Ipc Notify Recv thread");
    -#endif
    +//#ifdef QNX_BUILD
    + pthread_setname_np(pthread_self(), "VSDKAPPS_Ipc_Notify_Recv");
    +//#endif

    Regards,
    Raghu

  • 0 in reply to Raghu Kadari
    TI__Mastermind 30480 points

    Hi Raghu,

    Good, now you have reduced the number of threads and it shows names for all threads.

     I am seeing "Ipc msgQ thread" name but not "Ipc Notify Recv thread" and "Remote log client thread".

    Fullscreen apps.txt Download 
    1209 root      703m S    {main_loop} ./apps.out
 1210 root      703m S    {main_loop} ./apps.out
 1211 root      703m S    {main_loop} ./apps.out
 1212 root      703m S    {Ipc msgQ thread} ./apps.out
 1213 root      703m S    {IPC_OUT_0} ./apps.out
 1214 root      703m S    {IPC_OUT_1} ./apps.out
 1215 root      703m S    {IPC_OUT_2} ./apps.out
 1216 root      703m S    {IPC_OUT_3} ./apps.out
 1217 root      703m S    {IPC_OUT_4} ./apps.out
 1218 root      703m S    {IPC_IN_0} ./apps.out
 1219 root      703m S    {IPC_IN_1} ./apps.out
 1220 root      703m S    {IPC_IN_2} ./apps.out
 1221 root      703m S    {IPC_IN_3} ./apps.out
 1222 root      703m S    {IPC_IN_4} ./apps.out
 1223 root      703m S    {IPC_IN_5} ./apps.out
 1224 root      703m S    {IPC_IN_6} ./apps.out
 1225 root      703m S    {NULL_0} ./apps.out
 1226 root      703m S    {NULL_1} ./apps.out
 1227 root      703m S    {NULL_SRC_0} ./apps.out
 1228 root      703m S    {DISP_DIST_SRC_0} ./apps.out
 1229 root      703m S    {DISP_DIST_SRC_1} ./apps.out
 1230 root      703m S    {DISP_DIST_SRC_2} ./apps.out
 1231 root      703m S    {DISP_DIST_SRC_3} ./apps.out
 1232 root      703m S    {SGX3DSRV_0} ./apps.out
 1233 root      703m S    {ALGORITHM_0} ./apps.out
 1234 root      703m S    {ALGORITHM_1} ./apps.out
 1235 root      703m S    {ALGORITHM_2} ./apps.out
 1236 root      703m S    {ALGORITHM_3} ./apps.out
 1237 root      703m S    {ALGORITHM_4} ./apps.out
 1238 root      703m S    {ALGORITHM_5} ./apps.out
 1239 root      703m S    {ALGORITHM_6} ./apps.out
 1240 root      703m S    {ALGORITHM_7} ./apps.out
 1241 root      703m S    {DUP0} ./apps.out
 1242 root      703m S    {DUP1} ./apps.out
 1243 root      703m S    {DUP2} ./apps.out
 1244 root      703m S    {DUP3} ./apps.out
 1245 root      703m S    {DUP4} ./apps.out
 1246 root      703m S    {SYNC_0} ./apps.out
 1247 root      703m S    {SYNC_1} ./apps.out
 1248 root      703m S    {SYNC_2} ./apps.out
 1249 root      703m S    {SYNC_3} ./apps.out
 1250 root      703m S    {MERGE_0} ./apps.out
 1251 root      703m S    {MERGE_1} ./apps.out
 1252 root      703m S    {MERGE_2} ./apps.out
 1253 root      703m S    {MERGE_3} ./apps.out
 1254 root      703m S    {MERGE_4} ./apps.out
 1255 root      703m S    {SELECT_0} ./apps.out
 1256 root      703m S    {SELECT_1} ./apps.out
 1257 root      703m S    {GATE_0} ./apps.out
 1258 root      703m S    {GATE_1} ./apps.out
 1259 root      703m S    {GATE_2} ./apps.out
 1260 root      703m S    {GATE_3} ./apps.out
 1261 root      703m S    {SGXFRMCPY_0} ./apps.out
 1262 root      703m S    {SGX3DSFM_0} ./apps.out
 1263 root      703m S    {Network_loop} ./apps.out
 1264 root      703m S    {DataCollect} ./apps.out
 1265 root      703m S    {DataCollect} ./apps.out
 1266 root      703m S    {DataCollect} ./apps.out
 1267 root      703m S    ./apps.out

    I am not aware on what scenarios these threads are invoked but from my understanding they are not spawned.

    thanks

    Ram