Part Number: TDA2SX
Tool/software: TI C/C++ Compiler
Hi TIers,
Recently, a crash problem has bothered us for a long time. It is about the crash of TDA2XX soc when running usecase that include capture, sgx3dsrv, display links, and we use gpu to proccess the 4Ch captue 2d/3d surround view, and parking space detection algorithm to realize automatic parking.Sometimes when we do automatic parking, the kernel killed the usecase(apps.out), the complete log is/cfs-file/__key/communityserver-discussions-components-files/791/PVR_2D00_ERROR_2D00_out_2D00_of_2D00_memory-.log we suspect that the GPU crashes when implementing 2d/3d surround view, but each crash is different.The dma, lowmem and highmen is normal, but the kernel still warned out of memory, so we do "cat /proc/meminfo" to show memory status in the log/cfs-file/__key/communityserver-discussions-components-files/791/0815.20200829_5F00_1.log, it seems the memory is normal when the app is killed by kernel.The part of log about PVR_K ERROR is shown as follows, how can we trace the issue?
Regards,
Jason
-----------------------Part of log-----------------------------
[ 1051.658176] apps.out invoked oom-killer: gfp_mask=0x24000c4, order=0, oom_score_adj=0
[ 1051.666092] apps.out cpuset=/ mems_allowed=0
[ 1051.670422] CPU: 0 PID: 149 Comm: apps.out Tainted: G O 4.4.84+ #5
[ 1051.677762] Hardware name: Generic DRA74X (Flattened Device Tree)
[ 1051.683878] Backtrace:
[ 1051.686342] Function entered at [<c0013134>] from [<c0013320>]
[ 1051.692198] r7:ee64ae78 r6:60000013 r5:00000000 r4:c0650610
[ 1051.697915] Function entered at [<c0013308>] from [<c0234868>]
[ 1051.703771] Function entered at [<c02347dc>] from [<c011d0b0>]
[ 1051.709625] r7:ee64ae78 r6:00000000 r5:ee0ddb34 r4:ee64aa00
[ 1051.715339] Function entered at [<c011d054>] from [<c00d3008>]
[ 1051.721194] r10:c06397b0 r9:00008b97 r8:000000b3 r7:ee64ae78 r6:00030aaf r5:ee0ddb34
[ 1051.729097] r4:ee64aa00
[ 1051.731645] Function entered at [<c00d2d0c>] from [<c00d34b4>]
[ 1051.737500] r10:c06397b0 r9:00008b97 r8:c06397b0 r7:c0639a30 r6:00030aaf r5:ee0ddb34
[ 1051.745401] r4:ee64aa00
[ 1051.747949] Function entered at [<c00d31c4>] from [<c00d837c>]
[ 1051.753804] r10:c066c700 r9:024000c4 r8:00000000 r7:c063666c r6:ee0dc000 r5:00000000
[ 1051.761706] r4:00000000
[ 1051.764254] Function entered at [<c00d7a58>] from [<bf0052e4>]
[ 1051.770108] r10:00004000 r9:00000000 r8:00000000 r7:bf033c6c r6:000000b8 r5:0000002e
[ 1051.778010] r4:ee6118b8
[ 1051.780557] Function entered at [<bf005218>] from [<bf00089c>]
[ 1051.786411] r10:00000000 r9:ee0c1480 r8:00079000 r7:82014200 r6:ee0ddca0 r5:80000203
[ 1051.794312] r4:82014200
[ 1051.796860] Function entered at [<bf0007b8>] from [<bf008214>]
[ 1051.802714] r5:80000203 r4:ee0b6800
[ 1051.806318] Function entered at [<bf007f90>] from [<bf0088bc>]
[ 1051.812172] r10:00000040 r9:ee064200 r8:00079000 r7:c06f7908 r6:c0603b80 r5:ee0b6800
[ 1051.820072] r4:80000203
[ 1051.822619] Function entered at [<bf008510>] from [<bf008c38>]
[ 1051.828473] r10:bf03320c r9:ee0b6800 r8:00000000 r7:80000003 r6:ee0ddd4c r5:c06f7900
[ 1051.836375] r4:00000000
[ 1051.838923] Function entered at [<bf008b84>] from [<bf0095e0>]
[ 1051.844776] r9:ee62a540 r8:f18d1000 r7:ee0c1bc0 r6:eecc2f00 r5:ee0b6800 r4:80000003
[ 1051.852593] Function entered at [<bf009528>] from [<bf014f44>]
[ 1051.858446] r7:ee0c1bc0 r6:00000000 r5:f18d2000 r4:00000000
[ 1051.864160] Function entered at [<bf014db0>] from [<bf017ac4>]
[ 1051.870014] r8:f18d2000 r7:f18d1000 r6:bf014db0 r5:ee0c1bc0 r4:ee0dde68
[ 1051.876780] Function entered at [<bf017a30>] from [<bf00465c>]
[ 1051.882633] r8:00000040 r7:ee62a540 r6:0000007a r5:c01c6707 r4:ee0dde68
[ 1051.889400] Function entered at [<bf0044dc>] from [<c02d5210>]
[ 1051.895254] r7:eeccd800 r6:c06a458c r5:0000001c r4:ee0dde68
[ 1051.900968] Function entered at [<c02d50d0>] from [<c013089c>]
[ 1051.906822] r10:00000000 r9:ee0dc000 r8:84dfc7ec r7:0000001b r6:ee62af00 r5:ee688028
[ 1051.914724] r4:84dfc7ec
[ 1051.917271] Function entered at [<c01304ac>] from [<c0130afc>]
[ 1051.923126] r10:00000000 r9:ee0dc000 r8:84dfc7ec r7:401c6440 r6:ee62af00 r5:0000001b
[ 1051.931028] r4:ee62af01
[ 1051.933576] Function entered at [<c0130ac0>] from [<c000fa60>]
[ 1051.939430] r9:ee0dc000 r8:c000fc04 r7:00000036 r6:401c6440 r5:84dfc7ec r4:0000001c
[ 1051.947298] Mem-Info:
[ 1051.949604] active_anon:8343 inactive_anon:0 isolated_anon:0
[ 1051.949604] active_file:534 inactive_file:1866 isolated_file:0
[ 1051.949604] unevictable:0 dirty:0 writeback:0 unstable:0
[ 1051.949604] slab_reclaimable:156 slab_unreclaimable:1728
[ 1051.949604] mapped:27954 shmem:0 pagetables:456 bounce:0
[ 1051.949604] free:139172 free_pcp:240 free_cma:42036
[ 1051.982458] DMA free:104744kB min:1416kB low:1768kB high:2124kB active_anon:7004kB inactive_anon:0kB active_file:60kB inactive_file:40kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7s
[ 1052.026626] lowmem_reserve[]: 0 0 416 416
[ 1052.030720] HighMem free:451944kB min:416kB low:1616kB high:2820kB active_anon:26368kB inactive_anon:0kB active_file:2076kB inactive_file:7424kB unevictable:0kB isolated(anon):0kB isolated(file):0kB po
[ 1052.074711] lowmem_reserve[]: 0 0 0 0
[ 1052.078426] DMA: 34*4kB (H) 19*8kB (H) 4*16kB (H) 0*32kB 11*64kB (HC) 6*128kB (HC) 0*256kB 3*512kB (C) 1*1024kB (C) 1*2048kB (C) 24*4096kB (C) = 104736kB
[ 1052.092416] HighMem: 51*4kB (UMC) 20*8kB (UMC) 87*16kB (UMC) 117*32kB (UMC) 70*64kB (UMC) 25*128kB (UMC) 12*256kB (UMC) 3*512kB (UM) 2*1024kB (M) 3*2048kB (MC) 104*4096kB (MC) = 451964kB
[ 1052.109288] 2397 total pagecache pages
[ 1052.113065] 0 pages in swap cache
[ 1052.116392] Swap cache stats: add 0, delete 0, find 0/0
[ 1052.121655] Free swap = 0kB
[ 1052.124545] Total swap = 0kB
[ 1052.127435] 384000 pages RAM
[ 1052.130340] 195584 pages HighMem/MovableOnly
[ 1052.134625] 184657 pages reserved
[ 1052.137949] 61440 pages cma reserved
[ 1052.141548] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
[ 1052.150129] [ 122] 0 122 309001 36385 452 3 0 0 apps.out
[ 1052.159040] Out of memory: Kill process 122 (apps.out) score 179 or sacrifice child
[ 1052.167005] Killed process 122 (apps.out) total-vm:1236004kB, anon-rss:33256kB, file-rss:112284kB
[ 1052.176074] apps.out: page allocation failure: order:0, mode:0x24000c4
[ 1052.182658] CPU: 0 PID: 149 Comm: apps.out Tainted: G O 4.4.84+ #5
[ 1052.189999] Hardware name: Generic DRA74X (Flattened Device Tree)
[ 1052.196114] Backtrace:
[ 1052.198575] Function entered at [<c0013134>] from [<c0013320>]
[ 1052.204431] r7:c063666c r6:60000013 r5:00000000 r4:c0650610
[ 1052.210145] Function entered at [<c0013308>] from [<c0234868>]
[ 1052.215999] Function entered at [<c02347dc>] from [<c00d50b4>]
[ 1052.221855] r7:c063666c r6:00000000 r5:00000000 r4:024000c4
[ 1052.227571] Function entered at [<c00d4fd4>] from [<c00d7c1c>]
[ 1052.233426] r3:00040001 r2:00000000
[ 1052.237027] r6:ee0dc000 r5:00000000 r4:00000000
[ 1052.241686] Function entered at [<c00d7a58>] from [<bf0052e4>]
[ 1052.247541] r10:00004000 r9:00000000 r8:00000000 r7:bf033c6c r6:000000b8 r5:0000002e
[ 1052.255443] r4:ee6118b8
[ 1052.257991] Function entered at [<bf005218>] from [<bf00089c>]
[ 1052.263845] r10:00000000 r9:ee0c1480 r8:00079000 r7:82014200 r6:ee0ddca0 r5:80000203
[ 1052.271748] r4:82014200
[ 1052.274296] Function entered at [<bf0007b8>] from [<bf008214>]
[ 1052.280150] r5:80000203 r4:ee0b6800
[ 1052.283752] Function entered at [<bf007f90>] from [<bf0088bc>]
[ 1052.289606] r10:00000040 r9:ee064200 r8:00079000 r7:c06f7908 r6:c0603b80 r5:ee0b6800
[ 1052.297510] r4:80000203
[ 1052.300057] Function entered at [<bf008510>] from [<bf008c38>]
[ 1052.305911] r10:bf03320c r9:ee0b6800 r8:00000000 r7:80000003 r6:ee0ddd4c r5:c06f7900
[ 1052.313812] r4:00000000
[ 1052.316361] Function entered at [<bf008b84>] from [<bf0095e0>]
[ 1052.322215] r9:ee62a540 r8:f18d1000 r7:ee0c1bc0 r6:eecc2f00 r5:ee0b6800 r4:80000003
[ 1052.330030] Function entered at [<bf009528>] from [<bf014f44>]
[ 1052.335884] r7:ee0c1bc0 r6:00000000 r5:f18d2000 r4:00000000
[ 1052.341597] Function entered at [<bf014db0>] from [<bf017ac4>]
[ 1052.347451] r8:f18d2000 r7:f18d1000 r6:bf014db0 r5:ee0c1bc0 r4:ee0dde68
[ 1052.354218] Function entered at [<bf017a30>] from [<bf00465c>]
[ 1052.360072] r8:00000040 r7:ee62a540 r6:0000007a r5:c01c6707 r4:ee0dde68
[ 1052.366835] Function entered at [<bf0044dc>] from [<c02d5210>]
[ 1052.372690] r7:eeccd800 r6:c06a458c r5:0000001c r4:ee0dde68
[ 1052.378405] Function entered at [<c02d50d0>] from [<c013089c>]
[ 1052.384258] r10:00000000 r9:ee0dc000 r8:84dfc7ec r7:0000001b r6:ee62af00 r5:ee688028
[ 1052.392160] r4:84dfc7ec
[ 1052.394707] Function entered at [<c01304ac>] from [<c0130afc>]
[ 1052.400562] r10:00000000 r9:ee0dc000 r8:84dfc7ec r7:401c6440 r6:ee62af00 r5:0000001b
[ 1052.408461] r4:ee62af01
[ 1052.411008] Function entered at [<c0130ac0>] from [<c000fa60>]
[ 1052.416862] r9:ee0dc000 r8:c000fc04 r7:00000036 r6:401c6440 r5:84dfc7ec r4:0000001c
[ 1052.424714] Mem-Info:
[ 1052.427012] active_anon:8343 inactive_anon:0 isolated_anon:0
[ 1052.427012] active_file:532 inactive_file:1866 isolated_file:0
[ 1052.427012] unevictable:0 dirty:0 writeback:0 unstable:0
[ 1052.427012] slab_reclaimable:156 slab_unreclaimable:1728
[ 1052.427012] mapped:27954 shmem:0 pagetables:456 bounce:0
[ 1052.427012] free:139172 free_pcp:240 free_cma:42036
[ 1052.459855] DMA free:104744kB min:1416kB low:1768kB high:2124kB active_anon:7004kB inactive_anon:0kB active_file:52kB inactive_file:40kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7s
[ 1052.505078] lowmem_reserve[]: 0 0 416 416
[ 1052.509161] HighMem free:451944kB min:416kB low:1616kB high:2820kB active_anon:26368kB inactive_anon:0kB active_file:2076kB inactive_file:7424kB unevictable:0kB isolated(anon):0kB isolated(file):0kB po
[ 1052.553153] lowmem_reserve[]: 0 0 0 0
[ 1052.556868] DMA: 34*4kB (H) 27*8kB (UH) 6*16kB (UH) 0*32kB 11*64kB (HC) 6*128kB (HC) 0*256kB 3*512kB (C) 1*1024kB (C) 1*2048kB (C) 24*4096kB (C) = 104832kB
[ 1052.571042] HighMem: 51*4kB (UMC) 20*8kB (UMC) 87*16kB (UMC) 117*32kB (UMC) 70*64kB (UMC) 25*128kB (UMC) 12*256kB (UMC) 3*512kB (UM) 2*1024kB (M) 3*2048kB (MC) 104*4096kB (MC) = 451964kB
[ 1052.587918] 2397 total pagecache pages
[ 1052.591764] 0 pages in swap cache
[ 1052.595092] Swap cache stats: add 0, delete 0, find 0/0
[ 1052.600356] Free swap = 0kB
[ 1052.603246] Total swap = 0kB
[ 1052.606136] 384000 pages RAM
[ 1052.609025] 195584 pages HighMem/MovableOnly
[ 1052.613324] 184657 pages reserved
[ 1052.616649] 61440 pages cma reserved
[ 1052.620280] PVR_K:(Error): NewAllocPagesLinuxMemArea: failed
[ 1052.625966] PVR_K:(Error): BM_ImportMemory: OSAllocPages(0x79000) failed
[ 1052.632712] PVR_K:(Error): AllocMemory: BM_ImportMemory failed
[ 1052.638573] PVR_K:(Error): BM_Alloc: AllocMemory FAILED
[ 1052.643834] PVR_K:(Error): AllocDeviceMem: BM_Alloc Failed
/home/root/init-demo.sh: line 44: 122 Killed ./apps.out 2 1