This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

PROCESSOR-SDK-AM62X: How to handle the kernel collapse caused by the broadcast storm

Part Number: PROCESSOR-SDK-AM62X
Other Parts Discussed in Thread: AM625

Tool/software:

Network connection schematic

The network is distributed as follows

eth0 Link encap:Ethernet HWaddr 98:03:8A:76:13:E9
inet addr:192.168.0.2 Bcast:192.168.0.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

eth1 Link encap:Ethernet HWaddr DE:B8:12:A3:CF:CF
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

eth1.100 Link encap:Ethernet HWaddr DE:B8:12:A3:CF:CF
inet addr:192.168.2.10 Bcast:0.0.0.0 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

eth1.200 Link encap:Ethernet HWaddr DE:B8:12:A3:CF:CF
inet addr:192.168.3.10 Bcast:0.0.0.0 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

eth1.300 Link encap:Ethernet HWaddr DE:B8:12:A3:CF:CF
inet addr:192.168.4.10 Bcast:0.0.0.0 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)


When eth1.100,eth1.200, eth1.300, any two of the net ports is connected to the same router, the memory resources will be nervous and the system crashes, and how should I solve it?

sched: RT throttling activated
irq/205-8000000: page allocation failure: order:0, mode:0x820(GFP_ATOMIC), nodemask=(null)
CPU: 0 PID: 125 Comm: irq/205-8000000 Not tainted 6.6.58-rt45+ #176
Hardware name: H3 kernel (DT)
Call trace:
 0xffff800080018058
 0xffff8000800180a0
 0xffff800080c22334
 0xffff800080c2235c
 0xffff800080142f24
 0xffff800080143a1c
 0xffff800080161fb0
 0xffff800080163714
 0xffff800080163e1c
 0xffff800080a2b40c
 0xffff800080a94574
 0xffff800080a97294
 0xffff800080a97c98
 0xffff800080add0c0
 0xffff800080add538
 0xffff800080a245a4
 0xffff800080a249ec
 0xffff800080a24f3c
 0xffff8000807681f0
 0xffff800080a250b0
 0xffff800080a25310
 0xffff80008003b4ac
 0xffff80008003b738
 0xffff80008008945c
 0xffff800080089920
 0xffff8000800594c0
 0xffff80008001488c
Mem-Info:
active_anon:15 inactive_anon:853 isolated_anon:0
 active_file:226 inactive_file:260 isolated_file:0
 unevictable:4868 dirty:1 writeback:0
 slab_reclaimable:2611 slab_unreclaimable:45873
 mapped:2841 shmem:45 pagetables:111
 sec_pagetables:0 bounce:0
 kernel_misc_reclaimable:0
 free:30900 free_pcp:46 free_cma:30694
Node 0 active_anon:60kB inactive_anon:3412kB active_file:904kB inactive_file:1040kB unevictable:19472kB isolated(anon):0kB isolated(file):0kB mapped:11364kB dirty:4kB writeback:0kB shmem:180kB writeback_tmp:0kB ke
DMA free:123600kB boost:5368kB min:7756kB low:8352kB high:8948kB reserved_highatomic:0KB active_anon:60kB inactive_anon:3412kB active_file:1036kB inactive_file:964kB unevictable:19472kB writepending:4kB present:45
lowmem_reserve[]: 0 0 0 0
DMA: 92*4kB (MEC) 40*8kB (MEC) 18*16kB (UMEC) 9*32kB (UMC) 5*64kB (C) 2*128kB (C) 2*256kB (C) 1*512kB (C) 0*1024kB 1*2048kB (C) 29*4096kB (C) = 123696kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
3360 total pagecache pages
0 pages in swap cache
Free swap  = 0kB
Total swap = 0kB
114688 pages RAM
0 pages HighMem/MovableOnly
24442 pages reserved
32768 pages cma reserved
0 pages hwpoisoned
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 42192, objs: 886032, free: 0
CMCommCycleTask invoked oom-killer: gfp_mask=0x40cc0(GFP_KERNEL|__GFP_COMP), order=0, oom_score_adj=0
CPU: 1 PID: 411 Comm: CMCommCycleTask Not tainted 6.6.58-rt45+ #176
Hardware name: H3 kernel (DT)
Call trace:
 0xffff800080018058
 0xffff8000800180a0
 0xffff800080c22334
 0xffff800080c2235c
 0xffff8000800f89a8
 0xffff8000800f8fd4
 0xffff8000800f9790
 0xffff8000801435c0
 0xffff800080161fb0
 0xffff800080163714
 0xffff800080163e1c
 0xffff8000801769a8
 0xffff80008018700c
 0xffff800080188598
 0xffff800080172858
 0xffff800080172b08
 0xffff80008001d87c
 0xffff80008001d968
 0xffff800080c46094
 0xffff800080c4758c
 0xffff80008001148c
Mem-Info:
active_anon:15 inactive_anon:853 isolated_anon:0
 active_file:196 inactive_file:306 isolated_file:0
 unevictable:4868 dirty:1 writeback:0
 slab_reclaimable:2596 slab_unreclaimable:45934
 mapped:2845 shmem:45 pagetables:111
 sec_pagetables:0 bounce:0
 kernel_misc_reclaimable:0
 free:30898 free_pcp:8 free_cma:30660
Node 0 active_anon:60kB inactive_anon:3412kB active_file:784kB inactive_file:1224kB unevictable:19472kB isolated(anon):0kB isolated(file):0kB mapped:11380kB dirty:4kB writeback:0kB shmem:180kB writeback_tmp:0kB ke
DMA free:123592kB boost:2048kB min:4436kB low:5032kB high:5628kB reserved_highatomic:0KB active_anon:60kB inactive_anon:3412kB active_file:736kB inactive_file:1148kB unevictable:19472kB writepending:0kB present:45
lowmem_reserve[]: 0 0 0 0
DMA: 90*4kB (UMEC) 41*8kB (UMEC) 15*16kB (UMEC) 6*32kB (UMC) 5*64kB (C) 2*128kB (C) 2*256kB (C) 1*512kB (C) 0*1024kB 1*2048kB (C) 29*4096kB (C) = 123552kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
3410 total pagecache pages
0 pages in swap cache
Free swap  = 0kB
Total swap = 0kB
114688 pages RAM
0 pages HighMem/MovableOnly
24442 pages reserved
32768 pages cma reserved
0 pages hwpoisoned
Unreclaimable slab info:
Name                      Used          Total
bio-104                   12KB         12KB
mqueue_inode_cache         31KB         31KB
nfs_read_data             31KB         31KB
RAW                       30KB         30KB
UDP                      126KB        126KB
TCP                       95KB         95KB
hugetlbfs_inode_cache         15KB         15KB
bio-232                   12KB         12KB
inotify_inode_mark         15KB         15KB
request_queue             46KB         46KB
bio-168                   16KB         19KB
dmaengine-unmap-256         30KB         30KB
skbuff_small_head         62KB        125KB
skbuff_head_cache         24KB         32KB
file_lock_cache           15KB         15KB
sigqueue                  15KB         15KB
shmem_inode_cache        711KB        711KB
kernfs_iattrs_cache         15KB         15KB
kernfs_node_cache       3378KB       3378KB
filp                     132KB        132KB
avtab_node                 3KB          3KB
avc_xperms_decision_node          7KB          7KB
avc_xperms_node            7KB          7KB
lsm_inode_cache          729KB        818KB
vma_lock                  45KB         59KB
vm_area_struct            55KB         74KB
files_cache               63KB         63KB
signal_cache             243KB        255KB
sighand_cache            384KB        446KB
task_struct              534KB        616KB
anon_vma                  32KB         39KB
mm_struct                125KB        125KB
vmap_area                 19KB         19KB
kmalloc-8k               736KB        736KB
kmalloc-4k              2408KB       2464KB
kmalloc-2k               554KB        576KB
kmalloc-1k               874KB        912KB
kmalloc-512              683KB        696KB
kmalloc-256              532KB        560KB
kmalloc-192           166367KB     166367KB
kmalloc-128              112KB        120KB
kmalloc-96               116KB        129KB
kmalloc-64               189KB        204KB
kmalloc-32                64KB         72KB
kmalloc-16                75KB         76KB
kmalloc-8                 47KB         48KB
kmem_cache_node           16KB         16KB
kmem_cache                27KB         27KB
Tasks state (memory values in pages):
[  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[    166]     0   166      769      320    49152        0             0 syslogd
[    171]     0   171      769      384    40960        0             0 klogd
[    184]     0   184     4513      499    49152        0         -1000 udevd
[    312]   100   312      875      225    45056        0             0 dbus-daemon
[    322]     0   322     2314      551    49152        0         -1000 sshd
[    329]     0   329      769      256    49152        0             0 telnetd
[    335]     0   335      545      352    36864        0             0 seatd
[    342]     0   342      724      288    45056        0             0 dnsmasq
[    388]     0   388    54049     4736    86016        0             0 codesyscontrol
[    392]     0   392      769      384    45056        0             0 sh
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),task=codesyscontrol,pid=388,uid=0
Out of memory: Killed process 388 (codesyscontrol) total-vm:216196kB, anon-rss:7936kB, file-rss:11008kB, shmem-rss:0kB, UID:0 pgtables:84kB oom_score_adj:0
slab_out_of_memory: 573493 callbacks suppressed
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0
SLUB: Unable to allocate memory on node -1, gfp=0x820(GFP_ATOMIC)
  cache: kmalloc-192, object size: 192, buffer size: 192, default order: 0, min order: 0
  node 0: slabs: 47207, objs: 991347, free: 0