This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

Linux/WL1831MOD: panic at ieee80211_scan_rx (wl1831mod, am335x, R8.7 SP3)

Part Number: WL1831MOD

Tool/software: Linux

Hello,

I am seeing an occasional kernel panic, similar to that reported elsewhere.

[   27.756757] Unable to handle kernel NULL pointer dereference at virtual address 00000020
[   27.767878] pgd = c0004000
[   27.770705] [00000020] *pgd=00000000
[   27.784138] Internal error: Oops: 17 [#1] PREEMPT ARM
[   27.784143] Modules linked in: wl18xx wlcore sensedaq_driver(O) sense_multicolor_led(O) wlcore_sdio
[   27.784170] CPU: 0 PID: 5 Comm: kworker/u2:0 Tainted: G           O    4.14.79-rt47 #1
[   27.784173] Hardware name: Generic AM33XX (Flattened Device Tree)
[   27.784311] Workqueue: wl12xx_wq wl1271_netstack_work [wlcore]
[   27.784317] task: db451800 task.stack: db460000
[   27.784336] PC is at ieee80211_scan_rx+0xc0/0x150
[   27.784339] LR is at 0x79c
[   27.784343] pc : [<c06e7790>]    lr : [<0000079c>]    psr: a0070113
[   27.784347] sp : db461d70  ip : 00000000  fp : db461e4c
[   27.784351] r10: 00000000  r9 : 00000000  r8 : da8a0800
[   27.784355] r7 : 00000000  r6 : daaed300  r5 : d9a244c0  r4 : d9925040
[   27.784360] r3 : ac34feed  r2 : 0000dba8  r1 : 00000197  r0 : ac34f6ec
[   27.784366] Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment none
[   27.784371] Control: 10c5387d  Table: 9a990019  DAC: 00000051
[   27.784376] Process kworker/u2:0 (pid: 5, stack limit = 0xdb460210)
[   27.784381] Stack: (0xdb461d70 to 0xdb462000)
[   27.784389] 1d60:                                     db461db4 db461d80 c0159fe0 c0159e84
[   27.784398] 1d80: d9925064 000000be 00000000 c014469c 00000000 db511100 00000002 00000001
[   27.784408] 1da0: db461e60 c0b133d8 db461ddc db461db8 c015a06c c015c594 db461de4 00002000
[   27.784418] 1dc0: db511100 c0b4dc10 00000008 db451800 db461e04 db461de0 c01507b4 c0161394
[   27.784427] 1de0: db451830 c0b13408 0555c018 00000004 00001b58 dad54f88 db461e2c db461e08
[   27.784437] 1e00: c0149408 c07276b0 c0b13408 dad34030 010b3e8c 00000000 db451830 00000001
[   27.784446] 1e20: db461e6c db461e30 daaed300 d9a244c0 d9925040 00000000 da8a0800 00000000
[   27.784456] 1e40: db461ed4 db461e50 c06fe9d4 c06e76dc db451830 dad34030 db451800 00000000
[   27.784465] 1e60: db461e9c 00000000 c014a614 bf043a04 00000000 c0b133d8 00000001 00000000
[   27.784474] 1e80: daaed300 d9a244c0 00000000 00000000 00000000 00000000 00000010 00000010
[   27.784483] 1ea0: 00000000 00000000 db461ed4 d9a24f20 daaed300 d9a250e8 d9a244c0 da8a0800
[   27.784493] 1ec0: 00000000 00000088 db461ef4 db461ed8 bf02327c c06fe4c8 d9a251d4 d9a24f20
[   27.784502] 1ee0: db405000 00000000 db461f0c db461ef8 bf0232a0 bf023218 db435080 d9a251d4
[   27.784512] 1f00: db461f44 db461f10 c013974c bf023290 db461f2c db461f20 c013abe4 db435080
[   27.784522] 1f20: db405000 db405000 c0b18fc0 db405028 db435098 00000088 db461f74 db461f48
[   27.784531] 1f40: c013a710 c01395a0 00000000 db430680 db4305c0 db460000 00000000 db435080
[   27.784541] 1f60: c013a468 db44fe8c db461fac db461f78 c013f014 c013a474 db430698 db430698
[   27.784550] 1f80: db461fac db4305c0 c013eed4 00000000 00000000 00000000 00000000 00000000
[   27.784558] 1fa0: 00000000 db461fb0 c0107310 c013eee0 00000000 00000000 00000000 00000000
[   27.784567] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   27.784575] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[   27.784577] Backtrace: 
[   27.784599] [<c06e76d0>] (ieee80211_scan_rx) from [<c06fe9d4>] (ieee80211_rx_napi+0x518/0x7cc)
[   27.784609]  r9:00000000 r8:da8a0800 r7:00000000 r6:d9925040 r5:d9a244c0 r4:daaed300
[   27.784665] [<c06fe4bc>] (ieee80211_rx_napi) from [<bf02327c>] (wl1271_flush_deferred_work+0x70/0x78 [wlcore])
[   27.784675]  r10:00000088 r9:00000000 r8:da8a0800 r7:d9a244c0 r6:d9a250e8 r5:daaed300
[   27.784678]  r4:d9a24f20
[   27.784767] [<bf02320c>] (wl1271_flush_deferred_work [wlcore]) from [<bf0232a0>] (wl1271_netstack_work+0x1c/0x2c [wlcore])
[   27.784773]  r7:00000000 r6:db405000 r5:d9a24f20 r4:d9a251d4
[   27.784827] [<bf023284>] (wl1271_netstack_work [wlcore]) from [<c013974c>] (process_one_work+0x1b8/0x304)
[   27.784832]  r5:d9a251d4 r4:db435080
[   27.784842] [<c0139594>] (process_one_work) from [<c013a710>] (worker_thread+0x2a8/0x454)
[   27.784851]  r10:00000088 r9:db435098 r8:db405028 r7:c0b18fc0 r6:db405000 r5:db405000
[   27.784854]  r4:db435080
[   27.784868] [<c013a468>] (worker_thread) from [<c013f014>] (kthread+0x140/0x158)
[   27.784876]  r10:db44fe8c r9:c013a468 r8:db435080 r7:00000000 r6:db460000 r5:db4305c0
[   27.784880]  r4:db430680 r3:00000000
[   27.784896] [<c013eed4>] (kthread) from [<c0107310>] (ret_from_fork+0x14/0x24)
[   27.784904]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c013eed4
[   27.784907]  r4:db4305c0
[   27.784916] Code: e1d430b8 e0233002 e1903003 0a000002 (e59c3020) 
[   28.211510] ---[ end trace 0000000000000002 ]---

For reference:

[    5.632437] wlcore: wl18xx HW: 183x or 180x, PG 2.2 (ROM 0x11)
[    5.642934] wlcore: loaded
[   14.660557] wlcore: PHY firmware version: Rev 8.2.0.0.242
[   14.744510] wlcore: firmware booted (Rev 8.9.0.0.79)



This is using the R8.7 SP3 package. I don't have more details about what was happening at the time of the panic, but given that the uptime was only 27 seconds, I suspect that the machine was probably in the process of associating with WiFi at the time.

Please advise on severity and next steps.

  • Hi Jonah, 

    Can you please let us know the steps to reproduce this issue? 

    Regards, 

    Sudharshan K N

  • I'm afraid I don't have specific steps to reproduce the issue.  You can see my above comment for all the details I have:

    I don't have more details about what was happening at the time of the panic, but given that the uptime was only 27 seconds, I suspect that the machine was probably in the process of associating with WiFi at the time.

  • Hi Jonah, 

    How frequently does the issue occur? Is the device attempting to connect to the same AP while the issue occurs? Pl let us know the steps involved 

    Regards, 

    Sudharshan K N

  • As I said twice before, I have no information on how to reproduce the issue.  I also have no information on prevalence, as our software normally only reports errors via WiFi. The unit in question was booting at the time of the panic, and WiFi appears to have been rendered inoperable on the unit until the next reboot, which for us is a major concern.

    I have searched the serial logs from our automated testing units and found 21 other instances of the same panic.  There does not seem to be a pattern, so I suspect a race condition in your driver.

  • Another one:

    [   26.811852] Unable to handle kernel NULL pointer dereference at virtual address 00000020
    [   26.820300] pgd = c0004000
    [   26.830210] [00000020] *pgd=00000000
    [   26.837543] Internal error: Oops: 17 [#1] PREEMPT ARM
    [   26.837548] Modules linked in: wl18xx wlcore sensedaq_driver(O) sense_multicolor_led(O) wlcore_sdio
    [   26.837578] CPU: 0 PID: 124 Comm: kworker/u2:3 Tainted: G           O    4.14.79-rt47 #1
    [   26.837581] Hardware name: Generic AM33XX (Flattened Device Tree)
    [   26.837719] Workqueue: wl12xx_wq wl1271_netstack_work [wlcore]
    [   26.837725] task: db71de00 task.stack: da8a4000
    [   26.837743] PC is at ieee80211_scan_rx+0xc0/0x150
    [   26.837746] LR is at 0x79c
    [   26.837750] pc : [<c06e7790>]    lr : [<0000079c>]    psr: a0000113
    [   26.837754] sp : da8a5d70  ip : 00000000  fp : da8a5e4c
    [   26.837757] r10: 00000000  r9 : 00000000  r8 : da86a500
    [   26.837762] r7 : 00000000  r6 : dab3b540  r5 : d99d04c0  r4 : dab3c440
    [   26.837767] r3 : e89edb77  r2 : 0000a800  r1 : 000000cd  r0 : e89ec064
    [   26.837774] Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment none
    [   26.837778] Control: 10c5387d  Table: 9a944019  DAC: 00000051
    [   26.837784] Process kworker/u2:3 (pid: 124, stack limit = 0xda8a4210)
    [   26.837789] Stack: (0xda8a5d70 to 0xda8a6000)
    [   26.837797] 5d60:                                     00000080 da8a5e00 00000000 c0159e84
    [   26.837806] 5d80: dab3c464 000000b8 00000000 00000000 00000001 da8a5d90 00000001 da8a5d98
    [   26.837816] 5da0: dab3c47a dae904e0 dab3c440 dab3b840 00000080 dae9051c c093a9e0 00000088
    [   26.837825] 5dc0: da8a5ddc da8a5dd0 00000008 db71de00 da8a5e04 da8a5de0 c01507b4 c0161394
    [   26.837835] 5de0: db71de30 c0b13408 139b2282 00000004 00003780 dadff488 da8a5e2c da8a5e08
    [   26.837845] 5e00: c0149408 c07276b0 c0b13408 dad34030 0048abd9 00000000 db71de30 00000001
    [   26.837854] 5e20: da8a5e6c da8a5e30 dab3b540 d99d04c0 dab3c440 00000000 da86a500 00000000
    [   26.837864] 5e40: da8a5ed4 da8a5e50 c06fe9d4 c06e76dc db71de30 dad34030 db71de00 00000000
    [   26.837873] 5e60: da8a5e9c 00000000 c014a614 bf043a10 00000000 c0b133d8 00000001 00000000
    [   26.837882] 5e80: dab3b540 d99d04c0 00000000 00000000 00000000 00000000 00000010 00000010
    [   26.837891] 5ea0: 00000000 00000000 da8a5ed4 d99d0f20 dab3b540 d99d10e8 d99d04c0 da86a500
    [   26.837901] 5ec0: 00000000 00000088 da8a5ef4 da8a5ed8 bf02327c c06fe4c8 d99d11d4 d99d0f20
    [   26.837911] 5ee0: db405000 00000000 da8a5f0c da8a5ef8 bf0232a0 bf023218 da805e80 d99d11d4
    [   26.837921] 5f00: da8a5f44 da8a5f10 c013974c bf023290 da8a5f2c da8a5f20 c013abe4 da805e80
    [   26.837931] 5f20: db405000 db405000 c0b18fc0 db405028 da805e98 00000088 da8a5f74 da8a5f48
    [   26.837940] 5f40: c013a710 c01395a0 00000000 daf73840 daf73500 da8a4000 00000000 da805e80
    [   26.837950] 5f60: c013a468 da837e94 da8a5fac da8a5f78 c013f014 c013a474 daf73858 daf73858
    [   26.837959] 5f80: da8a5fac daf73500 c013eed4 00000000 00000000 00000000 00000000 00000000
    [   26.837968] 5fa0: 00000000 da8a5fb0 c0107310 c013eee0 00000000 00000000 00000000 00000000
    [   26.837976] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
    [   26.837984] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
    [   26.837986] Backtrace: 
    [   26.838008] [<c06e76d0>] (ieee80211_scan_rx) from [<c06fe9d4>] (ieee80211_rx_napi+0x518/0x7cc)
    [   26.838018]  r9:00000000 r8:da86a500 r7:00000000 r6:dab3c440 r5:d99d04c0 r4:dab3b540
    [   26.838074] [<c06fe4bc>] (ieee80211_rx_napi) from [<bf02327c>] (wl1271_flush_deferred_work+0x70/0x78 [wlcore])
    [   26.838083]  r10:00000088 r9:00000000 r8:da86a500 r7:d99d04c0 r6:d99d10e8 r5:dab3b540
    [   26.838086]  r4:d99d0f20
    [   26.838172] [<bf02320c>] (wl1271_flush_deferred_work [wlcore]) from [<bf0232a0>] (wl1271_netstack_work+0x1c/0x2c [wlcore])
    [   26.838179]  r7:00000000 r6:db405000 r5:d99d0f20 r4:d99d11d4
    [   26.838233] [<bf023284>] (wl1271_netstack_work [wlcore]) from [<c013974c>] (process_one_work+0x1b8/0x304)
    [   26.838237]  r5:d99d11d4 r4:da805e80
    [   26.838247] [<c0139594>] (process_one_work) from [<c013a710>] (worker_thread+0x2a8/0x454)
    [   26.838256]  r10:00000088 r9:da805e98 r8:db405028 r7:c0b18fc0 r6:db405000 r5:db405000
    [   26.838259]  r4:da805e80
    [   26.838273] [<c013a468>] (worker_thread) from [<c013f014>] (kthread+0x140/0x158)
    [   26.838282]  r10:da837e94 r9:c013a468 r8:da805e80 r7:00000000 r6:da8a4000 r5:daf73500
    [   26.838286]  r4:daf73840 r3:00000000
    [   26.838302] [<c013eed4>] (kthread) from [<c0107310>] (ret_from_fork+0x14/0x24)
    [   26.838309]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c013eed4
    [   26.838312]  r4:daf73500
    [   26.838322] Code: e1d430b8 e0233002 e1903003 0a000002 (e59c3020) 
    [   27.277808] wlan0: send auth to b8:27:eb:a0:35:07 (try 1/3)
    [   27.298981] ---[ end trace 0000000000000002 ]---
  • Hi, 

    Unfortunately we will need more details to reproduce and fix the issue. is there a specific setup where you can reproduce the issue? Pl let us know. 

    Regards, 

    Sudharshan K N

  • This seems to happen occasionally (approximately once per week) in my automated test setup.  I don't have specific instructions for you, though, as I have never reproduced it directly.

    Can you give me an example of the type of data I could give you which would be helpful?