This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

UG: soft lockup - CPU#0 stuck error on AM3352 based system

Other Parts Discussed in Thread: AM3352

I just went to reboot our AM3352 based custom board and saw the error below.  The system is now stuck and requires a manual reset.

We are using the 5.06PSP with 3.2 kernel and Debian Wheezy as the RFS.  Any ideas on what the cause is and how to fix?

[ ok ] Stopping enhanced syslogd: rsyslogd.
[....] Deconfiguring network interfaces...Internet Systems Consortium DHCP Client 4.2.2
Copyright 2004-2011 Internet Systems Consortium.
All rights reserved.
For info, please visit https://www.isc.org/software/dhcp/

Listening on LPF/eth0/bc:6a:29:57:bd:7e
Sending on LPF/eth0/bc:6a:29:57:bd:7e
Sending on Socket/fallback
DHCPRELEASE on eth0 to 192.168.94.10 port 67
[94388.415252] BUG: soft lockup - CPU#0 stuck for 23s! [ip:19920]
[94388.421386] Modules linked in: ppp_async ppp_generic slhc wl12xx_sdio wl12xx mac80211 cfg80211
[94388.430419]
[94388.431976] Pid: 19920, comm: ip
[94388.436981] CPU: 0 Not tainted (3.2.0suned_01-svn50041 #3)
[94388.443115] PC is at __netif_schedule+0x5c/0x64
[94388.447845] LR is at __netif_schedule+0x58/0x64
[94388.452575] pc : [<c02bac44>] lr : [<c02bac40>] psr: 20000013
[94388.452575] sp : cfb69a08 ip : 00000001 fp : cfb69a1c
[94388.464569] r10: 00000000 r9 : 00000000 r8 : ffffffff
[94388.470031] r7 : cfb69a70 r6 : 00000001 r5 : 00000001 r4 : 60000013
[94388.476837] r3 : c06deb40 r2 : 00000200 r1 : 00000004 r0 : 00000002
[94388.483642] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[94388.491088] Control: 10c5387d Table: 8f040019 DAC: 00000015
[94388.497100] Backtrace:
[94388.499694] [<c001bae8>] (dump_backtrace+0x0/0x10c) from [<c0385e18>] (dump_stack+0x18/0x1c)
[94388.508483] r6:c0506990 r5:00000017 r4:cfb699c0 r3:00000002
[94388.514434] [<c0385e00>] (dump_stack+0x0/0x1c) from [<c0019700>] (show_regs+0x4c/0x50)
[94388.522735] [<c00196b4>] (show_regs+0x0/0x50) from [<c007df50>] (watchdog_timer_fn+0x110/0x148)
[94388.531799] r4:c068d6e0 r3:00000002
[94388.535583] [<c007de40>] (watchdog_timer_fn+0x0/0x148) from [<c006230c>] (__run_hrtimer.isra.19+0x60/0x13c)
[94388.545745] [<c00622ac>] (__run_hrtimer.isra.19+0x0/0x13c) from [<c0062c60>] (hrtimer_interrupt+0xf0/0x27c)
[94388.555938] r7:00000001 r6:c052c9f0 r5:00000000 r4:c052ca48
[94388.561889] [<c0062b70>] (hrtimer_interrupt+0x0/0x27c) from [<c0025bf8>] (omap2_gp_timer_interrupt+0x34/0x3c)
[94388.572265] [<c0025bc4>] (omap2_gp_timer_interrupt+0x0/0x3c) from [<c007e918>] (handle_irq_event_percpu+0x54/0x1c0)
[94388.583160] [<c007e8c4>] (handle_irq_event_percpu+0x0/0x1c0) from [<c007eac8>] (handle_irq_event+0x44/0x64)
[94388.593353] [<c007ea84>] (handle_irq_event+0x0/0x64) from [<c0080950>] (handle_level_irq+0x94/0x114)
[94388.602874] r6:00000000 r5:c0690a88 r4:c0690a38 r3:00020000
[94388.608825] [<c00808bc>] (handle_level_irq+0x0/0x114) from [<c007e248>] (generic_handle_irq+0x34/0x48)
[94388.618560] r5:00000044 r4:c06ae300
[94388.622314] [<c007e214>] (generic_handle_irq+0x0/0x48) from [<c001909c>] (handle_IRQ+0x38/0x8c)
[94388.631378] [<c0019064>] (handle_IRQ+0x0/0x8c) from [<c00085c4>] (omap3_intc_handle_irq+0x80/0x88)
[94388.640747] r6:00000044 r5:fa200000 r4:00000004 r3:00000002
[94388.646697] [<c0008544>] (omap3_intc_handle_irq+0x0/0x88) from [<c0017dc0>] (__irq_svc+0x40/0x70)
[94388.655975] Exception stack(0xcfb699c0 to 0xcfb69a08)
[94388.661254] 99c0: 00000002 00000004 00000200 c06deb40 60000013 00000001 00000001 cfb69a70
[94388.669799] 99e0: ffffffff 00000000 00000000 cfb69a1c 00000001 cfb69a08 c02bac40 c02bac44
[94388.678344] 9a00: 20000013 ffffffff
[94388.681976] r7:cfb699f4 r6:ffffffff r5:20000013 r4:c02bac44
[94388.687927] [<c02babe8>] (__netif_schedule+0x0/0x64) from [<c02d18e4>] (dev_deactivate_many+0x168/0x23c)
[94388.697845] r4:cfb22040 r3:cfb21800
[94388.701599] [<c02d177c>] (dev_deactivate_many+0x0/0x23c) from [<c02ba0b0>] (__dev_close_many+0x68/0xd4)
[94388.711395] [<c02ba048>] (__dev_close_many+0x0/0xd4) from [<c02ba14c>] (__dev_close+0x30/0x48)
[94388.720397] r5:00001202 r4:cfb22040
[94388.724151] [<c02ba11c>] (__dev_close+0x0/0x48) from [<c02bdb90>] (__dev_change_flags+0x84/0x13c)
[94388.733428] [<c02bdb0c>] (__dev_change_flags+0x0/0x13c) from [<c02bdcc4>] (dev_change_flags+0x18/0x50)
[94388.743164] r7:cfb69b40 r6:cfb22040 r5:00001203 r4:cfb22040
[94388.749114] [<c02bdcac>] (dev_change_flags+0x0/0x50) from [<c02ca650>] (do_setlink+0x260/0x880)
[94388.758178] r6:cfb22040 r5:cfb69c00 r4:cae57680 r3:00001202
[94388.764129] [<c02ca3f0>] (do_setlink+0x0/0x880) from [<c02cb6b8>] (rtnl_newlink+0x448/0x4ac)
[94388.772949] [<c02cb270>] (rtnl_newlink+0x0/0x4ac) from [<c02caee0>] (rtnetlink_rcv_msg+0x164/0x290)
[94388.782409] [<c02cad7c>] (rtnetlink_rcv_msg+0x0/0x290) from [<c02d5294>] (netlink_rcv_skb+0xc4/0xe0)
[94388.791961] [<c02d51d0>] (netlink_rcv_skb+0x0/0xe0) from [<c02ca204>] (rtnetlink_rcv+0x24/0x2c)
[94388.801055] r6:cae572c0 r5:cf5d7180 r4:cf5d7180 r3:00000000
[94388.806976] [<c02ca1e0>] (rtnetlink_rcv+0x0/0x2c) from [<c02d4c6c>] (netlink_unicast+0x2b0/0x304)
[94388.816253] r4:00000000 r3:c02ca1e0
[94388.820007] [<c02d49bc>] (netlink_unicast+0x0/0x304) from [<c02d4fa8>] (netlink_sendmsg+0x240/0x2a0)
[94388.829559] [<c02d4d68>] (netlink_sendmsg+0x0/0x2a0) from [<c02a7ccc>] (sock_sendmsg+0x9c/0xbc)
[94388.838653] [<c02a7c30>] (sock_sendmsg+0x0/0xbc) from [<c02a8074>] (__sys_sendmsg+0x2d0/0x2e8)
[94388.847656] r9:00000000 r8:00000020 r7:cfb69ec8 r6:cae57000 r5:cfb68000
[94388.854492] r4:cfb69f64
[94388.857238] [<c02a7da4>] (__sys_sendmsg+0x0/0x2e8) from [<c02a9bb0>] (sys_sendmsg+0x44/0x70)
[94388.866058] [<c02a9b6c>] (sys_sendmsg+0x0/0x70) from [<c00181c0>] (ret_fast_syscall+0x0/0x30)
[94388.874969] r6:00000000 r5:bedd76d0 r4:bedd76bc
[94388.879821] Kernel panic - not syncing: softlockup: hung tasks
[94388.885894] Backtrace:
[94388.888458] [<c001bae8>] (dump_backtrace+0x0/0x10c) from [<c0385e18>] (dump_stack+0x18/0x1c)
[94388.897277] r6:c0506990 r5:00000000 r4:c06ce1f8 r3:00000002
[94388.903228] [<c0385e00>] (dump_stack+0x0/0x1c) from [<c038606c>] (panic+0x7c/0x1ac)
[94388.911224] [<c0385ff0>] (panic+0x0/0x1ac) from [<c007df6c>] (watchdog_timer_fn+0x12c/0x148)
[94388.920043] r3:00000001 r2:00000000 r1:00000001 r0:c0469fc4
[94388.925964] r7:00000000
[94388.928619] [<c007de40>] (watchdog_timer_fn+0x0/0x148) from [<c006230c>] (__run_hrtimer.isra.19+0x60/0x13c)
[94388.938812] [<c00622ac>] (__run_hrtimer.isra.19+0x0/0x13c) from [<c0062c60>] (hrtimer_interrupt+0xf0/0x27c)
[94388.948974] r7:00000001 r6:c052c9f0 r5:00000000 r4:c052ca48
[94388.954925] [<c0062b70>] (hrtimer_interrupt+0x0/0x27c) from [<c0025bf8>] (omap2_gp_timer_interrupt+0x34/0x3c)
[94388.965301] [<c0025bc4>] (omap2_gp_timer_interrupt+0x0/0x3c) from [<c007e918>] (handle_irq_event_percpu+0x54/0x1c0)
[94388.976196] [<c007e8c4>] (handle_irq_event_percpu+0x0/0x1c0) from [<c007eac8>] (handle_irq_event+0x44/0x64)
[94388.986389] [<c007ea84>] (handle_irq_event+0x0/0x64) from [<c0080950>] (handle_level_irq+0x94/0x114)
[94388.995910] r6:00000000 r5:c0690a88 r4:c0690a38 r3:00020000
[94389.001861] [<c00808bc>] (handle_level_irq+0x0/0x114) from [<c007e248>] (generic_handle_irq+0x34/0x48)
[94389.011596] r5:00000044 r4:c06ae300
[94389.015350] [<c007e214>] (generic_handle_irq+0x0/0x48) from [<c001909c>] (handle_IRQ+0x38/0x8c)
[94389.024444] [<c0019064>] (handle_IRQ+0x0/0x8c) from [<c00085c4>] (omap3_intc_handle_irq+0x80/0x88)
[94389.033782] r6:00000044 r5:fa200000 r4:00000004 r3:00000002
[94389.039733] [<c0008544>] (omap3_intc_handle_irq+0x0/0x88) from [<c0017dc0>] (__irq_svc+0x40/0x70)
[94389.049011] Exception stack(0xcfb699c0 to 0xcfb69a08)
[94389.054290] 99c0: 00000002 00000004 00000200 c06deb40 60000013 00000001 00000001 cfb69a70
[94389.062835] 99e0: ffffffff 00000000 00000000 cfb69a1c 00000001 cfb69a08 c02bac40 c02bac44
[94389.071380] 9a00: 20000013 ffffffff
[94389.075012] r7:cfb699f4 r6:ffffffff r5:20000013 r4:c02bac44
[94389.080963] [<c02babe8>] (__netif_schedule+0x0/0x64) from [<c02d18e4>] (dev_deactivate_many+0x168/0x23c)
[94389.090850] r4:cfb22040 r3:cfb21800
[94389.094604] [<c02d177c>] (dev_deactivate_many+0x0/0x23c) from [<c02ba0b0>] (__dev_close_many+0x68/0xd4)
[94389.104431] [<c02ba048>] (__dev_close_many+0x0/0xd4) from [<c02ba14c>] (__dev_close+0x30/0x48)
[94389.113433] r5:00001202 r4:cfb22040
[94389.117187] [<c02ba11c>] (__dev_close+0x0/0x48) from [<c02bdb90>] (__dev_change_flags+0x84/0x13c)
[94389.126434] [<c02bdb0c>] (__dev_change_flags+0x0/0x13c) from [<c02bdcc4>] (dev_change_flags+0x18/0x50)
[94389.136169] r7:cfb69b40 r6:cfb22040 r5:00001203 r4:cfb22040
[94389.142120] [<c02bdcac>] (dev_change_flags+0x0/0x50) from [<c02ca650>] (do_setlink+0x260/0x880)
[94389.151184] r6:cfb22040 r5:cfb69c00 r4:cae57680 r3:00001202
[94389.157135] [<c02ca3f0>] (do_setlink+0x0/0x880) from [<c02cb6b8>] (rtnl_newlink+0x448/0x4ac)
[94389.165954] [<c02cb270>] (rtnl_newlink+0x0/0x4ac) from [<c02caee0>] (rtnetlink_rcv_msg+0x164/0x290)
[94389.175415] [<c02cad7c>] (rtnetlink_rcv_msg+0x0/0x290) from [<c02d5294>] (netlink_rcv_skb+0xc4/0xe0)
[94389.184936] [<c02d51d0>] (netlink_rcv_skb+0x0/0xe0) from [<c02ca204>] (rtnetlink_rcv+0x24/0x2c)
[94389.194030] r6:cae572c0 r5:cf5d7180 r4:cf5d7180 r3:00000000
[94389.199981] [<c02ca1e0>] (rtnetlink_rcv+0x0/0x2c) from [<c02d4c6c>] (netlink_unicast+0x2b0/0x304)
[94389.209228] r4:00000000 r3:c02ca1e0
[94389.212982] [<c02d49bc>] (netlink_unicast+0x0/0x304) from [<c02d4fa8>] (netlink_sendmsg+0x240/0x2a0)
[94389.222534] [<c02d4d68>] (netlink_sendmsg+0x0/0x2a0) from [<c02a7ccc>] (sock_sendmsg+0x9c/0xbc)
[94389.231628] [<c02a7c30>] (sock_sendmsg+0x0/0xbc) from [<c02a8074>] (__sys_sendmsg+0x2d0/0x2e8)
[94389.240631] r9:00000000 r8:00000020 r7:cfb69ec8 r6:cae57000 r5:cfb68000
[94389.247467] r4:cfb69f64
[94389.250213] [<c02a7da4>] (__sys_sendmsg+0x0/0x2e8) from [<c02a9bb0>] (sys_sendmsg+0x44/0x70)
[94389.259033] [<c02a9b6c>] (sys_sendmsg+0x0/0x70) from [<c00181c0>] (ret_fast_syscall+0x0/0x30)
[94389.267944] r6:00000000 r5:bedd76d0 r4:bedd76bc