AM3358: Hitting BUG_ON on ccpi41_dma_channel_program

Hello,

Our USB subject owner is on vacation the rest of this week. They will reply next week. In the meantime, this training shows how to use that debug log to pinpoint the line that is causing the problem: Debugging Embedded Linux Systems Training Series.

Regards,

Nick

Sure Nick I will ask our kernel engineers to take a look on it.

Hi Kiran,

Can you please attach the full kernel dmesg log which shows the error?

Hi Bin Liu,

This errors are not seen as a part of any dmesg/syslog/kern.log and observed this only when it is connected to uart only. 

This was clearly observed by our testing team when connected to uart only.

Regards,

Kiran 

Kiran,

By uart do you mean the linux uart console?

If so, when you see the error on the uart console, running 'dmesg' command on the console will dump the full kernel log with this error message. Please attach the entire kernel dmesg log.

Hi Liu,

yes, uart console only. Please find the requested dmesg printed on uart console. Please give us some pointers to resolve this issue.

$ dmesg
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 4.14.71-rt44-g52ea6d10d0 (oe-user@oe-host) (gcc version 7.2.1 20171011 (Linaro GCC 7.2-2017.11)) #1 PREEMPT RT Thu Aug 6 07:42:34 UTC 2020
[ 0.000000] CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c5387d
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[ 0.000000] OF: fdt: Machine model: [TI AM335x] Cloudleaf Gateway 1.5
[ 0.000000] Memory policy: Data cache writeback
[ 0.000000] efi: Getting EFI parameters from FDT:
[ 0.000000] efi: UEFI not found.
[ 0.000000] cma: Reserved 48 MiB at 0x9d000000
[ 0.000000] On node 0 totalpages: 131072
[ 0.000000] free_area_init_node: node 0, pgdat c0d527f4, node_mem_map dcb61000
[ 0.000000] Normal zone: 1152 pages used for memmap
[ 0.000000] Normal zone: 0 pages reserved
[ 0.000000] Normal zone: 131072 pages, LIFO batch:31
[ 0.000000] CPU: All CPU(s) started in SVC mode.
[ 0.000000] AM335X ES2.1 (sgx neon)
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 129920
[ 0.000000] Kernel command line: console=ttyO0,115200n8 root=PARTUUID=a6de78ae-03 rw rootfstype=ext4 rootwait init=/etc/init.d/flash-emmc
[ 0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[ 0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[ 0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[ 0.000000] Memory: 456900K/524288K available (8192K kernel code, 336K rwdata, 2592K rodata, 1024K init, 275K bss, 18236K reserved, 49152K cma-reserved, 0K highmem)
[ 0.000000] Virtual kernel memory layout:
vector : 0xffff0000 - 0xffff1000 ( 4 kB)
fixmap : 0xffc00000 - 0xfff00000 (3072 kB)
vmalloc : 0xe0800000 - 0xff800000 ( 496 MB)
lowmem : 0xc0000000 - 0xe0000000 ( 512 MB)
pkmap : 0xbfe00000 - 0xc0000000 ( 2 MB)
modules : 0xbf000000 - 0xbfe00000 ( 14 MB)
.text : 0xc0008000 - 0xc0900000 (9184 kB)
.init : 0xc0c00000 - 0xc0d00000 (1024 kB)
.data : 0xc0d00000 - 0xc0d54080 ( 337 kB)
.bss : 0xc0d54080 - 0xc0d98e6c ( 276 kB)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] Preemptible hierarchical RCU implementation.
[ 0.000000] RCU priority boosting: priority 1 delay 500 ms.
[ 0.000000] No expedited grace period (rcu_normal_after_boot).
[ 0.000000] Tasks RCU enabled.
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
[ 0.000000] OMAP clockevent source: timer2 at 24000000 Hz
[ 0.000014] sched_clock: 32 bits at 24MHz, resolution 41ns, wraps every 89478484971ns
[ 0.000025] clocksource: timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[ 0.000030] OMAP clocksource: timer1 at 24000000 Hz
[ 0.000175] timer_probe: no matching timers found
[ 0.000365] Console: colour dummy device 80x30
[ 0.000487] WARNING: Your 'console=ttyO0' has been replaced by 'ttyS0'
[ 0.000489] This ensures that you still see kernel messages. Please
[ 0.000491] update your kernel commandline.
[ 0.000515] Calibrating delay loop... 996.14 BogoMIPS (lpj=4980736)
[ 0.089208] pid_max: default: 32768 minimum: 301
[ 0.089387] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.089395] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[ 0.090172] CPU: Testing write buffer coherency: ok
[ 0.090893] Setting up static identity map for 0x80100000 - 0x80100060
[ 0.091135] Hierarchical SRCU implementation.
[ 0.091766] EFI services will not be available.
[ 0.092971] devtmpfs: initialized
[ 0.101306] random: get_random_u32 called from bucket_table_alloc+0x124/0x27c with crng_init=0
[ 0.101790] VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
[ 0.102091] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.102115] futex hash table entries: 256 (order: 1, 8192 bytes)
[ 0.105484] pinctrl core: initialized pinctrl subsystem
[ 0.106194] DMI not present or invalid.
[ 0.106656] NET: Registered protocol family 16
[ 0.109015] DMA: preallocated 256 KiB pool for atomic coherent allocations
[ 0.122104] omap_hwmod: debugss: _wait_target_disable failed
[ 0.178481] gpio gpiochip0: (gpio): added GPIO chardev (254:0)
[ 0.178573] gpiochip_setup_dev: registered GPIOs 0 to 31 on device: gpiochip0 (gpio)
[ 0.178852] OMAP GPIO hardware version 0.1
[ 0.179912] gpio gpiochip1: (gpio): added GPIO chardev (254:1)
[ 0.180005] gpiochip_setup_dev: registered GPIOs 32 to 63 on device: gpiochip1 (gpio)
[ 0.180905] gpio gpiochip2: (gpio): added GPIO chardev (254:2)
[ 0.180988] gpiochip_setup_dev: registered GPIOs 64 to 95 on device: gpiochip2 (gpio)
[ 0.181959] gpio gpiochip3: (gpio): added GPIO chardev (254:3)
[ 0.182043] gpiochip_setup_dev: registered GPIOs 96 to 127 on device: gpiochip3 (gpio)
[ 0.189655] No ATAGs?
[ 0.189673] hw-breakpoint: debug architecture 0x4 unsupported.
[ 0.203356] edma 49000000.edma: TI EDMA DMA engine driver
[ 0.203890] of_get_named_gpiod_flags: can't parse 'gpio' property of node '/fixedregulator0[0]'
[ 0.206337] omap_i2c 44e0b000.i2c: could not find pctldev for node /ocp/l4_wkup@44c00000/scm@210000/pinmux@800/pinmux_i2c0_pins, deferring probe
[ 0.206399] omap_i2c 4802a000.i2c: could not find pctldev for node /ocp/l4_wkup@44c00000/scm@210000/pinmux@800/pinmux_i2c1_pins, deferring probe
[ 0.206499] media: Linux media interface: v0.10
[ 0.206543] Linux video capture interface: v2.00
[ 0.206643] pps_core: LinuxPPS API ver. 1 registered
[ 0.206652] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.206683] PTP clock support registered
[ 0.206716] EDAC MC: Ver: 3.0.0
[ 0.207213] dmi: Firmware registration failed.
[ 0.207650] omap-mailbox 480c8000.mailbox: omap mailbox rev 0x400
[ 0.207978] Advanced Linux Sound Architecture Driver Initialized.
[ 0.209959] clocksource: Switched to clocksource timer1
[ 0.218025] NET: Registered protocol family 2
[ 0.218812] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
[ 0.218873] TCP bind hash table entries: 4096 (order: 4, 98304 bytes)
[ 0.219026] TCP: Hash tables configured (established 4096 bind 4096)
[ 0.219132] UDP hash table entries: 256 (order: 2, 16384 bytes)
[ 0.219168] UDP-Lite hash table entries: 256 (order: 2, 16384 bytes)
[ 0.219595] NET: Registered protocol family 1
[ 0.220131] RPC: Registered named UNIX socket transport module.
[ 0.220145] RPC: Registered udp transport module.
[ 0.220151] RPC: Registered tcp transport module.
[ 0.220157] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.220170] PCI: CLS 0 bytes, default 64
[ 0.221047] hw perfevents: no interrupt-affinity property for /pmu, guessing.
[ 0.221169] hw perfevents: enabled with armv7_cortex_a8 PMU driver, 5 counters available
[ 0.222609] workingset: timestamp_bits=14 max_order=17 bucket_order=3
[ 0.227204] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 0.228095] NFS: Registering the id_resolver key type
[ 0.228140] Key type id_resolver registered
[ 0.228148] Key type id_legacy registered
[ 0.228199] ntfs: driver 2.1.32 [Flags: R/O].
[ 0.231123] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[ 0.231146] io scheduler noop registered
[ 0.231153] io scheduler deadline registered
[ 0.231305] io scheduler cfq registered (default)
[ 0.231316] io scheduler mq-deadline registered
[ 0.231323] io scheduler kyber registered
[ 0.232471] pinctrl-single 44e10800.pinmux: 142 pins at pa f9e10800 size 568
[ 0.285345] Serial: 8250/16550 driver, 10 ports, IRQ sharing disabled
[ 0.288326] 44e09000.serial: ttyS0 at MMIO 0x44e09000 (irq = 30, base_baud = 3000000) is a 8250
[ 0.924309] console [ttyS0] enabled
[ 0.929002] 48022000.serial: ttyS1 at MMIO 0x48022000 (irq = 31, base_baud = 3000000) is a 8250
[ 0.938842] 48024000.serial: ttyS2 at MMIO 0x48024000 (irq = 32, base_baud = 3000000) is a 8250
[ 0.948623] 481a6000.serial: ttyS3 at MMIO 0x481a6000 (irq = 33, base_baud = 3000000) is a 8250
[ 0.958420] 481a8000.serial: ttyS4 at MMIO 0x481a8000 (irq = 34, base_baud = 3000000) is a 8250
[ 0.969069] omap_rng 48310000.rng: Random Number Generator ver. 20
[ 0.987596] brd: module loaded
[ 0.997677] loop: module loaded
[ 1.002943] mdio_bus fixed-0: GPIO lookup for consumer reset
[ 1.002955] mdio_bus fixed-0: using lookup tables for GPIO lookup
[ 1.002962] mdio_bus fixed-0: lookup for GPIO reset failed
[ 1.002984] libphy: Fixed MDIO Bus: probed
[ 1.022549] mdio_bus 4a101000.mdio: GPIO lookup for consumer reset
[ 1.022562] mdio_bus 4a101000.mdio: using lookup tables for GPIO lookup
[ 1.022569] mdio_bus 4a101000.mdio: lookup for GPIO reset failed
[ 1.080052] davinci_mdio 4a101000.mdio: davinci mdio revision 1.6, bus freq 1000000
[ 1.087755] davinci_mdio 4a101000.mdio: detected phy mask fffffffe
[ 1.095222] libphy: 4a101000.mdio: probed
[ 1.099267] davinci_mdio 4a101000.mdio: phy[0]: device 4a101000.mdio:00, driver SMSC LAN8710/LAN8720
[ 1.109354] cpsw 4a100000.ethernet: Detected MACID = c8:fd:19:f3:b3:c4
[ 1.116052] cpsw 4a100000.ethernet: initialized cpsw ale version 1.4
[ 1.122439] cpsw 4a100000.ethernet: ALE Table size 1024
[ 1.127726] cpsw 4a100000.ethernet: cpts: overflow check period 500 (jiffies)
[ 1.136281] PPP generic driver version 2.4.2
[ 1.141306] i2c /dev entries driver
[ 1.145258] IR NEC protocol handler initialized
[ 1.149810] IR RC5(x/sz) protocol handler initialized
[ 1.154884] IR RC6 protocol handler initialized
[ 1.159435] IR JVC protocol handler initialized
[ 1.163982] IR Sony protocol handler initialized
[ 1.168617] IR SANYO protocol handler initialized
[ 1.173338] IR Sharp protocol handler initialized
[ 1.178060] IR MCE Keyboard/mouse protocol handler initialized
[ 1.183915] IR XMP protocol handler initialized
[ 1.189356] sdhci: Secure Digital Host Controller Interface driver
[ 1.195565] sdhci: Copyright(c) Pierre Ossman
[ 1.200576] omap_hsmmc 48060000.mmc: GPIO lookup for consumer cd
[ 1.200585] omap_hsmmc 48060000.mmc: using device tree for GPIO lookup
[ 1.200625] of_get_named_gpiod_flags: parsed 'cd-gpios' property of node '/ocp/mmc@48060000[0]' - status (0)
[ 1.200690] omap_hsmmc 48060000.mmc: Got CD GPIO
[ 1.205342] omap_hsmmc 48060000.mmc: GPIO lookup for consumer wp
[ 1.205347] omap_hsmmc 48060000.mmc: using device tree for GPIO lookup
[ 1.205356] of_get_named_gpiod_flags: can't parse 'wp-gpios' property of node '/ocp/mmc@48060000[0]'
[ 1.205364] of_get_named_gpiod_flags: can't parse 'wp-gpio' property of node '/ocp/mmc@48060000[0]'
[ 1.205370] omap_hsmmc 48060000.mmc: using lookup tables for GPIO lookup
[ 1.205378] omap_hsmmc 48060000.mmc: lookup for GPIO wp failed
[ 1.260612] omap_hsmmc 481d8000.mmc: GPIO lookup for consumer cd
[ 1.260624] omap_hsmmc 481d8000.mmc: using device tree for GPIO lookup
[ 1.260640] of_get_named_gpiod_flags: can't parse 'cd-gpios' property of node '/ocp/mmc@481d8000[0]'
[ 1.260648] of_get_named_gpiod_flags: can't parse 'cd-gpio' property of node '/ocp/mmc@481d8000[0]'
[ 1.260654] omap_hsmmc 481d8000.mmc: using lookup tables for GPIO lookup
[ 1.260660] omap_hsmmc 481d8000.mmc: lookup for GPIO cd failed
[ 1.260668] omap_hsmmc 481d8000.mmc: GPIO lookup for consumer wp
[ 1.260673] omap_hsmmc 481d8000.mmc: using device tree for GPIO lookup
[ 1.260680] of_get_named_gpiod_flags: can't parse 'wp-gpios' property of node '/ocp/mmc@481d8000[0]'
[ 1.260686] of_get_named_gpiod_flags: can't parse 'wp-gpio' property of node '/ocp/mmc@481d8000[0]'
[ 1.260691] omap_hsmmc 481d8000.mmc: using lookup tables for GPIO lookup
[ 1.260697] omap_hsmmc 481d8000.mmc: lookup for GPIO wp failed
[ 1.320203] sdhci-pltfm: SDHCI platform and OF driver helper
[ 1.326614] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led2[0]' - status (0)
[ 1.326674] no flags found for gpios
[ 1.326827] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led3[0]' - status (0)
[ 1.326857] no flags found for gpios
[ 1.326988] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led4[0]' - status (0)
[ 1.326994] no flags found for gpios
[ 1.327083] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led5[0]' - status (0)
[ 1.327089] no flags found for gpios
[ 1.334782] NET: Registered protocol family 10
[ 1.343482] Segment Routing with IPv6
[ 1.347239] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[ 1.353933] NET: Registered protocol family 17
[ 1.358667] Key type dns_resolver registered
[ 1.363106] omap_voltage_late_init: Voltage driver support not added
[ 1.387869] mmc1: new high speed MMC card at address 0001
[ 1.393867] mmcblk1: mmc1:0001 Q2J54A 3.59 GiB
[ 1.398599] mmcblk1boot0: mmc1:0001 Q2J54A partition 1 16.0 MiB
[ 1.405131] mmcblk1boot1: mmc1:0001 Q2J54A partition 2 16.0 MiB
[ 1.411801] mmcblk1rpmb: mmc1:0001 Q2J54A partition 3 512 KiB
[ 1.414187] tps65217 0-0024: TPS65217 ID 0xe version 1.2
[ 1.414570] omap_i2c 44e0b000.i2c: bus 0 rev0.11 at 400 kHz
[ 1.421142] rtc-ds1307 1-0068: writing trickle charger info 0xaa to 0xa
[ 1.434726] mmcblk1: p1 p2 p3 p4 < p5 p6 p7 >
[ 1.450812] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[ 1.450832] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[ 1.451163] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[ 1.451173] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[ 1.451367] rtc-ds1307 1-0068: char device (253:0)
[ 1.451394] rtc-ds1307 1-0068: registered as rtc0
[ 1.456223] omap_i2c 4802a000.i2c: bus 1 rev0.11 at 400 kHz
[ 1.462725] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[ 1.462740] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[ 1.462774] rtc-ds1307 1-0068: setting system clock to 2020-08-17 13:49:28 UTC (1597672168)
[ 1.471662] ALSA device list:
[ 1.474651] No soundcards found.
[ 1.530218] EXT4-fs (mmcblk1p3): warning: maximal mount count reached, running e2fsck is recommended
[ 1.541310] EXT4-fs (mmcblk1p3): recovery complete
[ 1.547270] EXT4-fs (mmcblk1p3): mounted filesystem with ordered data mode. Opts: (null)
[ 1.555477] VFS: Mounted root (ext4 filesystem) on device 179:3.
[ 1.561666] devtmpfs: mounted
[ 1.565941] Freeing unused kernel memory: 1024K
[ 1.866284] systemd[1]: systemd 234 running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -S)
[ 1.887799] systemd[1]: Detected architecture arm.
[ 1.920384] systemd[1]: No hostname configured.
[ 1.924988] systemd[1]: Set hostname to <localhost>.
[ 2.393398] systemd[1]: systemd-networkd.socket: Socket service systemd-networkd.service not loaded, refusing.
[ 2.403634] systemd[1]: Failed to listen on Network Service Netlink Socket.
[ 2.470285] random: systemd: uninitialized urandom read (16 bytes read)
[ 2.477360] systemd[1]: Listening on udev Control Socket.
[ 2.510292] random: systemd: uninitialized urandom read (16 bytes read)
[ 2.517376] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[ 2.560236] random: systemd: uninitialized urandom read (16 bytes read)
[ 2.567278] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 2.610687] systemd[1]: Listening on Journal Socket.
[ 2.898883] cryptodev: loading out-of-tree module taints kernel.
[ 2.906899] cryptodev: driver 1.9 loaded.
[ 3.222514] EXT4-fs (mmcblk1p3): re-mounted. Opts: (null)
[ 3.901208] systemd-journald[91]: Received request to flush runtime journal from PID 1
[ 6.290254] omap_wdt: OMAP Watchdog Timer Rev 0x01: initial timeout 60 sec
[ 6.413102] at24 0-0050: 32768 byte 24c256 EEPROM, writable, 1 bytes/write
[ 6.469458] omap_rtc 44e3e000.rtc: already running
[ 6.515573] omap_rtc 44e3e000.rtc: char device (253:1)
[ 6.515682] omap_rtc 44e3e000.rtc: registered as rtc1
[ 6.648182] of_get_named_gpiod_flags: parsed 'reset-gpios' property of node '/ocp/i2c@4802a000/usb2513@2C[0]' - status (0)
[ 6.683223] usb251xb 1-002c: configuring block 0 failed: -121
[ 6.689021] usb251xb 1-002c: Failed to connect hub (-121)
[ 6.793073] usb251xb: probe of 1-002c failed with error -121
[ 7.480448] omap-sham 53100000.sham: hw accel on OMAP rev 4.3
[ 7.596580] omap-aes 53500000.aes: OMAP AES hw accel rev: 3.2
[ 7.685876] omap-aes 53500000.aes: will run requests pump with realtime priority
[ 7.711561] remoteproc remoteproc0: wkup_m3 is available
[ 7.794449] remoteproc remoteproc0: powering up wkup_m3
[ 7.805530] PM: Cannot get wkup_m3_ipc handle
[ 7.843277] remoteproc remoteproc0: Booting fw image am335x-pm-firmware.elf, size 224680
[ 7.843532] remoteproc remoteproc0: remote processor wkup_m3 is now up
[ 7.843591] wkup_m3_ipc 44e11324.wkup_m3_ipc: CM3 Firmware Version = 0x192
[ 8.385349] PM: bootloader does not support rtc-only!
[ 10.935431] EXT4-fs (mmcblk1p7): recovery complete
[ 10.979263] EXT4-fs (mmcblk1p7): mounted filesystem with ordered data mode. Opts: (null)
[ 11.718852] EXT4-fs (mmcblk1p2): warning: maximal mount count reached, running e2fsck is recommended
[ 11.836654] EXT4-fs (mmcblk1p2): recovery complete
[ 11.876505] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
[ 11.900815] EXT4-fs (mmcblk1p5): recovery complete
[ 11.910376] EXT4-fs (mmcblk1p5): mounted filesystem with ordered data mode. Opts: (null)
[ 11.934360] FAT-fs (mmcblk1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[ 13.091042] EXT4-fs (mmcblk1p6): recovery complete
[ 13.122446] EXT4-fs (mmcblk1p6): mounted filesystem with ordered data mode. Opts: (null)
[ 16.022565] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer reset
[ 16.022582] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
[ 16.022605] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[ 16.022615] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[ 16.022621] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
[ 16.022629] am335x-phy-driver 47401300.usb-phy: lookup for GPIO reset failed
[ 16.022637] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer vbus-detect
[ 16.022642] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
[ 16.022651] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[ 16.022660] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[ 16.022665] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
[ 16.022671] am335x-phy-driver 47401300.usb-phy: lookup for GPIO vbus-detect failed
[ 16.022752] am335x-phy-driver 47401300.usb-phy: 47401300.usb-phy supply vcc not found, using dummy regulator
[ 16.104145] usbcore: registered new interface driver usbfs
[ 16.104211] usbcore: registered new interface driver hub
[ 16.104373] usbcore: registered new device driver usb
[ 16.429470] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer reset
[ 16.429488] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
[ 16.429509] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[ 16.429518] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[ 16.429525] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
[ 16.429532] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO reset failed
[ 16.429542] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer vbus-detect
[ 16.429547] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
[ 16.429555] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[ 16.429563] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[ 16.429569] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
[ 16.429575] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO vbus-detect failed
[ 16.429657] am335x-phy-driver 47401b00.usb-phy: 47401b00.usb-phy supply vcc not found, using dummy regulator
[ 16.565747] musb-hdrc musb-hdrc.1: MUSB HDRC host driver
[ 16.626166] musb-hdrc musb-hdrc.1: new USB bus registered, assigned bus number 1
[ 16.746263] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 16.823080] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 16.888813] usb usb1: Product: MUSB HDRC host driver
[ 16.964915] usb usb1: Manufacturer: Linux 4.14.71-rt44-g52ea6d10d0 musb-hcd
[ 17.038402] usb usb1: SerialNumber: musb-hdrc.1
[ 17.134968] hub 1-0:1.0: USB hub found
[ 17.203927] hub 1-0:1.0: 1 port detected
[ 17.710217] usb 1-1: new high-speed USB device number 2 using musb-hdrc
[ 17.920555] usb 1-1: New USB device found, idVendor=0424, idProduct=2513
[ 17.927312] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 17.970403] hub 1-1:1.0: USB hub found
[ 17.987705] hub 1-1:1.0: 3 ports detected
[ 18.320548] usb 1-1.2: new high-speed USB device number 3 using musb-hdrc
[ 18.461036] usb 1-1.2: New USB device found, idVendor=0bda, idProduct=1a2b
[ 18.467965] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 18.493636] usb 1-1.2: Product: DISK
[ 18.497240] usb 1-1.2: Manufacturer: D-Link Corporation
[ 18.684162] SCSI subsystem initialized
[ 18.728737] usb-storage 1-1.2:1.0: USB Mass Storage device detected
[ 18.732865] usb 1-1.2: USB disconnect, device number 3
[ 18.768270] scsi host0: usb-storage 1-1.2:1.0
[ 18.789024] usbcore: registered new interface driver usb-storage
[ 19.110510] usb 1-1.2: new high-speed USB device number 4 using musb-hdrc
[ 19.251106] usb 1-1.2: New USB device found, idVendor=2001, idProduct=331d
[ 19.258034] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 19.283096] usb 1-1.2: Product: DWA-171
[ 19.286960] usb 1-1.2: Manufacturer: D-Link Corporation
[ 19.309264] usb 1-1.2: SerialNumber: 123456
[ 19.775644] usbcore: registered new interface driver rtl8821cu
[ 20.050160] usb 1-1.1: new high-speed USB device number 5 using musb-hdrc
[ 20.377902] using random self ethernet address
[ 20.382514] using random host ethernet address
[ 20.486796] usb0: HOST MAC 1a:0c:1d:ce:a7:e7
[ 20.503378] usb0: MAC e2:d8:47:03:d4:46
[ 20.600254] rtc-ds1307 1-0068: write secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[ 20.600276] rtc-ds1307 1-0068: write: 47 49 13 02 17 08 20
[ 20.600992] rtc-ds1307 1-0068: read: 47 49 13 02 17 08 20
[ 20.601007] rtc-ds1307 1-0068: read secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[ 20.742467] IPv6: ADDRCONF(NETDEV_UP): usb0: link is not ready
[ 21.590193] usb 1-1.1: new high-speed USB device number 6 using musb-hdrc
[ 21.754665] usb 1-1.1: New USB device found, idVendor=1bc7, idProduct=0025
[ 21.785998] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 21.830532] usb 1-1.1: Product: 6 CDC-ACM + 1 CDC-ECM
[ 21.856436] usb 1-1.1: Manufacturer: Telit
[ 21.879108] usb 1-1.1: SerialNumber: 357152071476111
[ 22.243883] cdc_acm 1-1.1:1.0: ttyACM0: USB ACM device
[ 22.358214] cdc_acm 1-1.1:1.2: ttyACM1: USB ACM device
[ 22.483480] cdc_acm 1-1.1:1.4: ttyACM2: USB ACM device
[ 22.602718] cdc_ether 1-1.1:1.12 wwan0: register 'cdc_ether' at usb-musb-hdrc.1-1.1, Mobile Broadband Network Device, 00:00:11:12:13:14
[ 22.712480] cdc_acm 1-1.1:1.6: ttyACM3: USB ACM device
[ 22.723596] usbcore: registered new interface driver cdc_ether
[ 22.761882] cdc_acm 1-1.1:1.8: ttyACM4: USB ACM device
[ 22.859776] cdc_acm 1-1.1:1.10: ttyACM5: USB ACM device
[ 22.949366] usbcore: registered new interface driver cdc_acm
[ 22.994362] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[ 23.510228] net eth0: initializing cpsw version 1.12 (0)
[ 23.661786] SMSC LAN8710/LAN8720 4a101000.mdio:00: attached PHY driver [SMSC LAN8710/LAN8720] (mii_bus:phy_addr=4a101000.mdio:00, irq=POLL)
[ 23.717859] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 24.782157] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 89.871406] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[ 96.987422] rtc-ds1307 1-0068: write secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
[ 96.987444] rtc-ds1307 1-0068: write: 01 51 13 02 17 08 20
[ 96.988220] rtc-ds1307 1-0068: read: 01 51 13 02 17 08 20
[ 96.988234] rtc-ds1307 1-0068: read secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
[ 125.946427] watchdog: watchdog0: watchdog did not stop!

Hi Kiran,

Thanks for the log. Can you please provide the dmesg log when the error happens? I'd like to check the kernel messages right before the error.

Since the log is very log, please attach it as a file instead of copy&paste. Thanks.

Hi Liu,

Sorry, attaching the uart console log of dmesg 
Kern log before the reboot and after the reboot.

Please let me know if you need any other information.

Regards,

Kiran

1597672972 clf@5.238:~$ dmesg
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 4.14.71-rt44-g52ea6d10d0 (oe-user@oe-host) (gcc version 7.2.1 20171011 (Linaro GCC 7.2-2017.11)) #1 PREEMPT RT Thu Aug 6 07:42:34 UTC 2020
[    0.000000] CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: [TI AM335x] Cloudleaf Gateway 1.5
[    0.000000] Memory policy: Data cache writeback
[    0.000000] efi: Getting EFI parameters from FDT:
[    0.000000] efi: UEFI not found.
[    0.000000] cma: Reserved 48 MiB at 0x9d000000
[    0.000000] On node 0 totalpages: 131072
[    0.000000] free_area_init_node: node 0, pgdat c0d527f4, node_mem_map dcb61000
[    0.000000]   Normal zone: 1152 pages used for memmap
[    0.000000]   Normal zone: 0 pages reserved
[    0.000000]   Normal zone: 131072 pages, LIFO batch:31
[    0.000000] CPU: All CPU(s) started in SVC mode.
[    0.000000] AM335X ES2.1 (sgx neon)
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 129920
[    0.000000] Kernel command line: console=ttyO0,115200n8 root=PARTUUID=a6de78ae-03 rw rootfstype=ext4 rootwait init=/etc/init.d/flash-emmc
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Memory: 456900K/524288K available (8192K kernel code, 336K rwdata, 2592K rodata, 1024K init, 275K bss, 18236K reserved, 49152K cma-reserved, 0K highmem)
[    0.000000] Virtual kernel memory layout:
                   vector  : 0xffff0000 - 0xffff1000   (   4 kB)
                   fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
                   vmalloc : 0xe0800000 - 0xff800000   ( 496 MB)
                   lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
                   pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
                   modules : 0xbf000000 - 0xbfe00000   (  14 MB)
                     .text : 0xc0008000 - 0xc0900000   (9184 kB)
                     .init : 0xc0c00000 - 0xc0d00000   (1024 kB)
                     .data : 0xc0d00000 - 0xc0d54080   ( 337 kB)
                      .bss : 0xc0d54080 - 0xc0d98e6c   ( 276 kB)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Preemptible hierarchical RCU implementation.
[    0.000000]  RCU priority boosting: priority 1 delay 500 ms.
[    0.000000]  No expedited grace period (rcu_normal_after_boot).
[    0.000000]  Tasks RCU enabled.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] IRQ: Found an INTC at 0xfa200000 (revision 5.0) with 128 interrupts
[    0.000000] OMAP clockevent source: timer2 at 24000000 Hz
[    0.000014] sched_clock: 32 bits at 24MHz, resolution 41ns, wraps every 89478484971ns
[    0.000025] clocksource: timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[    0.000030] OMAP clocksource: timer1 at 24000000 Hz
[    0.000175] timer_probe: no matching timers found
[    0.000365] Console: colour dummy device 80x30
[    0.000487] WARNING: Your 'console=ttyO0' has been replaced by 'ttyS0'
[    0.000489] This ensures that you still see kernel messages. Please
[    0.000491] update your kernel commandline.
[    0.000515] Calibrating delay loop... 996.14 BogoMIPS (lpj=4980736)
[    0.089208] pid_max: default: 32768 minimum: 301
[    0.089387] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.089395] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.090172] CPU: Testing write buffer coherency: ok
[    0.090893] Setting up static identity map for 0x80100000 - 0x80100060
[    0.091135] Hierarchical SRCU implementation.
[    0.091766] EFI services will not be available.
[    0.092971] devtmpfs: initialized
[    0.101306] random: get_random_u32 called from bucket_table_alloc+0x124/0x27c with crng_init=0
[    0.101790] VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
[    0.102091] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.102115] futex hash table entries: 256 (order: 1, 8192 bytes)
[    0.105484] pinctrl core: initialized pinctrl subsystem
[    0.106194] DMI not present or invalid.
[    0.106656] NET: Registered protocol family 16
[    0.109015] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.122104] omap_hwmod: debugss: _wait_target_disable failed
[    0.178481] gpio gpiochip0: (gpio): added GPIO chardev (254:0)
[    0.178573] gpiochip_setup_dev: registered GPIOs 0 to 31 on device: gpiochip0 (gpio)
[    0.178852] OMAP GPIO hardware version 0.1
[    0.179912] gpio gpiochip1: (gpio): added GPIO chardev (254:1)
[    0.180005] gpiochip_setup_dev: registered GPIOs 32 to 63 on device: gpiochip1 (gpio)
[    0.180905] gpio gpiochip2: (gpio): added GPIO chardev (254:2)
[    0.180988] gpiochip_setup_dev: registered GPIOs 64 to 95 on device: gpiochip2 (gpio)
[    0.181959] gpio gpiochip3: (gpio): added GPIO chardev (254:3)
[    0.182043] gpiochip_setup_dev: registered GPIOs 96 to 127 on device: gpiochip3 (gpio)
[    0.189655] No ATAGs?
[    0.189673] hw-breakpoint: debug architecture 0x4 unsupported.
[    0.203356] edma 49000000.edma: TI EDMA DMA engine driver
[    0.203890] of_get_named_gpiod_flags: can't parse 'gpio' property of node '/fixedregulator0[0]'
[    0.206337] omap_i2c 44e0b000.i2c: could not find pctldev for node /ocp/l4_wkup@44c00000/scm@210000/pinmux@800/pinmux_i2c0_pins, deferring probe
[    0.206399] omap_i2c 4802a000.i2c: could not find pctldev for node /ocp/l4_wkup@44c00000/scm@210000/pinmux@800/pinmux_i2c1_pins, deferring probe
[    0.206499] media: Linux media interface: v0.10
[    0.206543] Linux video capture interface: v2.00
[    0.206643] pps_core: LinuxPPS API ver. 1 registered
[    0.206652] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.206683] PTP clock support registered
[    0.206716] EDAC MC: Ver: 3.0.0
[    0.207213] dmi: Firmware registration failed.
[    0.207650] omap-mailbox 480c8000.mailbox: omap mailbox rev 0x400
[    0.207978] Advanced Linux Sound Architecture Driver Initialized.
[    0.209959] clocksource: Switched to clocksource timer1
[    0.218025] NET: Registered protocol family 2
[    0.218812] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
[    0.218873] TCP bind hash table entries: 4096 (order: 4, 98304 bytes)
[    0.219026] TCP: Hash tables configured (established 4096 bind 4096)
[    0.219132] UDP hash table entries: 256 (order: 2, 16384 bytes)
[    0.219168] UDP-Lite hash table entries: 256 (order: 2, 16384 bytes)
[    0.219595] NET: Registered protocol family 1
[    0.220131] RPC: Registered named UNIX socket transport module.
[    0.220145] RPC: Registered udp transport module.
[    0.220151] RPC: Registered tcp transport module.
[    0.220157] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.220170] PCI: CLS 0 bytes, default 64
[    0.221047] hw perfevents: no interrupt-affinity property for /pmu, guessing.
[    0.221169] hw perfevents: enabled with armv7_cortex_a8 PMU driver, 5 counters available
[    0.222609] workingset: timestamp_bits=14 max_order=17 bucket_order=3
[    0.227204] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.228095] NFS: Registering the id_resolver key type
[    0.228140] Key type id_resolver registered
[    0.228148] Key type id_legacy registered
[    0.228199] ntfs: driver 2.1.32 [Flags: R/O].
[    0.231123] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.231146] io scheduler noop registered
[    0.231153] io scheduler deadline registered
[    0.231305] io scheduler cfq registered (default)
[    0.231316] io scheduler mq-deadline registered
[    0.231323] io scheduler kyber registered
[    0.232471] pinctrl-single 44e10800.pinmux: 142 pins at pa f9e10800 size 568
[    0.285345] Serial: 8250/16550 driver, 10 ports, IRQ sharing disabled
[    0.288326] 44e09000.serial: ttyS0 at MMIO 0x44e09000 (irq = 30, base_baud = 3000000) is a 8250
[    0.924309] console [ttyS0] enabled
[    0.929002] 48022000.serial: ttyS1 at MMIO 0x48022000 (irq = 31, base_baud = 3000000) is a 8250
[    0.938842] 48024000.serial: ttyS2 at MMIO 0x48024000 (irq = 32, base_baud = 3000000) is a 8250
[    0.948623] 481a6000.serial: ttyS3 at MMIO 0x481a6000 (irq = 33, base_baud = 3000000) is a 8250
[    0.958420] 481a8000.serial: ttyS4 at MMIO 0x481a8000 (irq = 34, base_baud = 3000000) is a 8250
[    0.969069] omap_rng 48310000.rng: Random Number Generator ver. 20
[    0.987596] brd: module loaded
[    0.997677] loop: module loaded
[    1.002943] mdio_bus fixed-0: GPIO lookup for consumer reset
[    1.002955] mdio_bus fixed-0: using lookup tables for GPIO lookup
[    1.002962] mdio_bus fixed-0: lookup for GPIO reset failed
[    1.002984] libphy: Fixed MDIO Bus: probed
[    1.022549] mdio_bus 4a101000.mdio: GPIO lookup for consumer reset
[    1.022562] mdio_bus 4a101000.mdio: using lookup tables for GPIO lookup
[    1.022569] mdio_bus 4a101000.mdio: lookup for GPIO reset failed
[    1.080052] davinci_mdio 4a101000.mdio: davinci mdio revision 1.6, bus freq 1000000
[    1.087755] davinci_mdio 4a101000.mdio: detected phy mask fffffffe
[    1.095222] libphy: 4a101000.mdio: probed
[    1.099267] davinci_mdio 4a101000.mdio: phy[0]: device 4a101000.mdio:00, driver SMSC LAN8710/LAN8720
[    1.109354] cpsw 4a100000.ethernet: Detected MACID = c8:fd:19:f3:b3:c4
[    1.116052] cpsw 4a100000.ethernet: initialized cpsw ale version 1.4
[    1.122439] cpsw 4a100000.ethernet: ALE Table size 1024
[    1.127726] cpsw 4a100000.ethernet: cpts: overflow check period 500 (jiffies)
[    1.136281] PPP generic driver version 2.4.2
[    1.141306] i2c /dev entries driver
[    1.145258] IR NEC protocol handler initialized
[    1.149810] IR RC5(x/sz) protocol handler initialized
[    1.154884] IR RC6 protocol handler initialized
[    1.159435] IR JVC protocol handler initialized
[    1.163982] IR Sony protocol handler initialized
[    1.168617] IR SANYO protocol handler initialized
[    1.173338] IR Sharp protocol handler initialized
[    1.178060] IR MCE Keyboard/mouse protocol handler initialized
[    1.183915] IR XMP protocol handler initialized
[    1.189356] sdhci: Secure Digital Host Controller Interface driver
[    1.195565] sdhci: Copyright(c) Pierre Ossman
[    1.200576] omap_hsmmc 48060000.mmc: GPIO lookup for consumer cd
[    1.200585] omap_hsmmc 48060000.mmc: using device tree for GPIO lookup
[    1.200625] of_get_named_gpiod_flags: parsed 'cd-gpios' property of node '/ocp/mmc@48060000[0]' - status (0)
[    1.200690] omap_hsmmc 48060000.mmc: Got CD GPIO
[    1.205342] omap_hsmmc 48060000.mmc: GPIO lookup for consumer wp
[    1.205347] omap_hsmmc 48060000.mmc: using device tree for GPIO lookup
[    1.205356] of_get_named_gpiod_flags: can't parse 'wp-gpios' property of node '/ocp/mmc@48060000[0]'
[    1.205364] of_get_named_gpiod_flags: can't parse 'wp-gpio' property of node '/ocp/mmc@48060000[0]'
[    1.205370] omap_hsmmc 48060000.mmc: using lookup tables for GPIO lookup
[    1.205378] omap_hsmmc 48060000.mmc: lookup for GPIO wp failed
[    1.260612] omap_hsmmc 481d8000.mmc: GPIO lookup for consumer cd
[    1.260624] omap_hsmmc 481d8000.mmc: using device tree for GPIO lookup
[    1.260640] of_get_named_gpiod_flags: can't parse 'cd-gpios' property of node '/ocp/mmc@481d8000[0]'
[    1.260648] of_get_named_gpiod_flags: can't parse 'cd-gpio' property of node '/ocp/mmc@481d8000[0]'
[    1.260654] omap_hsmmc 481d8000.mmc: using lookup tables for GPIO lookup
[    1.260660] omap_hsmmc 481d8000.mmc: lookup for GPIO cd failed
[    1.260668] omap_hsmmc 481d8000.mmc: GPIO lookup for consumer wp
[    1.260673] omap_hsmmc 481d8000.mmc: using device tree for GPIO lookup
[    1.260680] of_get_named_gpiod_flags: can't parse 'wp-gpios' property of node '/ocp/mmc@481d8000[0]'
[    1.260686] of_get_named_gpiod_flags: can't parse 'wp-gpio' property of node '/ocp/mmc@481d8000[0]'
[    1.260691] omap_hsmmc 481d8000.mmc: using lookup tables for GPIO lookup
[    1.260697] omap_hsmmc 481d8000.mmc: lookup for GPIO wp failed
[    1.320203] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.326614] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led2[0]' - status (0)
[    1.326674] no flags found for gpios
[    1.326827] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led3[0]' - status (0)
[    1.326857] no flags found for gpios
[    1.326988] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led4[0]' - status (0)
[    1.326994] no flags found for gpios
[    1.327083] of_get_named_gpiod_flags: parsed 'gpios' property of node '/leds/led5[0]' - status (0)
[    1.327089] no flags found for gpios
[    1.334782] NET: Registered protocol family 10
[    1.343482] Segment Routing with IPv6
[    1.347239] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    1.353933] NET: Registered protocol family 17
[    1.358667] Key type dns_resolver registered
[    1.363106] omap_voltage_late_init: Voltage driver support not added
[    1.387869] mmc1: new high speed MMC card at address 0001
[    1.393867] mmcblk1: mmc1:0001 Q2J54A 3.59 GiB 
[    1.398599] mmcblk1boot0: mmc1:0001 Q2J54A partition 1 16.0 MiB
[    1.405131] mmcblk1boot1: mmc1:0001 Q2J54A partition 2 16.0 MiB
[    1.411801] mmcblk1rpmb: mmc1:0001 Q2J54A partition 3 512 KiB
[    1.414187] tps65217 0-0024: TPS65217 ID 0xe version 1.2
[    1.414570] omap_i2c 44e0b000.i2c: bus 0 rev0.11 at 400 kHz
[    1.421142] rtc-ds1307 1-0068: writing trickle charger info 0xaa to 0xa
[    1.434726]  mmcblk1: p1 p2 p3 p4 < p5 p6 p7 >
[    1.450812] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[    1.450832] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[    1.451163] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[    1.451173] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[    1.451367] rtc-ds1307 1-0068: char device (253:0)
[    1.451394] rtc-ds1307 1-0068: registered as rtc0
[    1.456223] omap_i2c 4802a000.i2c: bus 1 rev0.11 at 400 kHz
[    1.462725] rtc-ds1307 1-0068: read: 28 49 13 02 17 08 20
[    1.462740] rtc-ds1307 1-0068: read secs=28, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[    1.462774] rtc-ds1307 1-0068: setting system clock to 2020-08-17 13:49:28 UTC (1597672168)
[    1.471662] ALSA device list:
[    1.474651]   No soundcards found.
[    1.530218] EXT4-fs (mmcblk1p3): warning: maximal mount count reached, running e2fsck is recommended
[    1.541310] EXT4-fs (mmcblk1p3): recovery complete
[    1.547270] EXT4-fs (mmcblk1p3): mounted filesystem with ordered data mode. Opts: (null)
[    1.555477] VFS: Mounted root (ext4 filesystem) on device 179:3.
[    1.561666] devtmpfs: mounted
[    1.565941] Freeing unused kernel memory: 1024K
[    1.866284] systemd[1]: systemd 234 running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -S)
[    1.887799] systemd[1]: Detected architecture arm.
[    1.920384] systemd[1]: No hostname configured.
[    1.924988] systemd[1]: Set hostname to <localhost>.
[    2.393398] systemd[1]: systemd-networkd.socket: Socket service systemd-networkd.service not loaded, refusing.
[    2.403634] systemd[1]: Failed to listen on Network Service Netlink Socket.
[    2.470285] random: systemd: uninitialized urandom read (16 bytes read)
[    2.477360] systemd[1]: Listening on udev Control Socket.
[    2.510292] random: systemd: uninitialized urandom read (16 bytes read)
[    2.517376] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    2.560236] random: systemd: uninitialized urandom read (16 bytes read)
[    2.567278] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    2.610687] systemd[1]: Listening on Journal Socket.
[    2.898883] cryptodev: loading out-of-tree module taints kernel.
[    2.906899] cryptodev: driver 1.9 loaded.
[    3.222514] EXT4-fs (mmcblk1p3): re-mounted. Opts: (null)
[    3.901208] systemd-journald[91]: Received request to flush runtime journal from PID 1
[    6.290254] omap_wdt: OMAP Watchdog Timer Rev 0x01: initial timeout 60 sec
[    6.413102] at24 0-0050: 32768 byte 24c256 EEPROM, writable, 1 bytes/write
[    6.469458] omap_rtc 44e3e000.rtc: already running
[    6.515573] omap_rtc 44e3e000.rtc: char device (253:1)
[    6.515682] omap_rtc 44e3e000.rtc: registered as rtc1
[    6.648182] of_get_named_gpiod_flags: parsed 'reset-gpios' property of node '/ocp/i2c@4802a000/usb2513@2C[0]' - status (0)
[    6.683223] usb251xb 1-002c: configuring block 0 failed: -121
[    6.689021] usb251xb 1-002c: Failed to connect hub (-121)
[    6.793073] usb251xb: probe of 1-002c failed with error -121
[    7.480448] omap-sham 53100000.sham: hw accel on OMAP rev 4.3
[    7.596580] omap-aes 53500000.aes: OMAP AES hw accel rev: 3.2
[    7.685876] omap-aes 53500000.aes: will run requests pump with realtime priority
[    7.711561] remoteproc remoteproc0: wkup_m3 is available
[    7.794449] remoteproc remoteproc0: powering up wkup_m3
[    7.805530] PM: Cannot get wkup_m3_ipc handle
[    7.843277] remoteproc remoteproc0: Booting fw image am335x-pm-firmware.elf, size 224680
[    7.843532] remoteproc remoteproc0: remote processor wkup_m3 is now up
[    7.843591] wkup_m3_ipc 44e11324.wkup_m3_ipc: CM3 Firmware Version = 0x192
[    8.385349] PM: bootloader does not support rtc-only!
[   10.935431] EXT4-fs (mmcblk1p7): recovery complete
[   10.979263] EXT4-fs (mmcblk1p7): mounted filesystem with ordered data mode. Opts: (null)
[   11.718852] EXT4-fs (mmcblk1p2): warning: maximal mount count reached, running e2fsck is recommended
[   11.836654] EXT4-fs (mmcblk1p2): recovery complete
[   11.876505] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
[   11.900815] EXT4-fs (mmcblk1p5): recovery complete
[   11.910376] EXT4-fs (mmcblk1p5): mounted filesystem with ordered data mode. Opts: (null)
[   11.934360] FAT-fs (mmcblk1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[   13.091042] EXT4-fs (mmcblk1p6): recovery complete
[   13.122446] EXT4-fs (mmcblk1p6): mounted filesystem with ordered data mode. Opts: (null)
[   16.022565] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer reset
[   16.022582] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
[   16.022605] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[   16.022615] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[   16.022621] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
[   16.022629] am335x-phy-driver 47401300.usb-phy: lookup for GPIO reset failed
[   16.022637] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer vbus-detect
[   16.022642] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
[   16.022651] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[   16.022660] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
[   16.022665] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
[   16.022671] am335x-phy-driver 47401300.usb-phy: lookup for GPIO vbus-detect failed
[   16.022752] am335x-phy-driver 47401300.usb-phy: 47401300.usb-phy supply vcc not found, using dummy regulator
[   16.104145] usbcore: registered new interface driver usbfs
[   16.104211] usbcore: registered new interface driver hub
[   16.104373] usbcore: registered new device driver usb
[   16.429470] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer reset
[   16.429488] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
[   16.429509] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[   16.429518] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[   16.429525] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
[   16.429532] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO reset failed
[   16.429542] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer vbus-detect
[   16.429547] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
[   16.429555] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[   16.429563] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
[   16.429569] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
[   16.429575] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO vbus-detect failed
[   16.429657] am335x-phy-driver 47401b00.usb-phy: 47401b00.usb-phy supply vcc not found, using dummy regulator
[   16.565747] musb-hdrc musb-hdrc.1: MUSB HDRC host driver
[   16.626166] musb-hdrc musb-hdrc.1: new USB bus registered, assigned bus number 1
[   16.746263] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[   16.823080] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   16.888813] usb usb1: Product: MUSB HDRC host driver
[   16.964915] usb usb1: Manufacturer: Linux 4.14.71-rt44-g52ea6d10d0 musb-hcd
[   17.038402] usb usb1: SerialNumber: musb-hdrc.1
[   17.134968] hub 1-0:1.0: USB hub found
[   17.203927] hub 1-0:1.0: 1 port detected
[   17.710217] usb 1-1: new high-speed USB device number 2 using musb-hdrc
[   17.920555] usb 1-1: New USB device found, idVendor=0424, idProduct=2513
[   17.927312] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   17.970403] hub 1-1:1.0: USB hub found
[   17.987705] hub 1-1:1.0: 3 ports detected
[   18.320548] usb 1-1.2: new high-speed USB device number 3 using musb-hdrc
[   18.461036] usb 1-1.2: New USB device found, idVendor=0bda, idProduct=1a2b
[   18.467965] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   18.493636] usb 1-1.2: Product: DISK
[   18.497240] usb 1-1.2: Manufacturer: D-Link Corporation
[   18.684162] SCSI subsystem initialized
[   18.728737] usb-storage 1-1.2:1.0: USB Mass Storage device detected
[   18.732865] usb 1-1.2: USB disconnect, device number 3
[   18.768270] scsi host0: usb-storage 1-1.2:1.0
[   18.789024] usbcore: registered new interface driver usb-storage
[   19.110510] usb 1-1.2: new high-speed USB device number 4 using musb-hdrc
[   19.251106] usb 1-1.2: New USB device found, idVendor=2001, idProduct=331d
[   19.258034] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   19.283096] usb 1-1.2: Product: DWA-171
[   19.286960] usb 1-1.2: Manufacturer: D-Link Corporation
[   19.309264] usb 1-1.2: SerialNumber: 123456
[   19.775644] usbcore: registered new interface driver rtl8821cu
[   20.050160] usb 1-1.1: new high-speed USB device number 5 using musb-hdrc
[   20.377902] using random self ethernet address
[   20.382514] using random host ethernet address
[   20.486796] usb0: HOST MAC 1a:0c:1d:ce:a7:e7
[   20.503378] usb0: MAC e2:d8:47:03:d4:46
[   20.600254] rtc-ds1307 1-0068: write secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[   20.600276] rtc-ds1307 1-0068: write: 47 49 13 02 17 08 20
[   20.600992] rtc-ds1307 1-0068: read: 47 49 13 02 17 08 20
[   20.601007] rtc-ds1307 1-0068: read secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
[   20.742467] IPv6: ADDRCONF(NETDEV_UP): usb0: link is not ready
[   21.590193] usb 1-1.1: new high-speed USB device number 6 using musb-hdrc
[   21.754665] usb 1-1.1: New USB device found, idVendor=1bc7, idProduct=0025
[   21.785998] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   21.830532] usb 1-1.1: Product: 6 CDC-ACM + 1 CDC-ECM
[   21.856436] usb 1-1.1: Manufacturer: Telit
[   21.879108] usb 1-1.1: SerialNumber: 357152071476111
[   22.243883] cdc_acm 1-1.1:1.0: ttyACM0: USB ACM device
[   22.358214] cdc_acm 1-1.1:1.2: ttyACM1: USB ACM device
[   22.483480] cdc_acm 1-1.1:1.4: ttyACM2: USB ACM device
[   22.602718] cdc_ether 1-1.1:1.12 wwan0: register 'cdc_ether' at usb-musb-hdrc.1-1.1, Mobile Broadband Network Device, 00:00:11:12:13:14
[   22.712480] cdc_acm 1-1.1:1.6: ttyACM3: USB ACM device
[   22.723596] usbcore: registered new interface driver cdc_ether
[   22.761882] cdc_acm 1-1.1:1.8: ttyACM4: USB ACM device
[   22.859776] cdc_acm 1-1.1:1.10: ttyACM5: USB ACM device
[   22.949366] usbcore: registered new interface driver cdc_acm
[   22.994362] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[   23.510228] net eth0: initializing cpsw version 1.12 (0)
[   23.661786] SMSC LAN8710/LAN8720 4a101000.mdio:00: attached PHY driver [SMSC LAN8710/LAN8720] (mii_bus:phy_addr=4a101000.mdio:00, irq=POLL)
[   23.717859] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   24.782157] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[   89.871406] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   96.987422] rtc-ds1307 1-0068: write secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
[   96.987444] rtc-ds1307 1-0068: write: 01 51 13 02 17 08 20
[   96.988220] rtc-ds1307 1-0068: read: 01 51 13 02 17 08 20
[   96.988234] rtc-ds1307 1-0068: read secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
[  125.946427] watchdog: watchdog0: watchdog did not stop!
1597672984 clf@5.238:~$ 

2020-08-17T07:14:20.699475+00:00 MiWiFi-R3L-srv kernel: [147304.362744] rtc-ds1307 1-0068: write secs=20, mins=14, hours=7, mday=17, mon=7, year=120, wday=1
2020-08-17T07:14:20.699557+00:00 MiWiFi-R3L-srv kernel: [147304.362766] rtc-ds1307 1-0068: write: 20 14 07 02 17 08 20
2020-08-17T07:14:20.709361+00:00 MiWiFi-R3L-srv kernel: [147304.372857] rtc-ds1307 1-0068: read: 20 14 07 02 17 08 20
2020-08-17T07:14:20.709415+00:00 MiWiFi-R3L-srv kernel: [147304.372884] rtc-ds1307 1-0068: read secs=20, mins=14, hours=7, mday=17, mon=7, year=120, wday=1
2020-08-17T07:19:46.042413+00:00 MiWiFi-R3L-srv kernel: [147628.664262] rtc-ds1307 1-0068: write secs=46, mins=19, hours=7, mday=17, mon=7, year=120, wday=1
2020-08-17T07:19:46.042492+00:00 MiWiFi-R3L-srv kernel: [147628.664283] rtc-ds1307 1-0068: write: 46 19 07 02 17 08 20
2020-08-17T07:19:46.042503+00:00 MiWiFi-R3L-srv kernel: [147628.665039] rtc-ds1307 1-0068: read: 46 19 07 02 17 08 20
2020-08-17T07:19:46.042513+00:00 MiWiFi-R3L-srv kernel: [147628.665054] rtc-ds1307 1-0068: read secs=46, mins=19, hours=7, mday=17, mon=7, year=120, wday=1
2020-08-17T08:41:06.414650+00:00 MiWiFi-R3L-srv kernel: [152508.049142] sched: RT throttling activated
2020-08-17T08:41:08.485154+00:00 MiWiFi-R3L-srv kernel: [152509.075407] NOHZ: local_softirq_pending 102
2020-08-17T08:41:08.485211+00:00 MiWiFi-R3L-srv kernel: [152511.059670] usb 1-1-port1: disabled by hub (EMI?), re-enabling...
2020-08-17T08:41:08.485222+00:00 MiWiFi-R3L-srv kernel: [152511.071122] usb 1-1.1: USB disconnect, device number 6
2020-08-17T08:41:08.485232+00:00 MiWiFi-R3L-srv kernel: [152511.100282] cdc_acm 1-1.1:1.6: acm_ctrl_irq - usb_submit_urb failed: -19
2020-08-17T08:41:08.532352+00:00 MiWiFi-R3L-srv kernel: [152511.120539] cdc_acm 1-1.1:1.6: failed to set dtr/rts
2020-08-17T08:41:08.722398+00:00 MiWiFi-R3L-srv kernel: [152511.242281] cdc_ether 1-1.1:1.12 wwan0: unregister 'cdc_ether' usb-musb-hdrc.1-1.1, Mobile Broadband Network Device
2020-08-17T08:41:09.122221+00:00 MiWiFi-R3L-srv kernel: [152511.739180] usb 1-1.1: new high-speed USB device number 7 using musb-hdrc
2020-08-17T08:41:09.262193+00:00 MiWiFi-R3L-srv kernel: [152511.878680] usb 1-1.1: New USB device found, idVendor=1bc7, idProduct=0025
2020-08-17T08:41:09.262265+00:00 MiWiFi-R3L-srv kernel: [152511.885696] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
2020-08-17T08:41:09.272303+00:00 MiWiFi-R3L-srv kernel: [152511.894822] usb 1-1.1: Product: 6 CDC-ACM + 1 CDC-ECM
2020-08-17T08:41:09.282313+00:00 MiWiFi-R3L-srv kernel: [152511.901418] usb 1-1.1: Manufacturer: Telit
2020-08-17T08:41:09.282365+00:00 MiWiFi-R3L-srv kernel: [152511.908248] usb 1-1.1: SerialNumber: 357152071476111
2020-08-17T08:41:09.342292+00:00 MiWiFi-R3L-srv kernel: [152511.956179] cdc_acm 1-1.1:1.0: ttyACM0: USB ACM device
2020-08-17T08:41:09.342372+00:00 MiWiFi-R3L-srv kernel: [152511.968210] cdc_acm 1-1.1:1.2: ttyACM1: USB ACM device
2020-08-17T08:41:09.372376+00:00 MiWiFi-R3L-srv kernel: [152511.986512] cdc_acm 1-1.1:1.4: ttyACM2: USB ACM device
2020-08-17T08:41:09.392390+00:00 MiWiFi-R3L-srv kernel: [152512.004413] cdc_acm 1-1.1:1.6: ttyACM4: USB ACM device
2020-08-17T08:41:09.412294+00:00 MiWiFi-R3L-srv kernel: [152512.024896] cdc_acm 1-1.1:1.8: ttyACM5: USB ACM device
2020-08-17T08:41:09.432361+00:00 MiWiFi-R3L-srv kernel: [152512.042576] cdc_acm 1-1.1:1.10: ttyACM6: USB ACM device
2020-08-17T08:41:09.472428+00:00 MiWiFi-R3L-srv kernel: [152512.073121] cdc_ether 1-1.1:1.12 wwan0: register 'cdc_ether' at usb-musb-hdrc.1-1.1, Mobile Broadband Network Device, 00:00:11:12:13:14
2020-08-17T13:26:37.804029+00:00 MiWiFi-R3L-srv kernel: [169640.412262] EXT4-fs (mmcblk1p3): warning: maximal mount count reached, running e2fsck is recommended
2020-08-17T13:26:37.804119+00:00 MiWiFi-R3L-srv kernel: [169640.424847] EXT4-fs (mmcblk1p3): re-mounted. Opts: (null)
2020-08-17T13:45:10.657222+00:00 MiWiFi-R3L-srv kernel: [170753.083937] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657309+00:00 MiWiFi-R3L-srv kernel: [170753.112464] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657325+00:00 MiWiFi-R3L-srv kernel: [170753.140957] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657336+00:00 MiWiFi-R3L-srv kernel: [170753.169446] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657347+00:00 MiWiFi-R3L-srv kernel: [170753.197930] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657357+00:00 MiWiFi-R3L-srv kernel: [170753.226417] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:45:10.657367+00:00 MiWiFi-R3L-srv kernel: [170753.254900] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T13:49:38.017541+00:00 localhost kernel: [   10.935431] EXT4-fs (mmcblk1p7): recovery complete
2020-08-17T13:49:38.017600+00:00 localhost kernel: [   10.979263] EXT4-fs (mmcblk1p7): mounted filesystem with ordered data mode. Opts: (null)
2020-08-17T13:49:38.767368+00:00 localhost kernel: [   11.718852] EXT4-fs (mmcblk1p2): warning: maximal mount count reached, running e2fsck is recommended
2020-08-17T13:49:38.917442+00:00 localhost kernel: [   11.836654] EXT4-fs (mmcblk1p2): recovery complete
2020-08-17T13:49:38.917497+00:00 localhost kernel: [   11.876505] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
2020-08-17T13:49:39.367738+00:00 localhost kernel: [   11.900815] EXT4-fs (mmcblk1p5): recovery complete
2020-08-17T13:49:39.367796+00:00 localhost kernel: [   11.910376] EXT4-fs (mmcblk1p5): mounted filesystem with ordered data mode. Opts: (null)
2020-08-17T13:49:39.367807+00:00 localhost kernel: [   11.934360] FAT-fs (mmcblk1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
2020-08-17T13:49:40.137702+00:00 localhost kernel: [   13.091042] EXT4-fs (mmcblk1p6): recovery complete
2020-08-17T13:49:40.257434+00:00 localhost kernel: [   13.122446] EXT4-fs (mmcblk1p6): mounted filesystem with ordered data mode. Opts: (null)
2020-08-17T13:49:43.067545+00:00 localhost kernel: [   16.022565] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer reset
2020-08-17T13:49:43.067627+00:00 localhost kernel: [   16.022582] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
2020-08-17T13:49:43.067641+00:00 localhost kernel: [   16.022605] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
2020-08-17T13:49:43.067653+00:00 localhost kernel: [   16.022615] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
2020-08-17T13:49:43.067664+00:00 localhost kernel: [   16.022621] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
2020-08-17T13:49:43.067673+00:00 localhost kernel: [   16.022629] am335x-phy-driver 47401300.usb-phy: lookup for GPIO reset failed
2020-08-17T13:49:43.067682+00:00 localhost kernel: [   16.022637] am335x-phy-driver 47401300.usb-phy: GPIO lookup for consumer vbus-detect
2020-08-17T13:49:43.067691+00:00 localhost kernel: [   16.022642] am335x-phy-driver 47401300.usb-phy: using device tree for GPIO lookup
2020-08-17T13:49:43.067701+00:00 localhost kernel: [   16.022651] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
2020-08-17T13:49:43.067711+00:00 localhost kernel: [   16.022660] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401300[0]'
2020-08-17T13:49:43.067720+00:00 localhost kernel: [   16.022665] am335x-phy-driver 47401300.usb-phy: using lookup tables for GPIO lookup
2020-08-17T13:49:43.067729+00:00 localhost kernel: [   16.022671] am335x-phy-driver 47401300.usb-phy: lookup for GPIO vbus-detect failed
2020-08-17T13:49:43.067738+00:00 localhost kernel: [   16.022752] am335x-phy-driver 47401300.usb-phy: 47401300.usb-phy supply vcc not found, using dummy regulator
2020-08-17T13:49:43.377578+00:00 localhost kernel: [   16.104145] usbcore: registered new interface driver usbfs
2020-08-17T13:49:43.377652+00:00 localhost kernel: [   16.104211] usbcore: registered new interface driver hub
2020-08-17T13:49:43.377665+00:00 localhost kernel: [   16.104373] usbcore: registered new device driver usb
2020-08-17T13:49:43.467493+00:00 localhost kernel: [   16.429470] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer reset
2020-08-17T13:49:43.467551+00:00 localhost kernel: [   16.429488] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
2020-08-17T13:49:43.467565+00:00 localhost kernel: [   16.429509] of_get_named_gpiod_flags: can't parse 'reset-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
2020-08-17T13:49:43.467576+00:00 localhost kernel: [   16.429518] of_get_named_gpiod_flags: can't parse 'reset-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
2020-08-17T13:49:43.467586+00:00 localhost kernel: [   16.429525] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
2020-08-17T13:49:43.467595+00:00 localhost kernel: [   16.429532] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO reset failed
2020-08-17T13:49:43.467604+00:00 localhost kernel: [   16.429542] am335x-phy-driver 47401b00.usb-phy: GPIO lookup for consumer vbus-detect
2020-08-17T13:49:43.467612+00:00 localhost kernel: [   16.429547] am335x-phy-driver 47401b00.usb-phy: using device tree for GPIO lookup
2020-08-17T13:49:43.467621+00:00 localhost kernel: [   16.429555] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpios' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
2020-08-17T13:49:43.467630+00:00 localhost kernel: [   16.429563] of_get_named_gpiod_flags: can't parse 'vbus-detect-gpio' property of node '/ocp/usb@47400000/usb-phy@47401b00[0]'
2020-08-17T13:49:43.467639+00:00 localhost kernel: [   16.429569] am335x-phy-driver 47401b00.usb-phy: using lookup tables for GPIO lookup
2020-08-17T13:49:43.467648+00:00 localhost kernel: [   16.429575] am335x-phy-driver 47401b00.usb-phy: lookup for GPIO vbus-detect failed
2020-08-17T13:49:43.467657+00:00 localhost kernel: [   16.429657] am335x-phy-driver 47401b00.usb-phy: 47401b00.usb-phy supply vcc not found, using dummy regulator
2020-08-17T13:49:43.667410+00:00 localhost kernel: [   16.565747] musb-hdrc musb-hdrc.1: MUSB HDRC host driver
2020-08-17T13:49:43.667488+00:00 localhost kernel: [   16.626166] musb-hdrc musb-hdrc.1: new USB bus registered, assigned bus number 1
2020-08-17T13:49:43.847510+00:00 localhost kernel: [   16.746263] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
2020-08-17T13:49:43.927405+00:00 localhost kernel: [   16.823080] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
2020-08-17T13:49:43.927461+00:00 localhost kernel: [   16.888813] usb usb1: Product: MUSB HDRC host driver
2020-08-17T13:49:44.007407+00:00 localhost kernel: [   16.964915] usb usb1: Manufacturer: Linux 4.14.71-rt44-g52ea6d10d0 musb-hcd
2020-08-17T13:49:44.077592+00:00 localhost kernel: [   17.038402] usb usb1: SerialNumber: musb-hdrc.1
2020-08-17T13:49:44.227454+00:00 localhost kernel: [   17.134968] hub 1-0:1.0: USB hub found
2020-08-17T13:49:44.247373+00:00 localhost kernel: [   17.203927] hub 1-0:1.0: 1 port detected
2020-08-17T13:49:44.757416+00:00 localhost kernel: [   17.710217] usb 1-1: new high-speed USB device number 2 using musb-hdrc
2020-08-17T13:49:44.967344+00:00 localhost kernel: [   17.920555] usb 1-1: New USB device found, idVendor=0424, idProduct=2513
2020-08-17T13:49:44.967403+00:00 localhost kernel: [   17.927312] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
2020-08-17T13:49:45.017584+00:00 localhost kernel: [   17.970403] hub 1-1:1.0: USB hub found
2020-08-17T13:49:45.047613+00:00 localhost kernel: [   17.987705] hub 1-1:1.0: 3 ports detected
2020-08-17T13:49:45.367785+00:00 localhost kernel: [   18.320548] usb 1-1.2: new high-speed USB device number 3 using musb-hdrc
2020-08-17T13:49:45.507641+00:00 localhost kernel: [   18.461036] usb 1-1.2: New USB device found, idVendor=0bda, idProduct=1a2b
2020-08-17T13:49:45.507726+00:00 localhost kernel: [   18.467965] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
2020-08-17T13:49:45.537665+00:00 localhost kernel: [   18.493636] usb 1-1.2: Product: DISK
2020-08-17T13:49:45.537735+00:00 localhost kernel: [   18.497240] usb 1-1.2: Manufacturer: D-Link Corporation
2020-08-17T13:49:45.727673+00:00 localhost kernel: [   18.684162] SCSI subsystem initialized
2020-08-17T13:49:45.787472+00:00 localhost kernel: [   18.728737] usb-storage 1-1.2:1.0: USB Mass Storage device detected
2020-08-17T13:49:45.787547+00:00 localhost kernel: [   18.732865] usb 1-1.2: USB disconnect, device number 3
2020-08-17T13:49:45.817669+00:00 localhost kernel: [   18.768270] scsi host0: usb-storage 1-1.2:1.0
2020-08-17T13:49:45.847660+00:00 localhost kernel: [   18.789024] usbcore: registered new interface driver usb-storage
2020-08-17T13:49:46.157794+00:00 localhost kernel: [   19.110510] usb 1-1.2: new high-speed USB device number 4 using musb-hdrc
2020-08-17T13:49:46.297669+00:00 localhost kernel: [   19.251106] usb 1-1.2: New USB device found, idVendor=2001, idProduct=331d
2020-08-17T13:49:46.297754+00:00 localhost kernel: [   19.258034] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
2020-08-17T13:49:46.327332+00:00 localhost kernel: [   19.283096] usb 1-1.2: Product: DWA-171
2020-08-17T13:49:46.327393+00:00 localhost kernel: [   19.286960] usb 1-1.2: Manufacturer: D-Link Corporation
2020-08-17T13:49:46.347580+00:00 localhost kernel: [   19.309264] usb 1-1.2: SerialNumber: 123456
2020-08-17T13:49:46.827515+00:00 localhost kernel: [   19.775644] usbcore: registered new interface driver rtl8821cu
2020-08-17T13:49:47.097408+00:00 localhost kernel: [   20.050160] usb 1-1.1: new high-speed USB device number 5 using musb-hdrc
2020-08-17T13:49:47.427672+00:00 localhost kernel: [   20.377902] using random self ethernet address
2020-08-17T13:49:47.427755+00:00 localhost kernel: [   20.382514] using random host ethernet address
2020-08-17T13:49:47.537507+00:00 localhost kernel: [   20.486796] usb0: HOST MAC 1a:0c:1d:ce:a7:e7
2020-08-17T13:49:47.547394+00:00 localhost kernel: [   20.503378] usb0: MAC e2:d8:47:03:d4:46
2020-08-17T13:49:47.647566+00:00 localhost kernel: [   20.600254] rtc-ds1307 1-0068: write secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
2020-08-17T13:49:47.647623+00:00 localhost kernel: [   20.600276] rtc-ds1307 1-0068: write: 47 49 13 02 17 08 20
2020-08-17T13:49:47.647633+00:00 localhost kernel: [   20.600992] rtc-ds1307 1-0068: read: 47 49 13 02 17 08 20
2020-08-17T13:49:47.647643+00:00 localhost kernel: [   20.601007] rtc-ds1307 1-0068: read secs=47, mins=49, hours=13, mday=17, mon=7, year=120, wday=1
2020-08-17T13:49:47.797614+00:00 localhost kernel: [   20.742467] IPv6: ADDRCONF(NETDEV_UP): usb0: link is not ready
2020-08-17T13:49:48.657467+00:00 localhost kernel: [   21.590193] usb 1-1.1: new high-speed USB device number 6 using musb-hdrc
2020-08-17T13:49:48.827462+00:00 localhost kernel: [   21.754665] usb 1-1.1: New USB device found, idVendor=1bc7, idProduct=0025
2020-08-17T13:49:48.827542+00:00 localhost kernel: [   21.785998] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
2020-08-17T13:49:48.877434+00:00 localhost kernel: [   21.830532] usb 1-1.1: Product: 6 CDC-ACM + 1 CDC-ECM
2020-08-17T13:49:48.897487+00:00 localhost kernel: [   21.856436] usb 1-1.1: Manufacturer: Telit
2020-08-17T13:49:48.917449+00:00 localhost kernel: [   21.879108] usb 1-1.1: SerialNumber: 357152071476111
2020-08-17T13:49:49.287405+00:00 localhost kernel: [   22.243883] cdc_acm 1-1.1:1.0: ttyACM0: USB ACM device
2020-08-17T13:49:49.487523+00:00 localhost kernel: [   22.358214] cdc_acm 1-1.1:1.2: ttyACM1: USB ACM device
2020-08-17T13:49:49.607558+00:00 localhost kernel: [   22.483480] cdc_acm 1-1.1:1.4: ttyACM2: USB ACM device
2020-08-17T13:49:49.737504+00:00 localhost kernel: [   22.602718] cdc_ether 1-1.1:1.12 wwan0: register 'cdc_ether' at usb-musb-hdrc.1-1.1, Mobile Broadband Network Device, 00:00:11:12:13:14
2020-08-17T13:49:49.757415+00:00 localhost kernel: [   22.712480] cdc_acm 1-1.1:1.6: ttyACM3: USB ACM device
2020-08-17T13:49:49.767420+00:00 localhost kernel: [   22.723596] usbcore: registered new interface driver cdc_ether
2020-08-17T13:49:49.807554+00:00 localhost kernel: [   22.761882] cdc_acm 1-1.1:1.8: ttyACM4: USB ACM device
2020-08-17T13:49:49.927518+00:00 localhost kernel: [   22.859776] cdc_acm 1-1.1:1.10: ttyACM5: USB ACM device
2020-08-17T13:49:50.037574+00:00 localhost kernel: [   22.949366] usbcore: registered new interface driver cdc_acm
2020-08-17T13:49:50.037633+00:00 localhost kernel: [   22.994362] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
2020-08-17T13:49:50.557600+00:00 localhost kernel: [   23.510228] net eth0: initializing cpsw version 1.12 (0)
2020-08-17T13:49:50.727456+00:00 localhost kernel: [   23.661786] SMSC LAN8710/LAN8720 4a101000.mdio:00: attached PHY driver [SMSC LAN8710/LAN8720] (mii_bus:phy_addr=4a101000.mdio:00, irq=POLL)
2020-08-17T13:49:50.777524+00:00 localhost kernel: [   23.717859] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
2020-08-17T13:49:51.827461+00:00 localhost kernel: [   24.782157] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
2020-08-17T13:50:56.918225+00:00 localhost kernel: [   89.871406] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
2020-08-17T13:51:01.286238+00:00 localhost kernel: [   96.987422] rtc-ds1307 1-0068: write secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
2020-08-17T13:51:01.286317+00:00 localhost kernel: [   96.987444] rtc-ds1307 1-0068: write: 01 51 13 02 17 08 20
2020-08-17T13:51:01.286329+00:00 localhost kernel: [   96.988220] rtc-ds1307 1-0068: read: 01 51 13 02 17 08 20
2020-08-17T13:51:01.286339+00:00 localhost kernel: [   96.988234] rtc-ds1307 1-0068: read secs=1, mins=51, hours=13, mday=17, mon=7, year=120, wday=1
2020-08-17T13:51:30.256167+00:00 localhost kernel: [  125.946427] watchdog: watchdog0: watchdog did not stop!
2020-08-17T14:08:38.196597+00:00 localhost kernel: [ 1153.843444] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T14:08:38.196676+00:00 localhost kernel: [ 1153.872011] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) show-blocked-tasks(w) 
2020-08-17T14:08:38.206178+00:00 localhost kernel: [ 1153.902553] ttyS ttyS0: 1 input overrun(s)
2020-08-17T14:08:41.376400+00:00 localhost kernel: [ 1157.067898] ttyS ttyS0: 1 input overrun(s)

The kernel logs do not have the error "Internal error: Oops - undefined instruction".

Can you please provide a log with the error messages?

Hi Liu,

Actual problem is, we are not observing this "Internal error: Oops - undefined instruction" in any of the dmesg, kern.log, syslog or messages in /var/log/.

This is observed only when it is connected to uart console and when it occurs ("Internal error: Oops - undefined instruction" ) our device is rebooted. 

Regards,

Kiran 

Okay, is the line below in the uart console log the first line when the issue happens? Or is there any other message before this line?

Kiran kumar13 said:

Internal error: Oops - undefined instruction: 0 [#1] PREEMPT ARM

[166426.830246] Modules linked in: usb_f_acm u_serial usb_f_rndis u_ether libcomposite 8821cu(O) usb_storage scsi_mod musb_dsps musb_hdrc

yes Bin, this is the sequence of error.

Internal error: Oops - undefined instruction: 0 [#1] PREEMPT ARM

Modules linked in: cdc_ether usbnet cdc_acm usb_f_acm u_serial usb_f_rndis u_ether libcomposite 8821cu(O) cfg80211 usb_storage s csi_mod musb_dsps musb_hdrc udc_core phy_am335x usbcore phy_generic phy_am335x_control usb_common sha512_generic sha512_arm sha256_generic sha1 _generic sha1_arm md5 des_generic cbc wkup_m3_rproc pm33xx omap_aes_driver wkup_m3_ipc crypto_engine remoteproc omap_sham omap_crypto ti_emif_s ram at24 usb251xb rtc_omap musb_am335x omap_wdt sch_fq_codel cryptodev(O)

Kiran,

Kiran kumar13 said:

[166426.830464] PC is at cppi41_dma_channel_program+0x31c/0x50c [musb_hdrc]

Function cppi41_dma_channel_program() has one place which uses BUG_ON(). Can you please get the source code line number of offset 0x31c as in the log above using the instruction below so that we know if the issue is on the BUG_ON()?

$ gdb drivers/usb/musb/musb_hdrc.ko
(gdb) list *(cppi41_dma_channel_program+0x31c)

The following training video has details on how to get the line number.

https://training.ti.com/debugging-embedded-linux-kernel-oops-logs

Kiran,

After you get the line number in the kernel source code, can you please test with the kernel in the Processor SDK? The version v4.14.71 which you use is not in any of the Processor SDK release, so the kernel v4.14.71 is not supported on this forums.

Hi Bin,

Sure, I will get the details of the source code.

As per your comment kernel v4.14.71 is not in any of the processor SDK. 

Sorry when I download the code the branch(PROCESSOR_SDK),  Branch of linux kernel is ti-rt-linux-4.14.y ( we have branched off based on this and this is ti-linux-kernel only)

Regards,

Kiran

Okay, as long as you use the TI kernel from git.ti.com, you are supported.

Hi Liu,

Please find the requested info.

gdb vmlinux
GNU gdb (Ubuntu 8.2-0ubuntu1~14.04.1) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <gnu.org/.../gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<www.gnu.org/.../>.
Find the GDB manual and other documentation resources online at:
<www.gnu.org/.../>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from vmlinux...done.
(gdb) lx-symbols
loading vmlinux
(gdb) add-symbol-file drivers/usb/musb/musb_hdrc.ko
add symbol table from file drivers/usb/musb/musb_hdrc.ko"
(y or n) y
Reading symbols from drivers/usb/musb/musb_hdrc.ko...done.
(gdb) list *(cppi41_dma_channel_program+0x31c)
0x11fd0 is in cppi41_trans_done (/build/arago-tmp-external-linaro-toolchain/work-shared/am335x-gw15/kernel-source/drivers/usb/musb/musb_cppi41.c:124).
119 struct musb *musb = hw_ep->musb;
120 void __iomem *epio = hw_ep->regs;
121 u16 csr;
122
123 if (!cppi41_channel->prog_len ||
124 (cppi41_channel->channel.status == MUSB_DMA_STATUS_FREE)) {
125
126 /* done, complete */
127 cppi41_channel->channel.actual_len =
128 cppi41_channel->transferred;

Kiran,

Can you please double check the vmlinux and musb_hdrc.ko binaries you used in gdb are the ones running on your board? Because I am confused by the gdb results. The original kernel Oops log shows the PC is in function cppi41_dma_channel_program() but gdb says its offset 0x31c is in cppi41_trans_done(), and I don't see how the line 124 could trigger the "undefined instruction" kernel error.

One way you can validate is to copy out the kernel module musb_hdrc.ko from your board filesystem and use the gdb command I listed above to directly read the line number of cppi41_dma_channel_program+0x31c.

Or are you running gdb directly on the board not on a PC which builds the kernel? If so please ignore my previous response, but I am confused how line 124 could trigger the kernel Oops...

We have enabled all the DEBUG configs to build the KERNEL on same sources and ran the list command on host machine used to build it (on device it is only possible to run stripped sources only)

If this doesn't suffice the need, could you please give us the procedure to run it on device ?

Kiran,

The offset value in the Oops log would be different between the DEBUG on and DEBUG off kernels.

I suspect the Oops is triggered by the line BUG_ON() in cppi41_dma_channel_program(), but I think the following kernel patch will confirm it. Please apply the patch to your kernel, and if you see the log message "(NULL device *): before BUG()" right before the Oops message in the uart console, it confirms it; otherwise, the issue is somewhere else.

diff --git a/drivers/usb/musb/musb_cppi41.c b/drivers/usb/musb/musb_cppi41.c
index 1ec0a4947b6b..069ce398c0c7 100644
--- a/drivers/usb/musb/musb_cppi41.c
+++ b/drivers/usb/musb/musb_cppi41.c
@@ -527,8 +527,11 @@ static int cppi41_dma_channel_program(struct dma_channel *channel,
        struct cppi41_dma_channel *cppi41_channel = channel->private_data;
        int hb_mult = 0;

-       BUG_ON(channel->status == MUSB_DMA_STATUS_UNKNOWN ||
-               channel->status == MUSB_DMA_STATUS_BUSY);
+       if (channel->status == MUSB_DMA_STATUS_UNKNOWN ||
+               channel->status == MUSB_DMA_STATUS_BUSY) {
+               dev_err(NULL, "before BUG()\n");
+               BUG();
+       }

        if (is_host_active(cppi41_channel->controller->controller.musb)) {
                if (cppi41_channel->is_tx)

Liu,

When I built the image with the patch shared and flashed it on device. 

One device boot up itself I am observing the issue (Internal error: Oops), although the device is not restarted with this but seen this message on device boot log. May be this is not a valid one this might have happened with other changes (debug changes) . I will reconfirm it.

8.446335] Internal error: Oops: 80000007 [#1] PREEMPT ARM
[ 8.446341] Modules linked in: wkup_m3_rproc pm33xx omap_aes_driver(+) wkup_m3_ipc crypto_engine omap_crypto remoteproc omap_sham(+) ti_emif_sram usb251xb at24 musb_am)
[ 8.446390] CPU: 0 PID: 18 Comm: kworker/0:1 Tainted: G O 4.14.71-rt44-g6a3dcd5e69 #9
[ 8.446393] Hardware name: Generic AM33XX (Flattened Device Tree)
[ 8.446421] Workqueue: events deferred_probe_work_func
[ 8.446427] task: dc13b800 task.stack: dc1dc000
[ 8.446434] PC is at 0xbf096000
[ 8.446454] LR is at am33xx_pm_probe+0x84/0x190 [pm33xx]
[ 8.446458] pc : [<bf096000>] lr : [<bf091644>] psr: a00b0113
[ 8.446462] sp : dc1dddf0 ip : dc1dddc8 fp : dc1dde04
[ 8.446465] r10: c014c174 r9 : 00000000 r8 : 00000000
[ 8.446469] r7 : dc6f0a00 r6 : bf093014 r5 : dc6f0a10 r4 : dc6f0a00
[ 8.446474] r3 : bf093280 r2 : dc6d5900 r1 : bf092289 r0 : 3ffffff7
[ 8.446480] Flags: NzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
[ 8.446485] Control: 10c5387d Table: 9b494019 DAC: 00000051
[ 8.446490] Process kworker/0:1 (pid: 18, stack limit = 0xdc1dc208)
[ 8.446494] Stack: (0xdc1dddf0 to 0xdc1de000)
[ 8.446503] dde0: dc6f0a10 ffffffed dc1dde24 dc1dde08
[ 8.446512] de00: c066e4dc bf0915cc dc6f0a10 00000000 bf093014 00000010 dc1dde4c dc1dde28
[ 8.446521] de20: c066c658 c066e484 dc6f0a10 bf093014 dc1ddeb0 00000000 dcb3a200 00000000
[ 8.446531] de40: dc1dde64 dc1dde50 c066c86c c066c404 bf093014 dc6f0a10 dc1dde84 dc1dde68
[ 8.446540] de60: c066caa0 c066c820 00000000 dc1ddeb0 c066c9e8 00000000 dc1ddeac dc1dde88
[ 8.446549] de80: c066aaf0 c066c9f4 dc0c0a88 db450548 dc6f0a10 dc6f0a10 dc6f0a44 00000001
[ 8.446559] dea0: dc1dded4 dc1ddeb0 c066c758 c066aa9c dc6f0a10 00000001 dc6f0a10 c106d8f0
[ 8.446568] dec0: dc6f0a10 00000000 dc1ddee4 dc1dded8 c066cc6c c066c6ac dc1ddf04 dc1ddee8
[ 8.446577] dee0: c066b940 c066cc5c dc6f0a10 c106d6f4 c1012dd8 00000000 dc1ddf1c dc1ddf08
[ 8.446587] df00: c066be1c c066b8f8 dc1bb000 c106d6f4 dc1ddf54 dc1ddf20 c014bd90 c066bdfc
[ 8.446596] df20: 00000000 00000000 c1012dd8 dc1bb000 c1012dd8 dc1bb018 c1012dd8 00000008
[ 8.446606] df40: dc1bb000 c014c174 dc1ddf7c dc1ddf58 c014c314 c014bc6c dc1d8080 dc1ba000
[ 8.446615] df60: dc125e94 c0d0c76c 00000000 dc1bb000 dc1ddfac dc1ddf80 c0153034 c014c180
[ 8.446624] df80: dc1dc000 dc1ba000 c0152ecc 00000000 00000000 00000000 00000000 00000000
[ 8.446633] dfa0: 00000000 dc1ddfb0 c0108290 c0152ed8 00000000 00000000 00000000 00000000
[ 8.446642] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 8.446650] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 8.446652] Backtrace:
[ 8.446678] [<bf0915c0>] (am33xx_pm_probe [pm33xx]) from [<c066e4dc>] (platform_drv_probe+0x64/0xbc)
[ 8.446685] r5:ffffffed r4:dc6f0a10
[ 8.446695] [<c066e478>] (platform_drv_probe) from [<c066c658>] (really_probe+0x260/0x2a8)
[ 8.446702] r7:00000010 r6:bf093014 r5:00000000 r4:dc6f0a10
[ 8.446713] [<c066c3f8>] (really_probe) from [<c066c86c>] (driver_probe_device+0x58/0x94)
[ 8.446722] r9:00000000 r8:dcb3a200 r7:00000000 r6:dc1ddeb0 r5:bf093014 r4:dc6f0a10
[ 8.446732] [<c066c814>] (driver_probe_device) from [<c066caa0>] (__device_attach_driver+0xb8/0xc4)
[ 8.446737] r5:dc6f0a10 r4:bf093014
[ 8.446747] [<c066c9e8>] (__device_attach_driver) from [<c066aaf0>] (bus_for_each_drv+0x60/0x98)
[ 8.446753] r7:00000000 r6:c066c9e8 r5:dc1ddeb0 r4:00000000
[ 8.446762] [<c066aa90>] (bus_for_each_drv) from [<c066c758>] (__device_attach+0xb8/0x124)
[ 8.446767] r6:00000001 r5:dc6f0a44 r4:dc6f0a10
[ 8.446777] [<c066c6a0>] (__device_attach) from [<c066cc6c>] (device_initial_probe+0x1c/0x20)
[ 8.446783] r7:00000000 r6:dc6f0a10 r5:c106d8f0 r4:dc6f0a10
[ 8.446793] [<c066cc50>] (device_initial_probe) from [<c066b940>] (bus_probe_device+0x54/0x9c)
[ 8.446803] [<c066b8ec>] (bus_probe_device) from [<c066be1c>] (deferred_probe_work_func+0x2c/0xdc)
[ 8.446809] r7:00000000 r6:c1012dd8 r5:c106d6f4 r4:dc6f0a10
[ 8.446822] [<c066bdf0>] (deferred_probe_work_func) from [<c014bd90>] (process_one_work+0x130/0x4d4)
[ 8.446826] r5:c106d6f4 r4:dc1bb000
[ 8.446835] [<c014bc60>] (process_one_work) from [<c014c314>] (worker_thread+0x1a0/0x324)
[ 8.446844] r10:c014c174 r9:dc1bb000 r8:00000008 r7:c1012dd8 r6:dc1bb018 r5:c1012dd8
[ 8.446847] r4:dc1bb000
[ 8.446864] [<c014c174>] (worker_thread) from [<c0153034>] (kthread+0x168/0x170)
[ 8.446872] r9:dc1bb000 r8:00000000 r7:c0d0c76c r6:dc125e94 r5:dc1ba000 r4:dc1d8080
[ 8.446891] [<c0152ecc>] (kthread) from [<c0108290>] (ret_from_fork+0x14/0x24)
[ 8.446899] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0152ecc
[ 8.446903] r4:dc1ba000 r3:dc1dc000
[ 8.446911] Code: bad PC value
[ 8.446921] ---[ end trace 0000000000000002 ]---

Kiran,

The LR register in this new Oops log points to the am33xx_pm_probe() function, which is irrelevant to the musb debug change we just did, so this new Oops shouldn't be caused by the debug change in the musb driver.

Please run more test on multiple boards to see if you can find different Oops messages.

Agreed(please ignore the previous Oops shared) Liu, I am working on to reproduce the issue with the patch shared. Once it is reproduced I will share the logs with you.

Thanks. Please keep an eye on the kernel log for any different Oops. If you continue to see non-usb related Oops, it probably means your have a system issue, not just in the usb module.

Hi Liu,

I am able to reproduce it. Please find the log.

[ 255.509085] (NULL device *): before BUG()
[ 255.513175] Internal error: Oops - undefined instruction: 0 [#1] PREEMPT ARM
[ 255.513181] Modules linked in: cdc_ether usbnet cdc_acm 8821cu(O) usb_f_acm u_serial usb_f_rndis u_ether libcomposite usb_storage scsi_mod musb_dsps musb_hdrc udc_core)
[ 255.513259] CPU: 0 PID: 8 Comm: ktimersoftd/0 Tainted: G O 4.14.71-rt44-g6a3dcd5e69 #10
[ 255.513262] Hardware name: Generic AM33XX (Flattened Device Tree)
[ 255.513267] task: dc0ff100 task.stack: dc118000
[ 255.513401] PC is at cppi41_dma_channel_program+0x478/0x514 [musb_hdrc]
[ 255.513415] LR is at irq_work_queue+0x120/0x130
[ 255.513418] pc : [<bf1e3d54>] lr : [<c01ef124>] psr: 600f0113
[ 255.513421] sp : dc119bd8 ip : dc119a60 fp : dc119c34
[ 255.513425] r10: db710600 r9 : db76a048 r8 : 00000200
[ 255.513429] r7 : 00000000 r6 : 000012ae r5 : db76a048 r4 : bf1e38dc
[ 255.513432] r3 : 00000000 r2 : 00000000 r1 : c0e15b0c r0 : 0000001d
[ 255.513439] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
[ 255.513443] Control: 10c5387d Table: 94fec019 DAC: 00000051
[ 255.513447] Process ktimersoftd/0 (pid: 8, stack limit = 0xdc118208)
[ 255.513452] Stack: (0xdc119bd8 to 0xdc11a000)
[ 255.513458] 9bc0: bf1e7684 00000002
[ 255.513467] 9be0: c014de80 c017e41c bf1d9e1c bf1d9c88 db3e5c00 99a38000 db756010 e0dfac10
[ 255.513475] 9c00: bf1e970c e0dfac10 00002500 bf1e38dc db7564f0 d99fed00 00000000 db76a048
[ 255.513482] 9c20: 00000200 db710600 dc119c64 dc119c38 bf1d9e1c bf1e38e8 000012ae db756010
[ 255.513490] 9c40: db756010 db710600 bf1e9704 00000200 bf1e9700 00000002 dc119cfc dc119c68
[ 255.513498] 9c60: bf1da28c bf1d9d9c 00000000 000012ae 00000004 00000008 bf1e6544 00000002
[ 255.513506] 9c80: 00000000 000012ae d9e5d480 00000000 00000000 bf1d4eac e0dfac00 00000000
[ 255.513513] 9ca0: 0000ffff 00000200 db757010 db76a048 d9a38000 d99fed00 000012ae bf1e970c
[ 255.513521] 9cc0: e0dfac00 db7564f0 db1d7000 db7564f0 bf1e6604 db710600 00000000 d9e5d480
[ 255.513529] 9ce0: db7564f0 db7564f0 db756010 00000000 dc119d3c dc119d00 bf1dae74 bf1d9e94
[ 255.513537] 9d00: db1d7000 db710600 00000000 00000001 d9e5d494 00002000 db710600 db76a048
[ 255.513545] 9d20: 00000636 d9e5d494 db756010 00000000 dc119dc4 dc119d40 bf1dcc44 bf1dad2c
[ 255.513553] 9d40: bf1e6808 c01565a4 c0e14c78 bf1d50b4 000001c0 db756330 bf1e9228 ffffeffe
[ 255.513560] 9d60: fffffbfe bf1e9700 e0dfac00 00000000 bf1e970c 00000002 00000003 00000000
[ 255.513568] 9d80: db7564f0 bf1e9704 d9e5d480 e0dfac10 00000636 00000000 c0142f9c db76a048
[ 255.513576] 9da0: db7564f0 db756010 d99fed58 e0dfac10 bf1e4540 ffffe000 dc119dd4 dc119dc8
[ 255.513584] 9dc0: bf1d50b4 bf1dc6f8 dc119e24 dc119dd8 bf1e3fc4 bf1d5064 e0dfac10 bf1e301c
[ 255.513592] 9de0: db76a048 d99fed58 e0dfac10 bf1d3058 db76a048 d99fed58 d99fed28 db76a084
[ 255.513600] 9e00: d99fed1c db76a048 d99fed58 d99fed28 db756010 ffffe000 dc119e54 dc119e28
[ 255.513607] 9e20: bf1e4540 bf1e3dfc dc119e54 dc119e38 c0e1c7b8 d99fed28 c0ea53b0 c0ea539c
[ 255.513616] 9e40: bf1e44ac ffffe000 dc119ebc dc119e58 c018e098 bf1e44b8 c0ea4cd8 c0bf12d8
[ 255.513623] 9e60: 0000003b 7d5f7b73 c0e1c6c0 dc119e84 7d5f7b73 0000003b 600f0113 c0ea53c4
[ 255.513631] 9e80: ffffffff 00000020 7d5f7b73 0000003b c014db50 00000000 00000000 0320ff70
[ 255.513639] 9ea0: 162f9407 c0e1c6c0 600f0113 ffffe000 dc119ee4 dc119ec0 c018e51c c018dfa8
[ 255.513647] 9ec0: 00000008 00000020 c0e1127c 04208140 00000100 c0ea9ea0 dc119f34 dc119ee8
[ 255.513655] 9ee0: c0130dc4 c018e4a8 c01506c0 600f0113 dc119f74 dc119f00 c0e151a8 00000000
[ 255.513663] 9f00: c0ea502c c0ea9e40 dc118000 ffffe000 ffffe000 c0e10ec0 00000001 00000000
[ 255.513670] 9f20: c015040c dc101df4 dc119f4c dc119f38 c0131170 c0130be4 dc0cca80 ffffe000
[ 255.513679] 9f40: dc119f74 dc119f50 c01506c8 c0131140 dc0ccb40 dc0ccb00 00000000 dc118000
[ 255.513686] 9f60: dc0cca80 c015040c dc119fac dc119f78 c014c320 c0150418 dc0ccb58 dc0ccb58
[ 255.513694] 9f80: 00000000 dc0ccb00 c014c1b8 00000000 00000000 00000000 00000000 00000000
[ 255.513701] 9fa0: 00000000 dc119fb0 c0107db0 c014c1c4 00000000 00000000 00000000 00000000
[ 255.513709] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 255.513716] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 255.513718] Backtrace:
[ 255.513796] [<bf1e38dc>] (cppi41_dma_channel_program [musb_hdrc]) from [<bf1d9e1c>] (musb_tx_dma_program+0x8c/0xf8 [musb_hdrc])
[ 255.513805] r10:db710600 r9:00000200 r8:db76a048 r7:00000000 r6:d99fed00 r5:db7564f0
[ 255.513808] r4:bf1e38dc
[ 255.513873] [<bf1d9d90>] (musb_tx_dma_program [musb_hdrc]) from [<bf1da28c>] (musb_start_urb+0x404/0xe98 [musb_hdrc])
[ 255.513880] r9:00000002 r8:bf1e9700 r7:00000200 r6:bf1e9704 r5:db710600 r4:db756010
[ 255.513944] [<bf1d9e88>] (musb_start_urb [musb_hdrc]) from [<bf1dae74>] (musb_advance_schedule+0x154/0x2ac [musb_hdrc])
[ 255.513951] r10:00000000 r9:db756010 r8:db7564f0 r7:db7564f0 r6:d9e5d480 r5:00000000
[ 255.513954] r4:db710600
[ 255.514018] [<bf1dad20>] (musb_advance_schedule [musb_hdrc]) from [<bf1dcc44>] (musb_host_tx+0x558/0x904 [musb_hdrc])
[ 255.514025] r10:00000000 r9:db756010 r8:d9e5d494 r7:00000636 r6:db76a048 r5:db710600
[ 255.514027] r4:00002000
[ 255.514091] [<bf1dc6ec>] (musb_host_tx [musb_hdrc]) from [<bf1d50b4>] (musb_dma_completion+0x5c/0x88 [musb_hdrc])
[ 255.514098] r10:ffffe000 r9:bf1e4540 r8:e0dfac10 r7:d99fed58 r6:db756010 r5:db7564f0
[ 255.514101] r4:db76a048
[ 255.514164] [<bf1d5058>] (musb_dma_completion [musb_hdrc]) from [<bf1e3fc4>] (cppi41_trans_done+0x1d4/0x3c4 [musb_hdrc])
[ 255.514229] [<bf1e3df0>] (cppi41_trans_done [musb_hdrc]) from [<bf1e4540>] (cppi41_recheck_tx_req+0x94/0xf8 [musb_hdrc])
[ 255.514236] r10:ffffe000 r9:db756010 r8:d99fed28 r7:d99fed58 r6:db76a048 r5:d99fed1c
[ 255.514239] r4:db76a084
[ 255.514286] [<bf1e44ac>] (cppi41_recheck_tx_req [musb_hdrc]) from [<c018e098>] (__hrtimer_run_queues.constprop.4+0xfc/0x3d0)
[ 255.514293] r9:ffffe000 r8:bf1e44ac r7:c0ea539c r6:c0ea53b0 r5:d99fed28 r4:c0e1c7b8
[ 255.514303] [<c018df9c>] (__hrtimer_run_queues.constprop.4) from [<c018e51c>] (hrtimer_run_softirq+0x80/0x118)
[ 255.514310] r10:ffffe000 r9:600f0113 r8:c0e1c6c0 r7:162f9407 r6:0320ff70 r5:00000000
[ 255.514313] r4:00000000
[ 255.514323] [<c018e49c>] (hrtimer_run_softirq) from [<c0130dc4>] (do_current_softirqs+0x1ec/0x3c4)
[ 255.514330] r9:c0ea9ea0 r8:00000100 r7:04208140 r6:c0e1127c r5:00000020 r4:00000008
[ 255.514337] [<c0130bd8>] (do_current_softirqs) from [<c0131170>] (run_ksoftirqd+0x3c/0x7c)
[ 255.514344] r10:dc101df4 r9:c015040c r8:00000000 r7:00000001 r6:c0e10ec0 r5:ffffe000
[ 255.514347] r4:ffffe000
[ 255.514354] [<c0131134>] (run_ksoftirqd) from [<c01506c8>] (smpboot_thread_fn+0x2bc/0x2c0)
[ 255.514358] r5:ffffe000 r4:dc0cca80
[ 255.514367] [<c015040c>] (smpboot_thread_fn) from [<c014c320>] (kthread+0x168/0x170)
[ 255.514373] r9:c015040c r8:dc0cca80 r7:dc118000 r6:00000000 r5:dc0ccb00 r4:dc0ccb40
[ 255.514388] [<c014c1b8>] (kthread) from [<c0107db0>] (ret_from_fork+0x14/0x24)
[ 255.514395] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014c1b8
[ 255.514397] r4:dc0ccb00
[ 255.514406] Code: eaffff91 e307168c e34b1f1e eb509a0f (e7f001f2)

Hi Liu,

Did you get a chance to look into the log shared ? 

Regards,

Kiran

Hi Kiran,

Sorry for the delay. Yes, the log confirms the Oops is triggered by the line BUG_ON() in cppi41_dma_channel_program().

We would have to enable kernel FTRACE and add some debug traces in the driver to understand why this BUG_ON() is triggered. You mentioned you have to run a stripped kernel image, but are you able to run the kernel with FTRACE enabled?

You also mentioned when the Oops happened, Linux would restart on the board. Can you please change your Linux configuration so that Linux won't restart when the Oops happens? We need that to dump the FTRACE log after the issue happened.

Please let me know if you can do both, I will create a kernel patch to get a FTRACE debug log.

Hi Liu, 

Np, 

>>>>>>

You also mentioned when the Oops happened, Linux would restart on the board. Can you please change your Linux configuration so that Linux won't restart when the Oops happens? We need that to dump the FTRACE log after the issue happened.

>>>>>> 

Could you please let us know how do I change the linux configuration so that I won't reboot when Oops happen.

Yes,we are able to run the device with linux Kernel below configs enabled (FTRACE)

CONFIG_TRACING=y
CONFIG_TRACING_SUPPORT=y
CONFIG_BLOCK=y
CONFIG_SYSFS=y
CONFIG_FTRACE=y
CONFIG_BLK_DEV_IO_TRACE=y
CONFIG_FUNCTION_TRACER=y

Please share the patch to apply to linux kernel to reproduce.

Regards,

Kiran

Kiran,

I am not sure how your Linux system is configured to restart when kernel Oops. The root filesystem in the Processor SDK Linux release doesn't restart. So you would have to figure it out by yourself.

The kernel debug patch doesn't exist yet, I have to create it. Please give me some time. I am currently working on another task, which would take a few days. I will post the patch here when it is ready.

Liu,

I have a question on my mind, why this error is seen only when UART console is connected and why it is not redirecting to syslog. could you please let me know if we are missing any configurations to route it to syslog when issue occurs.

Regards,

Kiran

Kiran,

After your Linux is rebooted, can you still see the previous syslog which is generated before the reboot? If not, I guess the reason is that when the error happens, the board will reboot within a couple seconds, then the previous syslog is lost. But when you connected to the UART console, the kernel error message directly prints on the console, that is why you can see it. Does it make sense?

This is also the reason why I asked you to disable system reboot when kernel Oops happens, so that we can exam the system.

Liu,

I got what you said, but when I intentionally created the oops on device using the  echo c > /proc/sysrq-trigger which didn't reboot my device ( Is this the one you are referring to--device reboot didn't happen though it is Oops)  

[113393.869790] sysrq: SysRq : Trigger a crash
[113393.874046] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[113393.883953] pgd = d6838000
[113393.887343] [00000000] *pgd=96859831, *pte=00000000, *ppte=00000000
[113393.894946] Internal error: Oops: 817 [#1] PREEMPT ARM
[113393.894951] Modules linked in: cdc_ether usbnet cdc_acm usb_f_acm u_serial usb_f_rndis u_ether libcomposite 8821cu(O) usb_storage scsi_mod musb_dsps musb_hdrc udc_cor)
[113393.895043] CPU: 0 PID: 18493 Comm: bash Tainted: G O 4.14.71-rt44-g6cc310b95a #1
[113393.895046] Hardware name: Generic AM33XX (Flattened Device Tree)
[113393.895052] task: d9e23800 task.stack: d68ce000
[113393.895074] PC is at sysrq_handle_crash+0x2c/0x34
[113393.895079] LR is at sysrq_handle_crash+0x28/0x34
[113393.895082] pc : [<c04bf028>] lr : [<c04bf024>] psr: 600e0013
[113393.895085] sp : d68cfe50 ip : d68cfe50 fp : d68cfe64
[113393.895088] r10: 00000000 r9 : 00000002 r8 : c0d2b154
[113393.895092] r7 : 00000000 r6 : 00000063 r5 : 00000007 r4 : 00000001
[113393.895095] r3 : 00000000 r2 : 00000000 r1 : c0d1393c r0 : 00000063
[113393.895101] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
[113393.895105] Control: 10c5387d Table: 96838019 DAC: 00000051
[113393.895109] Process bash (pid: 18493, stack limit = 0xd68ce208)
[113393.895114] Stack: (0xd68cfe50 to 0xd68d0000)
[113393.895121] fe40: c0d13924 00000007 d68cfe9c d68cfe68
[113393.895129] fe60: c04bf55c c04bf008 dc6c3910 dbcc15a0 d68cfe70 00000002 00000000 00000000
[113393.895137] fe80: dc3dfd80 00000000 00000002 00000000 d68cfeb4 d68cfea0 c04bfb28 c04bf4b4
[113393.895144] fea0: c04bfacc 00000000 d68cfed4 d68cfeb8 c0275d28 c04bfad8 c0275ccc d9f1b100
[113393.895152] fec0: d68cff78 d68cff78 d68cff44 d68cfed8 c021c350 c0275cd8 00000000 00000000
[113393.895160] fee0: 00000400 00000000 00000000 00000000 5f50a251 363d7f80 5f525d36 30faa740
[113393.895168] ff00: 5f525d36 30faa740 f0000096 00000000 befebdb0 b6edebec d68cffa4 d68cff28
[113393.895176] ff20: 00000002 d9f1b100 00115930 d68cff78 00000000 00000002 d68cff74 d68cff48
[113393.895184] ff40: c021c5cc c021c32c f0000096 00000000 d9f1b100 d9f1b100 00000000 00000000
[113393.895192] ff60: 00115930 00000002 d68cffa4 d68cff78 c021c7a8 c021c52c 00000000 00000000
[113393.895200] ff80: 00000002 00115930 b6ee0d60 00000004 c0107b84 d68ce000 00000000 d68cffa8
[113393.895207] ffa0: c01079a0 c021c770 00000002 00115930 00000001 00115930 00000002 00000001
[113393.895215] ffc0: 00000002 00115930 b6ee0d60 00000004 00000002 b6edebec 00000000 00000000
[113393.895223] ffe0: 00000000 befec304 b6e43b5b b6e7f538 600e0030 00000001 00000000 00000000
[113393.895224] Backtrace:
[113393.895239] [<c04beffc>] (sysrq_handle_crash) from [<c04bf55c>] (__handle_sysrq+0xb4/0x1a0)
[113393.895244] r5:00000007 r4:c0d13924
[113393.895254] [<c04bf4a8>] (__handle_sysrq) from [<c04bfb28>] (write_sysrq_trigger+0x5c/0x6c)
[113393.895261] r10:00000000 r9:00000002 r8:00000000 r7:dc3dfd80 r6:00000000 r5:00000000
[113393.895264] r4:00000002
[113393.895276] [<c04bfacc>] (write_sysrq_trigger) from [<c0275d28>] (proc_reg_write+0x5c/0x84)
[113393.895280] r5:00000000 r4:c04bfacc
[113393.895298] [<c0275ccc>] (proc_reg_write) from [<c021c350>] (__vfs_write+0x30/0x128)
[113393.895304] r7:d68cff78 r6:d68cff78 r5:d9f1b100 r4:c0275ccc
[113393.895312] [<c021c320>] (__vfs_write) from [<c021c5cc>] (vfs_write+0xac/0x170)
[113393.895319] r9:00000002 r8:00000000 r7:d68cff78 r6:00115930 r5:d9f1b100 r4:00000002
[113393.895328] [<c021c520>] (vfs_write) from [<c021c7a8>] (SyS_write+0x44/0x98)
[113393.895335] r9:00000002 r8:00115930 r7:00000000 r6:00000000 r5:d9f1b100 r4:d9f1b100
[113393.895350] [<c021c764>] (SyS_write) from [<c01079a0>] (ret_fast_syscall+0x0/0x5c)
[113393.895357] r9:d68ce000 r8:c0107b84 r7:00000004 r6:b6ee0d60 r5:00115930 r4:00000002
[113393.895366] Code: e5834000 f57ff04e ebf153d0 e3a03000 (e5c34000)
[113394.25
Message from syslogd@localhost at Sep 4 15:28:55 ...
kern8794] ---[ end trace 000000000000000el:[113393.894946] Internal error: Oops: 817 [#1] PREEMPT ARM

It stays in the same screen forever until unless I manually power cycle the device. May be because of the oops hitting because of BUG_ON in  cppi41_dma_channel_program in function and it is going to unrecoverable state causing the device reboot ? 

Kiran,

This is very important information. Thanks for the testing.

It sounds like the system reboot is not directly caused by the kernel Oops, but might be a hardware condition which is triggered when the kernel Oops happened in the CPPI41 driver.

I think one way to figure it out is to force the CPPI41 driver BUG_ON() to see if your system reboot or not. Please apply the following debug patch to your kernel, then plug in a USB device, for example, a thumb drive, after Linux is booted, this will immediately trigger the BUG_ON() in the CPPI41 driver. Please let me know if your system reboots or not.

diff --git a/drivers/usb/musb/musb_cppi41.c b/drivers/usb/musb/musb_cppi41.c
index 1ec0a4947b6b..2da01961f867 100644
--- a/drivers/usb/musb/musb_cppi41.c
+++ b/drivers/usb/musb/musb_cppi41.c
@@ -527,8 +527,7 @@ static int cppi41_dma_channel_program(struct dma_channel *channel,
        struct cppi41_dma_channel *cppi41_channel = channel->private_data;
        int hb_mult = 0;

-       BUG_ON(channel->status == MUSB_DMA_STATUS_UNKNOWN ||
-               channel->status == MUSB_DMA_STATUS_BUSY);
+       BUG_ON(1);

        if (is_host_active(cppi41_channel->controller->controller.musb)) {
                if (cppi41_channel->is_tx)

Liu,

No system reboot occured with this patch and screen hanged when Oopses is hit. 

It is happening irrespective of whether wifi dongle is attached or not via usb.

[ 19.883104] Internal error: Oops - undefined instruction: 0 [#1] PREEMPT ARM
[ 19.883113] Modules linked in: musb_dsps musb_hdrc udc_core phy_am335x usbcore phy_generic usb_common phy_am335x_control sha512_generic sha512_arm sha256_generic sha1_)
[ 19.883180] CPU: 0 PID: 18 Comm: kworker/0:1 Tainted: G O 4.14.71-rt44-g6a3dcd5e69 #11
[ 19.883184] Hardware name: Generic AM33XX (Flattened Device Tree)
[ 19.883444] Workqueue: events_power_efficient hub_init_func3 [usbcore]
[ 19.883452] task: dc11f800 task.stack: dc1c2000
[ 19.883573] PC is at cppi41_dma_channel_program+0x68/0x70 [musb_hdrc]
[ 19.883576] LR is at 0x1
[ 19.883579] pc : [<bf2134e4>] lr : [<00000001>] psr: 20070113
[ 19.883582] sp : dc1c3c70 ip : dc1c3c90 fp : dc1c3c8c
[ 19.883585] r10: d9b2d880 r9 : 0000000a r8 : db4dea88
[ 19.883589] r7 : bf21347c r6 : bf219704 r5 : 00001000 r4 : db55e010
[ 19.883593] r3 : 00000001 r2 : 00000001 r1 : 00000001 r0 : db4dea88
[ 19.883599] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
[ 19.883604] Control: 10c5387d Table: 9c7d0019 DAC: 00000051
[ 19.883608] Process kworker/0:1 (pid: 18, stack limit = 0xdc1c2208)
[ 19.883613] Stack: (0xdc1c3c70 to 0xdc1c4000)
[ 19.883620] 3c60: bf219704 00000001 db4dea88 db55e010
[ 19.883628] 3c80: dc1c3d24 dc1c3c90 bf20a8c4 bf213488 00000001 00000003 00000002 00000001
[ 19.883636] 3ca0: bf21653c 00000000 00000000 00000001 c0ed81d4 0009b1e0 dc1c3cfc dc1c3cc8
[ 19.883644] 3cc0: e0e23c00 00000000 c016a65c 00000001 db55f010 dcf31380 00000000 d9b2d880
[ 19.883651] 3ce0: 00000001 bf21970c e0e23c00 db4dea88 db29a080 db55ebf0 bf2166c4 db257600
[ 19.883659] 3d00: db55e010 db29a080 db55ebf0 db383400 00000010 00000000 dc1c3d94 dc1c3d28
[ 19.883667] 3d20: bf20bfc8 bf209e94 db29a080 db383400 00000000 db29a080 db383400 00000000
[ 19.883674] 3d40: 00000001 00000000 bf219708 db55e330 00000081 00000080 0000000a 0000003f
[ 19.883683] 3d60: db29a080 db25760c dc1c3d94 db29a080 db383400 00000000 db29a088 01400000
[ 19.883690] 3d80: bf1338c4 00000002 dc1c3e44 dc1c3d98 bf120748 bf20ba40 dc1c3dd4 dc1c3da8
[ 19.883698] 3da0: c011da74 c0125e44 ffffe000 c096e494 00000000 c0e0d8a4 dc1c3dd4 dc1c3dc8
[ 19.883706] 3dc0: c096e494 c0154094 dc1c3dec dc1c3dd8 c011e5e4 c096e43c 00000001 00000000
[ 19.883714] 3de0: dc1c3e0c c01631c4 00000000 00000003 ffffe000 c096e494 dc1d22c4 00000000
[ 19.883721] 3e00: dc1c3e1c dc1c3e10 c096e494 c0154094 dc1c3e64 dc1c3e20 c01631d0 db29a080
[ 19.883729] 3e20: db66e800 00000003 01400000 00000200 bf1338c4 00000002 dc1c3e8c dc1c3e48
[ 19.883737] 3e40: bf122020 bf120698 dc1c3e7c c096e2b4 ffffe000 dc1d2280 dc1c3e7c dc1c3e68
[ 19.883745] 3e60: c096e2b4 db294a00 db294a08 db66e8a4 dcb3a600 00000000 db66e800 00000002
[ 19.883753] 3e80: dc1c3ee4 dc1c3e90 bf118ecc bf121cdc 00000000 c0969f98 dc1c3ecc dc1c3ea8
[ 19.883761] 3ea0: c014de80 c096e2b4 00000001 c096e494 dc1d22b4 dc1d2280 dc1c3ed4 db294ae4
[ 19.883768] 3ec0: dc1a9000 c0e12dd4 dcb3a600 00000000 c0ea50b8 00000000 dc1c3ef4 dc1c3ee8
[ 19.883776] 3ee0: bf11920c bf118b80 dc1c3f34 dc1c3ef8 c0145b88 bf1191f8 ffffe000 dc11f800
[ 19.883784] 3f00: dc1c3f1c c096e2b4 ffffe000 dc1a9000 c0e12dd4 dc1a9018 ffffe000 c0e12dfc
[ 19.883792] 3f20: 00000008 c0e1a880 dc1c3f74 dc1c3f38 c0145f34 c01459c4 dc11f800 c0beb808
[ 19.883800] 3f40: c0ea4c41 c0e12dd4 c0145ed0 dc1ae0c0 dc1a8040 00000000 dc1c2000 dc1a9000
[ 19.883808] 3f60: c0145ed0 dc10be84 dc1c3fac dc1c3f78 c014c320 c0145edc dc1ae0d8 dc1ae0d8
[ 19.883815] 3f80: 00000000 dc1a8040 c014c1b8 00000000 00000000 00000000 00000000 00000000
[ 19.883823] 3fa0: 00000000 dc1c3fb0 c0107db0 c014c1c4 00000000 00000000 00000000 00000000
[ 19.883830] 3fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 19.883838] 3fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 19.883839] Backtrace:
[ 19.883917] [<bf21347c>] (cppi41_dma_channel_program [musb_hdrc]) from [<bf20a8c4>] (musb_start_urb+0xa3c/0xe98 [musb_hdrc])
[ 19.883922] r4:db55e010
[ 19.883987] [<bf209e88>] (musb_start_urb [musb_hdrc]) from [<bf20bfc8>] (musb_urb_enqueue+0x594/0x6bc [musb_hdrc])
[ 19.883996] r10:00000000 r9:00000010 r8:db383400 r7:db55ebf0 r6:db29a080 r5:db55e010
[ 19.883999] r4:db257600
[ 19.884136] [<bf20ba34>] (musb_urb_enqueue [musb_hdrc]) from [<bf120748>] (usb_hcd_submit_urb+0xbc/0x8c4 [usbcore])
[ 19.884143] r10:00000002 r9:bf1338c4 r8:01400000 r7:db29a088 r6:00000000 r5:db383400
[ 19.884146] r4:db29a080
[ 19.884292] [<bf12068c>] (usb_hcd_submit_urb [usbcore]) from [<bf122020>] (usb_submit_urb+0x350/0x4f0 [usbcore])
[ 19.884300] r10:00000002 r9:bf1338c4 r8:00000200 r7:01400000 r6:00000003 r5:db66e800
[ 19.884302] r4:db29a080
[ 19.884446] [<bf121cd0>] (usb_submit_urb [usbcore]) from [<bf118ecc>] (hub_activate+0x358/0x638 [usbcore])
[ 19.884454] r10:00000002 r9:db66e800 r8:00000000 r7:dcb3a600 r6:db66e8a4 r5:db294a08
[ 19.884456] r4:db294a00
[ 19.884599] [<bf118b74>] (hub_activate [usbcore]) from [<bf11920c>] (hub_init_func3+0x20/0x24 [usbcore])
[ 19.884606] r10:00000000 r9:c0ea50b8 r8:00000000 r7:dcb3a600 r6:c0e12dd4 r5:dc1a9000
[ 19.884609] r4:db294ae4
[ 19.884701] [<bf1191ec>] (hub_init_func3 [usbcore]) from [<c0145b88>] (process_one_work+0x1d0/0x518)
[ 19.884710] [<c01459b8>] (process_one_work) from [<c0145f34>] (worker_thread+0x64/0x608)
[ 19.884718] r10:c0e1a880 r9:00000008 r8:c0e12dfc r7:ffffe000 r6:dc1a9018 r5:c0e12dd4
[ 19.884720] r4:dc1a9000
[ 19.884730] [<c0145ed0>] (worker_thread) from [<c014c320>] (kthread+0x168/0x170)
[ 19.884738] r10:dc10be84 r9:c0145ed0 r8:dc1a9000 r7:dc1c2000 r6:00000000 r5:dc1a8040
[ 19.884740] r4:dc1ae0c0
[ 19.884755] [<c014c1b8>] (kthread) from [<c0107db0>] (ret_from_fork+0x14/0x24)
[ 19.884762] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014c1b8
[ 19.884764] r4:dc1a8040
[ 19.884774] Code: e5d2200c e59f0008 e88d5000 eb3f1738 (e7f001f2)
[ 20.439927] ---[ end trace 0000000000000002 ]---

Kiran,

Kiran kumar13 said:

It is happening irrespective of whether wifi dongle is attached or not via usb.

When the wifi dongle is not attached, do you have any other USB device which is attached? The Oops doesn't happen in my test if no any USB device is attached.

Kiran kumar13 said:

No system reboot occured with this patch and screen hanged when Oopses is hit. 

By "screen hanged" do you get the LInux prompt after you pressed "Enter" on your keyboard? Or Linux is locked up?

Anyway, since the Oops happens in this case but the system doesn't reboot, as what I expected, I think the reboot is not directly caused by the Oops. Since you have also seen the Oops in other area, such as am33xx_pm_probe(), I suspect your board have hardware issue which causes the reboot. Can you please exam your board, maybe start from the power supplies?

Liu,

Sorry for late response.

Yes, there is no other USB attached to my device when issue is observed ( i mean when Oopses is hit and it is hanged when it is flashed with patch shared).

We will get back to you with some analyses from our h/w team

Regards,

Kiran