This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM625: The core kernel crash issue

Part Number: AM625
Other Parts Discussed in Thread: AB15, TEST2

Hi,

Please refer to below that we use the AM6254, and please advise why this core kernel crash, thanks.

The below is the print imformation:

root@am62xx-evm:~# 
root@am62xx-evm:~# [ 2833.974238] usb 1-1.3: USB disconnect, device number 3
[ 2834.149302] FAT-fs (sda1): unable to read boot sector to mark fs as dirty
[21251.654469] ------------[ cut here ]------------
[21251.659111] kernel BUG at arch/arm64/kernel/traps.c:407!
[21251.664416] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[21251.669895] Modules linked in: xt_conntrack xt_MASQUERADE xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_tables x_tables br_netfilter bridge stp
 llc overlay xfrm_user xfrm_algo md5 des_generic libdes cbc wlcore_sdio wl18xx wlcore mac80211 cfg80211 rfkill libarc4 usbhid usb_storage xhci_plat_hcd xhci_hcd usbcore dwc3 udc_core rpmsg_char
 roles usb_common cdns_csi2rx v4l2_fwnode pru_rproc irq_pruss_intc pvrsrvkm(O) crct10dif_ce ti_k3_r5_remoteproc virtio_rpmsg_bus dwc3_am62 rti_wdt j721e_csi2rx videobuf2_dma_contig videobuf2_memops 
videobuf2_v4l2 videobuf2_common sa2ul pruss sha512_generic authenc cdns_dphy mcrc rtc_ds1307 sch_fq_codel cryptodev(O) ipv6
[21251.732352] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G           O      5.10.168-g2c23e6c538 #1
[21251.740861] Hardware name: LICHAN Texas Instruments AM625 SK (DT)
[21251.746942] pstate: 00000085 (nzcv daIf -PAN -UAO -TCO BTYPE=--)
[21251.752948] pc : do_undefinstr+0x2f4/0x318
[21251.757036] lr : do_undefinstr+0x1e8/0x318
[21251.761119] sp : ffff80001132be00
[21251.764421] x29: ffff80001132be00 x28: ffff8000111919c0 
[21251.769723] x27: ffff8000111919c0 x26: ffff80001132c000 
[21251.775025] x25: ffff800011328000 x24: ffff800011189a54 
[21251.780326] x23: 0000000040000085 x22: ffff80001052b940 
[21251.785626] x21: ffff80001132bfe0 x20: ffff8000111919c0 
[21251.790926] x19: ffff80001132be90 x18: 0000000000000000 
[21251.796226] x17: 0000000000000000 x16: 0000000000000000 
[21251.801527] x15: ffff80001052b940 x14: 0000000000000099 
[21251.806827] x13: 0000000000000000 x12: 0000000000000001 
[21251.812127] x11: 0000000000000000 x10: 0000000000

  • Hi Liang,

    It seems the kernel Oops is triggered by USB. Can you please describle your USB use case? What operation triggers it?

  • Is this happening on AM62x EVM or your custom board?

    Please attach the full kernel log including the crash messages.

  • [   32.115665] Initializing XFRM netlink socket
    [   33.846508] vdd_mmc1: disabling
    [   33.849687] tlv71033: disabling
    [   41.299527] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
    [   41.320960] Bridge firewalling registered
    [   42.750172] process 'docker/tmp/qemu-check224294517/check' started with executable stack
    [ 2871.726462] Unable to handle kernel NULL pointer dereference at virtual address 000000000000002e
    [ 2871.735269] Mem abort info:
    [ 2871.738073]   ESR = 0x96000046
    [ 2871.741118]   EC = 0x25: DABT (current EL), IL = 32 bits
    [ 2871.746416]   SET = 0, FnV = 0
    [ 2871.749459]   EA = 0, S1PTW = 0
    [ 2871.752591] Data abort info:
    [ 2871.755467]   ISV = 0, ISS = 0x00000046
    [ 2871.759290]   CM = 0, WnR = 1
    [ 2871.762261] user pgtable: 4k pages, 48-bit VAs, pgdp=000000008bda6000
    [ 2871.768695] [000000000000002e] pgd=000000008bdae003, p4d=000000008bdae003, pud=000000008bdad003, pmd=0000000000000000
    [ 2871.779305] Internal error: Oops: 96000046 [#1] PREEMPT SMP
    [ 2871.784866] Modules linked in: xt_conntrack xt_MASQUERADE xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_tables x_tables br_netfilter bridge stp llc overlay xfrm_user xfrm_algo md5 des_generic libdes cbc wlcore_sdio wl18xx wlcore mac80211 cfg80211 rfkill libarc4 usbhid xhci_plat_hcd xhci_hcd usbcore dwc3 udc_core rpmsg_char roles usb_common cdns_csi2rx v4l2_fwnode pru_rproc irq_pruss_intc pvrsrvkm(O) crct10dif_ce ti_k3_r5_remoteproc virtio_rpmsg_bus dwc3_am62 rti_wdt j721e_csi2rx sa2ul videobuf2_dma_contig videobuf2_memops videobuf2_v4l2 videobuf2_common sha512_generic mcrc pruss authenc cdns_dphy rtc_ds1307 sch_fq_codel cryptodev(O) ipv6
    [ 2871.846263] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G           O      5.10.168-g2c23e6c538 #1
    [ 2871.854772] Hardware name: LICHAN Texas Instruments AM625 SK (DT)
    [ 2871.860858] pstate: a0000085 (NzCv daIf -PAN -UAO -TCO BTYPE=--)
    [ 2871.866862] pc : irq_enter+0x4/0x20
    [ 2871.870346] lr : __handle_domain_irq+0x40/0xc0
    [ 2871.874777] sp : ffff800011343fa0
    [ 2871.878079] x29: ffff800011343fa0 x28: ffff0000000fe3c0 
    [ 2871.883383] x27: ffff0000000fe3c0 x26: ffff800011344000 
    [ 2871.888684] x25: ffff800011340000 x24: ffff800011189a54 
    [ 2871.893984] x23: 0000000000000001 x22: 0000000000000000 
    [ 2871.899286] x21: ffff00000001d000 x20: ffff80001103cd30 
    [ 2871.904588] x19: 000000000000001e x18: 0000000000000000 
    [ 2871.909887] x17: 0000000000000000 x16: 0000000000000000 
    [ 2871.915192] x15: 0000ffffa0b9c050 x14: 000000000000034a 
    [ 2871.920506] x13: 0000000000000000 x12: 0000000000000001 
    [ 2871.925823] x11: 0000000000000000 x10: 00000000000009f0 
    [ 2871.931128] x9 : ffff8000113f3e90 x8 : ffff0000000fee10 
    [ 2871.936435] x7 : ffff00001d8c86c0 x6 : ffff0000000fe3c0 
    [ 2871.941753] x5 : ffff80000c88a000 x4 : ffff80001103cd30 
    [ 2871.947057] x3 : ffff8000113f3de0 x2 : 0000000000000001 
    [ 2871.952361] x1 : 000000000000001e x0 : 000000000000d000 
    [ 2871.957664] Call trace:
    [ 2871.960110]  irq_enter+0x4/0x20
    [ 2871.963247]  gic_handle_irq+0x58/0x128
    [ 2871.966991]  el1_irq+0xcc/0x180
    [ 2871.970126]  arch_cpu_idle+0x18/0x28
    [ 2871.973700]  default_idle_call+0x20/0x68
    [ 2871.977624]  do_idle+0x218/0x268
    [ 2871.980871]  cpu_startup_entry+0x24/0x50
    [ 2871.984831]  secondary_start_kernel+0x15c/0x188
    [ 2871.989379] Code: 9402666d 97fffdc6 17fffff1 d503233f (a9bf7bfd) 
    [ 2871.995494] ---[ end trace 7673d6ab93466cb3 ]---
    [ 2872.000145] Kernel panic - not syncing: Attempted to kill the idle task!
    [ 2872.006855] SMP: stopping secondary CPUs
    [ 2872.010781] Kernel Offset: disabled
    [ 2872.014265] CPU features: 0x00040002,2000200c
    [ 2872.018608] Memory Limit: none
    [ 2872.021669] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]---


  • U-Boot SPL 2021.01-00001-g45cb7e44ae-dirty (Nov 13 2023 - 15:56:07 +0800)
    SYSFW ABI: 3.1 (firmware rev 0x0008 '8.6.4--v08.06.04 (Chill Capybar')
    SPL initial stack usage: 13424 bytes
    Trying to boot from NAND
    Warning: Detected image signing certificate on GP device. Skipping certificate to prevent boot failure. This will fail if the image was also encrypted
    Warning: Detected image signing certificate on GP device. Skipping certificate to prevent boot failure. This will fail if the image was also encrypted
    Warning: Detected image signing certificate on GP device. Skipping certificate to prevent boot failure. This will fail if the image was also encrypted
    init_env from device 11 not supported!
    Starting ATF on ARM64 core...

    NOTICE: BL31: v2.8(release):v2.8-226-g2fcd408bb3-dirty
    NOTICE: BL31: Built : 05:06:58, Feb 24 2023

    U-Boot SPL 2021.01-00001-g45cb7e44ae-dirty (Nov 13 2023 - 16:01:16 +0800)
    SYSFW ABI: 3.1 (firmware rev 0x0008 '8.6.4--v08.06.04 (Chill Capybar')
    Trying to boot from NAND


    U-Boot 2021.01-00001-g45cb7e44ae-dirty (Nov 13 2023 - 16:01:16 +0800)

    SoC: AM62X SR1.0 GP
    Model: LICHAN-UBOOT Texas Instruments AM625 SK
    EEPROM not available at 0x50, trying to read at 0x51
    Reading on-board EEPROM at 0x51 failed 1
    DRAM: 512 MiB
    NAND: 2048 MiB
    MMC: mmc@fa10000: 0, mmc@fa00000: 1, mmc@fa20000: 2
    Loading Environment from NAND... *** Warning - bad CRC, using default environment

    In: serial@2800000
    Out: serial@2800000
    Err: serial@2800000
    EEPROM not available at 0x50, trying to read at 0x51
    Reading on-board EEPROM at 0x51 failed 1
    Net: eth0: ethernet@8000000port@1
    Hit any key to stop autoboot: 0
    MMC: no card present
    Loading file '/boot/logo.bin' to addr 0x8c000000...
    Done
    Loading file '/boot/Image' to addr 0x82000000...
    Done
    Loading file '/boot/k3-am625-sk.dtb' to addr 0x88000000...
    Done
    ## Flattened Device Tree blob at 88000000
    Booting using the fdt blob at 0x88000000
    ERROR: reserving fdt memory region failed (addr=9da00000 size=100000)
    ERROR: reserving fdt memory region failed (addr=9db00000 size=c00000)
    ERROR: reserving fdt memory region failed (addr=9e700000 size=80000)
    ERROR: reserving fdt memory region failed (addr=9e780000 size=80000)
    ERROR: reserving fdt memory region failed (addr=9e800000 size=1800000)
    Loading Device Tree to 000000008fef0000, end 000000008fffffff ... OK

    Starting kernel ...

    [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
    [ 0.000000] Linux version 5.10.168-g2c23e6c538 (linux@linux-virtual-machine) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #1 SMP PREEMPT Mon Nov 13 16:13:23 CST 2023
    [ 0.000000] Machine model: LICHAN Texas Instruments AM625 SK
    [ 0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
    [ 0.000000] printk: bootconsole [ns16550a0] enabled
    [ 0.000000] efi: UEFI not found.
    [ 0.000000] Reserved memory: created CMA memory pool at 0x0000000098800000, size 80 MiB
    [ 0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
    [ 0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
    [ 0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
    [ 0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
    [ 0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
    [ 0.000000] Zone ranges:
    [ 0.000000] DMA [mem 0x0000000080000000-0x000000009fffffff]
    [ 0.000000] DMA32 empty
    [ 0.000000] Normal empty
    [ 0.000000] Movable zone start for each node
    [ 0.000000] Early memory node ranges
    [ 0.000000] node 0: [mem 0x0000000080000000-0x000000009d9fffff]
    [ 0.000000] node 0: [mem 0x000000009da00000-0x000000009e6fffff]
    [ 0.000000] node 0: [mem 0x000000009e700000-0x000000009e77ffff]
    [ 0.000000] node 0: [mem 0x000000009e780000-0x000000009fffffff]
    [ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000009fffffff]
    [ 0.000000] psci: probing for conduit method from DT.
    [ 0.000000] psci: PSCIv1.1 detected in firmware.
    [ 0.000000] psci: Using standard PSCI v0.2 function IDs
    [ 0.000000] psci: Trusted OS migration not required
    [ 0.000000] psci: SMC Calling Convention v1.2
    [ 0.000000] percpu: Embedded 22 pages/cpu s51288 r8192 d30632 u90112
    [ 0.000000] Detected VIPT I-cache on CPU0
    [ 0.000000] CPU features: detected: ARM erratum 845719
    [ 0.000000] CPU features: detected: GIC system register CPU interface
    [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 129024
    [ 0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 ubi.mtd=NAND.file-system root=ubi0:rootfs rootfstype=ubifs
    [ 0.000000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
    [ 0.000000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [ 0.000000] Memory: 365136K/524288K available (11392K kernel code, 1166K rwdata, 4512K rodata, 1920K init, 431K bss, 77232K reserved, 81920K cma-reserved)
    [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    [ 0.000000] rcu: Preemptible hierarchical RCU implementation.
    [ 0.000000] rcu: RCU event tracing is enabled.
    [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
    [ 0.000000] Trampoline variant of Tasks RCU enabled.
    [ 0.000000] Tracing variant of Tasks RCU enabled.
    [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [ 0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [ 0.000000] GICv3: 256 SPIs implemented
    [ 0.000000] GICv3: 0 Extended SPIs implemented
    [ 0.000000] GICv3: Distributor has no Range Selector support
    [ 0.000000] GICv3: 16 PPIs implemented
    [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
    [ 0.000000] ITS [mem 0x01820000-0x0182ffff]
    [ 0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [ 0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [ 0.000000] ITS@0x0000000001820000: allocated 524288 Devices @80800000 (flat, esz 8, psz 64K, shr 0)
    [ 0.000000] ITS: using cache flushing for cmd queue
    [ 0.000000] GICv3: using LPI property table @0x0000000080040000
    [ 0.000000] GIC: using cache flushing for LPI property table
    [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000080050000
    [ 0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [ 0.000004] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [ 0.008528] Console: colour dummy device 80x25
    [ 0.013122] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [ 0.023804] pid_max: default: 32768 minimum: 301
    [ 0.028603] LSM: Security Framework initializing
    [ 0.033375] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [ 0.040854] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [ 0.050560] rcu: Hierarchical SRCU implementation.
    [ 0.055744] Platform MSI: msi-controller@1820000 domain created
    [ 0.062052] PCI/MSI: /bus@f0000/interrupt-controller@1800000/msi-controller@1820000 domain created
    [ 0.071300] EFI services will not be available.
    [ 0.076195] smp: Bringing up secondary CPUs ...
    [ 0.081459] Detected VIPT I-cache on CPU1
    [ 0.081496] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
    [ 0.081511] GICv3: CPU1: using allocated LPI pending table @0x0000000080060000
    [ 0.081572] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
    [ 0.082204] Detected VIPT I-cache on CPU2
    [ 0.082228] GICv3: CPU2: found redistributor 2 region 0:0x00000000018c0000
    [ 0.082239] GICv3: CPU2: using allocated LPI pending table @0x0000000080070000
    [ 0.082273] CPU2: Booted secondary processor 0x0000000002 [0x410fd034]
    [ 0.082855] Detected VIPT I-cache on CPU3
    [ 0.082878] GICv3: CPU3: found redistributor 3 region 0:0x00000000018e0000
    [ 0.082888] GICv3: CPU3: using allocated LPI pending table @0x0000000080080000
    [ 0.082922] CPU3: Booted secondary processor 0x0000000003 [0x410fd034]
    [ 0.082989] smp: Brought up 1 node, 4 CPUs
    [ 0.162722] SMP: Total of 4 processors activated.
    [ 0.167535] CPU features: detected: 32-bit EL0 Support
    [ 0.172807] CPU features: detected: CRC32 instructions
    [ 0.185781] CPU: All CPU(s) started at EL2
    [ 0.189991] alternatives: patching kernel code
    [ 0.195727] devtmpfs: initialized
    [ 0.205684] KASLR disabled due to lack of seed
    [ 0.210448] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [ 0.220426] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
    [ 0.230033] pinctrl core: initialized pinctrl subsystem
    [ 0.236075] DMI not present or invalid.
    [ 0.240687] NET: Registered protocol family 16
    [ 0.246851] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
    [ 0.254161] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [ 0.262173] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [ 0.270907] thermal_sys: Registered thermal governor 'step_wise'
    [ 0.270913] thermal_sys: Registered thermal governor 'power_allocator'
    [ 0.277439] cpuidle: using governor menu
    [ 0.288310] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
    [ 0.295347] ASID allocator initialised with 65536 entries
    [ 0.324735] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
    [ 0.331616] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
    [ 0.338468] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
    [ 0.345320] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
    [ 0.353133] cryptd: max_cpu_qlen set to 1000
    [ 0.360409] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
    [ 0.369485] vcc_5v0: supplied by vmain_pd
    [ 0.374002] vcc_3v3_sys: supplied by vmain_pd
    [ 0.378828] vdd_mmc1: supplied by vcc_3v3_sys
    [ 0.383561] wlan_lten: supplied by vcc_3v3_sys
    [ 0.388390] wlan_en: supplied by wlan_lten
    [ 0.392838] vcc_1v8: supplied by vcc_3v3_sys
    [ 0.398482] iommu: Default domain type: Translated
    [ 0.403832] SCSI subsystem initialized
    [ 0.408172] mc: Linux media interface: v0.10
    [ 0.412564] videodev: Linux video capture interface: v2.00
    [ 0.418241] pps_core: LinuxPPS API ver. 1 registered
    [ 0.423315] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [ 0.432663] PTP clock support registered
    [ 0.436700] EDAC MC: Ver: 3.0.0
    [ 0.440592] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
    [ 0.447736] FPGA manager framework
    [ 0.451302] Advanced Linux Sound Architecture Driver Initialized.
    [ 0.458425] clocksource: Switched to clocksource arch_sys_counter
    [ 0.464878] VFS: Disk quotas dquot_6.6.0
    [ 0.468939] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [ 0.481270] NET: Registered protocol family 2
    [ 0.485920] IP idents hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [ 0.493998] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
    [ 0.502595] TCP established hash table entries: 4096 (order: 3, 32768 bytes, linear)
    [ 0.510546] TCP bind hash table entries: 4096 (order: 4, 65536 bytes, linear)
    [ 0.517918] TCP: Hash tables configured (established 4096 bind 4096)
    [ 0.524554] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
    [ 0.531247] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
    [ 0.538505] NET: Registered protocol family 1
    [ 0.543445] RPC: Registered named UNIX socket transport module.
    [ 0.549515] RPC: Registered udp transport module.
    [ 0.554325] RPC: Registered tcp transport module.
    [ 0.559133] RPC: Registered tcp NFSv4.1 backchannel transport module.
    [ 0.565723] NET: Registered protocol family 44
    [ 0.570279] PCI: CLS 0 bytes, default 64
    [ 0.575110] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
    [ 0.587291] Initialise system trusted keyrings
    [ 0.592066] workingset: timestamp_bits=46 max_order=17 bucket_order=0
    [ 0.602278] squashfs: version 4.0 (2009/01/31) Phillip Lougher
    [ 0.608907] NFS: Registering the id_resolver key type
    [ 0.614122] Key type id_resolver registered
    [ 0.618403] Key type id_legacy registered
    [ 0.622568] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
    [ 0.629424] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
    [ 0.637009] ntfs: driver 2.1.32 [Flags: R/W DEBUG].
    [ 0.642268] 9p: Installing v9fs 9p2000 file system support
    [ 0.682674] Key type asymmetric registered
    [ 0.686870] Asymmetric key parser 'x509' registered
    [ 0.691890] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
    [ 0.699456] io scheduler mq-deadline registered
    [ 0.704095] io scheduler kyber registered
    [ 0.710404] pinctrl-single 4084000.pinctrl: 34 pins, size 136
    [ 0.716765] pinctrl-single f4000.pinctrl: 171 pins, size 684
    [ 0.730337] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [ 0.743149] panel-simple panel-rgb: supply power not found, using dummy regulator
    [ 0.750985] panel-simple panel-rgb: Expected bpc in {6,8} but got: 0
    [ 0.765313] brd: module loaded
    [ 0.775592] loop: module loaded
    [ 0.779721] megasas: 07.714.04.00-rc1
    [ 0.787177] tun: Universal TUN/TAP device driver, 1.6
    [ 0.792945] igbvf: Intel(R) Gigabit Virtual Function Network Driver
    [ 0.799363] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
    [ 0.805474] sky2: driver version 1.30
    [ 0.810210] VFIO - User Level meta-driver version: 0.3
    [ 0.816519] i2c /dev entries driver
    [ 0.821886] sdhci: Secure Digital Host Controller Interface driver
    [ 0.828225] sdhci: Copyright(c) Pierre Ossman
    [ 0.833029] sdhci-pltfm: SDHCI platform and OF driver helper
    [ 0.839970] ledtrig-cpu: registered to indicate activity on CPUs
    [ 0.846506] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [ 0.854697] optee: probing for conduit method.
    [ 0.859292] optee: revision 3.20 (8e74d476)
    [ 0.859575] optee: dynamic shared memory is enabled
    [ 0.869088] optee: initialized driver
    [ 0.874823] NET: Registered protocol family 17
    [ 0.879535] 9pnet: Installing 9P2000 support
    [ 0.883977] Key type dns_resolver registered
    [ 0.888749] Loading compiled-in X.509 certificates
    [ 0.905442] ti-sci 44043000.system-controller: lpm region is required for suspend but not provided.
    [ 0.914783] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0008 '8.6.4--v08.06.04 (Chill Capybar')
    [ 0.982078] omap-gpmc 3b000000.memory-controller: GPMC revision 6.0
    [ 0.988604] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
    [ 0.996321] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x48
    [ 1.002864] nand: Micron MT29F16G08ABACAWP
    [ 1.007070] nand: 2048 MiB, SLC, erase size: 512 KiB, page size: 4096, OOB size: 224
    [ 1.014996] omap2-nand 51000000.nand: using prefetch polled xfer mode
    [ 1.021647] nand: using OMAP_ECC_BCH8_CODE_HW ECC scheme
    [ 1.027082] platform 25010000.ecc: Unable to configure elm - device not probed?
    [ 1.036134] omap_i2c 4900000.i2c: bus 0 rev0.12 at 100 kHz
    [ 1.042697] omap_i2c 2b200000.i2c: bus 1 rev0.12 at 100 kHz
    [ 1.049467] omap_i2c 20010000.i2c: bus 2 rev0.12 at 100 kHz
    [ 1.055576] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
    [ 1.063914] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
    [ 1.073155] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
    [ 1.084223] ti-udma 485c0100.dma-controller: Number of rings: 82
    [ 1.092367] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
    [ 1.103428] ti-udma 485c0000.dma-controller: Number of rings: 150
    [ 1.113273] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
    [ 1.123472] printk: console [ttyS2] disabled
    [ 1.127919] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 29, base_baud = 3000000) is a 8250
    [ 1.136691] printk: console [ttyS2] enabled
    [ 1.136691] printk: console [ttyS2] enabled
    [ 1.145135] printk: bootconsole [ns16550a0] disabled
    [ 1.145135] printk: bootconsole [ns16550a0] disabled
    [ 1.155993] omap8250 2830000.serial: failed to get alias
    [ 1.161907] omap8250 2840000.serial: failed to get alias
    [ 1.167688] omap8250 2850000.serial: failed to get alias
    [ 1.173359] omap8250 2860000.serial: failed to get alias
    [ 1.180791] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
    [ 1.193579] Logo parameter width:1366 ,height:768
    [ 1.193579]
    [ 1.199025] clutsize: 2
    [ 1.222254] Console: switching to colour frame buffer device 170x48
    [ 1.255574] tidss 30200000.dss: [drm] fb0: tidssdrmfb frame buffer device
    [ 1.271192] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [ 1.314458] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [ 1.323800] davinci_mdio 8000f00.mdio: phy[1]: device 8000f00.mdio:01, driver unknown
    [ 1.331641] davinci_mdio 8000f00.mdio: phy[2]: device 8000f00.mdio:02, driver unknown
    [ 1.339592] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000006
    [ 1.352561] am65-cpsw-nuss 8000000.ethernet: Use random MAC address
    [ 1.358832] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
    [ 1.365957] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
    [ 1.372690] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
    [ 1.383282] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
    [ 1.393776] rtc-ti-k3 2b1f0000.rtc: registered as rtc0
    [ 1.399001] rtc-ti-k3 2b1f0000.rtc: setting system clock to 1970-01-01T00:00:06 UTC (6)
    [ 1.511392] mmc1: CQHCI version 5.10
    [ 1.519065] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x48
    [ 1.525448] nand: Micron MT29F16G08ABACAWP
    [ 1.529539] nand: 2048 MiB, SLC, erase size: 512 KiB, page size: 4096, OOB size: 224
    [ 1.537274] omap2-nand 51000000.nand: using prefetch polled xfer mode
    [ 1.543770] nand: using OMAP_ECC_BCH8_CODE_HW ECC scheme
    [ 1.549154] 6 fixed-partitions partitions found on MTD device omap2-nand.0
    [ 1.556019] Creating 6 MTD partitions on "omap2-nand.0":
    [ 1.561325] 0x000000000000-0x000000200000 : "NAND.tiboot3"
    [ 1.568325] 0x000000200000-0x000000400000 : "NAND.tispl"
    [ 1.574917] 0x000000400000-0x000000800000 : "NAND.u-boot"
    [ 1.581727] 0x000000800000-0x000000900000 : "NAND.u-boot-env"
    [ 1.588629] 0x000000900000-0x000000b00000 : "NAND.logo"
    [ 1.595111] 0x000000b00000-0x000071300000 : "NAND.file-system"
    [ 1.777002] debugfs: Directory 'pd:53' with parent 'pm_genpd' already present!
    [ 1.784333] debugfs: Directory 'pd:52' with parent 'pm_genpd' already present!
    [ 1.791677] debugfs: Directory 'pd:51' with parent 'pm_genpd' already present!
    [ 1.799223] debugfs: Directory 'pd:182' with parent 'pm_genpd' already present!
    [ 1.808462] ubi0: attaching mtd5
    [ 3.007609] ubi0: scanning is finished
    [ 3.018457] ubi0: attached mtd5 (name "NAND.file-system", size 1800 MiB)
    [ 3.025167] ubi0: PEB size: 524288 bytes (512 KiB), LEB size: 520192 bytes
    [ 3.030488] sdhci-am654 fa00000.mmc: Power on failed
    [ 3.032030] ubi0: min./max. I/O unit sizes: 4096/4096, sub-page size 1024
    [ 3.043749] ubi0: VID header offset: 1024 (aligned 1024), data offset: 4096
    [ 3.050697] ubi0: good PEBs: 3598, bad PEBs: 2, corrupted PEBs: 0
    [ 3.056779] ubi0: user volume: 1, internal volumes: 1, max. volumes count: 128
    [ 3.063989] ubi0: max/mean erase counter: 9/1, WL threshold: 4096, image sequence number: 1939422268
    [ 3.067652] mmc1: SDHCI controller on fa00000.mmc [fa00000.mmc] using ADMA 64-bit
    [ 3.073106] ubi0: available PEBs: 0, total reserved PEBs: 3598, PEBs reserved for bad PEB handling: 78
    [ 3.073128] ubi0: background thread "ubi_bgt0d" started, PID 150
    [ 3.090067] ALSA device list:
    [ 3.098866] No soundcards found.
    [ 3.103354] UBIFS (ubi0:0): Mounting in unauthenticated mode
    [ 3.182358] UBIFS (ubi0:0): recovery needed
    [ 3.252343] UBIFS (ubi0:0): recovery deferred
    [ 3.256843] UBIFS (ubi0:0): UBIFS: mounted UBI device 0, volume 0, name "rootfs", R/O mode
    [ 3.265106] UBIFS (ubi0:0): LEB size: 520192 bytes (508 KiB), min./max. I/O unit sizes: 4096 bytes/4096 bytes
    [ 3.275004] UBIFS (ubi0:0): FS size: 1823793152 bytes (1739 MiB, 3506 LEBs), journal size 10469376 bytes (9 MiB, 21 LEBs)
    [ 3.285943] UBIFS (ubi0:0): reserved for root: 0 bytes (0 KiB)
    [ 3.291768] UBIFS (ubi0:0): media format: w4/r0 (latest is w5/r0), UUID EE80C1BE-5EAC-477D-B991-F56CE6E6B0D5, small LPT model
    [ 3.304415] VFS: Mounted root (ubifs filesystem) readonly on device 0:21.
    [ 3.313011] devtmpfs: mounted
    [ 3.317434] Freeing unused kernel memory: 1920K
    [ 3.322089] Run /sbin/init as init process
    [ 3.614740] systemd[1]: System time before build time, advancing clock.
    [ 3.719655] NET: Registered protocol family 10
    [ 3.725250] Segment Routing with IPv6
    [ 3.795716] systemd[1]: systemd 244.5+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
    [ 3.818623] systemd[1]: Detected architecture arm64.

    Welcome to Arago 2021.09!

    [ 3.864521] systemd[1]: Set hostname to <am62xx-evm>.
    [ 6.614365] systemd-sysv-generator[167]: Overwriting existing symlink /run/systemd/generator.late/sshd.service with real service.
    [ 6.984173] systemd[1]: /lib/systemd/system/startwlansta.service:7: Unknown key name 'After' in section 'Service', ignoring.
    [ 7.005809] systemd[1]: /lib/systemd/system/irqbalanced.service:6: Unknown key name 'ConditionCPUs' in section 'Unit', ignoring.
    [ 7.034814] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock 鈫/run/docker.sock; please update the unit file accordingly.
    [ 7.155109] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.168294] systemd[1]: Created slice system-getty.slice.
    [ OK ] Created slice system-getty.slice.
    [ 7.190630] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.199216] systemd[1]: Created slice system-serial\x2dgetty.slice.
    [ OK ] Created slice system-serial\x2dgetty.slice.
    [ 7.222616] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.230815] systemd[1]: Created slice User and Session Slice.
    [ OK ] Created slice User and Session Slice.
    [ 7.250955] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
    [ OK ] Started Dispatch Password 鈥s to Console Directory Watch.
    [ 7.274837] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
    [ OK ] Started Forward Password R鈥ests to Wall Directory Watch.
    [ 7.298740] systemd[1]: Reached target Paths.
    [ OK ] Reached target Paths.
    [ 7.314596] systemd[1]: Reached target Remote File Systems.
    [ OK ] Reached target Remote File Systems.
    [ 7.334533] systemd[1]: Reached target Slices.
    [ OK ] Reached target Slices.
    [ 7.350558] systemd[1]: Reached target Swap.
    [ OK ] Reached target Swap.
    [ 7.389126] systemd[1]: Listening on RPCbind Server Activation Socket.
    [ OK ] Listening on RPCbind Server Activation Socket.
    [ 7.410770] systemd[1]: Reached target RPC Port Mapper.
    [ OK ] Reached target RPC Port Mapper.
    [ 7.436549] systemd[1]: Listening on Process Core Dump Socket.
    [ OK ] Listening on Process Core Dump Socket.
    [ 7.458989] systemd[1]: Listening on initctl Compatibility Named Pipe.
    [ OK ] Listening on initctl Compatibility Named Pipe.
    [ 7.488439] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
    [ 7.498242] systemd[1]: Listening on Journal Socket (/dev/log).
    [ OK ] Listening on Journal Socket (/dev/log).
    [ 7.519290] systemd[1]: Listening on Journal Socket.
    [ OK ] Listening on Journal Socket.
    [ 7.535692] systemd[1]: Listening on Network Service Netlink Socket.
    [ OK ] Listening on Network Service Netlink Socket.
    [ 7.560347] systemd[1]: Listening on udev Control Socket.
    [ OK ] Listening on udev Control Socket.
    [ 7.582989] systemd[1]: Listening on udev Kernel Socket.
    [ OK ] Listening on udev Kernel Socket.
    [ 7.608392] systemd[1]: Mounting Huge Pages File System...
    Mounting Huge Pages File System...
    [ 7.628068] systemd[1]: Mounting POSIX Message Queue File System...
    Mounting POSIX Message Queue File System...
    [ 7.655651] systemd[1]: Mounting Kernel Debug File System...
    Mounting Kernel Debug File System...
    [ 7.676119] systemd[1]: Mounting Temporary Directory (/tmp)...
    Mounting Temporary Directory (/tmp)...
    [ 7.703166] systemd[1]: Starting Create list of static device nodes for the current kernel...
    Starting Create list of st鈥des for the current kernel...
    [ 7.733507] systemd[1]: Starting RPC Bind...
    Starting RPC Bind...
    [ 7.752083] systemd[1]: Starting File System Check on Root Device...
    Starting File System Check on Root Device...
    [ 7.781427] systemd[1]: Starting Journal Service...
    Starting Journal Service...
    [ 7.816092] systemd[1]: Starting Load Kernel Modules...
    Starting Load Kernel Modules...
    [ 7.832380] systemd[1]: Starting udev Coldplug all Devices...
    Starting udev Coldplug all Devices...
    [ 7.860482] systemd[1]: Started RPC Bind.
    [ OK ] Started RPC Bind.
    [ 7.872010] cryptodev: loading out-of-tree module taints kernel.
    [ 7.879273] systemd[1]: Mounted Huge Pages File System.
    [ OK ] Mounted Huge Pages File System.[ 7.885511] cryptodev: driver 1.10 loaded.

    [ 7.907857] systemd[1]: Started Journal Service.
    [ OK ] Started Journal Service.
    [ OK ] Mounted POSIX Message Queue File System.
    [ OK ] Mounted Kernel Debug File System.
    [ OK ] Mounted Temporary Directory (/tmp).
    [ OK ] Started Create list of sta鈥nodes for the current kernel.
    [ OK ] Started File System Check on Root Device.
    [ OK ] Started Load Kernel Modules.
    Mounting Kernel Configuration File System...
    Starting Remount Root and Kernel File Systems...
    [ 8.087716] UBIFS (ubi0:0): completing deferred recovery
    Starting Apply Kernel Variables...
    [ OK ] Mounted Kernel Configuration File System.
    [ OK ] Started udev Coldplug all Devices.
    [ 8.267190] random: systemd: uninitialized urandom read (16 bytes read)
    Starting udev Wait for Complete Device Initial[ 8.281156] random: systemd-journal: uninitialized urandom read (16 bytes read)
    [ 8.290599] UBIFS (ubi0:0): deferred recovery completed
    ization...
    [ 8.290606] UBIFS (ubi0:0): background thread "ubifs_bgt0_0" started, PID 196
    [ OK ] Started Remount Root and Kernel File Systems.
    [ OK ] Started Apply Kernel Variables.
    [ 8.355249] random: systemd: uninitialized urandom read (16 bytes read)
    Starting Flush Journal to Persistent Storage...
    Starting Create Static Device Nodes in /dev 8.389863] systemd-journald[181]: Received client request to flush runtime journal.
    m...
    [ OK ] Started Flush Journal to Persistent Storage.
    [ OK ] Started Create Static Device Nodes in /dev.
    [ OK ] Reached target Local File Systems (Pre).
    Mounting /media/ram...
    Mounting /var/volatile...
    Starting udev Kernel Device Manager...
    [ OK ] Mounted /media/ram.
    [ OK ] Mounted /var/volatile.
    Starting Load/Save Random Seed...
    [ OK ] Reached target Local File Systems.
    Starting Create Volatile Files and Directories...
    [ OK ] Started Create Volatile Files and Directories.
    Starting Network Time Synchronization...
    Starting Update UTMP about System Boot/Shutdown...
    [ OK ] Started udev Kernel Device Manager.
    [ OK ] Started Update UTMP about System Boot/Shutdown.
    [ OK ] Started Network Time Synchronization.
    [ OK ] Reached target System Time Set.
    [ OK ] Reached target System Time Synchronized.
    [ 9.209194] rtc-ds1307 2-0068: registered as rtc1
    [ 9.544883] random: systemd: uninitialized urandom read (16 bytes read)
    [ 9.551909] random: systemd: uninitialized urandom read (16 bytes read)
    [ 9.570849] random: systemd: uninitialized urandom read (16 bytes read)
    [ 9.706997] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [ 9.720909] platform 78000000.r5f: configured R5F for IPC-only mode
    [ 9.727669] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
    [ 9.736386] remoteproc remoteproc0: 78000000.r5f is available
    [ 9.742382] remoteproc remoteproc0: attaching to 78000000.r5f
    [ 9.748700] platform 78000000.r5f: R5F core initialized in IPC-only mode
    [ 9.755587] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.755592] remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@9da00000
    [ 9.756169] virtio_rpmsg_bus virtio0: rpmsg host is online
    [ 9.762018] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
    [ 9.771294] remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [ 9.776115] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [ 9.784264] remoteproc remoteproc0: remote processor 78000000.r5f is now attached
    [ 9.796915] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.821897] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.828275] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.842515] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.853451] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.862344] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.870717] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 9.878327] ubi0 warning: ubi_io_read: error -74 (ECC error) while reading 2961 bytes from PEB 1901:317544, read only 2961 bytes, retry
    [ 10.302261] PVR_K: 213: Read BVNC 33.15.11.3 from HW device registers
    [ 10.333642] PVR_K: 213: RGX Device registered with BVNC 33.15.11.3
    [ 10.349815] [drm] Initialized pvr 1.15.6133109 20170530 for fd00000.gpu on minor 1
    [ 10.554389] random: systemd: uninitialized urandom read (16 bytes read)
    [ 10.681202] remoteproc remoteproc1: 30074000.pru is available
    [ 10.700313] remoteproc remoteproc2: 30078000.pru is available
    [ 10.734350] cdns-csi2rx: probe of 30101000.csi-bridge failed with error -22
    [ 10.843089] usbcore: registered new interface driver usbfs
    [ 10.848743] usbcore: registered new interface driver hub
    [ 10.854243] usbcore: registered new device driver usb
    [ 10.883733] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
    [ 10.889282] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 1
    [ 10.897151] xhci-hcd xhci-hcd.1.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
    [ 10.906673] xhci-hcd xhci-hcd.1.auto: irq 492, io mem 0x31000000
    [ 10.912909] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
    [ 10.918445] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 2
    [ 10.922454] random: crng init done
    [ 10.926133] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
    [ 10.929496] random: 171 urandom warning(s) missed due to ratelimiting
    [ 10.942689] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
    [ OK ] Started Load/Save Random Seed.[ 10.950983] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1

    [ 10.963661] usb usb1: Product: xHCI Host Controller
    [ 10.968705] usb usb1: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 10.975336] usb usb1: SerialNumber: xhci-hcd.1.auto
    [ 10.980934] hub 1-0:1.0: USB hub found
    [ 10.984849] hub 1-0:1.0: 1 port detected
    [ 10.990963] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
    [ 10.999166] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
    [ 11.007444] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 11.014692] usb usb2: Product: xHCI Host Controller
    [ 11.019581] usb usb2: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 11.026205] usb usb2: SerialNumber: xhci-hcd.1.auto
    [ 11.031766] hub 2-0:1.0: USB hub found
    [ 11.035599] hub 2-0:1.0: config failed, hub doesn't have any ports! (err -19)
    [ 11.044708] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
    [ 11.050261] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 3
    [ 11.058153] xhci-hcd xhci-hcd.2.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
    [ 11.067638] xhci-hcd xhci-hcd.2.auto: irq 493, io mem 0x31100000
    [ 11.073823] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
    [ 11.079333] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 4
    [ 11.087018] xhci-hcd xhci-hcd.2.auto: Host supports USB 3.0 SuperSpeed
    [ 11.093723] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
    [ 11.102006] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 11.109230] usb usb3: Product: xHCI Host Controller
    [ 11.114111] usb usb3: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 11.120722] usb usb3: SerialNumber: xhci-hcd.2.auto
    [ 11.126233] hub 3-0:1.0: USB hub found
    [ 11.130076] hub 3-0:1.0: 1 port detected
    [ 11.136074] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
    [ 11.144290] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
    [ 11.152565] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 11.159813] usb usb4: Product: xHCI Host Controller
    [ 11.164700] usb usb4: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 11.171317] usb usb4: SerialNumber: xhci-hcd.2.auto
    [ 11.176840] hub 4-0:1.0: USB hub found
    [ 11.180667] hub 4-0:1.0: config failed, hub doesn't have any ports! (err -19)
    [ 11.250471] usb 1-1: new high-speed USB device number 2 using xhci-hcd
    [ 11.390443] usb 3-1: new high-speed USB device number 2 using xhci-hcd
    [ 11.403241] usb 1-1: New USB device found, idVendor=0781, idProduct=5581, bcdDevice= 1.00
    [ 11.411424] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
    [ 11.418570] usb 1-1: Product: SanDisk 3.2Gen1
    [ 11.423019] usb 1-1: Manufacturer: USB
    [ 11.426867] usb 1-1: SerialNumber: 090150589387be358e5dd62313e52c16b204d7c002a43fe071842e7612893e28827c0000000000000000000072c48442000a6420815581074daee96c
    [ 11.481919] usb-storage 1-1:1.0: USB Mass Storage device detected
    [ 11.488886] scsi host0: usb-storage 1-1:1.0
    [ 11.494548] usbcore: registered new interface driver usb-storage
    [ OK ] Started udev Wait for Complete Device Initialization.
    [ OK ] Started Hardware RNG Entropy Gather[ 11.542882] usb 3-1: New USB device found, idVendor=1a40, idProduct=0101, bcdDevice= 1.11
    er Daemon.[ 11.556685] usb 3-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0

    [ 11.565018] usb 3-1: Product: USB 2.0 Hub
    [ OK ] Reached target System Initialization.
    [ OK ] Started Daily rotation of log files.
    [ OK ] Started Daily Cleanup of Temporary [ 11.606010] hub 3-1:1.0: USB hub found
    Directories.
    [ 11.612408] hub 3-1:1.0: 4 ports detected
    [ OK ] Reached target Timers.
    [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
    [ OK ] Listening on D-Bus System Message Bus Socket.
    Starting Docker Socket for the API.
    [ OK ] Listening on dropbear.socket.
    Starting Reboot and dump vmcore via kexec...
    [ OK ] Listening on Docker Socket for the API.
    [ OK ] Reached target Sockets.
    [ OK ] Reached target Basic System.
    [ OK ] Started Job spooling tools.
    [ OK ] Started autorun.
    [ OK ] Started autorun2.
    [ OK ] Started Periodic Command Scheduler.
    [ OK ] Started D-Bus System Message Bus.
    Starting Print notice about GPLv3 packages...
    Starting IPv6 Packet Filtering Framework...
    Starting IPv4 Packet Filtering Framework...
    [ OK ] Started irqbalance daemon.
    Starting rc.pvr.service...
    Starting startwlansta...
    Starting Login Service...
    [ OK ] Started TEE Supplicant.
    [ OK ] Started Reboot and dump vmcore via kexec.
    [ OK ] Started startwlansta.
    [ 12.026589] usb 3-1.2: new low-speed USB device number 3 using xhci-hcd
    [ 12.087214] startwlansta.sh[515]: mount: /media/mmcblk1p1: special device /dev/mmcblk1p1 does not exist.
    [ 12.254299] usb 3-1.2: New USB device found, idVendor=046d, idProduct=c077, bcdDevice=72.00
    [ 12.262748] usb 3-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
    [ 12.270174] usb 3-1.2: Product: USB Optical Mouse
    [ 12.278509] usb 3-1.2: Manufacturer: Logitech
    [ 12.473523] input: Logitech USB Optical Mouse as /devices/platform/bus@f0000/f910000.dwc3-usb/31100000.usb/xhci-hcd.2.auto/usb3/3-1/3-1.2/3-1.2:1.0/0003:046D:C077.0001/input/input0
    [ 12.505261] scsi 0:0:0:0: Direct-Access USB SanDisk 3.2Gen1 1.00 PQ: 0 ANSI: 6
    [ 12.507194] hid-generic 0003:046D:C077.0001: input: USB HID v1.11 Mouse [Logitech USB Optical Mouse] on usb-xhci-hcd.2.auto-1.2/input0
    [ 12.514559] sd 0:0:0:0: [sda] 120176640 512-byte logical blocks: (61.5 GB/57.3 GiB)
    [ 12.542606] sd 0:0:0:0: [sda] Write Protect is off
    [ 12.549367] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
    [ 12.596137] usbcore: registered new interface driver usbhid
    [ 12.612186] sda: sda1
    [ 12.617212] usbhid: USB HID core driver
    [ 12.617380] sd 0:0:0:0: [sda] Attached SCSI removable disk
    [ 12.648754] cfg80211: Loading compiled-in X.509 certificates for regulatory database
    [ OK ] Started IPv6 Packet Filtering Frame[ 12.712201] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
    work.
    [ OK ] Started IPv4 Packet Filtering Framework.
    [ OK ] Reached target Network (Pre).
    [ OK ] Listening on Load/Save RF 鈥tch Status /dev/rfkill Watch.
    Starting Network Service...
    [ OK ] Started Login Service.
    [ OK ] Started Network Service.
    Starting Wait for Network to be Configured...
    Starting Network Name Resolution...
    [ OK ] Started rc.pvr.service.
    Starting weston.service...
    [ 13.561783] libphy: PHY:read_phy_id =0x1280000
    [ 13.573160] libphy: PHY YT8512:read reg 0x40c0 value =0x311
    [ 13.582568] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.590864] libphy: PHY YT8512:read reg 0x40c3 value =0x320
    [ 13.597073] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.599026] libphy: PHY YT8512:write reg 0x40c0 value =0x321
    [ 13.606531] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.615448] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.622818] libphy: PHY YT8512:write reg 0x40c3 value =0x820
    [ 13.630663] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.632994] am65-cpsw-nuss 8000000.ethernet eth1: PHY [8000f00.mdio:01] driver [Generic PHY] (irq=POLL)
    [ 13.637006] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.637012] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.637016] omap2-nand 51000000.nand: uncorrectable bit-flips found
    [ 13.637056] ubi0 warning: ubi_io_read: error -74 (ECC error) while reading 110 bytes from PEB 1849:81528, read only 110 bytes, retry
    [ 13.694547] am65-cpsw-nuss 8000000.ethernet eth1: configuring for phy/rmii link mode
    [ OK ] Started weston.service.
    Starting telnetd.service...
    [ 13.752128] libphy: PHY:read_phy_id =0x1280000
    [ 13.756860] libphy: PHY YT8512:read reg 0x40c0 value =0x311
    [ 13.770779] libphy: PHY YT8512:read reg 0x40c3 value =0x320
    [ 13.782821] libphy: PHY YT8512:write reg 0x40c0 value =0x321
    [ 13.795200] libphy: PHY YT8512:write reg 0x40c3 value =0x820
    [ 13.810796] am65-cpsw-nuss 8000000.ethernet eth0: PHY [8000f00.mdio:02] driver [Generic PHY] (irq=POLL)
    [ 13.828575] am65-cpsw-nuss 8000000.ethernet eth0: configuring for phy/rmii link mode
    [ OK ] Started telnetd.service.
    Starting hmi_demo.service...
    Starting LSB: Expand Rootfs of boot device...
    [ OK ] Started LSB: Expand Rootfs of boot device.
    [ OK ] Started Network Name Resolution.
    [ OK ] Reached target Network.
    [ OK ] Reached target Host and Network Name Lookups.
    Starting Avahi mDNS/DNS-SD Stack...
    Starting Enable and configure wl18xx bluetooth stack...
    [ OK ] Started NFS status monitor for NFSv2/3 locking..
    Starting Simple Network Ma鈥nt Protocol (SNMP) Daemon....
    Starting Permit User Sessions...
    [ OK ] Started Enable and configure wl18xx bluetooth stack.
    [ OK ] Started Permit User Sessions.
    [ OK ] Started Getty on tty1.
    [ OK ] Started Serial Getty on ttyS2.
    [ OK ] Reached target Login Prompts.
    Starting Synchronize System and HW clocks...
    [ OK ] Started Avahi mDNS/DNS-SD Stack.
    [ 14.261779] startwlansta.sh[497]: Wi-Fi user configuration file missing, exit
    [ OK ] Created slice system-systemd\x2dfsck.slice.
    [ OK ] Started Synchronize System and HW clocks.
    [ 15.734918] am65-cpsw-nuss 8000000.ethernet eth1: Link is Up - 100Mbps/Full - flow control off
    [ 15.743692] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
    [ 15.894996] am65-cpsw-nuss 8000000.ethernet eth0: Link is Up - 100Mbps/Full - flow control rx/tx
    [ 15.904221] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
    [ 16.115975] PVR_K: 666: RGX Firmware image 'rgx.fw.33.15.11.3' loaded
    [ 16.214077] PVR_K: 666: Shader binary image 'rgx.sh.33.15.11.3' loaded
    [ OK ] Started Simple Network Man鈥ment Protocol (SNMP) Daemon..
    [ OK ] Started hmi_demo.service.
    Stopping hmi_demo.service...
    [ OK ] Stopped hmi_demo.service.

    _____ _____ _ _
    | _ |___ ___ ___ ___ | _ |___ ___ |_|___ ___| |_
    | | _| .'| . | . | | __| _| . | | | -_| _| _|
    |__|__|_| |__,|_ |___| |__| |_| |___|_| |___|___|_|
    |___| |___|

    Arago Project am62xx-evm ttyS2

    Arago 2021.09 am62xx-evm ttyS2

    am62xx-evm login: ***************************************************************
    ***************************************************************
    NOTICE: This file system contains the following GPLv3 packages:
    autoconf
    bash-dev
    bash
    bc
    binutils
    cifs-utils
    coreutils-stdbuf
    coreutils
    cpio
    cpp-symlinks
    cpp
    dosfstools
    elfutils
    g++-symlinks
    g++
    gawk
    gcc-symlinks
    gcc
    gdb
    gdbserver
    gettext
    glmark2
    gstreamer1.0-libav
    gzip
    hidapi
    less
    libasm1
    libbfd
    libdw1
    libelf1
    libgdbm-compat4
    libgdbm-dev
    libgdbm6
    libgettextlib
    libgettextsrc
    libgmp10
    libidn2-0
    libmpc3
    libmpfr6
    libreadline-dev
    libreadline8
    libunistring2
    m4-dev
    m4
    make
    nettle
    parted
    tar
    which

    If you do not wish to distribute GPLv3 components please remove
    the above packages prior to distribution. This can be done using
    the opkg remove command. i.e.:
    opkg remove <package>
    Where <package> is the name printed in the list above

    NOTE: If the package is a dependency of another package you
    will be notified of the dependent packages. You should
    use the --force-removal-of-dependent-packages option to
    also remove the dependent packages as well
    ***************************************************************
    ***************************************************************
    [ 31.357030] Initializing XFRM netlink socket
    [ 33.846548] vdd_mmc1: disabling
    [ 33.849754] tlv71033: disabling
    [ 43.144205] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
    [ 43.163711] Bridge firewalling registered
    [ 45.051199] process 'docker/tmp/qemu-check633874785/check' started with executable stack

    am62xx-evm login: root
    root@am62xx-evm:~#
    root@am62xx-evm:~#
    root@am62xx-evm:~#

  • Hi Bin,

    This is urgent, so please kindly review the log and provide your commend if there are any more improved, thanks.

  • Hi Liang,

    [   42.750172] process 'docker/tmp/qemu-check224294517/check' started with executable stack
    [ 2871.726462] Unable to handle kernel NULL pointer dereference at virtual address 000000000000002e
    [ 2871.735269] Mem abort info:

    The kernel crash happens about 40 minutes after Linux is booted. Can you please explain what the system was doing during this time? We first need to understand what triggered the crash, the log doesn't expose much.

  • Hi Bin,

    So you mean we need to send all the log in the 40min, this maybe to long and I will send to you tomorrow. thanks.

  • Hi Liang,

    Can you please first explain what the system is doing? Any application is running which might trigger the crash? or you didn't specifically start any application?

    As of now I at least don't have any clue what could trigger the crash. The logs you provided so far do not provide the source of the crash.

  • linux system run qt program, hmi interface display, and Ethernet, usb and other peripherals

  • Hi Zexian,

    Does the issue happen on multiple boards?

    If you do not run your Qt program, does the issue still happens?

  • Hi,Bin,

    Test a day time, if do not run the qt program, the kernel does not crash, what is the reason?

  • Hi Bin,

    Run qt, a total of three new boards, two boards have a kernel crash, one board test normal

  • Hi Zexian,

    Please first check all the power rails on your board and ensure they all meet the requirements on the Datasheet.

  • HI Bin,

    The test of the power rail design is in line with the requirements of the data table, the system is running for several hours or more than ten hours before the kernel crash

  • HI Bin,

    We use a special PMIC chip TPS6521901 power supply, the power supply has been tested

  • Hi Zexian,

    Thanks for the details. It does sound like a software issue.

    I am routing your query to our Qt/Gfx expert for comments. He is currently out of office for the next 3 weeks. Please expect delayed responses.

  • Hi Bin,

    Could you check the problem as soon as possible, because our company needs to make the finished product in one or two weeks

  • Hello,

    Is there a way to replicate the issue on TI EVM? For example, if you run the Qt program on TI EVM, do you see a similar issue?

    Regards,
    Krunal

  • Hello,

    Because it is a homemade development board, it is not possible to implement this verification.

  • Okay, in order to isolate the problem from Qt and GPU, could you try running glmark-es2-wayland or kmscube? Let's see if with standalone applications, you also see kernel crash and please capture the logs while running the applications.

    Regards,
    Krunal

  • Hi .we run the kms command  . the kmscube can't  work . the information is below.:
    root@am62xx-evm:~# kmsprint
    Connector 0 (39) DPI-1 (connected)
    Encoder 0 (38) DPI
    Crtc 0 (37) 1366x768 85.500 1366/60/143/223 768/3/3/24 60 (59.79)
    Plane 0 (31) fb-id: 47 (crtcs: 0) 0,0 1366x768 -> 0,0 1366x768 (AR12 AB12 RA12 RG16 BG16 AR15 AB15 AR24 AB24 RA24 BA24 RG24 BG24 AR30 AB30 XR12 XB12 RX12 XR15 XB15 XR24 XB24 RX24 BX24 XR30 XB30 YUYV UYVY NV12)
    FB 47 1366x768
    root@am62xx-evm:~# kmstest
    Could not get DRM master permission. Card already in use?
    root@am62xx-evm:~# cd /usr/bin
    root@am62xx-evm:/usr/bin# modetest
    trying to open device 'i915'...failed
    trying to open device 'amdgpu'...failed
    trying to open device 'radeon'...failed
    trying to open device 'nouveau'...failed
    trying to open device 'vmwgfx'...failed
    trying to open device 'omapdrm'...failed
    trying to open device 'exynos'...failed
    trying to open device 'tilcdc'...failed
    trying to open device 'msm'...failed
    trying to open device 'sti'...failed
    trying to open device 'tegra'...failed
    trying to open device 'imx-drm'...failed
    trying to open device 'rockchip'...failed
    trying to open device 'atmel-hlcdc'...failed
    trying to open device 'fsl-dcu-drm'...failed
    trying to open device 'vc4'...failed
    trying to open device 'virtio_gpu'...failed
    trying to open device 'mediatek'...failed
    trying to open device 'meson'...failed
    trying to open device 'pl111'...failed
    trying to open device 'stm'...failed
    trying to open device 'sun4i-drm'...failed
    trying to open device 'armada-drm'...failed
    no device found
    root@am62xx-evm:/usr/bin# ./kmscube
    no connected connector!
    failed to initialize legacy DRM
    root@am62xx-evm:/usr/bin#

    so how to run kmscube correctly . I found in link on the e2e .but I can't open it .  processors.wiki.ti.com/index.php

    could you give some advices as soon as possbile ? 
    Thanks very much!

  • Hello,

    Step 1: Stop Weston using the command "systemctl stop weston"

    Step 2: Run kmscube "kmscube -D /dev/dri/card0"
    Step2A: For modetest, the command is modetest -M tidss

    Regards,
    Krunal

  • Hi,we have test the kmscube .   kernel crash at  2.6 hours. 

    below is the kernel corrupt information :
    [ 31.801973] tlv71033: disabling
    [ 39.991073] am65-cpsw-nuss 8000000.ethernet eth0: Link is Up - 100Mbps/Full - flow control rx/tx
    [ 39.999949] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
    [ 55.420196] Initializing XFRM netlink socket
    [ 66.396502] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
    [ 66.417011] Bridge firewalling registered
    [ 67.954396] process 'docker/tmp/qemu-check474982910/check' started with executable stack
    [ 5187.639131] am65-cpsw-nuss 8000000.ethernet eth0: Link is Down
    [ 9499.734692] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000076
    [ 9499.743483] Mem abort info:
    [ 9499.746268] ESR = 0x96000006
    [ 9499.749312] EC = 0x25: DABT (current EL), IL = 32 bits
    [ 9499.754607] SET = 0, FnV = 0
    [ 9499.757649] EA = 0, S1PTW = 0
    [ 9499.760779] Data abort info:
    [ 9499.763648] ISV = 0, ISS = 0x00000006
    [ 9499.767470] CM = 0, WnR = 0
    [ 9499.770428] user pgtable: 4k pages, 48-bit VAs, pgdp=00000000854b6000
    [ 9499.776851] [0000000000000076] pgd=000000008558e003, p4d=000000008558e003, pud=0000000087780003, pmd=0000000000000000
    [ 9499.787450] Internal error: Oops: 96000006 [#1] PREEMPT SMP
    [ 9499.793008] Modules linked in: xt_conntrack xt_MASQUERADE xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_tables x_tables br_netfilter bridge stp llc overlay xfrm_user xfrm_algo md5 des_generic libdes cbc wlcore_sdio wl18xx wlcore mac80211 cfg80211 rfkill libarc4 usbhid xhci_plat_hcd xhci_hcd usbcore rpmsg_char dwc3 udc_core roles usb_common cdns_csi2rx v4l2_fwnode irq_pruss_intc pru_rproc pvrsrvkm(O) crct10dif_ce dwc3_am62 ti_k3_r5_remoteproc rti_wdt virtio_rpmsg_bus j721e_csi2rx videobuf2_dma_contig videobuf2_memops videobuf2_v4l2 videobuf2_common sa2ul sha512_generic authenc cdns_dphy mcrc pruss rtc_ds1307 sch_fq_codel cryptodev(O) ipv6
    [ 9499.854396] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G O 5.10.168-g2c23e6c538 #22
    [ 9499.862986] Hardware name: LICHAN Texas Instruments AM625 SK (DT)
    [ 9499.869067] pstate: 60000085 (nZCv daIf -PAN -UAO -TCO BTYPE=--)
    [ 9499.875071] pc : irq_find_mapping+0x1c/0xd8
    [ 9499.879245] lr : __handle_domain_irq+0x9c/0xc0
    [ 9499.883673] sp : ffff80001132bfb0
    [ 9499.886975] x29: ffff80001132bfb0 x28: ffff8000111919c0
    [ 9499.892277] x27: ffff8000111919c0 x26: ffff80001132c000
    [ 9499.897577] x25: ffff800011328000 x24: ffff800011189a54
    [ 9499.902877] x23: ffff800011183eb0 x22: 000000000000001e
    [ 9499.908178] x21: 000000000000001e x20: 000000001132bfe0
    [ 9499.913477] x19: 000000000000001e x18: 0000000000000000
    [ 9499.918777] x17: 0000000000000000 x16: 0000000000000000
    [ 9499.924077] x15: 0000000000000000 x14: 000000000000037b
    [ 9499.929377] x13: 0000000000000108 x12: 00000000003447d9
    [ 9499.934676] x11: 000000000000010a x10: 0000000000000004
    [ 9499.939976] x9 : 0000000000000000 x8 : 000008a3cee7f700
    [ 9499.945276] x7 : 7fffffffffffffff x6 : 00000199dc0c5bf9
    [ 9499.950579] x5 : 00ffffffffffffff x4 : ffff8000111919c0
    [ 9499.955881] x3 : 0000000000000001 x2 : ffff80000c848000
    [ 9499.961181] x1 : 000000001132bfe0 x0 : 000000000000001e
    [ 9499.966481] Call trace:
    [ 9499.968923] irq_find_mapping+0x1c/0xd8
    [ 9499.972747] __handle_domain_irq+0x9c/0xc0
    [ 9499.976835] Code: a90153f3 aa0103f4 aa0003f3 b4000320 (b9405a60)
    [ 9499.982932] ---[ end trace b7e50179b866b904 ]---
    [ 9499.987539] Kernel panic - not syncing: Oops: Fatal exception in interrupt
    [ 9499.994397] SMP: stopping secondary CPUs
    [ 9499.998319] Kernel Offset: disabled
    [ 9500.001797] CPU features: 0x00040002,2000200c
    [ 9500.006139] Memory Limit: none
    [ 9500.009192] ---[ end Kernel panic - not syncing: Oops: Fatal exception in interrupt ]---



    so what's the problem . is it the hardware problem or the software problem?

  • I test for second times.  the kernel crash very soon . below is the crash information:

    [ 0.854750] optee: probing for conduit method.
    [ 0.859330] optee: revision 3.20 (8e74d476)
    [ 0.859605] optee: dynamic shared memory is enabled
    [ 0.869119] optee: initialized driver
    [ 0.874894] NET: Registered protocol family 17
    [ 0.879617] 9pnet: Installing 9P2000 support
    [ 0.884064] Key type dns_resolver registered
    [ 0.888830] Loading compiled-in X.509 certificates
    [ 0.905295] ti-sci 44043000.system-controller: lpm region is required for suspend but not provided.
    [ 0.914639] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0008 '8.6.4--v08.06.04 (Chill Capybar')
    [ 0.981839] omap-gpmc 3b000000.memory-controller: GPMC revision 6.0
    [ 0.988346] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
    [ 0.996545] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x48
    [ 1.003094] nand: Micron MT29F16G08ABACAWP
    [ 1.007306] nand: 2048 MiB, SLC, erase size: 512 KiB, page size: 4096, OOB size: 224
    [ 1.015241] omap2-nand 51000000.nand: using prefetch polled xfer mode
    [ 1.021893] nand: using OMAP_ECC_BCH8_CODE_HW ECC scheme
    [ 1.027327] platform 25010000.ecc: Unable to configure elm - device not probed?
    [ 1.036354] omap_i2c 4900000.i2c: bus 0 rev0.12 at 100 kHz
    [ 1.042920] omap_i2c 2b200000.i2c: bus 1 rev0.12 at 100 kHz
    [ 1.049681] omap_i2c 20010000.i2c: bus 2 rev0.12 at 100 kHz
    [ 1.055805] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
    [ 1.064140] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
    [ 1.073382] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
    [ 1.084468] ti-udma 485c0100.dma-controller: Number of rings: 82
    [ 1.092631] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
    [ 1.103701] ti-udma 485c0000.dma-controller: Number of rings: 150
    [ 1.113533] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
    [ 1.123731] printk: console [ttyS2] disabled
    [ 1.128181] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 29, base_baud = 3000000) is a 8250
    [ 1.136951] printk: console [ttyS2] enabled
    [ 1.136951] printk: console [ttyS2] enabled
    [ 1.145395] printk: bootconsole [ns16550a0] disabled
    [ 1.145395] printk: bootconsole [ns16550a0] disabled
    [ 1.156253] omap8250 2830000.serial: failed to get alias
    [ 1.162191] omap8250 2840000.serial: failed to get alias
    [ 1.167972] omap8250 2850000.serial: failed to get alias
    [ 1.173671] omap8250 2860000.serial: failed to get alias
    [ 1.181118] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
    [ 1.193817] Logo parameter width:1366 ,height:768
    [ 1.193817]
    [ 1.199214] clutsize: 2
    [ 1.222476] Console: switching to colour frame buffer device 170x48
    [ 1.255805] tidss 30200000.dss: [drm] fb0: tidssdrmfb frame buffer device
    [ 1.271342] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [ 1.314728] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [ 1.324069] davinci_mdio 8000f00.mdio: phy[1]: device 8000f00.mdio:01, driver unknown
    [ 1.331905] davinci_mdio 8000f00.mdio: phy[2]: device 8000f00.mdio:02, driver unknown
    [ 1.339854] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000006
    [ 1.352832] am65-cpsw-nuss 8000000.ethernet: Use random MAC address
    [ 1.359099] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
    [ 1.366223] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
    [ 1.372968] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
    [ 1.383561] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
    [ 1.496347] mmc1: CQHCI version 5.10
    [ 1.504105] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x48
    [ 1.510531] nand: Micron MT29F16G08ABACAWP
    [ 1.514623] nand: 2048 MiB, SLC, erase size: 512 KiB, page size: 4096, OOB size: 224
    [ 1.522359] omap2-nand 51000000.nand: using prefetch polled xfer mode
    [ 1.528845] nand: using OMAP_ECC_BCH8_CODE_HW ECC scheme
    [ 1.534203] 8 fixed-partitions partitions found on MTD device omap2-nand.0
    [ 1.541066] Creating 8 MTD partitions on "omap2-nand.0":
    [ 1.541443] mmc1: SDHCI controller on fa00000.mmc [fa00000.mmc] using ADMA 64-bit
    [ 1.546385] 0x000000000000-0x000000200000 : "NAND.tiboot3"
    [ 1.560891] 0x000000200000-0x000000400000 : "NAND.tispl"
    [ 1.567521] 0x000000400000-0x000000800000 : "NAND.u-boot"
    [ 1.574362] 0x000000800000-0x000000840000 : "NAND.u-boot-env"
    [ 1.580123] mtd: partition "NAND.u-boot-env" doesn't end on an erase/write block -- force read-only
    [ 1.590278] 0x000000840000-0x0000008c0000 : "NAND.dtb"
    [ 1.590598] mmc1: new high speed SDHC card at address aaaa
    [ 1.595432] mtd: partition "NAND.dtb" doesn't start on an erase/write block boundary -- force read-only
    [ 1.601671] mmcblk1: mmc1:aaaa SC16G 14.8 GiB
    [ 1.611487] 0x0000008c0000-0x000000ac0000 : "NAND.logo"
    [ 1.619642] mmcblk1: p1 p2
    [ 1.619994] mtd: partition "NAND.logo" doesn't start on an erase/write block boundary -- force read-only
    [ 1.633609] 0x000000ac0000-0x0000023c0000 : "NAND.kernel"
    [ 1.639025] mtd: partition "NAND.kernel" doesn't start on an erase/write block boundary -- force read-only
    [ 1.652106] 0x0000023c0000-0x00001efc0000 : "NAND.file-system"
    [ 1.657969] mtd: partition "NAND.file-system" doesn't start on an erase/write block boundary -- force read-only
    [ 1.715101] debugfs: Directory 'pd:53' with parent 'pm_genpd' already present!
    [ 1.722385] debugfs: Directory 'pd:52' with parent 'pm_genpd' already present!
    [ 1.729717] debugfs: Directory 'pd:51' with parent 'pm_genpd' already present!
    [ 1.737261] debugfs: Directory 'pd:182' with parent 'pm_genpd' already present!
    [ 1.756659] ALSA device list:
    [ 1.759653] No soundcards found.
    [ 2.067245] EXT4-fs (mmcblk1p2): recovery complete
    [ 2.073019] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
    [ 2.081184] VFS: Mounted root (ext4 filesystem) on device 179:2.
    [ 2.089884] devtmpfs: mounted
    [ 2.094283] Freeing unused kernel memory: 1920K
    [ 2.098941] Run /sbin/init as init process
    [ 2.439993] systemd[1]: System time before build time, advancing clock.
    [ 2.520377] NET: Registered protocol family 10
    [ 2.526038] Segment Routing with IPv6
    [ 2.570650] systemd[1]: systemd 244.5+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
    [ 2.592693] systemd[1]: Detected architecture arm64.

    Welcome to Arago 2021.09!

    [ 2.633574] systemd[1]: Set hostname to <am62xx-evm>.
    [ 5.123750] systemd-sysv-generator[173]: Overwriting existing symlink /run/systemd/generator.late/sshd.service with real service.
    [ 5.286372] systemd[1]: /lib/systemd/system/startwlansta.service:7: Unknown key name 'After' in section 'Service', ignoring.
    [ 5.312018] systemd[1]: /lib/systemd/system/irqbalanced.service:6: Unknown key name 'ConditionCPUs' in section 'Unit', ignoring.
    [ 5.343418] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock 鈫/run/docker.sock; please update the unit file accordingly.
    [ 5.453141] random: systemd: uninitialized urandom read (16 bytes read)
    [ 5.463814] systemd[1]: Created slice system-getty.slice.
    [ OK ] Created slice system-getty.slice.
    [ 5.486916] random: systemd: uninitialized urandom read (16 bytes read)
    [ 5.495523] systemd[1]: Created slice system-serial\x2dgetty.slice.
    [ OK ] Created slice system-serial\x2dgetty.slice.
    [ 5.518883] random: systemd: uninitialized urandom read (16 bytes read)
    [ 5.527068] systemd[1]: Created slice User and Session Slice.
    [ OK ] Created slice User and Session Slice.
    [ 5.547246] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
    [ OK ] Started Dispatch Password 鈥s to Console Directory Watch.
    [ 5.571050] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
    [ OK ] Started Forward Password R鈥ests to Wall Directory Watch.
    [ 5.595015] systemd[1]: Reached target Paths.
    [ OK ] Reached target Paths.
    [ 5.610859] systemd[1]: Reached target Remote File Systems.
    [ OK ] Reached target Remote File Systems.
    [ 5.630829] systemd[1]: Reached target Slices.
    [ OK ] Reached target Slices.
    [ 5.646838] systemd[1]: Reached target Swap.
    [ OK ] Reached target Swap.
    [ 5.682818] systemd[1]: Listening on RPCbind Server Activation Socket.
    [ OK ] Listening on RPCbind Server Activation Socket.
    [ 5.707143] systemd[1]: Reached target RPC Port Mapper.
    [ OK ] Reached target RPC Port Mapper.
    [ 5.733733] systemd[1]: Listening on Process Core Dump Socket.
    [ OK ] Listening on Process Core Dump Socket.
    [ 5.755293] systemd[1]: Listening on initctl Compatibility Named Pipe.
    [ OK ] Listening on initctl Compatibility Named Pipe.
    [ 5.782325] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
    [ 5.791231] systemd[1]: Listening on Journal Socket (/dev/log).
    [ OK ] Listening on Journal Socket (/dev/log).
    [ 5.815523] systemd[1]: Listening on Journal Socket.
    [ OK ] Listening on Journal Socket.
    [ 5.831630] systemd[1]: Listening on Network Service Netlink Socket.
    [ OK ] Listening on Network Service Netlink Socket.
    [ 5.855406] systemd[1]: Listening on udev Control Socket.
    [ OK ] Listening on udev Control Socket.
    [ 5.875235] systemd[1]: Listening on udev Kernel Socket.
    [ OK ] Listening on udev Kernel Socket.
    [ 5.900038] systemd[1]: Mounting Huge Pages File System...
    Mounting Huge Pages File System...
    [ 5.920000] systemd[1]: Mounting POSIX Message Queue File System...
    Mounting POSIX Message Queue File System...
    [ 5.947858] systemd[1]: Mounting Kernel Debug File System...
    Mounting Kernel Debug File System...
    [ 5.970465] systemd[1]: Mounting Temporary Directory (/tmp)...
    Mounting Temporary Directory (/tmp)...
    [ 5.992504] systemd[1]: Starting Create list of static device nodes for the current kernel...
    Starting Create list of st鈥des for the current kernel...
    [ 6.024383] systemd[1]: Starting RPC Bind...
    Starting RPC Bind...
    [ 6.039155] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
    [ 6.055942] systemd[1]: Starting Journal Service...
    Starting Journal Service...
    [ 6.088177] systemd[1]: Starting Load Kernel Modules...
    Starting Load Kernel Modules...
    [ 6.110903] cryptodev: loading out-of-tree module taints kernel.
    [ 6.112666] systemd[1]: Starting Remount Root and Kernel File Systems...
    Starting Remount Root and Kernel File Systems 6.124845] cryptodev: driver 1.10 loaded.
    [0m...
    [ 6.141777] EXT4-fs (mmcblk1p2): re-mounted. Opts: (null)
    [ 6.153255] systemd[1]: Starting udev Coldplug all Devices...
    Starting udev Coldplug all Devices...
    [ 6.181435] systemd[1]: Started RPC Bind.
    [ OK ] Started RPC Bind.
    [ 6.203855] systemd[1]: Started Journal Service.
    [ OK ] Started Journal Service.
    [ OK ] Mounted Huge Pages File System.
    [ OK ] Mounted POSIX Message Queue File System.
    [ OK ] Mounted Kernel Debug File System.
    [ OK ] Mounted Temporary Directory (/tmp).
    [ OK ] Started Create list of sta鈥nodes for the current kernel.
    [ OK ] Started Load Kernel Modules.
    [ OK ] Started Remount Root and Kernel File Systems.
    Mounting Kernel Configuration File System...
    Starting Flush Journal to Persistent Storage...
    [ 6.407598] systemd-journald[186]: Received client request to flush runtime journal.
    Starting Apply Kernel Variables...
    Starting Create Static Device Nodes in /dev...
    [ OK ] Mounted Kernel Configuration File System.
    [ OK ] Started Flush Journal to Persistent Storage.
    [ OK ] Started Apply Kernel Variables.
    [ OK ] Started Create Static Device Nodes in /dev.
    [ 6.552062] random: systemd: uninitialized urandom read (16 bytes read)
    [ OK ] Reached target Local File Systems (Pre).
    [ 6.575079] random: systemd: uninitialized urandom read (16 bytes read)
    Mounting /media/ram...
    [ 6.591445] random: systemd-journal: uninitialized urandom read (16 bytes read)
    Mounting /var/volatile...
    Starting udev Kernel Device Manager...
    [ OK ] Started udev Coldplug all Devices.
    [ OK ] Mounted /media/ram.
    [ OK ] Mounted /var/volatile.
    Starting udev Wait for Complete Device Initialization...
    Starting Load/Save Random Seed...
    [ OK ] Reached target Local File Systems.
    Starting Create Volatile Files and Directories...
    [ OK ] Started udev Kernel Device Manager.
    [ OK ] Started Create Volatile Files and Directories.
    Starting Network Time Synchronization...
    Starting Update UTMP about System Boot/Shutdown...
    [ OK ] Started Update UTMP about System Boot/Shutdown.
    [ OK ] Started Network Time Synchronization.
    [ OK ] Reached target System Time Set.
    [ OK ] Reached target System Time Synchronized.
    [ 7.179567] rtc-ds1307 2-0068: registered as rtc0
    [ 7.195047] rtc-ds1307 2-0068: setting system clock to 2019-08-30T01:47:32 UTC (1567129652)
    [ 7.597128] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.605794] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.628908] random: systemd: uninitialized urandom read (16 bytes read)
    [ 7.647142] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [ 7.707899] platform 78000000.r5f: configured R5F for IPC-only mode
    [ 7.716103] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
    [ 7.725090] remoteproc remoteproc0: 78000000.r5f is available
    [ 7.731064] remoteproc remoteproc0: attaching to 78000000.r5f
    [ 7.739052] platform 78000000.r5f: R5F core initialized in IPC-only mode
    [ 7.745851] remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@9da00000
    [ 7.755085] virtio_rpmsg_bus virtio0: rpmsg host is online
    [ 7.755693] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
    [ 7.768596] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [ 7.768848] remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [ 7.785810] remoteproc remoteproc0: remote processor 78000000.r5f is now attached
    [ 7.806182] PVR_K: 210: Read BVNC 33.15.11.3 from HW device registers
    [ 7.814701] PVR_K: 210: RGX Device registered with BVNC 33.15.11.3
    [ 7.822403] [drm] Initialized pvr 1.15.6133109 20170530 for fd00000.gpu on minor 1
    [ 8.318629] remoteproc remoteproc1: 30074000.pru is available
    [ 8.351678] remoteproc remoteproc2: 30078000.pru is available
    [ 8.372882] cdns-csi2rx: probe of 30101000.csi-bridge failed with error -22
    [ 8.457206] usbcore: registered new interface driver usbfs
    [ 8.462855] usbcore: registered new interface driver hub
    [ 8.468313] usbcore: registered new device driver usb
    [ 8.495395] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
    [ 8.500935] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
    [ 8.508806] xhci-hcd xhci-hcd.0.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
    [ 8.518304] xhci-hcd xhci-hcd.0.auto: irq 492, io mem 0x31000000
    [ 8.524512] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
    [ 8.530035] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
    [ 8.537709] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
    [ 8.544410] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
    [ 8.552699] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 8.560008] usb usb1: Product: xHCI Host Controller
    [ 8.564902] usb usb1: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 8.571520] usb usb1: SerialNumber: xhci-hcd.0.auto
    [ 8.577104] hub 1-0:1.0: USB hub found
    [ 8.581001] hub 1-0:1.0: 1 port detected
    [ 8.587021] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
    [ 8.595233] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
    [ 8.603499] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 8.610741] usb usb2: Product: xHCI Host Controller
    [ 8.615624] usb usb2: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 8.622235] usb usb2: SerialNumber: xhci-hcd.0.auto
    [ 8.627767] hub 2-0:1.0: USB hub found
    [ 8.631580] hub 2-0:1.0: config failed, hub doesn't have any ports! (err -19)
    [ 8.640640] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
    [ 8.646182] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 3
    [ 8.654068] xhci-hcd xhci-hcd.1.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
    [ 8.654711] random: crng init done
    [ 8.663546] xhci-hcd xhci-hcd.1.auto: irq 493, io mem 0x31100000
    [ 8.666863] random: 189 urandom warning(s) missed due to ratelimiting
    [ 8.679589] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller

    [ 8.690655] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 4
    [ 8.698395] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
    [ 8.705092] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
    [ 8.713395] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 8.720629] usb usb3: Product: xHCI Host Controller
    [ 8.725517] usb usb3: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 8.732127] usb usb3: SerialNumber: xhci-hcd.1.auto
    [ 8.737666] hub 3-0:1.0: USB hub found
    [ 8.741489] hub 3-0:1.0: 1 port detected
    [ 8.747481] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
    [ 8.755720] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
    [ 8.763997] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [ 8.771240] usb usb4: Product: xHCI Host Controller
    [ 8.776122] usb usb4: Manufacturer: Linux 5.10.168-g2c23e6c538 xhci-hcd
    [ 8.782741] usb usb4: SerialNumber: xhci-hcd.1.auto
    [ 8.788279] hub 4-0:1.0: USB hub found
    [ 8.792098] hub 4-0:1.0: config failed, hub doesn't have any ports! (err -19)
    [ 8.842788] usb 1-1: new low-speed USB device number 2 using xhci-hcd
    [ 8.998182] usb 1-1: New USB device found, idVendor=17ef, idProduct=608d, bcdDevice= 1.00
    [ 9.006372] usb 3-1: new high-speed USB device number 2 using xhci-hcd
    [ 9.012910] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
    [ 9.020063] usb 1-1: Product: lenovo USB Optical Mouse
    [ 9.025257] usb 1-1: Manufacturer: PixArt
    [ 9.083567] input: PixArt lenovo USB Optical Mouse as /devices/platform/bus@f0000/f900000.dwc3-usb/31000000.usb/xhci-hcd.0.auto/usb1/1-1/1-1:1.0/0003:17EF:608D.0001/input/input0
    [ 9.099950] hid-generic 0003:17EF:608D.0001: input: USB HID v1.11 Mouse [PixArt lenovo USB Optical Mouse] on usb-xhci-hcd.0.auto-1/input0
    [ 9.114169] usbcore: registered new interface driver usbhid
    [ 9.119883] usbhid: USB HID core driver
    [ 9.171030] usb 3-1: New USB device found, idVendor=1a40, idProduct=0101, bcdDevice= 1.11
    [ 9.179226] usb 3-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
    [ 9.186390] usb 3-1: Product: USB 2.0 Hub
    [ 9.249335] hub 3-1:1.0: USB hub found
    [ 9.253221] hub 3-1:1.0: 4 ports detected
    [ OK ] Started udev Wait for Complete Device Initialization.
    [ OK ] Started Hardware RNG Entropy Gatherer Daemon.
    [ OK ] Reached target System Initialization.
    [ OK ] Started Daily rotation of log files.
    [ OK ] Started Daily Cleanup of Temporary Directories.
    [ OK ] Reached target Timers.
    [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
    [ OK ] Listening on D-Bus System Message Bus Socket.
    Starting Docker Socket for the API.
    [ OK ] Listening on dropbear.socket.
    Starting Reboot and dump vmcore via kexec...
    [ OK ] Listening on Docker Socket for the API.
    [ OK ] Started Reboot and dump vmcore via kexec.
    [ OK ] Reached target Sockets.
    [ OK ] Reached target Basic System.
    [ OK ] Started Job spooling tools.
    [ OK ] Started autorun.
    [ OK ] Started autorun2.
    [ OK ] Started Periodic Command Scheduler.
    [ OK ] Started D-Bus System Message Bus 9.646859] usb 3-1.2: new full-speed USB device number 3 using xhci-hcd
    m.
    Starting Print notice about GPLv3 packages...
    Starting IPv6 Packet Filtering Framework...
    Starting IPv4 Packet Filtering Framework...
    [ OK ] Started irqbalance daemon.
    Starting rc.pvr.service...
    Starting startwlansta...
    Starting Login Service...
    [ OK ] Started TEE Supplicant.
    [ OK ] Started IPv6 Packet Filtering Framework.
    [ OK ] Started IPv4 Packet Filtering Framework.
    [ OK ] Started startwlansta.
    [ OK ] Reached target Network (Pre).
    Starting Network Service...
    [ 9.885391] usb 3-1.2: New USB device found, idVendor=046d, idProduct=c534, bcdDevice=29.01
    [ 9.893984] usb 3-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
    [ 9.901383] usb 3-1.2: Product: USB Receiver
    [ 9.910756] usb 3-1.2: Manufacturer: Logitech
    [ 9.989599] input: Logitech USB Receiver as /devices/platform/bus@f0000/f910000.dwc3-usb/31100000.usb/xhci-hcd.1.auto/usb3/3-1/3-1.2/3-1.2:1.0/0003:046D:C534.0002/input/input1
    [ 10.013055] FAT-fs (mmcblk1p1): utf8 is not a recommended IO charset for FAT filesystems, filesystem will be case sensitive!
    [ 10.034494] FAT-fs (mmcblk1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
    [ 10.071612] hid-generic 0003:046D:C534.0002: input: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-xhci-hcd.1.auto-1.2/input0
    [ 10.096438] input: Logitech USB Receiver Mouse as /devices/platform/bus@f0000/f910000.dwc3-usb/31100000.usb/xhci-hcd.1.auto/usb3/3-1/3-1.2/3-1.2:1.1/0003:046D:C534.0003/input/input2
    [ 10.120025] input: Logitech USB Receiver Consumer Control as /devices/platform/bus@f0000/f910000.dwc3-usb/31100000.usb/xhci-hcd.1.auto/usb3/3-1/3-1.2/3-1.2:1.1/0003:046D:C534.0003/input/input3
    [ 10.196062] input: Logitech USB Receiver System Control as /devices/platform/bus@f0000/f910000.dwc3-usb/31100000.usb/xhci-hcd.1.auto/usb3/3-1/3-1.2/3-1.2:1.1/0003:046D:C534.0003/input/input4
    [ 10.219501] hid-generic 0003:046D:C534.0003: input: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-xhci-hcd.1.auto-1.2/input1
    [ OK ] Listening on Load/Save RF 鈥tch Status /dev/rfkill Watch.
    [ 10.314156] cfg80211: Loading compiled-in X.509 certificates for regulatory database
    [ 10.367907] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
    [ OK ] Started Network Service.
    Starting Wait for Network to be Configured...
    Starting Network Name Resolution...
    [ 10.425829] am65-cpsw-nuss 8000000.ethernet eth1: PHY [8000f00.mdio:01] driver [Generic PHY] (irq=POLL)
    [ 10.441107] am65-cpsw-nuss 8000000.ethernet eth1: configuring for phy/rmii link mode
    [ 10.512348] am65-cpsw-nuss 8000000.ethernet eth0: PHY [8000f00.mdio:02] driver [Generic PHY] (irq=POLL)
    [ 10.582834] am65-cpsw-nuss 8000000.ethernet eth0: configuring for phy/rmii link mode
    [ OK ] Started Login Service.
    [ OK ] Started rc.pvr.service.
    Starting weston.service...
    [ OK ] Started Network Name Resolution.
    [ OK ] Reached target Network.
    [ OK ] Reached target Host and Network Name Lookups.
    Starting Avahi mDNS/DNS-SD Stack...
    Starting Enable and configure wl18xx bluetooth stack...
    [ OK ] Started NFS status monitor for NFSv2/3 locking..
    Starting Simple Network Ma鈥nt Protocol (SNMP) Daemon....
    Starting Permit User Sessions...
    [ OK ] Started Avahi mDNS/DNS-SD Stack.
    [ OK ] Started Enable and configure wl18xx bluetooth stack.
    [ OK ] Started Permit User Sessions.
    [ OK ] Started Getty on tty1.
    [ OK ] Started Serial Getty on ttyS2.
    [ OK ] Reached target Login Prompts.
    Starting Synchronize System and HW clocks...
    [ OK ] Started weston.service.
    Starting telnetd.service...
    [ OK ] Started telnetd.service.
    Starting hmi_demo.service...
    Starting LSB: Expand Rootfs of boot device...
    [ 11.481786] startwlansta.sh[398]: Wi-Fi user configuration file missing, exit
    [ OK ] Started Synchronize System and HW clocks.
    [ OK ] Started LSB: Expand Rootfs of boot device.
    [ 12.492961] PVR_K: 516: RGX Firmware image 'rgx.fw.33.15.11.3' loaded
    [ 12.503207] am65-cpsw-nuss 8000000.ethernet eth1: Link is Up - 100Mbps/Full - flow control off
    [ 12.511978] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
    [ 12.539019] PVR_K: 516: Shader binary image 'rgx.sh.33.15.11.3' loaded
    [ OK ] Started Simple Network Man鈥ment Protocol (SNMP) Daemon..
    [ OK ] Started hmi_demo.service.
    Stopping hmi_demo.service...
    [ OK ] Stopped hmi_demo.service.
    usb device not exist
    ***************************************************************
    ***************************************************************
    NOTICE: This file system contains the following GPLv3 packages:
    autoconf
    bash-dev
    bash
    bc
    binutils
    cifs-utils
    coreutils-stdbuf
    coreutils
    cpio
    cpp-symlinks
    cpp
    dosfstools
    elfutils
    g++-symlinks
    g++
    gawk
    gcc-symlinks
    gcc
    gdb
    gdbserver
    gettext
    glmark2
    gstreamer1.0-libav
    gzip
    hidapi
    less
    libasm1
    libbfd
    libdw1
    libelf1
    libgdbm-compat4
    libgdbm-dev
    libgdbm6
    libgettextlib
    libgettextsrc
    libgmp10
    libidn2-0
    libmpc3
    libmpfr6
    libreadline-dev
    libreadline8
    libunistring2
    m4-dev
    m4
    make
    nettle
    parted
    tar
    which

    If you do not wish to distribute GPLv3 components please remove
    the above packages prior to distribution. This can be done using
    the opkg remove command. i.e.:
    opkg remove <package>
    Where <package> is the name printed in the list above

    NOTE: If the package is a dependency of another package you
    will be notified of the dependent packages. You should
    use the --force-removal-of-dependent-packages option to
    also remove the dependent packages as well
    ***************************************************************
    ***************************************************************
    [ OK ] Started Print notice about GPLv3 packages.

    _____ _____ _ _
    | _ |___ ___ ___ ___ | _ |___ ___ |_|___ ___| |_
    | | _| .'| . | . | | __| _| . | | | -_| _| _|
    |__|__|_| |__,|_ |___| |__| |_| |___|_| |___|___|_|
    |___| |___|

    Arago Project am62xx-evm ttyS2

    Arago 2021.09 am62xx-evm ttyS2

    am62xx-evm login:
    am62xx-evm login:
    am62xx-evm login: root
    root@am62xx-evm:~# systemctl stop weston
    root@am62xx-evm:~# kmxcube[ 31.798808] vdd_mmc1: disabling
    [ 31.801984] tlv71033: disabling

    -sh: kmxcube: command not found
    root@am62xx-evm:~# kmscube -D /dev/dri/card0
    Using display 0x2fc149c0 with EGL version 1.5
    ===================================
    EGL information:
    version: "1.5"
    vendor: "Mesa Project"
    client extensions: "EGL_EXT_client_extensions EGL_EXT_device_base EGL_EXT_device_enumeration EGL_EXT_device_query EGL_EXT_platform_base EGL_KHR_client_get_all_proc_addresses EGL_KHR_debug EGL_EXT_platform_device EGL_EXT_platform_wayland EGL_KHR_platform_wayland EGL_MESA_platform_gbm EGL_KHR_platform_gbm EGL_MESA_platform_surfaceless"
    display extensions: "EGL_ANDROID_native_fence_sync EGL_EXT_buffer_age EGL_EXT_create_context_robustness EGL_EXT_image_dma_buf_import EGL_EXT_image_dma_buf_import_modifiers EGL_EXT_image_gl_colorspace EGL_EXT_yuv_surface EGL_IMG_context_priority EGL_KHR_cl_event2 EGL_KHR_config_attribs EGL_KHR_create_context EGL_KHR_fence_sync EGL_KHR_get_all_proc_addresses EGL_KHR_gl_colorspace EGL_KHR_gl_renderbuffer_image EGL_KHR_gl_texture_2D_image EGL_KHR_gl_texture_3D_image EGL_KHR_gl_texture_cubemap_image EGL_KHR_image EGL_KHR_image_base EGL_KHR_image_pixmap EGL_KHR_no_config_context EGL_KHR_partial_update EGL_KHR_reusable_sync EGL_KHR_surfaceless_context EGL_EXT_pixel_format_float EGL_KHR_wait_sync EGL_MESA_configless_context EGL_MESA_drm_image EGL_MESA_image_dma_buf_export EGL_WL_bind_wayland_display EGL_IMG_cl_image "
    ===================================
    OpenGL ES 2.x information:
    version: "OpenGL ES 3.1 build 1.15@6133109"
    shading language version: "OpenGL ES GLSL ES 3.10 build 1.15@6133109"
    vendor: "Imagination Technologies"
    renderer: "PowerVR Rogue AXE-1-16M"
    extensions: "GL_APPLE_texture_format_BGRA8888 GL_EXT_blend_minmax GL_EXT_buffer_storage GL_EXT_clip_control GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_EXT_compressed_ETC1_RGB8_sub_texture GL_EXT_conservative_depth GL_EXT_copy_image GL_EXT_discard_framebuffer GL_EXT_draw_buffers GL_EXT_draw_buffers_indexed GL_EXT_draw_elements_base_vertex GL_EXT_EGL_image_array GL_EXT_float_blend GL_EXT_gpu_shader5 GL_EXT_memory_object GL_EXT_memory_object_fd GL_EXT_multi_draw_arrays GL_EXT_multisampled_render_to_texture GL_EXT_multisampled_render_to_texture2 GL_EXT_occlusion_query_boolean GL_EXT_polygon_offset_clamp GL_EXT_read_format_bgra GL_EXT_robustness GL_EXT_separate_shader_objects GL_EXT_shader_framebuffer_fetch GL_EXT_shader_group_vote GL_EXT_shader_implicit_conversions GL_EXT_shader_io_blocks GL_EXT_shader_non_constant_global_initializers GL_EXT_shader_pixel_local_storage GL_EXT_shader_pixel_local_storage2 GL_EXT_shader_texture_lod GL_EXT_shadow_samplers GL_EXT_sparse_texture GL_EXT_sRGB_write_control GL_EXT_texture_border_clamp GL_EXT_texture_buffer GL_EXT_texture_cube_map_array GL_EXT_texture_format_BGRA8888 GL_EXT_texture_format_sRGB_override GL_EXT_texture_rg GL_EXT_texture_shadow_lod GL_EXT_texture_sRGB_decode GL_EXT_texture_sRGB_R8 GL_EXT_texture_sRGB_RG8 GL_EXT_YUV_target GL_IMG_framebuffer_downsample GL_IMG_multisampled_render_to_texture GL_IMG_program_binary GL_IMG_read_format GL_IMG_shader_binary GL_IMG_texture_format_BGRA8888 GL_IMG_texture_npot GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_KHR_debug GL_KHR_robustness GL_OES_compressed_ETC1_RGB8_texture GL_OES_depth24 GL_OES_depth_texture GL_OES_draw_buffers_indexed GL_OES_draw_elements_base_vertex GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_image_external_essl3 GL_OES_EGL_sync GL_OES_element_index_uint GL_OES_fragment_precision_high GL_OES_get_program_binary GL_OES_gpu_shader5 GL_OES_mapbuffer GL_OES_packed_depth_stencil GL_OES_required_internalformat GL_OES_rgb8_rgba8 GL_OES_sample_shading GL_OES_sample_variables GL_OES_shader_image_atomic GL_OES_shader_io_blocks GL_OES_shader_multisample_interpolation GL_OES_standard_derivatives GL_OES_surfaceless_context GL_OES_texture_border_clamp GL_OES_texture_buffer GL_OES_texture_cube_map_array GL_OES_texture_float GL_OES_texture_half_float GL_OES_texture_npot GL_OES_texture_stencil8 GL_OES_texture_storage_multisample_2d_array GL_OES_vertex_array_object GL_OES_vertex_half_float"
    ===================================
    [ 113.982708] Unable to handle kernel execute from non-executable memory at virtual address ffff8000113ebde0
    [ 113.992371] Mem abort info:
    [ 113.995160] ESR = 0x8600000f
    [ 113.998206] EC = 0x21: IABT (current EL), IL = 32 bits
    [ 114.003506] SET = 0, FnV = 0
    [ 114.006559] EA = 0, S1PTW = 0
    [ 114.009691] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082f9b000
    [ 114.016376] [ffff8000113ebde0] pgd=000000009d9ff003, p4d=000000009d9ff003, pud=000000009d9fe003, pmd=000000009d9fa003, pte=006800008010b703
    [ 114.028899] Internal error: Oops: 8600000f [#1] PREEMPT SMP
    [ 114.034470] Modules linked in: wlcore_sdio wl18xx wlcore mac80211 cfg80211 rfkill libarc4 usbhid xhci_plat_hcd xhci_hcd usbcore rpmsg_char dwc3 udc_core roles usb_common cdns_csi2rx v4l2_fwnode pru_rproc irq_pruss_intc crct10dif_ce pvrsrvkm(O) dwc3_am62 ti_k3_r5_remoteproc rti_wdt virtio_rpmsg_bus sa2ul sha512_generic authenc mcrc cdns_dphy j721e_csi2rx videobuf2_dma_contig videobuf2_memops pruss videobuf2_v4l2 videobuf2_common rtc_ds1307 sch_fq_codel cryptodev(O) ipv6
    [ 114.076059] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G O 5.10.168-g2c23e6c538 #22
    [ 114.084671] Hardware name: LICHAN Texas Instruments AM625 SK (DT)
    [ 114.090770] pstate: 40000085 (nZcv daIf -PAN -UAO -TCO BTYPE=--)
    [ 114.096776] pc : 0xffff8000113ebde0
    [ 114.100319] lr : gic_handle_irq+0x2c/0x128
    [ 114.104428] sp : ffff80001133bfe0
    [ 114.107732] x29: ffff80001133bfe0 x28: ffff0000000fd580
    [ 114.113037] x27: ffff0000000fd580 x26: ffff80001133c000
    [ 114.118343] x25: ffff800011338000 x24: ffff800011189a54
    [ 114.123655] x23: 0000000040000005 x22: ffff800010b12510
    [ 114.128958] x21: ffff8000113ebf30 x20: 0000ffffffffffff
    [ 114.134264] x19: 000000000000001e x18: 0000000000000000
    [ 114.139571] x17: 0000000000000000 x16: 0000000000000000
    [ 114.144875] x15: 000009fef747f0d6 x14: 00000000000002e9
    [ 114.150183] x13: 0000000000000000 x12: 0000000000000001
    [ 114.155491] x11: 0000000000000000 x10: 00000000000009f0
    [ 114.160795] x9 : ffff8000113ebe90 x8 : ffff0000000fdfd0
    [ 114.166096] x7 : ffff00001d8b26c0 x6 : ffff0000000fd580
    [ 114.171405] x5 : ffff00001d8b32c0 x4 : ffff00001d8b33c0
    [ 114.176717] x3 : ffff8000113ebde0 x2 : 00000000fffffc22
    [ 114.182022] x1 : ffff80001052b898 x0 : ffff8000113ebde0
    [ 114.187328] Call trace:
    [ 114.189775] 0xffff8000113ebde0
    [ 114.192915] el1_irq+0xcc/0x180
    [ 114.196051] arch_cpu_idle+0x18/0x28
    [ 114.199649] default_idle_call+0x20/0x68
    [ 114.203577] do_idle+0x218/0x268
    [ 114.206797] cpu_startup_entry+0x24/0x50
    [ 114.210712] secondary_start_kernel+0x15c/0x188
    [ 114.215237] Code: 113ebf10 ffff8000 10011c8c ffff8000 (000000e0)
    [ 114.221342] ---[ end trace 42eee9201a4c3f5f ]---
    [ 114.225955] Kernel panic - not syncing: Attempted to kill the idle task!
    [ 114.232645] SMP: stopping secondary CPUs
    [ 114.236584] Kernel Offset: disabled
    [ 114.240066] CPU features: 0x00040002,2000200c
    [ 114.244411] Memory Limit: none
    [ 114.247467] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]---

  • Hello,

    Unfortunately, the logs do not tell much about the issue and it's a generic log. 

    Do you see similar behavior if you try the following tests:

    Test 1: Disable GPU and try running CPU based display tests
    rmmod pvrsrvkm
    glmark2-es2-drm 

    Test 2: Run a CPU stress tests to see if it triggers the issue

    stress-ng -c4 --cpu-method=all

    Regards,
    Krunal

  • Hello, I have run the 2 tests.
    test1: it is not work .

    root@am62xx-evm:/usr/lib# glmark2-es2-drm
    (1181) PVR:(Error): PVRDRICreateScreenImpl: Failed to open render device node [ :179 ]
    MESA-LOADER: failed to open kms_swrast: /usr/lib/dri/kms_swrast_dri.so: cannot open shared object file: No such file or directory (search paths /usr/lib/dri)
    failed to load driver: kms_swrast
    MESA-LOADER: failed to open swrast: /usr/lib/dri/swrast_dri.so: cannot open shared object file: No such file or directory (search paths /usr/lib/dri)
    failed to load swrast driver
    Error: Failed to create GBM device
    Error: main: Could not initialize canvas
    Segmentation fault (core dumped)
    root@am62xx-evm:/usr/lib# cd dri
    root@am62xx-evm:/usr/lib/dri# ls
    pvr_dri.so
    root@am62xx-evm:/usr/lib/dri# cd

    Test2: it seems the coredump .
    root@am62xx-evm:~# stress-ng -c4 --cpu-method=all
    stress-ng: info: [1193] defaulting to a 86400 second (1 day, 0.00 secs) run per stressor
    stress-ng: info: [1193] dispatching hogs: 4 cpu
    [ 1080.436410] systemd-coredump[1206]: Failed to get EXE, ignoring: No such process
    [ 1458.603296] systemd-coredump[1214]: Failed to get EXE, ignoring: No such process

  • For test 1, could you migrate to 9.0 SDK because it seems like you are using an older release?

    For test 2, how many ARM cores do you have on your custom board?

    Regards,
    Krunal

  • we now use 8.6.0.42 sdk .
    we use AM6254, 4 cores on the board.

  • Is it possible to migrate to newer SDK? What kernel version are you using and have you made major modifications? We do not see the same issue on our software running on our EVM.

    Regards,
    Krunal

  • now  I am migrating the newest SDK 9.0. 
     

    The SDK8.6.0.42 kernel version is  5.10.168.and we didn't do modification. we just change RAM size to 512M(0x20000000).

  • What changes did you make in Uboot and Kernel for 512MB RAM? Also, please post your changes/logs/diffs in a text file and do not just copy/paste your code.

    Regards,
    Krunal

  • u-boot:k3-am62x-sk-common.dtsi
    	memory@80000000 {
    		device_type = "memory";
    		/* 512M RAM */
    	+   reg = <0x00000000 0x80000000 0x00000000 0x20000000>;//512M
    	-	reg = <0x00000000 0x80000000 0x00000000 0x80000000>;// 2G
    
    	};
    	
    	k3-am62x-r5-sk-common.dtsi
    		memory@80000000 {
    		device_type = "memory";
    		/* 512M RAM */
    	+	reg = <0x00000000 0x80000000 0x00000000 0x20000000>;//512M
    	-	reg = <0x00000000 0x80000000 0x00000000 0x80000000>;//2G
    
    		u-boot,dm-spl;
    	};
    
    
    kernel:k3-am625-sd.dts
    
    	memory@80000000 {
    		device_type = "memory";
    		/* 512M RAM */
    	+	reg = <0x00000000 0x80000000 0x00000000 0x20000000>;//512M
    	-	reg = <0x00000000 0x80000000 0x00000000 0x80000000>;//2G
    
    	}; 

  • Okay, that looks okay to me. Let's see the behavior of your board once you migrate  to 9.0 release. 

    Regards,
    Krunal

  • HI,I have migrated to 9.0 release . 

    and do the 2 tests:

    Test 1: Disable GPU and try running CPU based display tests
    rmmod pvrsrvkm
    glmark2-es2-drm

    the error is below:
     root@am62xx-evm:/usr/bin# glmark2-es2-drm
    MESA-LOADER: failed to open zink: /usr/lib/dri/zink_dri.so: cannot open shared object file: No such file or directory (search paths /usr/lib/dri, suffix _dri)
    failed to load driver: zink 

    the applcation just run about 10s then killed .

    Test 2: Run a CPU stress tests to see if it triggers the issue

    stress-ng -c4 --cpu-method=all

    the test2  run  successfully  for 12 hours  ,but there is some print information during running .

    root@am62xx-evm:/usr/lib# glmark2-es2-drm
    MESA-LOADER: failed to open zink: /usr/lib/dri/zink_dri.so: cannot open shared object file: No such file or directory (search paths /usr/lib/dri, suffix _dri)
    failed to load driver: zink
    =======================================================
        glmark2 2021.12
    =======================================================
        OpenGL Information
        GL_VENDOR:     Mesa/X.org
        GL_RENDERER:   softpipe
        GL_VERSION:    OpenGL ES 3.1 Mesa 22.3.5 (git-54fd9d7dea)
    =======================================================
    [build] use-vbo=false: FPS: 5 FrameTime: 200.000 ms
    [build] use-vbo=true: FPS: 5 FrameTime: 200.000 ms
    [  654.447406] glmark2-es2-drm invoked oom-killer: gfp_mask=0x140dca(GFP_HIGHUSER_MOVABLE|__GFP_COMP|__GFP_ZERO), order=0, oom_score_adj=0
    [  654.459690] CPU: 1 PID: 2085 Comm: glmark2-es2-drm Tainted: G           O       6.1.46-dirty #1
    [  654.468398] Hardware name: Texas Instruments AM625 SK (DT)
    [  654.473883] Call trace:
    [  654.476339]  dump_backtrace.part.0+0xdc/0xf0
    [  654.480641]  show_stack+0x18/0x30
    [  654.483973]  dump_stack_lvl+0x68/0x84
    [  654.487657]  dump_stack+0x18/0x34
    [  654.490988]  dump_header+0x48/0x1a4
    [  654.494492]  oom_kill_process+0x2b4/0x2c0
    [  654.498514]  out_of_memory+0xe8/0x360
    [  654.502186]  __alloc_pages+0x964/0xce4
    [  654.505947]  __folio_alloc+0x1c/0x60
    [  654.509532]  alloc_zeroed_user_highpage_movable+0x38/0x44
    [  654.514943]  __handle_mm_fault+0x56c/0xc10
    [  654.519062]  handle_mm_fault+0xec/0x280
    [  654.522904]  do_page_fault+0x124/0x3d0
    [  654.526664]  do_translation_fault+0xac/0xc0
    [  654.530858]  do_mem_abort+0x44/0x94
    [  654.534356]  el0_da+0x30/0x90
    [  654.537340]  el0t_64_sync_handler+0xf8/0x140
    [  654.541616]  el0t_64_sync+0x18c/0x190
    [  654.545368] Mem-Info:
    [  654.547664] active_anon:59 inactive_anon:89134 isolated_anon:0
    [  654.547664]  active_file:164 inactive_file:245 isolated_file:0
    [  654.547664]  unevictable:0 dirty:0 writeback:0
    [  654.547664]  slab_reclaimable:3066 slab_unreclaimable:6536
    [  654.547664]  mapped:879 shmem:2434 pagetables:773
    [  654.547664]  sec_pagetables:0 bounce:0
    [  654.547664]  kernel_misc_reclaimable:0
    [  654.547664]  free:1312 free_pcp:43 free_cma:2
    [  654.585723] Node 0 active_anon:236kB inactive_anon:356536kB active_file:428kB inactive_file:768kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:3192kB dirty:0kB writeback:0kB shmem:9736kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:2624kB pagetables:3092kB sec_pagetables:0kB all_unreclaimable? no
    [  654.616489] DMA free:4700kB boost:0kB min:2640kB low:3300kB high:3960kB reserved_highatomic:0KB active_anon:236kB inactive_anon:356460kB active_file:428kB inactive_file:1432kB unevictable:0kB writepending:0kB present:524288kB managed:437756kB mlocked:0kB bounce:0kB free_pcp:536kB local_pcp:0kB free_cma:8kB
    [  654.643623] lowmem_reserve[]: 0 0 0 0
    [  654.647310] DMA: 450*4kB (UMEC) 196*8kB (UME) 72*16kB (UME) 24*32kB (UME) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5288kB
    [  654.659973] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
    [  654.668685] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
    [  654.677225] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
    [  654.685681] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
    [  654.693943] 2933 total pagecache pages
    [  654.697695] 0 pages in swap cache
    [  654.701008] Free swap  = 0kB
    [  654.703891] Total swap = 0kB
    [  654.706772] 131072 pages RAM
    [  654.709722] 0 pages HighMem/MovableOnly
    [  654.713580] 21633 pages reserved
    [  654.716828] 12800 pages cma reserved
    [  654.720411] 0 pages hwpoisoned
    [  654.723465] Tasks state (memory values in pages):
    [  654.728170] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
    [  654.736820] [    165]   997   165     1095       69    45056        0             0 rpcbind
    [  654.745170] [    166]     0   166     8517     1056    65536        0          -250 systemd-journal
    [  654.754238] [    187]     0   187     5480      703    73728        0         -1000 systemd-udevd
    [  654.763137] [    190]   991   190    20760      121    65536        0             0 systemd-timesyn
    [  654.772198] [    234]   998   234     1666      133    49152        0          -900 dbus-broker-lau
    [  654.781268] [    280]   998   280      850      133    40960        0          -900 dbus-broker
    [  654.790002] [    281]     0   281      607       34    40960        0             0 atd
    [  654.798045] [    282]     0   282      719       66    40960        0             0 crond
    [  654.806250] [    305]     0   305    19614       62    53248        0             0 irqbalance
    [  654.814866] [    307]     0   307     2396      188    49152        0             0 ofonod
    [  654.823143] [    308]   990   308    38054      305    77824        0             0 pulseaudio
    [  654.831780] [    313]     0   313      699       58    40960        0             0 starter
    [  654.840160] [    320]     0   320     2341      140    61440        0             0 systemd-logind
    [  654.849147] [    327]     0   327      677       29    45056        0             0 tee-supplicant
    [  654.858116] [    331]     0   331      772       23    40960        0             0 telnetd
    [  654.866474] [    334]   993   334     2634      135    57344        0             0 systemd-network
    [  654.875525] [    451]     0   451   298854      343   200704        0             0 charon
    [  654.883813] [    453]   992   453     2323      115    53248        0             0 systemd-resolve
    [  654.892893] [    462]   995   462     1450       90    49152        0             0 avahi-daemon
    [  654.901699] [    467]     0   467      763       24    45056        0             0 netserver
    [  654.910255] [    469]   996   469      732       41    45056        0             0 rpc.statd
    [  654.918795] [    473]     0   473     3304      821    61440        0             0 snmpd
    [  654.926997] [    476]     0   476      561       19    40960        0             0 agetty
    [  654.935319] [    482]     0   482     1322       97    53248        0             0 login
    [  654.943551] [    485]     0   485   393100     4687   311296        0          -999 containerd
    [  654.952204] [    486]   995   486     1404       64    49152        0             0 avahi-daemon
    [  654.961021] [    488]     0   488     2216       92    57344        0             0 systemd-userdbd
    [  654.970076] [    944]     0   944   358706     6736   331776        0             0 dockerd
    [  654.978462] [   1094]     0  1094     2726      226    61440        0           100 systemd
    [  654.986859] [   1097]     0  1097     3409      555    61440        0           100 (sd-pam)
    [  654.995343] [   1115]     0  1115     1258      403    45056        0             0 sh
    [  655.003315] [   2085]     0  2085   110666    69244   925696        0             0 glmark2-es2-drm
    [  655.012456] [   2089]     0  2089     2218       88    57344        0             0 systemd-userwor
    [  655.021534] [   2090]     0  2090     2218       87    53248        0             0 systemd-userwor
    [  655.030637] [   2091]     0  2091     2218       87    53248        0             0 systemd-userwor
    [  655.039743] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-0.slice/session-c2.scope,task=glmark2-es2-drm,pid=2085,uid=0
    [  655.056519] Out of memory: Killed process 2085 (glmark2-es2-drm) total-vm:442664kB, anon-rss:276976kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:904kB oom_score_adj:0
    Killed
    root@am62xx-evm:/usr/lib# ls
    root@am62xx-evm:~# stress-ng -c4 --cpu-method=all
    stress-ng: info:  [3664] defaulting to a 86400 second (1 day, 0.00 secs) run per stressor
    stress-ng: info:  [3664] dispatching hogs: 4 cpu
    
    [ 9983.915283] rcu: INFO: rcu_preempt self-detected stall on CPU
    [ 9983.921064] rcu:     0-....: (5369 ticks this GP) idle=aa6c/1/0x4000000000000000 softirq=137487/137490 fqs=2518
    [ 9983.930877]  (t=5253 jiffies g=240069 q=615 ncpus=4)
    [ 9983.935836] CPU: 0 PID: 3667 Comm: stress-ng Tainted: G           O       6.1.46-dirty #1
    [ 9983.943998] Hardware name: Texas Instruments AM625 SK (DT)
    [ 9983.949471] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
    [ 9983.956417] pc : _raw_spin_unlock_irqrestore+0xc/0x50
    [ 9983.961474] lr : vblank_disable_fn+0x84/0xa0 [drm]
    [ 9983.966537] sp : ffff800008003e30
    [ 9983.969840] x29: ffff800008003e30 x28: 0000000000000020 x27: 0000000000000000
    [ 9983.976971] x26: ffff800000ce2900 x25: ffff8000092279c0 x24: ffff000018bb61a8
    [ 9983.984095] x23: 0000000000000000 x22: ffff000001e70480 x21: ffff000004154000
    [ 9983.991218] x20: ffff000004154144 x19: 0000000000000000 x18: ffff800000dd8000
    [ 9983.998342] x17: ffff80000faf8000 x16: ffff800008000000 x15: 000000000000003c
    [ 9984.005464] x14: ffffffffffffffff x13: 0000000000000001 x12: 000000000000003c
    [ 9984.012587] x11: 0000000000000901 x10: 0000000000000002 x9 : 0000000000000031
    [ 9984.019711] x8 : 000000000000002b x7 : ffff800000dd85c0 x6 : 000001d02ab512f2
    [ 9984.026834] x5 : 03ffffffffffffff x4 : ffff0000002611c0 x3 : 0000000000000000
    [ 9984.033956] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff000004154144
    [ 9984.041080] Call trace:
    [ 9984.043517]  _raw_spin_unlock_irqrestore+0xc/0x50
    [ 9984.048220]  call_timer_fn.constprop.0+0x24/0x80
    [ 9984.052831]  __run_timers.part.0+0x1f4/0x234
    [ 9984.057089]  run_timer_softirq+0x3c/0x7c
    [ 9984.061004]  _stext+0x124/0x2a4
    [ 9984.064143]  ____do_softirq+0x10/0x20
    [ 9984.067800]  call_on_irq_stack+0x24/0x4c
    [ 9984.071719]  do_softirq_own_stack+0x1c/0x30
    [ 9984.075895]  __irq_exit_rcu+0xcc/0xf4
    [ 9984.079556]  irq_exit_rcu+0x10/0x20
    [ 9984.083036]  el0_interrupt+0x50/0xdc
    [ 9984.086606]  __el0_irq_handler_common+0x18/0x24
    [ 9984.091134]  el0t_64_irq_handler+0x10/0x20
    [ 9984.095233]  el0t_64_irq+0x18c/0x190
    
    
    
    
    
    ^Cstress-ng: info:  [3664] successful run completed in 45105.35s (12 hours, 31 mins, 45.35 secs)

  • Hi, the glmark2-es2-drm now run 。 
    the informaiton is below ;

    root@am62xx-evm:/hmi_test# glmark2-es2-drm
    =======================================================
    glmark2 2021.12
    =======================================================
    OpenGL Information
    GL_VENDOR: Imagination Technologies
    GL_RENDERER: PowerVR A-Series AXE-1-16M
    GL_VERSION: OpenGL ES 3.1 build 23.2@6460340
    =======================================================
    [build] use-vbo=false: FPS: 59 FrameTime: 16.949 ms
    [build] use-vbo=true: FPS: 59 FrameTime: 16.949 ms
    [texture] texture-filter=nearest: FPS: 59 FrameTime: 16.949 ms
    [texture] texture-filter=linear: FPS: 59 FrameTime: 16.949 ms
    [texture] texture-filter=mipmap: FPS: 59 FrameTime: 16.949 ms
    [shading] shading=gouraud: FPS: 59 FrameTime: 16.949 ms
    [shading] shading=blinn-phong-inf: FPS: 59 FrameTime: 16.949 ms
    [shading] shading=phong: FPS: 59 FrameTime: 16.949 ms
    [shading] shading=cel: FPS: 59 FrameTime: 16.949 ms
    [bump] bump-render=high-poly: FPS: 59 FrameTime: 16.949 ms
    [bump] bump-render=normals: FPS: 59 FrameTime: 16.949 ms
    [bump] bump-render=height: FPS: 59 FrameTime: 16.949 ms
    [effect2d] kernel=0,1,0;1,-4,1;0,1,0;: FPS: 59 FrameTime: 16.949 ms
    [effect2d] kernel=1,1,1,1,1;1,1,1,1,1;1,1,1,1,1;: FPS: 19 FrameTime: 52.632 ms
    [pulsar] light=false:quads=5:texture=false: FPS: 59 FrameTime: 16.949 ms
    [desktop] blur-radius=5:effect=blur:passes=1:separable=true:windows=4: FPS: 29 FrameTime: 34.483 ms
    [desktop] effect=shadow:windows=4: FPS: 59 FrameTime: 16.949 ms
    [buffer] columns=200:interleave=false:update-dispersion=0.9:update-fraction=0.5:update-method=map: FPS: 29 FrameTime: 34.483 ms
    [buffer] columns=200:interleave=false:update-dispersion=0.9:update-fraction=0.5:update-method=subdata: FPS: 29 FrameTime: 34.483 ms
    [buffer] columns=200:interleave=true:update-dispersion=0.9:update-fraction=0.5:update-method=map: FPS: 59 FrameTime: 16.949 ms
    [ideas] speed=duration: FPS: 50 FrameTime: 20.000 ms
    [jellyfish] <default>: FPS: 50 FrameTime: 20.000 ms
    [terrain] <default>: FPS: 3 FrameTime: 333.333 ms
    [shadow] <default>: FPS: 30 FrameTime: 33.333 ms
    [refract] <default>: FPS: 8 FrameTime: 125.000 ms
    [conditionals] fragment-steps=0:vertex-steps=0: FPS: 59 FrameTime: 16.949 ms
    [conditionals] fragment-steps=5:vertex-steps=0: FPS: 59 FrameTime: 16.949 ms
    [conditionals] fragment-steps=0:vertex-steps=5: FPS: 59 FrameTime: 16.949 ms
    [function] fragment-complexity=low:fragment-steps=5: FPS: 59 FrameTime: 16.949 ms
    [function] fragment-complexity=medium:fragment-steps=5: FPS: 29 FrameTime: 34.483 ms
    [loop] fragment-loop=false:fragment-steps=5:vertex-steps=5: FPS: 59 FrameTime: 16.949 ms
    [loop] fragment-steps=5:fragment-uniform=false:vertex-steps=5: FPS: 59 FrameTime: 16.949 ms
    [loop] fragment-steps=5:fragment-uniform=true:vertex-steps=5: FPS: 59 FrameTime: 16.949 ms
    =======================================================
    glmark2 Score: 49
    =======================================================
    root@am62xx-evm:/hmi_test#

    Is this normal ?

  • HI,we test  board again with stress-ng -c4 --cpu-method=all.

    the system run for 16 hours then we kill it by manually.

    the run information is below. I want to know if it is normal ?

    sdk-9.1.0.8-stress-ng-info.txt

  • Hello,

    After killing the test, did you see the Kernel warning or it happened during the test run?

    Regards,
    Krunal

  • NO.now it runs ok when we have test on the two hardwards. we have made the third verison of hardware . it may the DDR4 problems.

  • Thank you for the update! Please keep us posted on your DDR4 analysis.

    Regards,
    Krunal