AM625: Customer Board SD Boot Fail

Part Number: AM625

Tool/software:

Hi TI Experts,

Customer bring up their AM62x board successfully on SDK9.2 last week. However, they meet some problem using SD card to flash the eMMC and boot from eMMC. As being suggested, there is some upgrade for the eMMC performance in SDK10.0, customer now tries to upgrade from SDK9.2 to SDK10.0. However, customer founds the below SD booting problem using SDK10.0 base image. (they did not meet this problem on SDK9.2, they could SD boot successfully on SDK9.2 base image)

=~=~=~=~=~=~=~=~=~=~=~= MobaXterm log 2024.11.18 18:04:06 =~=~=~=~=~=~=~=~=~=~=~=

U-Boot SPL 2024.04-dirty (Nov 18 2024 - 17:35:54 +0800)
SYSFW ABI: 4.0 (firmware rev 0x000a '10.0.8--v10.00.08 (Fiery Fox)')
SPL initial stack usage: 13392 bytes
Trying to boot from MMC2
Authentication passed
Authentication passed
Authentication passed
Authentication passed
Authentication passed
Starting ATF on ARM64 core...

NOTICE:  BL31: v2.10.0(release):v2.10.0-367-g00f1ec6b87-dirty
NOTICE:  BL31: Built : 16:09:05, Feb  9 2024

U-Boot SPL 2024.04-dirty (Nov 18 2024 - 17:50:08 +0800)
SYSFW ABI: 4.0 (firmware rev 0x000a '10.0.8--v10.00.08 (Fiery Fox)')
SPL initial stack usage: 1856 bytes
Error (-2): cannot determine file size
Trying to boot from MMC2
Authentication passed
Authentication passed


U-Boot 2024.04-dirty (Nov 18 2024 - 17:50:08 +0800)

SoC:   AM62X SR1.0 HS-FS
Model: Texas Instruments AM625 SK
EEPROM not available at 0x50, trying to read at 0x51
Reading on-board EEPROM at 0x51 failed -19
DRAM:  2 GiB
Core:  79 devices, 29 uclasses, devicetree: separate
MMC:   mmc@fa10000: 0, mmc@fa00000: 1
Loading Environment from nowhere... OK
In:    serial
Out:   serial
Err:   serial
EEPROM not available at 0x50, trying to read at 0x51
Reading on-board EEPROM at 0x51 failed -121
Net:   eth0: ethernet@8000000port@1
Hit any key to stop autoboot:  2  1  0 
=> setenv serverip 192.168.8.189
=> 
=> setenv ipaddr 192.168.8.122 
=> 
=> setenv rootpath /home/vekin/ti-processor-sdk-linux-am62xx-evm-09.02.01.10/targetNFS 
=> setenv bootargs console=${console} ${optargs} root=/dev/nfs nfsroot=${serverip}:${rootpath},nolock,v3 rw ip=${ipaddr}:::::eth0
=> 
=> fatload mmc 1:1 80800000 Image
20353536 bytes read in 865 ms (22.4 MiB/s)
=> 
=> fatload mmc 1:1 83000000 dtb/ti/k3-am625-sk.dtb
65620 bytes read in 24 ms (2.6 MiB/s)
=> booti 80800000 - 83000000
## Flattened Device Tree blob at 83000000
   Booting using the fdt blob at 0x83000000
Working FDT set to 83000000
   Loading Device Tree to 000000008ffec000, end 000000008ffff053 ... OK
Working FDT set to 8ffec000

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 6.6.32-g6de6e418c80e-dirty (vekin@vekin-virtual-machine) (aarch64-oe-linux-gcc (GCC) 13.3.0, GNU ld (GNU Binutils) 2.42.0.20240716) #3 SMP PREEMPT Mon Nov 18 17:41:19 CST 2024
[    0.000000] KASLR disabled due to lack of seed
[    0.000000] Machine model: Texas Instruments AM625 Gree Board V02
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x00000000f8000000, size 128 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x00000000f8000000..0x00000000ffffffff (131072 KiB) map reusable linux,cma
[    0.000000] OF: reserved mem: 0x0000000080000000..0x000000008007ffff (512 KiB) nomap non-reusable tfa@80000000
[    0.000000] OF: reserved mem: 0x000000009c700000..0x000000009c7fffff (1024 KiB) map non-reusable ramoops@9c700000
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009c800000, size 3 MiB
[    0.000000] OF: reserved mem: initialized node ipc-memories@9c800000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000009c800000..0x000000009cafffff (3072 KiB) nomap non-reusable ipc-memories@9c800000
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009cb00000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node m4f-dma-memory@9cb00000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000009cb00000..0x000000009cbfffff (1024 KiB) nomap non-reusable m4f-dma-memory@9cb00000
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009cc00000, size 14 MiB
[    0.000000] OF: reserved mem: initialized node m4f-memory@9cc00000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000009cc00000..0x000000009d9fffff (14336 KiB) nomap non-reusable m4f-memory@9cc00000
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000009da00000..0x000000009dafffff (1024 KiB) nomap non-reusable r5f-dma-memory@9da00000
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000009db00000..0x000000009e6fffff (12288 KiB) nomap non-reusable r5f-memory@9db00000
[    0.000000] OF: reserved mem: 0x000000009e800000..0x000000009fffffff (24576 KiB) nomap non-reusable optee@9e800000
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000008007ffff]
[    0.000000]   node   0: [mem 0x0000000080080000-0x000000009c7fffff]
[    0.000000]   node   0: [mem 0x000000009c800000-0x000000009e6fffff]
[    0.000000]   node   0: [mem 0x000000009e700000-0x000000009e7fffff]
[    0.000000]   node   0: [mem 0x000000009e800000-0x000000009fffffff]
[    0.000000]   node   0: [mem 0x00000000a0000000-0x00000000ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.4
[    0.000000] percpu: Embedded 20 pages/cpu s42920 r8192 d30808 u81920
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Kernel command line: console=ttyS2,115200n8 root=/dev/nfs nfsroot=192.168.8.189:/home/vekin/ti-processor-sdk-linux-am62xx-evm-09.02.01.10/targetNFS,nolock,v3 rw ip=192.168.8.122:::::eth0
[    0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 516096
[    0.000000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.000000] software IO TLB: area num 4.
[    0.000000] software IO TLB: mapped [mem 0x00000000f1800000-0x00000000f5800000] (64MB)
[    0.000000] Memory: 1780980K/2097152K available (12032K kernel code, 1252K rwdata, 4052K rodata, 2432K init, 504K bss, 185100K reserved, 131072K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: RCU event tracing is enabled.
[    0.000000] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] Trampoline variant of Tasks RCU enabled.
[    0.000000] Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 256 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GICv3: GICv3 features: 16 PPIs
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
[    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @82000000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x0000000080440000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000080450000
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0x3ffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000000] sched_clock: 58 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.000378] Console: colour dummy device 80x25
[    0.000435] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.000449] pid_max: default: 32768 minimum: 301
[    0.000536] LSM: initializing lsm=capability,integrity
[    0.000663] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.000686] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.002676] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.002753] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.002959] rcu: Hierarchical SRCU implementation.
[    0.002963] rcu: Max phase no-delay instances is 1000.
[    0.003238] Platform MSI: msi-controller@1820000 domain created
[    0.003504] PCI/MSI: /bus@f0000/interrupt-controller@1800000/msi-controller@1820000 domain created
[    0.003761] EFI services will not be available.
[    0.004141] smp: Bringing up secondary CPUs ...
[    0.004827] Detected VIPT I-cache on CPU1
[    0.004918] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
[    0.004936] GICv3: CPU1: using allocated LPI pending table @0x0000000080460000
[    0.004995] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.005779] Detected VIPT I-cache on CPU2
[    0.005845] GICv3: CPU2: found redistributor 2 region 0:0x00000000018c0000
[    0.005858] GICv3: CPU2: using allocated LPI pending table @0x0000000080470000
[    0.005894] CPU2: Booted secondary processor 0x0000000002 [0x410fd034]
[    0.006553] Detected VIPT I-cache on CPU3
[    0.006608] GICv3: CPU3: found redistributor 3 region 0:0x00000000018e0000
[    0.006622] GICv3: CPU3: using allocated LPI pending table @0x0000000080480000
[    0.006651] CPU3: Booted secondary processor 0x0000000003 [0x410fd034]
[    0.006732] smp: Brought up 1 node, 4 CPUs
[    0.006739] SMP: Total of 4 processors activated.
[    0.006744] CPU features: detected: 32-bit EL0 Support
[    0.006749] CPU features: detected: CRC32 instructions
[    0.006819] CPU: All CPU(s) started at EL2
[    0.006822] alternatives: applying system-wide alternatives
[    0.008857] devtmpfs: initialized
[    0.018089] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.018121] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.022727] pinctrl core: initialized pinctrl subsystem
[    0.023300] DMI not present or invalid.
[    0.024029] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.025057] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations
[    0.025167] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.025287] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.025384] audit: initializing netlink subsys (disabled)
[    0.025621] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1
[    0.026116] thermal_sys: Registered thermal governor 'step_wise'
[    0.026121] thermal_sys: Registered thermal governor 'power_allocator'
[    0.026169] cpuidle: using governor menu
[    0.026340] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.026432] ASID allocator initialised with 65536 entries
[    0.037384] platform a40000.pinctrl: Fixed dependency cycle(s) with /bus@f0000/pinctrl@a40000/cpsw-cpts
[    0.041107] Modules: 27664 pages in range for non-PLT usage
[    0.041121] Modules: 519184 pages in range for PLT usage
[    0.041992] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    0.042004] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page
[    0.042009] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[    0.042012] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
[    0.042017] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.042020] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[    0.042024] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[    0.042028] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[    0.043588] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
[    0.044462] iommu: Default domain type: Translated
[    0.044474] iommu: DMA domain TLB invalidation policy: strict mode
[    0.044792] SCSI subsystem initialized
[    0.045162] usbcore: registered new interface driver usbfs
[    0.045190] usbcore: registered new interface driver hub
[    0.045220] usbcore: registered new device driver usb
[    0.045671] pps_core: LinuxPPS API ver. 1 registered
[    0.045676] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.045689] PTP clock support registered
[    0.045850] EDAC MC: Ver: 3.0.0
[    0.046387] scmi_core: SCMI protocol bus registered
[    0.046686] FPGA manager framework
[    0.046789] Advanced Linux Sound Architecture Driver Initialized.
[    0.047779] vgaarb: loaded
[    0.048185] clocksource: Switched to clocksource arch_sys_counter
[    0.048450] VFS: Disk quotas dquot_6.6.0
[    0.048481] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.054879] NET: Registered PF_INET protocol family
[    0.055155] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.056829] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)
[    0.056865] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.056879] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.057041] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    0.057574] TCP: Hash tables configured (established 16384 bind 16384)
[    0.057777] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.057839] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.058082] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.058633] RPC: Registered named UNIX socket transport module.
[    0.058642] RPC: Registered udp transport module.
[    0.058645] RPC: Registered tcp transport module.
[    0.058648] RPC: Registered tcp-with-tls transport module.
[    0.058651] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.058662] NET: Registered PF_XDP protocol family
[    0.058687] PCI: CLS 0 bytes, default 64
[    0.060149] Initialise system trusted keyrings
[    0.060442] workingset: timestamp_bits=46 max_order=19 bucket_order=0
[    0.060793] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.061089] NFS: Registering the id_resolver key type
[    0.061114] Key type id_resolver registered
[    0.061118] Key type id_legacy registered
[    0.061138] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.061143] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.094956] Key type asymmetric registered
[    0.094966] Asymmetric key parser 'x509' registered
[    0.095024] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    0.095031] io scheduler mq-deadline registered
[    0.095036] io scheduler kyber registered
[    0.095079] io scheduler bfq registered
[    0.098132] pinctrl-single 4084000.pinctrl: 34 pins, size 136
[    0.098755] pinctrl-single f4000.pinctrl: 171 pins, size 684
[    0.100577] pinctrl-single a40000.pinctrl: 512 pins, size 2048
[    0.106894] Serial: 8250/16550 driver, 12 ports, IRQ sharing enabled
[    0.118089] loop: module loaded
[    0.119218] megasas: 07.725.01.00-rc1
[    0.122982] tun: Universal TUN/TAP device driver, 1.6
[    0.123268] CAN device driver interface
[    0.124141] VFIO - User Level meta-driver version: 0.3
[    0.125341] usbcore: registered new interface driver usb-storage
[    0.125887] i2c_dev: i2c /dev entries driver
[    0.127481] sdhci: Secure Digital Host Controller Interface driver
[    0.127490] sdhci: Copyright(c) Pierre Ossman
[    0.127695] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.128757] ledtrig-cpu: registered to indicate activity on CPUs
[    0.129048] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.129740] usbcore: registered new interface driver usbhid
[    0.129745] usbhid: USB HID core driver
[    0.130090] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
[    0.131517] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
[    0.132091] optee: probing for conduit method.
[    0.132128] optee: revision 4.2 (12d7c4ee)
[    0.132517] optee: dynamic shared memory is enabled
[    0.133309] random: crng init done
[    0.133399] optee: initialized driver
[    0.135193] NET: Registered PF_PACKET protocol family
[    0.135207] can: controller area network core
[    0.135278] NET: Registered PF_CAN protocol family
[    0.135284] can: raw protocol
[    0.135293] can: broadcast manager protocol
[    0.135302] can: netlink gateway - max_hops=1
[    0.135419] Key type dns_resolver registered
[    0.143607] registered taskstats version 1
[    0.143789] Loading compiled-in X.509 certificates
[    0.159023] ti-sci 44043000.system-controller: ABI: 4.0 (firmware rev 0x000a '10.0.8--v10.00.08 (Fiery Fox)')
[    0.216904] omap_i2c 20000000.i2c: bus 0 rev0.12 at 400 kHz
[    0.217161] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
[    0.217770] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
[    0.219260] ti-udma 485c0100.dma-controller: Number of rings: 82
[    0.221965] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
[    0.224722] ti-udma 485c0000.dma-controller: Number of rings: 150
[    0.229814] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
[    0.232736] printk: console [ttyS2] disabled
[    0.233122] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 237, base_baud = 3000000) is a 8250
[    0.233202] printk: console [ttyS2] enabled
[    1.701171] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 239, base_baud = 3000000) is a 8250
[    1.711329] 2820000.serial: ttyS4 at MMIO 0x2820000 (irq = 240, base_baud = 3000000) is a 8250
[    1.721382] 2850000.serial: ttyS5 at MMIO 0x2850000 (irq = 241, base_baud = 3000000) is a 8250
[    1.731555] m_can_platform 20701000.can: m_can device registered (irq=242, version=32)
[    1.740933] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
[    1.784188] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.791991] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000006
[    1.804793] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
[    1.811925] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
[    1.818469] pps pps0: new PPS source ptp0
[    1.822789] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:1
[    1.837594] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
[   22.852174] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[   22.858281] rcu: 1-...0: (1 GPs behind) idle=1c94/1/0x4000000000000000 softirq=55/56 fqs=2625
[   22.866882] rcu: (detected by 0, t=5252 jiffies, g=-1087, q=36 ncpus=4)
[   22.873570] Task dump for CPU 1:
[   22.876788] task:kworker/u8:3    state:R  running task     stack:0     pid:47    ppid:2      flags:0x0000000a
[   22.886692] Workqueue: events_unbound deferred_probe_work_func
[   22.892533] Call trace:
[   22.894970]  __switch_to+0xcc/0x12c
[   22.898457]  kmem_cache_alloc_node+0x134/0x254
[   22.902896]  alloc_vmap_area+0xf0/0x8c4
[   22.906729]  0xffff8000815d5000
[   85.876170] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[   85.882251] rcu: 1-...0: (1 GPs behind) idle=1c94/1/0x4000000000000000 softirq=55/56 fqs=10496
[   85.890937] rcu: (detected by 0, t=21008 jiffies, g=-1087, q=36 ncpus=4)
[   85.897708] Task dump for CPU 1:
[   85.900924] task:kworker/u8:3    state:R  running task     stack:0     pid:47    ppid:2      flags:0x0000000a
[   85.910823] Workqueue: events_unbound deferred_probe_work_func
[   85.916649] Call trace:
[   85.919085]  __switch_to+0xcc/0x12c
[   85.922568]  kmem_cache_alloc_node+0x134/0x254
[   85.927002]  alloc_vmap_area+0xf0/0x8c4
[   85.930832]  0xffff8000815d5000

The major problem is:  "rcu_preempt detected stalls on CPUs/tasks" during the kernel booting.

Could you help provide some suggestions for customer?

Many Thanks,

Kevin