• State
  • Locked Locked
  • Replies 7 replies
  • Subscribers 101 subscribers
  • Views 831 views
  • Users 0 members are here
Support feedback
Options
Options
Similar topics

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

Original question:

AM625: Boot stall and RCU preempt stall

AM625: Crash (`Internal error: synchronous external abort`) in MCAN Driver At Low Temperatures (< 20 degrees celsius)

fd
Intellectual 655 points
Part Number: AM625
Other Parts Discussed in Thread: AM623

We are experiencing the following random failure during boot.

[   10.512202] Internal error: synchronous external abort: 0000000096000010 [#1] PREEMPT SMP
[   10.522024] Modules linked in: crct10dif_ce snd_soc_simple_card snd_soc_simple_card_utils display_connector ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns rtc_ti_k3 ti_k3_m4_remoteproc ti_k3_common mcrc sa2ul tidss snd_soc_davinci_mcasp snd_soc_ti_udma drm_dma_helper pruss snd_soc_ti_edma snd_soc_ti_sdma m_can_platform m_can can_dev snd_soc_nau8822 pwm_tiehrpwm spi_omap2_mcspi ina2xx lontium_lt8912b tc358768 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops lm75 optee_rng rng_core libcomposite fuse drm drm_panel_orientation_quirks ipv6
[   10.573193] CPU: 1 PID: 180 Comm: systemd-udevd Not tainted 6.1.46-6.5.0-devel+git.3e7fd3d544db #1
[   10.582156] Hardware name: Toradex Verdin AM62 on Verdin Development Board (DT)
[   10.589458] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   10.596413] pc : iomap_read_reg+0xc/0x30 [m_can_platform]
[   10.601822] lr : m_can_get_berr_counter+0x3c/0x10c [m_can]
[   10.607313] sp : ffff8000098d35f0
[   10.610621] x29: ffff8000098d35f0 x28: 0000000000000240 x27: ffff800000cc21b8
[   10.617754] x26: ffff0000024b3000 x25: ffff0000024b3240 x24: 0000000000000000
[   10.624885] x23: 0000000000000000 x22: ffff000000c06010 x21: ffff000002430000
[   10.632016] x20: ffff000002430980 x19: ffff8000098d362c x18: 0000000000000000
[   10.639146] x17: ffff800036e64000 x16: ffff800008008000 x15: 0000ccbd4c56cc8a
[   10.646277] x14: 0000000000000037 x13: 0000000000000037 x12: 0000000000000000
[   10.653408] x11: 0000000000000001 x10: 00000000000009b0 x9 : ffff8000098d31e0
[   10.660538] x8 : ffff00003fda2180 x7 : 0000000100000300 x6 : ffff000000c06190
[   10.667668] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000
[   10.674799] x2 : ffff800000ce7000 x1 : 0000000000000040 x0 : ffff8000097e3040
[   10.681931] Call trace:
[   10.684372]  iomap_read_reg+0xc/0x30 [m_can_platform]
[   10.689423]  can_fill_info+0x108/0x524 [can_dev]
[   10.694058]  rtnl_fill_ifinfo+0x844/0x11b0
[   10.698161]  rtnl_getlink+0x23c/0x424
[   10.701821]  rtnetlink_rcv_msg+0x130/0x3a0
[   10.705914]  netlink_rcv_skb+0x60/0x130
[   10.709747]  rtnetlink_rcv+0x18/0x2c
[   10.713318]  netlink_unicast+0x2e4/0x340
[   10.717235]  netlink_sendmsg+0x1b0/0x420
[   10.721153]  __sys_sendto+0x134/0x170
[   10.724812]  __arm64_sys_sendto+0x28/0x40
[   10.728815]  invoke_syscall+0x48/0x114
[   10.732566]  el0_svc_common.constprop.0+0xd4/0xfc
[   10.737264]  do_el0_svc+0x20/0x30
[   10.740575]  el0_svc+0x28/0xa0
[   10.743630]  el0t_64_sync_handler+0xbc/0x140
[   10.747894]  el0t_64_sync+0x18c/0x190
[   10.751564] Code: bad PC value

HW: custom board, happening with AM623 and AM625 SKU, both GP and HSFS.

SW: custom BSP, based on TI 09.01.00.008. No changes related to MCAN, clocks, or anything that seems related to this issue. Linux kernel GIT: https://git.toradex.com/cgit/linux-toradex.git/log/?h=toradex_ti-linux-6.1.y 

Such issue would happen in `m_can_get_berr_counter()` when calling `__m_can_get_berr_counter()` without calling `m_can_clk_start()`, IOW without enabling the clocks. I did look at the code and I was not able to spot any bug in the m_can driver that would justify such behavior.

It's important to note that so far we have not been able to reproduce the issue at temperatures above -20 degrees Celsius.

We were not able to reproduce the issue running continuosly `ip -det link show can0` after the system was properly booted at room temperature.

The only thing I was able to think is that the issue could be because `m_can_runtime_resume()` returns before the clocks are enabled, and maybe this could be related to some kind of race condition with the DM firmware that is running on the cortex R5? 

  • 0
    TI__Mastermind 38720 points

    Hi,

    If you are not running the MCAN interface does this condition happen when using any other interfaces?

    Best Regards,

    Schuyler

  • 0 in reply to Schuyler Patton
    Intellectual 655 points

    I am not sure I understand your question, let me try ...

    This specific stack trace can happen only when using the CAN interface. 

    The error `Internal error: synchronous external abort: 0000000096000010` is happening only in this specific situation when using the CAN.

  • 0 in reply to fd
    TI__Mastermind 38720 points

    Hi,

    You mentioned that the failure was happening during boot. I was curious if other interfaces were causing a kernel panic.

    I was going to ask if you have a TI EVM and try to see if the same failure occurs when running that board at that temperature.

    Could you attach the boot log? To confirm since I am seeing two different use cases, does the error happen on boot or while using the CAN interface or both?

    Best Regards,

    Schuyler

  • 0 in reply to Schuyler Patton
    Intellectual 655 points

    The error happens during boot. The issue was never reproduced while using the CAN.

    The issue is NOT systematic, not easy to reproduce, and happens normally below -20 degrees Celsius.

    Full log is attached, after the internal error the system pretty much froze and it's not able to complete the boot.

    23-12-30_07-53-32-Fail.txt 
    Climate Chamber:       TempEvent T/180/70a/3
Start Temperature:     -25.0�C
End Temperature:       -25.0�C
Measured Temperature:  -25.0�C
Shelf Temperature:     -25.0�C
Shelf Name:            Shelf_19
Module Serial Number:  15207020
Module Location:       Shelf 1, Carrier Board 5
Test duration:         157.43s

Test Log
********
07:53:32.20 13->14 Waited 60.00s
07:52:32.01 12->13 Set Reset Low
07:52:31.90 11->12 Power Off
07:52:31.79 5->11 Not found, time out: "login:"
07:51:01.68 4->5 Message found: "Starting kernel"
07:50:56.61 3->4 Message found: "U-Boot"
07:50:56.49 2->3 Waited 1.00s
07:50:55.32 1->2 Set Reset High
07:50:55.21 0->1 Power On

Search Strings
**************
PASS : U-Boot
PASS : Less than 64MB RAM detected
PASS : Starting kernel
PASS : mmcblk0: mmc0
OK : cut here
PASS : rcu: INFO: rcu_preempt detected
PASS : rcu: INFO: rcu_preempt self-detected stall
PASS : I/O error
Disabled : WIFI test passed
FAIL : Internal error
FAIL : CPU stress
PASS : critical temperature reached
FAIL : successful run
PASS : unsuccessful run
Disabled : connected with
N/A : eth0: Link is Up - 
PASS : connect failed: No route to host
PASS : connect failed: Network is unreachable
PASS : IPERF stuck
PASS : memtester failed
FAIL : memtester version
PASS : FAILURE
PASS : bonnie\+\+ failed
FAIL : Waiting for power-cycle
0 : OAK ERROR
0 : UART ERROR
OK : registered as rtc0
OK : registered as rtc1
OK : xception stack
2 : U-Boot SPL
N/A : Device life time estimation type B 
N/A : Pre EOL information
3 : USB hub found
0 : xception stack
PASS : page allocation failure
PASS : hwclock

Terminal
********

U-Boot SPL 2023.04-6.5.0-devel+git.9c8485712f05 (Dec 19 2023 - 08:33:12 +0000)
SYSFW ABI: 3.1 (firmware rev 0x0009 '9.1.8--v09.01.08 (Kool Koala)')
SPL initial stack usage: 13384 bytes
Trying to boot from MMC1
Authentication passed
Authentication passed
Authentication passed
Authentication passed
Authentication passed
Starting ATF on ARM64 core...

NOTICE:  BL31: v2.9(release):v2.9.0-614-gd7a7135d32-dirty
NOTICE:  BL31: Built : 09:34:15, Aug 24 2023

U-Boot SPL 2023.04-6.5.0-devel+git.9c8485712f05 (Dec 19 2023 - 08:33:12 +0000)
SYSFW ABI: 3.1 (firmware rev 0x0009 '9.1.8--v09.01.08 (Kool Koala)')
SPL initial stack usage: 1856 bytes
Trying to boot from MMC1
Authentication passed
Authentication passed


U-Boot 2023.04-6.5.0-devel+git.9c8485712f05 (Dec 19 2023 - 08:33:12 +0000)

SoC:   AM62X SR1.0 HS-FS
DRAM:  1 GiB
Core:  143 devices, 31 uclasses, devicetree: separate
MMC:   mmc@fa10000: 0, mmc@fa00000: 1
Loading Environment from MMC... OK
In:    serial@2800000
Out:   serial@2800000
Err:   serial@2800000
Model: Toradex 0073 Verdin AM62 Dual 1GB ET V1.1A
Serial#: 15207020
MISSING TORADEX CARRIER CONFIG BLOCKS
am65_cpsw_nuss ethernet@8000000: K3 CPSW: nuss_ver: 0x6BA01103 cpsw_ver: 0x6BA81103 ale_ver: 0x00290105 Ports:2 mdio_freq:1000000
Setting variant to nonwifi
Net:   
Warning: ethernet@8000000port@1 MAC addresses don't match:
Address in ROM is		28:b5:e8:cb:79:f4
Address in environment is	00:14:2d:e8:0a:6c
eth0: ethernet@8000000port@1 [PRIME]Could not get PHY for ethernet@8000000port@1: addr 7
am65_cpsw_nuss_port ethernet@8000000port@2: phy_connect() failed

Hit any key to stop autoboot:  1  0 
MMC: no card present
switch to partitions #0, OK
mmc0(part 0) is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
6003 bytes read in 10 ms (585.9 KiB/s)
## Executing script at 90280000
Loading DeviceTree: k3-am625-verdin-nonwifi-dev.dtb
69025 bytes read in 10 ms (6.6 MiB/s)
82 bytes read in 9 ms (8.8 KiB/s)
Working FDT set to 90200000
Applying Overlay: verdin-am62_dsi-to-hdmi_overlay.dtbo
3050 bytes read in 9 ms (330.1 KiB/s)
Applying Overlay: verdin-am62_spidev_overlay.dtbo
560 bytes read in 10 ms (54.7 KiB/s)
7818670 bytes read in 99 ms (75.3 MiB/s)
Bootargs: root=PARTUUID=81834fb8-02 ro rootwait console=tty1 console=ttyS2,115200 consoleblank=0 earlycon=ns16550a,mmio32,0x02800000
   Uncompressing Kernel Image
## Flattened Device Tree blob at 90200000
   Booting using the fdt blob at 0x90200000
Working FDT set to 90200000
ERROR: reserving fdt memory region failed (addr=9cb00000 size=100000 flags=4)
ERROR: reserving fdt memory region failed (addr=9cc00000 size=e00000 flags=4)
ERROR: reserving fdt memory region failed (addr=9da00000 size=100000 flags=4)
ERROR: reserving fdt memory region failed (addr=9db00000 size=c00000 flags=4)
ERROR: reserving fdt memory region failed (addr=9e780000 size=80000 flags=4)
ERROR: reserving fdt memory region failed (addr=9e800000 size=1800000 flags=4)
   Loading Device Tree to 0000000098eae000, end 0000000098ee1fff ... OK
Working FDT set to 98eae000

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 6.1.46-6.5.0-devel+git.3e7fd3d544db (oe-user@oe-host) (aarch64-tdx-linux-gcc (GCC) 11.4.0, GNU ld (GNU Binutils) 2.38.20220708) #1 SMP PREEMPT Wed Dec 13 23:32:33 UTC 2023
[    0.000000] Machine model: Toradex Verdin AM62 on Verdin Development Board
[    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
[    0.000000] printk: bootconsole [ns16550a0] enabled
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009cb00000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node m4f-dma-memory@9cb00000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009cc00000, size 14 MiB
[    0.000000] OF: reserved mem: initialized node m4f-memory@9cc00000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000bfffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000009cafffff]
[    0.000000]   node   0: [mem 0x000000009cb00000-0x000000009e6fffff]
[    0.000000]   node   0: [mem 0x000000009e700000-0x000000009e77ffff]
[    0.000000]   node   0: [mem 0x000000009e780000-0x000000009fffffff]
[    0.000000]   node   0: [mem 0x00000000a0000000-0x00000000bfffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000000bfffffff]
[    0.000000] cma: Reserved 128 MiB at 0x00000000b6c00000
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.4
[    0.000000] percpu: Embedded 19 pages/cpu s37992 r8192 d31640 u77824
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 258048
[    0.000000] Kernel command line: root=PARTUUID=81834fb8-02 ro rootwait console=tty1 console=ttyS2,115200 consoleblank=0 earlycon=ns16550a,mmio32,0x02800000
[    0.000000] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 824324K/1048576K available (11008K kernel code, 1350K rwdata, 3848K rodata, 2176K init, 422K bss, 93180K reserved, 131072K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 256 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GICv3: GICv3 features: 16 PPIs
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
[    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @80800000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x0000000080030000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000080040000
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0x3ffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000001] sched_clock: 58 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.008617] Console: colour dummy device 80x25
[    0.013699] printk: console [tty1] enabled
[    0.017945] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.028640] pid_max: default: 32768 minimum: 301
[    0.033422] LSM: Security Framework initializing
[    0.038298] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.045887] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.055910] cblist_init_generic: Setting adjustable number of callback queues.
[    0.063397] cblist_init_generic: Setting shift to 1 and lim to 1.
[    0.069708] cblist_init_generic: Setting adjustable number of callback queues.
[    0.077115] cblist_init_generic: Setting shift to 1 and lim to 1.
[    0.083546] rcu: Hierarchical SRCU implementation.
[    0.088462] rcu: 	Max phase no-delay instances is 1000.
[    0.094513] Platform MSI: msi-controller@1820000 domain created
[    0.101164] EFI services will not be available.
[    0.106124] smp: Bringing up secondary CPUs ...
[    0.111508] Detected VIPT I-cache on CPU1
[    0.111640] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
[    0.111661] GICv3: CPU1: using allocated LPI pending table @0x0000000080050000
[    0.111726] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.111859] smp: Brought up 1 node, 2 CPUs
[    0.141298] SMP: Total of 2 processors activated.
[    0.146119] CPU features: detected: 32-bit EL0 Support
[    0.151401] CPU features: detected: CRC32 instructions
[    0.156724] CPU: All CPU(s) started at EL2
[    0.160917] alternatives: applying system-wide alternatives
[    0.168309] devtmpfs: initialized
[    0.181281] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.191329] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
[    0.203919] pinctrl core: initialized pinctrl subsystem
[    0.210142] DMI not present or invalid.
[    0.214835] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.222121] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
[    0.229474] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.237487] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.245693] audit: initializing netlink subsys (disabled)
[    0.251510] audit: type=2000 audit(0.160:1): state=initialized audit_enabled=0 res=1
[    0.252058] thermal_sys: Registered thermal governor 'step_wise'
[    0.259455] thermal_sys: Registered thermal governor 'power_allocator'
[    0.265828] cpuidle: using governor menu
[    0.276734] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.283753] ASID allocator initialised with 65536 entries
[    0.302267] platform 30200000.dss: Fixed dependency cycle(s) with /bus@f0000/i2c@20000000/dsi@e
[    0.314548] KASLR disabled due to lack of seed
[    0.325473] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    0.332479] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page
[    0.338898] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[    0.345845] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
[    0.352260] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.359206] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[    0.365621] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[    0.372568] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[    0.380695] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
[    0.390758] iommu: Default domain type: Translated 
[    0.395785] iommu: DMA domain TLB invalidation policy: strict mode 
[    0.402517] SCSI subsystem initialized
[    0.406755] usbcore: registered new interface driver usbfs
[    0.412413] usbcore: registered new interface driver hub
[    0.417882] usbcore: registered new device driver usb
[    0.423585] pps_core: LinuxPPS API ver. 1 registered
[    0.428675] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.438037] PTP clock support registered
[    0.442191] EDAC MC: Ver: 3.0.0
[    0.446510] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
[    0.453625] FPGA manager framework
[    0.457223] Advanced Linux Sound Architecture Driver Initialized.
[    0.464521] clocksource: Switched to clocksource arch_sys_counter
[    0.471069] VFS: Disk quotas dquot_6.6.0
[    0.475140] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.488491] NET: Registered PF_INET protocol family
[    0.493783] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.502538] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[    0.511191] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.519140] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.527136] TCP bind hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    0.534874] TCP: Hash tables configured (established 8192 bind 8192)
[    0.541586] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.548404] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.555830] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.562220] RPC: Registered named UNIX socket transport module.
[    0.568320] RPC: Registered udp transport module.
[    0.573138] RPC: Registered tcp transport module.
[    0.577954] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.584578] NET: Registered PF_XDP protocol family
[    0.590350] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
[    0.600637] Initialise system trusted keyrings
[    0.605481] workingset: timestamp_bits=46 max_order=18 bucket_order=0
[    0.616740] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.623445] NFS: Registering the id_resolver key type
[    0.628699] Key type id_resolver registered
[    0.632986] Key type id_legacy registered
[    0.637150] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.644015] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.687716] Key type asymmetric registered
[    0.691928] Asymmetric key parser 'x509' registered
[    0.696985] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.704790] io scheduler mq-deadline registered
[    0.709438] io scheduler kyber registered
[    0.717261] pinctrl-single 4084000.pinctrl: 34 pins, size 136
[    0.724244] pinctrl-single f4000.pinctrl: 171 pins, size 684
[    0.736168] Serial: 8250/16550 driver, 6 ports, IRQ sharing enabled
[    0.753592] brd: module loaded
[    0.761864] loop: module loaded
[    0.769202] tun: Universal TUN/TAP device driver, 1.6
[    0.775229] VFIO - User Level meta-driver version: 0.3
[    0.781378] usbcore: registered new interface driver usb-storage
[    0.788232] i2c_dev: i2c /dev entries driver
[    0.794702] sdhci: Secure Digital Host Controller Interface driver
[    0.801096] sdhci: Copyright(c) Pierre Ossman
[    0.805803] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.812237] ledtrig-cpu: registered to indicate activity on CPUs
[    0.818603] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.825576] usbcore: registered new interface driver usbhid
[    0.831290] usbhid: USB HID core driver
[    0.836328] optee: probing for conduit method.
[    0.840953] optee: revision 4.0 (2a5b1d12)
[    0.841318] optee: dynamic shared memory is enabled
[    0.850977] optee: initialized driver
[    0.856906] Initializing XFRM netlink socket
[    0.861354] NET: Registered PF_PACKET protocol family
[    0.866622] Key type dns_resolver registered
[    0.871489] registered taskstats version 1
[    0.875727] Loading compiled-in X.509 certificates
[    0.890350] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0009 '9.1.8--v09.01.08 (Kool Koala)')
[    0.956735] omap_i2c 4900000.i2c: bus 3 rev0.12 at 100 kHz
[    0.963613] i2c 0-000e: Fixed dependency cycle(s) with /bus@f0000/i2c@20010000/hdmi@48
[    1.005037] input: tps65219-pwrbutton as /devices/platform/bus@f0000/20000000.i2c/i2c-0/0-0030/tps65219-pwrbutton.2.auto/input/input0
[    1.019108] rtc-ds1307 0-0032: oscillator failed, set time!
[    1.025017] rtc-ds1307 0-0032: registered as rtc0
[    1.029984] rtc-ds1307 0-0032: hctosys: unable to read the hardware clock
[    1.039084] at24 0-0050: supply vcc not found, using dummy regulator
[    1.046077] at24 0-0050: 256 byte 24c02 EEPROM, writable, 16 bytes/write
[    1.053016] omap_i2c 20000000.i2c: bus 0 rev0.12 at 400 kHz
[    1.060579] platform hdmi-connector: Fixed dependency cycle(s) with /bus@f0000/i2c@20010000/hdmi@48
[    1.070623] pca953x 1-0021: supply vcc not found, using dummy regulator
[    1.077556] pca953x 1-0021: using no AI
[    1.104663] pca953x 1-0021: failed writing register
[    1.109867] pca953x: probe of 1-0021 failed with error -121
[    1.116175] at24 1-0057: supply vcc not found, using dummy regulator
[    1.123402] at24 1-0057: 256 byte 24c02 EEPROM, writable, 16 bytes/write
[    1.130343] omap_i2c 20010000.i2c: bus 1 rev0.12 at 100 kHz
[    1.137523] omap_i2c 20020000.i2c: bus 2 rev0.12 at 100 kHz
[    1.144245] omap_i2c 20030000.i2c: bus 4 rev0.12 at 100 kHz
[    1.150260] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
[    1.158639] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
[    1.167908] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
[    1.180452] ti-udma 485c0100.dma-controller: Number of rings: 82
[    1.188837] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
[    1.200033] ti-udma 485c0000.dma-controller: Number of rings: 150
[    1.210350] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
[    1.220849] 4a00000.serial: ttyS3 at MMIO 0x4a00000 (irq = 292, base_baud = 3000000) is a 8250
[    1.230966] 2b300000.serial: ttyS1 at MMIO 0x2b300000 (irq = 293, base_baud = 3000000) is a 8250
[    1.241151] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 294, base_baud = 3000000) is a 8250
[    1.250090] printk: console [ttyS2] enabled
[    1.250090] printk: console [ttyS2] enabled
[    1.258552] printk: bootconsole [ns16550a0] disabled
[    1.258552] printk: bootconsole [ns16550a0] disabled
[    1.269698] 2810000.serial: ttyS0 at MMIO 0x2810000 (irq = 295, base_baud = 3000000) is a 8250
[    1.280015] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
[    1.324525] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.333416] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000006
[    1.346368] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
[    1.353509] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
[    1.360269] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
[    1.370813] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
[    1.383387] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller
[    1.388991] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 1
[    1.396824] xhci-hcd xhci-hcd.3.auto: USB3 root hub has no ports
[    1.402840] xhci-hcd xhci-hcd.3.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
[    1.412300] xhci-hcd xhci-hcd.3.auto: irq 299, io mem 0x31100000
[    1.419199] hub 1-0:1.0: USB hub found
[    1.423026] hub 1-0:1.0: 1 port detected
[    1.531747] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 1200000 KHz, changing to: 1250000 KHz
[    1.545037] mmc0: CQHCI version 5.10
[    1.546913] gpio-427 (CTRL_SLEEP_MOCI#): hogged as output/high
[    1.563879] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
[    1.587283] mmc0: SDHCI controller on fa10000.mmc [fa10000.mmc] using ADMA 64-bit
[    1.608540] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.621137] mdio_bus 8000f00.mdio: MDIO device at address 7 is missing.
[    1.627801] davinci_mdio 8000f00.mdio: phy[0]: device 8000f00.mdio:00, driver TI DP83867
[    1.639011] xhci-hcd xhci-hcd.4.auto: xHCI Host Controller
[    1.639168] mmc1: CQHCI version 5.10
[    1.644606] xhci-hcd xhci-hcd.4.auto: new USB bus registered, assigned bus number 2
[    1.649251] debugfs: Directory 'pd:182' with parent 'pm_genpd' already present!
[    1.656090] xhci-hcd xhci-hcd.4.auto: USB3 root hub has no ports
[    1.666635] input: gpio-keys as /devices/platform/gpio-keys/input/input1
[    1.669231] xhci-hcd xhci-hcd.4.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000000000010010
[    1.685448] xhci-hcd xhci-hcd.4.auto: irq 483, io mem 0x31000000
[    1.688542] usb 1-1: new high-speed USB device number 2 using xhci-hcd
[    1.692323] hub 2-0:1.0: USB hub found
[    1.701894] hub 2-0:1.0: 1 port detected
[    1.706409] xhci-hcd xhci-hcd.4.auto: remove, state 1
[    1.711497] usb usb2: USB disconnect, device number 1
[    1.717629] xhci-hcd xhci-hcd.4.auto: USB bus 2 deregistered
[    1.732199] ALSA device list:
[    1.735238]   No soundcards found.
[    1.746005] mmc0: Command Queue Engine enabled
[    1.750507] mmc0: new HS200 MMC card at address 0001
[    1.756559] mmcblk0: mmc0:0001 S40004 3.64 GiB 
[    1.763078]  mmcblk0: p1 p2
[    1.766858] mmcblk0boot0: mmc0:0001 S40004 4.00 MiB 
[    1.773168] mmcblk0boot1: mmc0:0001 S40004 4.00 MiB 
[    1.779149] mmcblk0rpmb: mmc0:0001 S40004 4.00 MiB, chardev (241:0)
[    1.899518] hub 1-1:1.0: USB hub found
[    1.903659] hub 1-1:1.0: 4 ports detected
[    2.252643] usb 1-1.4: new high-speed USB device number 3 using xhci-hcd
[    3.176186] sdhci-am654 fa00000.mmc: Power on failed
[    3.212573] mmc1: SDHCI controller on fa00000.mmc [fa00000.mmc] using ADMA 64-bit
[    3.232185] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Quota mode: none.
[    3.241118] VFS: Mounted root (ext4 filesystem) readonly on device 179:2.
[    3.248697] devtmpfs: mounted
[    3.253401] Freeing unused kernel memory: 2176K
[    3.264652] Run /sbin/init as init process
[    3.411860] systemd[1]: System time before build time, advancing clock.
[    3.461731] NET: Registered PF_INET6 protocol family
[    3.468912] Segment Routing with IPv6
[    3.472681] In-situ OAM (IOAM) with IPv6
[    3.509192] systemd[1]: systemd 250.5+ running in system mode (+PAM -AUDIT -SELINUX -APPARMOR +IMA -SMACK +SECCOMP -GCRYPT -GNUTLS -OPENSSL +ACL +BLKID -CURL -ELFUTILS -FIDO2 -IDN2 -IDN -IPTC +KMOD -LIBCRYPTSETUP +LIBFDISK -PCRE2 -PWQUALITY -P11KIT -QRENCODE -BZIP2 -LZ4 -XZ -ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=hybrid)
[    3.541252] systemd[1]: Detected architecture arm64.

Welcome to TDX Wayland with XWayland 6.5.0-devel-20231219+build.475 (kirkstone)!

[    3.629716] systemd[1]: Hostname set to <verdin-am62-15207020>.
[    4.116159] systemd[1]: Queued start job for default target Graphical Interface.
[    4.170136] systemd[1]: Created slice Slice /system/getty.
[  OK  ] Created slice Slice /system/getty.
[    4.195145] systemd[1]: Created slice Slice /system/modprobe.
[  OK  ] Created slice Slice /system/modprobe.
[    4.219402] systemd[1]: Created slice Slice /system/serial-getty.
[  OK  ] Created slice Slice /system/serial-getty.
[    4.243043] systemd[1]: Created slice User and Session Slice.
[  OK  ] Created slice User and Session Slice.
[    4.265374] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Dispatch Password …ts to Console Directory Watch.
[    4.289221] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[  OK  ] Started Forward Password R…uests to Wall Directory Watch.
[    4.313634] systemd[1]: Reached target Host and Network Name Lookups.
[  OK  ] Reached target Host and Network Name Lookups.
[    4.336758] systemd[1]: Reached target Path Units.
[  OK  ] Reached target Path Units.
[    4.356974] systemd[1]: Reached target Remote File Systems.
[  OK  ] Reached target Remote File Systems.
[    4.376853] systemd[1]: Reached target Slice Units.
[  OK  ] Reached target Slice Units.
[    4.396956] systemd[1]: Reached target Swaps.
[  OK  ] Reached target Swaps.
[    4.468294] systemd[1]: Listening on RPCbind Server Activation Socket.
[  OK  ] Listening on RPCbind Server Activation Socket.
[    4.493840] systemd[1]: Reached target RPC Port Mapper.
[  OK  ] Reached target RPC Port Mapper.
[    4.518571] systemd[1]: Listening on Syslog Socket.
[  OK  ] Listening on Syslog Socket.
[    4.541973] systemd[1]: Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[    4.568444] systemd[1]: Listening on Journal Audit Socket.
[  OK  ] Listening on Journal Audit Socket.
[    4.591129] systemd[1]: Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket (/dev/log).
[    4.615479] systemd[1]: Listening on Journal Socket.
[  OK  ] Listening on Journal Socket.
[    4.640500] systemd[1]: Listening on Network Service Netlink Socket.
[  OK  ] Listening on Network Service Netlink Socket.
[    4.667903] systemd[1]: Listening on udev Control Socket.
[  OK  ] Listening on udev Control Socket.
[    4.690944] systemd[1]: Listening on udev Kernel Socket.
[  OK  ] Listening on udev Kernel Socket.
[    4.715172] systemd[1]: Listening on User Database Manager Socket.
[  OK  ] Listening on User Database Manager Socket.
[    4.773387] systemd[1]: Mounting Huge Pages File System...
         Mounting Huge Pages File System...
[    4.807344] systemd[1]: Mounting POSIX Message Queue File System...
         Mounting POSIX Message Queue File System...
[    4.857316] systemd[1]: Mounting Kernel Debug File System...
         Mounting Kernel Debug File System...
[    4.882069] systemd[1]: Kernel Trace File System was skipped because of a failed condition check (ConditionPathExists=/sys/kernel/tracing).
[    4.908968] systemd[1]: Mounting Temporary Directory /tmp...
         Mounting Temporary Directory /tmp...
[    4.965998] systemd[1]: Starting Create List of Static Device Nodes...
         Starting Create List of Static Device Nodes...
[    5.000190] systemd[1]: Starting Load Kernel Module configfs...
         Starting Load Kernel Module configfs...
[    5.049886] systemd[1]: Starting Load Kernel Module drm...
         Starting Load Kernel Module drm...
[    5.073888] systemd[1]: Starting Load Kernel Module fuse...
         Starting Load Kernel Module fuse...
[    5.099578] fuse: init (API version 7.37)
[    5.125795] systemd[1]: Starting RPC Bind...
         Starting RPC Bind...
[    5.148831] systemd[1]: Starting File System Check on Root Device...
         Starting File System Check on Root Device...
[    5.172964] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    5.192930] systemd[1]: Starting Load Kernel Modules...
         Starting Load Kernel Modules...
[    5.210362] systemd[1]: Starting Generate network units from Kernel command line...
         Starting Generate network …ts from Kernel command line...
[    5.241749] systemd[1]: Starting Coldplug All udev Devices...
         Starting Coldplug All udev Devices...
[    5.277680] systemd[1]: Started RPC Bind.
[  OK  ] Started RPC Bind.
[    5.283275] systemd[1]: Mounted Huge Pages File System.
[  OK  ] Mounted Huge Pages File System.
[    5.314003] systemd[1]: Mounted POSIX Message Queue File System.
[  OK  ] Mounted POSIX Message Queue File System.
[    5.329701] systemd[1]: Mounted Kernel Debug File System.
[  OK  ] Mounted Kernel Debug File System.
[    5.361654] systemd[1]: Mounted Temporary Directory /tmp.
[  OK  ] Mounted Temporary Directory /tmp.
[    5.391441] systemd[1]: Finished Create List of Static Device Nodes.
[  OK  ] Finished Create List of Static Device Nodes.
[    5.417824] systemd[1]: Started Journal Service.
[  OK  ] Started Journal Service.
[  OK  ] Finished Load Kernel Module configfs.
[  OK  ] Finished Load Kernel Module drm.
[  OK  ] Finished Load Kernel Module fuse.
[  OK  ] Finished File System Check on Root Device.
[  OK  ] Finished Load Kernel Modules.
[  OK  ] Finished Generate network units from Kernel command line.
         Mounting FUSE Control File System...
         Mounting Kernel Configuration File System...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Finished Apply Kernel Variables.
[    5.745226] EXT4-fs (mmcblk0p2): re-mounted. Quota mode: none.
[  OK  ] Finished Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting Create Static Device Nodes in /dev...
[    5.836406] systemd-journald[159]: Received client request to flush runtime journal.
[  OK  ] Finished Flush Journal to Persistent Storage.
[  OK  ] Finished Create Static Device Nodes in /dev.
[  OK  ] Reached target Preparation for Local File Systems.
[    5.917573] audit: type=1334 audit(1651167747.504:2): prog-id=5 op=LOAD
[    5.929336] audit: type=1334 audit(1651167747.512:3): prog-id=6 op=LOAD
         Starting Rule-based Manage…for Device Events and Files...
[  OK  ] Finished Coldplug All udev Devices.
         Starting Wait for udev To …plete Device Initialization...
[  OK  ] Started Rule-based Manager for Device Events and Files.
         Mounting /var/volatile...
[  OK  ] Mounted /var/volatile.
         Starting Load/Save Random Seed...
[  OK  ] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
[  OK  ] Finished Create Volatile Files and Directories.
         Starting Network Time Synchronization...
[    6.520869] random: crng init done
         Starting Record System Boot/Shutdown in UTMP...
[  OK  ] Finished Load/Save Random Seed.
[  OK  ] Finished Record System Boot/Shutdown in UTMP.
[    6.624812] lm75 0-0048: supply vs not found, using dummy regulator
[    6.761173] hwmon hwmon0: temp1_input not attached to any thermal zone
[    6.798114] ina2xx 1-0040: error configuring the device: -121
[    6.818304] lm75 0-0048: hwmon0: sensor 'tmp1075'
[    6.829024] CAN device driver interface
[    6.835561] nau8822 1-001a: Failed to issue reset: -121
[    6.860409] nau8822: probe of 1-001a failed with error -121
[    6.879674] lm75 1-004f: supply vs not found, using dummy regulator
[    6.927771] m_can_platform 4e08000.can: m_can device registered (irq=0, version=32)
[  OK  ] Found device /dev/ttyS2.
[    6.947170] hwmon hwmon1: temp1_input not attached to any thermal zone
[    6.987843] lm75 1-004f: hwmon1: sensor 'tmp75c'
[    7.047739] m_can_platform 20701000.can: m_can device registered (irq=486, version=32)
[    7.091891] systemd-journald[159]: Oldest entry in /run/log/journal/082518a881d846128081fe90764f0486/system.journal is older than the configured file retention duration (1month), suggesting rotation.
[  OK  ] Started Network Time Synchronization.
[    7.121766] systemd-journald[159]: /run/log/journal/082518a881d846128081fe90764f0486/system.journal: Journal header limits reached or header out-of-date, rotating.
[  OK  ] Reached target System Time Set.
[    7.240686] k3-m4-rproc 5000000.m4fss: assigned reserved memory node m4f-dma-memory@9cb00000
[    7.272031] k3-m4-rproc 5000000.m4fss: configured M4 for remoteproc mode
[    7.292693] k3-m4-rproc 5000000.m4fss: local reset is deasserted for device
[    7.310843] remoteproc remoteproc0: 5000000.m4fss is available
[    7.330505] remoteproc remoteproc0: Direct firmware load for am62-mcu-m4f0_0-fw failed with error -2
[    7.342354] remoteproc remoteproc0: powering up 5000000.m4fss
[    7.351159] remoteproc remoteproc0: Direct firmware load for am62-mcu-m4f0_0-fw failed with error -2
[    7.364695] remoteproc remoteproc0: request_firmware failed: -2
[    7.416777] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    7.423283] rtc-ti-k3 2b1f0000.rtc: registered as rtc1
[    7.479241] platform 78000000.r5f: configured R5F for IPC-only mode
[    7.499743] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
[    7.510508] remoteproc remoteproc1: 78000000.r5f is available
[    7.556384] remoteproc remoteproc1: attaching to 78000000.r5f
[    7.563346] platform 78000000.r5f: R5F core initialized in IPC-only mode
[    7.571073] rproc-virtio rproc-virtio.5.auto: assigned reserved memory node r5f-dma-memory@9da00000
[    7.584848] virtio_rpmsg_bus virtio0: rpmsg host is online
[    7.585755] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
[    7.607244] rproc-virtio rproc-virtio.5.auto: registered virtio0 (type 7)
[    7.607318] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
[    7.625534] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
[    7.637010] tidss 30200000.dss: [drm] Cannot find any crtc or sizes
[    7.645205] remoteproc remoteproc1: remote processor 78000000.r5f is now attached
[    7.653232] tidss 30200000.dss: [drm] Cannot find any crtc or sizes
[*     ] A start job is running for Wait for…ic[   10.512202] Internal error: synchronous external abort: 0000000096000010 [#1] PREEMPT SMP
e Initialization (3s / 2min 58s)
[   10.522024] Modules linked in: crct10dif_ce snd_soc_simple_card snd_soc_simple_card_utils display_connector ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns rtc_ti_k3 ti_k3_m4_remoteproc ti_k3_common mcrc sa2ul tidss snd_soc_davinci_mcasp snd_soc_ti_udma drm_dma_helper pruss snd_soc_ti_edma snd_soc_ti_sdma m_can_platform m_can can_dev snd_soc_nau8822 pwm_tiehrpwm spi_omap2_mcspi ina2xx lontium_lt8912b tc358768 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops lm75 optee_rng rng_core libcomposite fuse drm drm_panel_orientation_quirks ipv6
[   10.573193] CPU: 1 PID: 180 Comm: systemd-udevd Not tainted 6.1.46-6.5.0-devel+git.3e7fd3d544db #1
[   10.582156] Hardware name: Toradex Verdin AM62 on Verdin Development Board (DT)
[   10.589458] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   10.596413] pc : iomap_read_reg+0xc/0x30 [m_can_platform]
[   10.601822] lr : m_can_get_berr_counter+0x3c/0x10c [m_can]
[   10.607313] sp : ffff8000098d35f0
[   10.610621] x29: ffff8000098d35f0 x28: 0000000000000240 x27: ffff800000cc21b8
[   10.617754] x26: ffff0000024b3000 x25: ffff0000024b3240 x24: 0000000000000000
[   10.624885] x23: 0000000000000000 x22: ffff000000c06010 x21: ffff000002430000
[   10.632016] x20: ffff000002430980 x19: ffff8000098d362c x18: 0000000000000000
[   10.639146] x17: ffff800036e64000 x16: ffff800008008000 x15: 0000ccbd4c56cc8a
[   10.646277] x14: 0000000000000037 x13: 0000000000000037 x12: 0000000000000000
[   10.653408] x11: 0000000000000001 x10: 00000000000009b0 x9 : ffff8000098d31e0
[   10.660538] x8 : ffff00003fda2180 x7 : 0000000100000300 x6 : ffff000000c06190
[   10.667668] x5 : 0000000000000000 x4 : 0000000000000000 x3 : 0000000000000000
[   10.674799] x2 : ffff800000ce7000 x1 : 0000000000000040 x0 : ffff8000097e3040
[   10.681931] Call trace:
[   10.684372]  iomap_read_reg+0xc/0x30 [m_can_platform]
[   10.689423]  can_fill_info+0x108/0x524 [can_dev]
[   10.694058]  rtnl_fill_ifinfo+0x844/0x11b0
[   10.698161]  rtnl_getlink+0x23c/0x424
[   10.701821]  rtnetlink_rcv_msg+0x130/0x3a0
[   10.705914]  netlink_rcv_skb+0x60/0x130
[   10.709747]  rtnetlink_rcv+0x18/0x2c
[   10.713318]  netlink_unicast+0x2e4/0x340
[   10.717235]  netlink_sendmsg+0x1b0/0x420
[   10.721153]  __sys_sendto+0x134/0x170
[   10.724812]  __arm64_sys_sendto+0x28/0x40
[   10.728815]  invoke_syscall+0x48/0x114
[   10.732566]  el0_svc_common.constprop.0+0xd4/0xfc
[   10.737264]  do_el0_svc+0x20/0x30
[   10.740575]  el0_svc+0x28/0xa0
[   10.743630]  el0t_64_sync_handler+0xbc/0x140
[   10.747894]  el0t_64_sync+0x18c/0x190
[   10.751564] Code: bad PC value
[   10.754619] ---[ end trace 0000000000000000 ]---
[   10.811703] remoteproc remoteproc2: 30074000.pru is available
[   10.822052] remoteproc remoteproc3: 30078000.pru is available
M
[**    ] A start job is running for Wait for…ice Initialization (3s / 2min 58s)
M
[  OK  ] Created slice Slice /system/systemd-fsck.
[  OK  ] Found device /dev/mmcblk0p1.
         Starting File System Check on /dev/mmcblk0p1...
[  OK  ] Finished File System Check on /dev/mmcblk0p1.
         Mounting /media/BOOT-mmcblk0p1...
[  OK  ] Mounted /media/BOOT-mmcblk0p1.
         Mounting /boot...
[  OK  ] Mounted /boot.
[***   ] A start job is running for Wait for…ice Initialization (6s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ice Initialization (7s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ice Initialization (7s / 2min 58s)
M
[   ***] A start job is running for Wait for…ice Initialization (8s / 2min 58s)
M
[    **] A start job is running for Wait for…ice Initialization (8s / 2min 58s)
M
[     *] A start job is running for Wait for…ice Initialization (9s / 2min 58s)
M
[    **] A start job is running for Wait for…ice Initialization (9s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (10s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (10s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (11s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (11s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (12s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (12s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (13s / 2min 58s)
[   21.103689] platform sound: deferred probe pending
M
[***   ] A start job is running for Wait for…ce Initialization (13s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (14s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (14s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (15s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (15s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (16s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (16s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (17s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (17s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (18s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (18s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (19s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (19s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (20s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (20s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (21s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (21s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (22s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (22s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (23s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (23s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (24s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (24s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (25s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (25s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (26s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (26s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (27s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (27s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (28s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (28s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (29s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (29s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (30s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (30s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (31s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (31s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (32s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (32s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (33s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (33s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (34s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (34s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (35s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (35s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (36s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (36s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (37s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (37s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (38s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (38s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (39s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (39s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (40s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (40s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (41s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (41s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (42s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (42s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (43s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (43s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (44s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (44s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (45s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (45s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (46s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (46s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (47s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (47s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (48s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (48s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (49s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (49s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (50s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (50s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (51s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (51s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (52s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (52s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (53s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (53s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (54s / 2min 58s)
M
[*     ] A start job is running for Wait for…ce Initialization (54s / 2min 58s)
M
[**    ] A start job is running for Wait for…ce Initialization (55s / 2min 58s)
M
[***   ] A start job is running for Wait for…ce Initialization (55s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…ce Initialization (56s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (56s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (57s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (57s / 2min 58s)
M
[     *] A start job is running for Wait for…ce Initialization (58s / 2min 58s)
M
[    **] A start job is running for Wait for…ce Initialization (58s / 2min 58s)
M
[   ***] A start job is running for Wait for…ce Initialization (59s / 2min 58s)
M
[  *** ] A start job is running for Wait for…ce Initialization (59s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…e Initialization (1min / 2min 58s)
M
[***   ] A start job is running for Wait for…e Initialization (1min / 2min 58s)
M
[**    ] A start job is running for Wait for…nitialization (1min 1s / 2min 58s)
M
[*     ] A start job is running for Wait for…nitialization (1min 1s / 2min 58s)
M
[**    ] A start job is running for Wait for…nitialization (1min 2s / 2min 58s)
M
[***   ] A start job is running for Wait for…nitialization (1min 2s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…nitialization (1min 3s / 2min 58s)
M
[  *** ] A start job is running for Wait for…nitialization (1min 3s / 2min 58s)
M
[   ***] A start job is running for Wait for…nitialization (1min 4s / 2min 58s)
M
[    **] A start job is running for Wait for…nitialization (1min 4s / 2min 58s)
M
[     *] A start job is running for Wait for…nitialization (1min 5s / 2min 58s)
M
[    **] A start job is running for Wait for…nitialization (1min 5s / 2min 58s)
M
[   ***] A start job is running for Wait for…nitialization (1min 6s / 2min 58s)
M
[  *** ] A start job is running for Wait for…nitialization (1min 6s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…nitialization (1min 7s / 2min 58s)
M
[***   ] A start job is running for Wait for…nitialization (1min 7s / 2min 58s)
M
[**    ] A start job is running for Wait for…nitialization (1min 8s / 2min 58s)
M
[*     ] A start job is running for Wait for…nitialization (1min 8s / 2min 58s)
M
[**    ] A start job is running for Wait for…nitialization (1min 9s / 2min 58s)
M
[***   ] A start job is running for Wait for…nitialization (1min 9s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…itialization (1min 10s / 2min 58s)
M
[  *** ] A start job is running for Wait for…itialization (1min 10s / 2min 58s)
M
[   ***] A start job is running for Wait for…itialization (1min 11s / 2min 58s)
M
[    **] A start job is running for Wait for…itialization (1min 11s / 2min 58s)
M
[     *] A start job is running for Wait for…itialization (1min 12s / 2min 58s)
M
[    **] A start job is running for Wait for…itialization (1min 12s / 2min 58s)
M
[   ***] A start job is running for Wait for…itialization (1min 13s / 2min 58s)
M
[  *** ] A start job is running for Wait for…itialization (1min 13s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…itialization (1min 14s / 2min 58s)
M
[***   ] A start job is running for Wait for…itialization (1min 14s / 2min 58s)
M
[**    ] A start job is running for Wait for…itialization (1min 15s / 2min 58s)
M
[*     ] A start job is running for Wait for…itialization (1min 15s / 2min 58s)
M
[**    ] A start job is running for Wait for…itialization (1min 16s / 2min 58s)
M
[***   ] A start job is running for Wait for…itialization (1min 16s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…itialization (1min 17s / 2min 58s)
M
[  *** ] A start job is running for Wait for…itialization (1min 17s / 2min 58s)
M
[   ***] A start job is running for Wait for…itialization (1min 18s / 2min 58s)
M
[    **] A start job is running for Wait for…itialization (1min 18s / 2min 58s)
M
[     *] A start job is running for Wait for…itialization (1min 19s / 2min 58s)
M
[    **] A start job is running for Wait for…itialization (1min 19s / 2min 58s)
M
[   ***] A start job is running for Wait for…itialization (1min 20s / 2min 58s)
M
[  *** ] A start job is running for Wait for…itialization (1min 20s / 2min 58s)
M
[ ***  ] A start job is running for Wait for…itialization (1min 21s / 2min 58s)
M
[***   ] A start job is running for Wait for…itialization (1min 21s / 2min 58s)
M
[**    ] A start job is running for Wait for…itialization (1min 22s / 2min 58s)
M
[*     ] A start job is running for Wait for…itialization (1min 22s / 2min 58s)

  • 0 in reply to fd
    TI__Mastermind 38720 points

    Hi,

    I can understand that the lockup issue is hard to reproduce. Apologies as I should have asked this before is what happens if you removed CAN from the device tree do you see this lock up?

    I am checking with our device characterization teams on this error. Looking at the device errata the only temperature related issue I see is on the OSPI interface. 

    Best Regards,

    Schuyler

  • 0 in reply to Schuyler Patton
    Intellectual 655 points
    Schuyler Patton said:
    Apologies as I should have asked this before is what happens if you removed CAN from the device tree do you see this lock up?

    Given that the code that is crashing is executed only when the CAN is enabled the crash will just not happen. Doing a test to confirm this will consume a lot of time/effort and provide zero value in my opinion.

    Schuyler Patton said:
    I am checking with our device characterization teams on this error. Looking at the device errata the only temperature related issue I see is on the OSPI interface. 

    Did you consider my comment in the first message? 


    > Such issue would happen in `m_can_get_berr_counter()` when calling `__m_can_get_berr_counter()` without calling `m_can_clk_start()`,

    > IOW without enabling the clocks. I did look at the code and I was not able to spot any bug in the m_can driver that would justify such behavior.

    > The only thing I was able to think is that the issue could be because `m_can_runtime_resume()` returns before the clocks are enabled,

    > and maybe this could be related to some kind of race condition with the DM firmware that is running on the cortex R5? 

    I would personally suggest to investigate in this direction.
    Francesco
  • 0 in reply to fd
    Intellectual 655 points

    : any update on this?