This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM5708: SDK Upgrade to 08.02.01.00 , kernel crash at L3

Part Number: AM5708
Other Parts Discussed in Thread: CDCE913, AM5718

Tool/software:

We are in the process of upgrading our SDK from version 05.03.00.07 to 08.02.01.00 for a custom board based on the TI AM5708.

However, the kernel crashes at the L3 handler during boot.

Full Booting Log:
----------------------

the previous SDK boots without any problem. i have disabled dsp1 in dts file. what was the problem in L3 handle ?

Thanks you in advance.

U-Boot 2021.01-00003-g16d964ac27-dirty (May 05 2025 - 21:12:46 +0000)

CPU : DRA722-GP ES2.1
Model: TI AM5708 IDK
Board: AM5708 IDK REV
DRAM: 1 GiB
MMC: OMAP SD/MMC: 0
Loading Environment from FAT... *** Warning - bad CRC, using default environment

Loading Environment from MMC... *** Warning - bad CRC, using default environment

invalid mmc device
i2c_write: error waiting for data ACK (status=0x116)
cdce9xx-clk cdce913@65: cdce9xx_reg_write: failed for addr:5, ret:-121
Net: Could not get PHY for ethernet@48484000: addr 0
eth2: ethernet@48484000
Hit any key to stop autoboot: 0
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
Failed to load 'boot.scr'
4468 bytes read in 10 ms (435.5 KiB/s)
Loaded env from uEnv.txt
Importing environment from mmc0 ...
Running uenvcmd ...
Failed to load 'newpart_attempt'
Failed to load 'newpart_request'
Failed to load 'PART_A'
Failed to load 'PART_B'
WARNING: Could not find either flag file (PART_A or PART_B). Will boot from PART_A by default
INFO: Booting from partition A (mmcblk0p2)
switch to partitions #0, OK
mmc0 is current device
SD/MMC found on device 0
5251584 bytes read in 226 ms (22.2 MiB/s)
142504 bytes read in 16 ms (8.5 MiB/s)
## Flattened Device Tree blob at 88000000
Booting using the fdt blob at 0x88000000
Loading Device Tree to 8ffda000, end 8ffffca7 ... OK

Starting kernel ...

[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 5.10.100-g7a7a3af903 (root@useadevbtcvm001) (arm-linux-gnueabihf-gcc (Linaro GCC 7.2-2017.11) 7.2.1 20171011, GNU ld (Linaro_Binutils-2017.11) 2.28.2.20170706) #30 SMP PREEMPT Fri May 30 18:17:29 UTC 2025
[ 0.000000] CPU: ARMv7 Processor [412fc0f2] revision 2 (ARMv7), cr=30c5387d
[ 0.000000] CPU: div instructions available: patching division code
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
[ 0.000000] OF: fdt: Machine model: TI AM5718 IDK
[ 0.000000] Memory policy: Data cache writealloc
[ 0.000000] efi: UEFI not found.
[ 0.000000] Reserved memory: created CMA memory pool at 0x0000000095800000, size 56 MiB
[ 0.000000] OF: reserved mem: initialized node ipu2-memory@95800000, compatible id shared-dma-pool
[ 0.000000] Reserved memory: created CMA memory pool at 0x0000000099000000, size 64 MiB
[ 0.000000] OF: reserved mem: initialized node dsp1-memory@99000000, compatible id shared-dma-pool
[ 0.000000] Reserved memory: created CMA memory pool at 0x000000009d000000, size 32 MiB
[ 0.000000] OF: reserved mem: initialized node ipu1-memory@9d000000, compatible id shared-dma-pool
[ 0.000000] cma: Reserved 24 MiB at 0x00000000be800000
[ 0.000000] OMAP4: Map 0x00000000afd00000 to (ptrval) for dram barrier
[ 0.000000] Hit pending asynchronous external abort (FSR=0x00001211) during first unmask, this is most likely caused by a firmware/bootloader bug.
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000080000000-0x00000000afcfffff]
[ 0.000000] Normal empty
[ 0.000000] HighMem [mem 0x00000000afd00000-0x00000000bfffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000080000000-0x00000000afcfffff]
[ 0.000000] node 0: [mem 0x00000000b0000000-0x00000000bfffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000000bfffffff]
[ 0.000000] DRA722 ES2.1
[ 0.000000] percpu: Embedded 16 pages/cpu s33228 r8192 d24116 u65536
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 259654
[ 0.000000] Kernel command line: console=ttyS0,115200n8 root=PARTUUID=bfa840d4-02 rw rootfstype=ext4 rootwait
[ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] Memory: 836896K/1045504K available (10240K kernel code, 717K rwdata, 3500K rodata, 2048K init, 329K bss, 28384K reserved, 180224K cma-reserved, 237568K highmem)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] rcu: Preemptible hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
[ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=2 to nr_cpu_ids=1.
[ 0.000000] Trampoline variant of Tasks RCU enabled.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] GIC: Using split EOI/Deactivate mode
[ 0.000000] random: get_random_bytes called from start_kernel+0x328/0x4dc with crng_init=0
[ 0.000000] arch_timer: cp15 timer(s) running at 5.90MHz (phys).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x15c70fb29, max_idle_ns: 440795202138 ns
[ 0.000006] sched_clock: 56 bits at 5MHz, resolution 169ns, wraps every 4398046511093ns
[ 0.000019] Switching to timer-based delay loop, resolution 169ns
[ 0.000978] OMAP clocksource: 32k_counter at 32768 Hz
[ 0.000991] clocksource: 32k_counter: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 58327039986419 ns
[ 0.002292] TI gptimer clockevent: always-on 31475 Hz at /ocp/interconnect@4ae00000/segment@10000/target-module@8000
[ 0.002362] ARM architected timer wrap issue i940 detected
[ 0.004153] Console: colour dummy device 80x30
[ 0.004206] Calibrating delay loop (skipped), value calculated using timer frequency.. 11.80 BogoMIPS (lpj=59016)
[ 0.004223] pid_max: default: 32768 minimum: 301
[ 0.004354] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.004369] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.004998] CPU: Testing write buffer coherency: ok
[ 0.005043] CPU0: Spectre v2: firmware did not set auxiliary control register IBE bit, system vulnerable
[ 0.005219] /cpus/cpu@0 missing clock-frequency property
[ 0.005232] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[ 0.005675] Setting up static identity map for 0x80200000 - 0x80200060
[ 0.005760] rcu: Hierarchical SRCU implementation.
[ 0.005910] EFI services will not be available.
[ 0.005992] smp: Bringing up secondary CPUs ...
[ 0.006003] smp: Brought up 1 node, 1 CPU
[ 0.006013] SMP: Total of 1 processors activated (11.80 BogoMIPS).
[ 0.006022] CPU: All CPU(s) started in HYP mode.
[ 0.006030] CPU: Virtualization extensions available.
[ 0.006385] devtmpfs: initialized
[ 0.027163] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0
[ 0.027344] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.027365] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[ 0.031290] pinctrl core: initialized pinctrl subsystem
[ 0.031911] DMI not present or invalid.
[ 0.032195] NET: Registered protocol family 16
[ 0.033376] DMA: preallocated 256 KiB pool for atomic coherent allocations
[ 0.036076] omap_hwmod: l3_main_2 using broken dt data from ocp
[ 0.053471] thermal_sys: Registered thermal governor 'fair_share'
[ 0.053479] thermal_sys: Registered thermal governor 'bang_bang'
[ 0.053490] thermal_sys: Registered thermal governor 'step_wise'
[ 0.053500] thermal_sys: Registered thermal governor 'user_space'
[ 0.054305] cpuidle: using governor ladder
[ 0.054336] cpuidle: using governor menu
[ 0.068924] omap_l3_probe...................................
[ 1.388445] No ATAGs?
[ 1.388497] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4 watchpoint registers.
[ 1.388508] hw-breakpoint: maximum watchpoint size is 8 bytes.
[ 1.415076] reg-fixed-voltage fixedregulator-v3_3d: Failed to register regulator: -517
[ 1.415340] V1_2D: supplied by VMAIN
[ 1.415848] reg-fixed-voltage fixedregulator-vtt: Failed to register regulator: -517
[ 1.417215] iommu: Default domain type: Translated
[ 1.420744] SCSI subsystem initialized
[ 1.421249] mc: Linux media interface: v0.10
[ 1.421280] videodev: Linux video capture interface: v2.00
[ 1.421481] pps_core: LinuxPPS API ver. 1 registered
[ 1.421491] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 1.421510] PTP clock support registered
[ 1.421548] EDAC MC: Ver: 3.0.0
[ 1.422465] Advanced Linux Sound Architecture Driver Initialized.
[ 1.423304] clocksource: Switched to clocksource arch_sys_counter
[ 1.429079] NET: Registered protocol family 2
[ 1.429237] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[ 1.430035] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 6144 bytes, linear)
[ 1.430066] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear)
[ 1.430131] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
[ 1.430258] TCP: Hash tables configured (established 8192 bind 8192)
[ 1.430337] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 1.430372] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 1.430486] NET: Registered protocol family 1
[ 1.430829] RPC: Registered named UNIX socket transport module.
[ 1.430841] RPC: Registered udp transport module.
[ 1.430850] RPC: Registered tcp transport module.
[ 1.430859] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 1.430872] PCI: CLS 0 bytes, default 64
[ 1.432551] hw perfevents: enabled with armv7_cortex_a15 PMU driver, 7 counters available
[ 1.433272] Initialise system trusted keyrings
[ 1.433490] workingset: timestamp_bits=14 max_order=18 bucket_order=4
[ 1.437514] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 1.438000] NFS: Registering the id_resolver key type
[ 1.438025] Key type id_resolver registered
[ 1.438034] Key type id_legacy registered
[ 1.438101] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[ 1.438111] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[ 1.438139] ntfs: driver 2.1.32 [Flags: R/O].
[ 1.438532] Key type asymmetric registered
[ 1.438544] Asymmetric key parser 'x509' registered
[ 1.438588] bounce: pool size: 64 pages
[ 1.438621] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[ 1.438632] io scheduler mq-deadline registered
[ 1.438641] io scheduler kyber registered
[ 1.634890] omap-dma-engine 4a056000.dma-controller: OMAP DMA engine driver (LinkedList1/2/3 supported)
[ 1.681169] OMAP GPIO hardware version 0.1
[ 1.714269] palmas 0-0058: IRQ missing: skipping irq request
[ 1.743620] palmas 0-0058: Muxing GPIO 51, PWM 0, LED 2
[ 1.746365] smps12: supplied by regulator-dummy
[ 1.747706] smps3: supplied by VMAIN
[ 1.749151] smps45: Bringing 0uV into 850000-850000uV
[ 1.749863] smps45: supplied by regulator-dummy
[ 1.750049] smps45: Bringing 0uV into 850000-850000uV
[ 1.752084] smps6: supplied by VMAIN
[ 1.753254] SMPS7: supplied by regulator-dummy
[ 1.754288] smps8: supplied by VMAIN
[ 1.755150] smps9: supplied by VMAIN
[ 1.755353] ldo1: supplied by VMAIN
[ 1.756980] ldo2: supplied by VMAIN
[ 1.758598] ldo3: Bringing 0uV into 1800000-1800000uV
[ 1.759293] ldo3: supplied by VMAIN
[ 1.760622] random: fast init done
[ 1.761006] ldo4: Bringing 0uV into 1800000-1800000uV
[ 1.761689] ldo4: supplied by VMAIN
[ 1.761873] ldo4: Bringing 0uV into 1800000-1800000uV
[ 1.764226] LDO5: supplied by regulator-dummy
[ 1.764559] LDO6: supplied by regulator-dummy
[ 1.764885] LDO7: supplied by regulator-dummy
[ 1.765216] LDO8: supplied by regulator-dummy
[ 1.765527] LDO9: supplied by VMAIN
[ 1.765829] LDOLN: supplied by VMAIN
[ 1.766131] LDOUSB: supplied by VMAIN
[ 1.769056] omap_i2c 48070000.i2c: bus 0 rev0.12 at 400 kHz
[ 1.790143] omap-mailbox 48840000.mailbox: omap mailbox rev 0x400
[ 1.791291] omap-mailbox 48842000.mailbox: omap mailbox rev 0x400
[ 1.797901] edma 43300000.dma: memcpy is disabled
[ 1.800695] edma 43300000.dma: TI EDMA DMA engine driver
[ 1.816546] pinctrl-single 4a003400.pinmux: 282 pins, size 1128
[ 1.816724] pinctrl-single 4a002e8c.pinmux: please update dts to use #pinctrl-cells = <1>
[ 1.816773] pinctrl-single 4a002e8c.pinmux: initialized with no interrupts
[ 1.816784] pinctrl-single 4a002e8c.pinmux: 1 pins, size 4
[ 1.822188] dra7-pcie 51000000.pcie: host bridge /ocp/axi@0/pcie@51000000 ranges:
[ 1.822240] dra7-pcie 51000000.pcie: IO 0x0020003000..0x0020012fff -> 0x0000000000
[ 1.822272] dra7-pcie 51000000.pcie: MEM 0x0020013000..0x002fffffff -> 0x0020013000
[ 2.813513] dra7-pcie 51000000.pcie: Phy link never came up
[ 2.813637] dra7-pcie 51000000.pcie: PCI host bridge to bus 0000:00
[ 2.813651] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 2.813663] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]
[ 2.813674] pci_bus 0000:00: root bus resource [mem 0x20013000-0x2fffffff]
[ 2.813715] pci 0000:00:00.0: [104c:8888] type 01 class 0x060400
[ 2.813738] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x000fffff]
[ 2.813753] pci 0000:00:00.0: reg 0x14: [mem 0x00000000-0x0000ffff]
[ 2.813821] pci 0000:00:00.0: supports D1
[ 2.813832] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[ 2.821334] PCI: bus0: Fast back to back transfers disabled
[ 2.828516] PCI: bus1: Fast back to back transfers enabled
[ 2.828552] pci 0000:00:00.0: BAR 0: assigned [mem 0x20100000-0x201fffff]
[ 2.828567] pci 0000:00:00.0: BAR 1: assigned [mem 0x20020000-0x2002ffff]
[ 2.828582] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[ 2.828952] pcieport 0000:00:00.0: PME: Signaling with IRQ 170
[ 2.871105] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[ 2.875198] printk: console [ttyS0] disabled
[ 2.875347] 4806a000.serial: ttyS0 at MMIO 0x4806a000 (irq = 124, base_baud = 3000000) is a 8250
[ 4.007598] printk: console [ttyS0] enabled
[ 4.013097] 4806e000.serial: ttyS3 at MMIO 0x4806e000 (irq = 125, base_baud = 3000000) is a 8250
[ 4.024928] omap_rng 48090000.rng: Random Number Generator ver. 20
[ 4.032265] omapdss_dss 58000000.dss: supply vdda_video not found, using dummy regulator
[ 4.040596] random: crng init done
[ 4.044743] DSS: OMAP DSS rev 6.1
[ 4.073229] brd: module loaded
[ 4.081954] loop: module loaded
[ 4.085422] RflActel: actel base addr: 0x12000000, count: 4096, ioremap addr: 0xf10b9000
[ 4.093586] RflActel: system config nvram base addr: 0x13000020, count: 2016, ioremap addr: 0xf10bb020
[ 4.102932] RflActel: Creating /proc/rfl directory
[ 4.108170] Actel Proc Regs Module Initialized. Registers: 48 fields: 137
[ 4.115192] LED timer thread is started
[ 4.123377] spi-nor spi0.0: unrecognized JEDEC id bytes: 00 00 00 00 00 00
[ 4.135875] max24287: All bugs added by Ben Shapiro
[ 4.203332] davinci_mdio 48485000.mdio: davinci mdio revision 1.6, bus freq 1000000
[ 4.217214] probe mdio phy device
[ 4.220548] davinci_mdio 48485000.mdio: phy[1]: device 48485000.mdio:01, driver max24287
[ 4.228729] davinci_mdio 48485000.mdio: phy[31]: device 48485000.mdio:1f, driver max24287
[ 4.236985] davinci_mdio 48485000.mdio: RFL: Creating /proc/rfl entries for Vitesse vsc7511
[ 4.245404] calling mdio bus write ... reg0
[ 4.249818] trying to write mdio bus reg1
[ 4.254172] read from mdio bus
[ 4.258678] Found Vitesse VSC7511 Switch.
[ 4.262703] calling mdio bus write ... reg0
[ 4.267137] trying to write mdio bus reg1
[ 4.271460] read from mdio bus
[ 4.275996] calling mdio bus write ... reg0
[ 4.280409] trying to write mdio bus reg1
[ 4.284745] read from mdio bus
[ 4.289749] cpsw-switch 48484000.switch: /ocp/interconnect@48400000/segment@0/target-module@84000/switch@0/ethernet-ports/port@1 Missing dual_emac_res_vlan in DT.
[ 4.304373] cpsw-switch 48484000.switch: /ocp/interconnect@48400000/segment@0/target-module@84000/switch@0/ethernet-ports/port@1 Using 1 as Reserved VLAN
[ 4.318459] cpsw-switch 48484000.switch: /ocp/interconnect@48400000/segment@0/target-module@84000/switch@0/ethernet-ports/port@2 Missing dual_emac_res_vlan in DT.
[ 4.333075] cpsw-switch 48484000.switch: /ocp/interconnect@48400000/segment@0/target-module@84000/switch@0/ethernet-ports/port@2 Using 2 as Reserved VLAN
[ 4.346896] cpsw-switch 48484000.switch: initialized cpsw ale version 1.4
[ 4.353725] cpsw-switch 48484000.switch: ALE Table size 1024
[ 4.359488] cpsw-switch 48484000.switch: cpts: overflow check period 500 (jiffies)
[ 4.367113] cpsw-switch 48484000.switch: CPTS: ref_clk_freq:265920000 calc_mult:4037837786 calc_shift:30 error:0 nsec/sec
[ 4.378236] cpsw-switch 48484000.switch: Detected MACID = 68:47:49:d8:13:e6
[ 4.385269] cpsw-switch 48484000.switch: Detected MACID = 68:47:49:d8:13:e7
[ 4.393708] cpsw-switch 48484000.switch: initialized (regs 0x0000000048484000, pool size 256) hw_ver:0019010F 1.15 (0)
[ 4.405404] i2c /dev entries driver
[ 4.418749] sdhci: Secure Digital Host Controller Interface driver
[ 4.425015] sdhci: Copyright(c) Pierre Ossman
[ 4.431121] sdhci-pltfm: SDHCI platform and OF driver helper
[ 4.439220] omap_gpio 4805d000.gpio: Could not set line 27 debounce to 200000 microseconds (-22)
[ 4.449722] ledtrig-cpu: registered to indicate activity on CPUs
[ 4.455782] sdhci-omap 4809c000.mmc: Got CD GPIO
[ 4.467626] NET: Registered protocol family 10
[ 4.473630] Segment Routing with IPv6
[ 4.477359] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[ 4.483851] NET: Registered protocol family 17
[ 4.488634] Key type dns_resolver registered
[ 4.493018] Registering SWP/SWPB emulation handler
[ 4.498457] omap_voltage_late_init: Voltage driver support not added
[ 4.504886] Power Management for TI OMAP4+ devices.
[ 4.510176] Loading compiled-in X.509 certificates
[ 4.546823] dmm 4e000000.dmm: workaround for errata i878 in use
[ 4.554637] dmm 4e000000.dmm: initialized all PAT entries
[ 4.561187] omap-gpmc 50000000.gpmc: GPMC revision 6.0
[ 4.566398] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
[ 4.575960] V3_3D: supplied by smps9
[ 4.580633] vtt_fixed: supplied by V3_3D
[ 4.598303] ------------[ cut here ]------------
[ 4.602950] WARNING: CPU: 0 PID: 64 at drivers/bus/omap_l3_noc.c:149 l3_interrupt_handler+0x2a0/0x3c8
[ 4.612210] 44000000.ocp:L3 Standard Error: MASTER MPU TARGET DSP1_SDMA (Read Link): At Address: 0x00501000 : Data Access in User mode during Functional access
[ 4.626525] Modules linked in:
[ 4.629600] CPU: 0 PID: 64 Comm: kworker/0:3 Not tainted 5.10.100-g7a7a3af903 #30
[ 4.637113] Hardware name: Generic DRA72X (Flattened Device Tree)
[ 4.643238] Workqueue: events deferred_probe_work_func
[ 4.648419] [<c020f0e8>] (unwind_backtrace) from [<c020a314>] (show_stack+0x10/0x14)
[ 4.656204] [<c020a314>] (show_stack) from [<c0b3b6e0>] (dump_stack+0x9c/0xb0)
[ 4.663463] [<c0b3b6e0>] (dump_stack) from [<c022a35c>] (__warn+0xe0/0xe4)
[ 4.670370] [<c022a35c>] (__warn) from [<c022a3d4>] (warn_slowpath_fmt+0x74/0xb8)
[ 4.677889] [<c022a3d4>] (warn_slowpath_fmt) from [<c05ef9c0>] (l3_interrupt_handler+0x2a0/0x3c8)
[ 4.686806] [<c05ef9c0>] (l3_interrupt_handler) from [<c02855d0>] (__handle_irq_event_percpu+0x50/0x120)
[ 4.696331] [<c02855d0>] (__handle_irq_event_percpu) from [<c02856cc>] (handle_irq_event_percpu+0x2c/0x7c)
[ 4.706029] [<c02856cc>] (handle_irq_event_percpu) from [<c0285754>] (handle_irq_event+0x38/0x5c)
[ 4.714942] [<c0285754>] (handle_irq_event) from [<c0289bf0>] (handle_fasteoi_irq+0xb0/0x164)
[ 4.723507] [<c0289bf0>] (handle_fasteoi_irq) from [<c0284844>] (generic_handle_irq+0x34/0x44)
[ 4.732157] [<c0284844>] (generic_handle_irq) from [<c0284e14>] (__handle_domain_irq+0x5c/0xb4)
[ 4.740896] [<c0284e14>] (__handle_domain_irq) from [<c05edcd8>] (gic_handle_irq+0x70/0x84)
[ 4.749287] [<c05edcd8>] (gic_handle_irq) from [<c0200af8>] (__irq_svc+0x58/0x8c)
[ 4.756802] Exception stack(0xc2187db8 to 0xc2187e00)
[ 4.761873] 7da0: 00000000 00000000
[ 4.770086] 7dc0: 00000050 00000000 c2199240 c1204cc8 c12e94a0 00000000 c16c8810 00000000
[ 4.778299] 7de0: c0c2f914 c0c2fcf4 00000000 c2187e08 c067adc8 c05f2b74 20000013 ffffffff
[ 4.786517] [<c0200af8>] (__irq_svc) from [<c05f2b74>] (sysc_probe+0x102c/0x15bc)
[ 4.794038] [<c05f2b74>] (sysc_probe) from [<c075fe78>] (platform_drv_probe+0x48/0x98)
[ 4.801994] [<c075fe78>] (platform_drv_probe) from [<c075deb8>] (really_probe+0xf0/0x398)
[ 4.810211] [<c075deb8>] (really_probe) from [<c075e2c8>] (driver_probe_device+0x5c/0xb4)
[ 4.818427] [<c075e2c8>] (driver_probe_device) from [<c075c344>] (bus_for_each_drv+0x58/0xb8)
[ 4.826992] [<c075c344>] (bus_for_each_drv) from [<c075dd54>] (__device_attach+0xe0/0x14c)
[ 4.835294] [<c075dd54>] (__device_attach) from [<c075d014>] (bus_probe_device+0x84/0x8c)
[ 4.843510] [<c075d014>] (bus_probe_device) from [<c075d4c4>] (deferred_probe_work_func+0x7c/0xa8)
[ 4.852511] [<c075d4c4>] (deferred_probe_work_func) from [<c02426b4>] (process_one_work+0x204/0x460)
[ 4.861687] [<c02426b4>] (process_one_work) from [<c0242ba4>] (worker_thread+0x294/0x590)
[ 4.869903] [<c0242ba4>] (worker_thread) from [<c0249790>] (kthread+0x188/0x18c)
[ 4.877334] [<c0249790>] (kthread) from [<c0200138>] (ret_from_fork+0x14/0x3c)
[ 4.884586] Exception stack(0xc2187fb0 to 0xc2187ff8)
[ 4.889657] 7fa0: 00000000 00000000 00000000 00000000
[ 4.897869] 7fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 4.906081] 7fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 4.912723] ---[ end trace e397f96a6996a3b4 ]---
[ 4.917401] 8<--- cut here ---
[ 4.920469] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 4.927809] pgd = 3a86d976
[ 4.930524] [00000000] *pgd=80000080004003, *pmd=00000000
[ 4.935958] Internal error: : 1211 [#1] PREEMPT SMP ARM
[ 4.941203] Modules linked in:
[ 4.944274] CPU: 0 PID: 64 Comm: kworker/0:3 Tainted: G W 5.10.100-g7a7a3af903 #30
[ 4.953182] Hardware name: Generic DRA72X (Flattened Device Tree)
[ 4.959304] Workqueue: events deferred_probe_work_func
[ 4.964470] PC is at sysc_probe+0x102c/0x15bc
[ 4.968847] LR is at omap_reset_deassert+0x17c/0x2cc
[ 4.973830] pc : [<c05f2b74>] lr : [<c067adc8>] psr: 20000013
[ 4.980121] sp : c2187e08 ip : 00000000 fp : c0c2fcf4
[ 4.985367] r10: c0c2f914 r9 : 00000000 r8 : c16c8810
[ 4.990612] r7 : 00000000 r6 : c12e94a0 r5 : c1204cc8 r4 : c2199240
[ 4.997166] r3 : 00000000 r2 : 00000050 r1 : 00000000 r0 : 00000000
[ 5.003721] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 5.010886] Control: 30c5387d Table: 80003000 DAC: fffffffd
[ 5.016655] Process kworker/0:3 (pid: 64, stack limit = 0x206ff60d)
[ 5.022948] Stack: (0xc2187e08 to 0xc2188000)
[ 5.027323] 7e00: 00000001 00000000 c120e734 c1204cc8 00000028 00000000
[ 5.035536] 7e20: c0ee60a4 c0e83610 c0e835d0 c12e94a0 00000001 00000001 00000303 e680d64c
[ 5.043749] 7e40: 00000000 c16c8810 00000000 c1284304 00000000 00000000 c1284304 00000004
[ 5.051962] 7e60: efc3d1c0 c075fe78 c16c8810 c12eddf4 c12eddfc c075deb8 00000000 c16c8810
[ 5.060174] 7e80: c1284304 c075e3d0 c1204cc8 00000001 00000000 00000000 efc3d1c0 c075e2c8
[ 5.068385] 7ea0: 00000000 c2187edc c075e3d0 c075c344 00000000 c145a76c c17acb38 e680d64c
[ 5.076597] 7ec0: c1204cc8 c1204cc8 c16c8810 c16c8854 c12944d8 c075dd54 c1204cc8 c16c8810
[ 5.084809] 7ee0: 00000001 e680d64c c16c8810 c16c8810 c1294780 c12944d8 00000000 c075d014
[ 5.093021] 7f00: c16c8810 c12944c4 c12944c4 c075d4c4 c1294504 c2171080 efc3d1c0 efc40400
[ 5.101233] 7f20: 00000000 c02426b4 c1203d00 efc3d1d8 c2171080 efc3d1c0 c2171094 c1203d00
[ 5.109446] 7f40: efc3d1d8 ffffe000 00000008 c0242ba4 00000000 c12b3164 c0e52008 c14a5ea4
[ 5.117658] 7f60: c2187f74 c2170840 c2186000 c21702c0 00000000 c0242910 c2171080 c14a5ea4
[ 5.125869] 7f80: c2170864 c0249790 00000000 c21702c0 c0249608 00000000 00000000 00000000
[ 5.134081] 7fa0: 00000000 00000000 00000000 c0200138 00000000 00000000 00000000 00000000
[ 5.142292] 7fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 5.150504] 7fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 5.158723] [<c05f2b74>] (sysc_probe) from [<c075fe78>] (platform_drv_probe+0x48/0x98)
[ 5.166679] [<c075fe78>] (platform_drv_probe) from [<c075deb8>] (really_probe+0xf0/0x398)
[ 5.174895] [<c075deb8>] (really_probe) from [<c075e2c8>] (driver_probe_device+0x5c/0xb4)
[ 5.183112] [<c075e2c8>] (driver_probe_device) from [<c075c344>] (bus_for_each_drv+0x58/0xb8)
[ 5.191676] [<c075c344>] (bus_for_each_drv) from [<c075dd54>] (__device_attach+0xe0/0x14c)
[ 5.199979] [<c075dd54>] (__device_attach) from [<c075d014>] (bus_probe_device+0x84/0x8c)
[ 5.208194] [<c075d014>] (bus_probe_device) from [<c075d4c4>] (deferred_probe_work_func+0x7c/0xa8)
[ 5.217194] [<c075d4c4>] (deferred_probe_work_func) from [<c02426b4>] (process_one_work+0x204/0x460)
[ 5.226368] [<c02426b4>] (process_one_work) from [<c0242ba4>] (worker_thread+0x294/0x590)
[ 5.234584] [<c0242ba4>] (worker_thread) from [<c0249790>] (kthread+0x188/0x18c)
[ 5.242015] [<c0249790>] (kthread) from [<c0200138>] (ret_from_fork+0x14/0x3c)
[ 5.249266] Exception stack(0xc2187fb0 to 0xc2187ff8)
[ 5.254337] 7fa0: 00000000 00000000 00000000 00000000
[ 5.262549] 7fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 5.270760] 7fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 5.277404] Code: e5943014 e0833001 e593c000 e584c05c (e59a0004)
[ 5.283526] ---[ end trace e397f96a6996a3b5 ]---


The previous SDK boots without any issues. I have disabled dsp1 in the device tree (.dts) file.

------------------------------------
dts snippet:

reserved-memory {
#address-cells = <2>;
#size-cells = <2>;
ranges;

ipu2_memory_region: ipu2-memory@95800000 {
compatible = "shared-dma-pool";
reg = <0x0 0x95800000 0x0 0x3800000>;
reusable;
status = "okay";
};

dsp1_memory_region: dsp1-memory@99000000 {
compatible = "shared-dma-pool";
reg = <0x0 0x99000000 0x0 0x4000000>;
reusable;
status = "okay";
};

ipu1_memory_region: ipu1-memory@9d000000 {
compatible = "shared-dma-pool";
reg = <0x0 0x9d000000 0x0 0x2000000>;
reusable;
status = "okay";
};
};
----------------------------

Could anyone help me understand what might be causing the L3 handler crash?

Thank you in advance.

  • Hello Mahesh,

    This is explained in the TRM section  14.2.3.8.5 Example for Decoding Standard/Custom Errors Logged in L3_MAIN .

    You can read more about this here --> 14.2.3.8 L3_MAIN Interconnect Error Handling

    There are also existing threads which expand on what could be potentially be the issue, like for example increasing the size of shared memory - https://e2e.ti.com/support/processors-group/processors/f/processors-forum/761621/linux-am5728-44000000-ocp-l3-standard-error-master-mpu-target-dsp1_sdma-read-at-address-0x00000000-data-access-in-user-mode-during-functional-access.

    My first recommendation would be to take care of the U-boot errors that usually will create issues at the time of kernel boot.

    invalid mmc device
    i2c_write: error waiting for data ACK (status=0x116)
    cdce9xx-clk cdce913@65: cdce9xx_reg_write: failed for addr:5, ret:-121

    Best,

    Josue

  • Hi Josue,

    Thanks, The same custom board works with the previous SDK (05.03.00.07), but not with the new one (08.02.01.00). You’re right—I tested using the 05.03 SDK’s U-Boot and the 08.02 kernel, and I still encountered the same kernel crash. That made me think the issue might be related to the kernel side, possibly something with the DTS or other kernel configurations. 

    The existing thread doesn’t provide a solution—it was closed without any clear conclusion. Anyway, I’m revisiting the U-Boot configuration to see if that helps resolve the issue.

    Thanks,

    Mahesh R

  • By going through the kernel log, I noticed the following:

    [ 4.794038] [<c05f2b74>] (sysc_probe) from [<c075fe78>] (platform_drv_probe+0x48/0x98)

    It looks like sysc_probe is causing the kernel to crash. If I delay this function, the behavior changes.

    Previously, the crash looked like this:

    [ 4.794038] [<c05f2b74>] (sysc_probe) from [<c075fe78>] (platform_drv_probe+0x48/0x98) [ 4.602950] WARNING: CPU: 0 PID: 64 at drivers/bus/omap_l3_noc.c:149 l3_interrupt_handler+0x2a0/0x3c8 [ 4.612210] 44000000.ocp: L3 Standard Error: MASTER MPU TARGET DSP1_SDMA (Read Link): At Address: 0x00501000 : Data Access in User mode during

    Now, after delaying ( adding some logs) sysc_probe, the error looks like this:

    [ 18.866001] WARNING: CPU: 0 PID: 378 at drivers/bus/omap_l3_noc.c:147 l3_interrupt_handler+0x254/0x36c [ 18.875349] 44000000.ocp: L3 Custom Error: MASTER MPU TARGET L4_PER1_P3 (Read): Data Access in User mode during Functional access [ 18.886961] Modules linked in: RflAcid(+) [ 18.891002] CPU: 0 PID: 378 Comm: insmod Not tainted 5.10.100-g7a7a3af903 #3 [ 18.898080] Hardware name: Generic DRA72X (Flattened Device Tree)

    I noticed that ti-sysc.c is introduced in the new SDK. The previous SDK didn’t have this module.


    Does anyone know what this module does or how it might be related to the crash?

  • Hello Mahesh,

    Yes, this is more than likely some DTS issues that need to be resolved. You can find a description to this Linux Module under device tree bindings bus:

    https://git.ti.com/cgit/ti-linux-kernel/ti-linux-kernel/tree/Documentation/devicetree/bindings/bus/ti-sysc.txt?h=ti-linux-5.10.y

    Reasons could be: (Linked above)

     

    You are porting from such a delta that you might be missing some of the DTS changes needed.

    This explanation was the gist of the linked thread:

    Which made the responder think it could possibly be related to memory buffer size.(Not saying that is your case)

    Random example of how a previous customer fixed a similar message: https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1223533/am5729-beaglebone-ai----got-kernel-warning-44000000-ocp-l3-custom-error-master-mpu-target-l4_per1_p3-read-data-access-in-user-mode-during-functional-access

    -Josue

  • Hi Jouse,

    After introducing a small delay in drivers/bus/ti-sysc.c before enabling the main clocks, the boot proceeds without crashing:


    error = sysc_enable_main_clocks(ddata);
    if (error)
    goto err_opt_clocks;

    udelay(20); // Added delay

    This change allows the kernel to load further successfully. However, when we later try to access a register inside GPIO4 using devmem2, we encounter a similar crash:

    root@am57xx-evm:~# devmem2 0x4805902C b
    /dev/mem opened.[ 468.889311] Entering l3_interrupt_handler ============>
    [ 468.896014] err_reg == 0
    [ 468.898644] err_reg == 64
    [ 468.901361] Entering ..... l3_handle_target ======>
    [ 468.906349] ------------[ cut here ]------------
    [ 468.911000] WARNING: CPU: 0 PID: 238 at drivers/bus/omap_l3_noc.c:149 l3_interrupt_handler+0x2a0/0x3c8
    [ 468.920347] 44000000.ocp:L3 Custom Error: MASTER MPU TARGET L4_PER1_P3 (Read): Data Access in User mode during Functional access
    [ 468.931958] Modules linked in:
    [ 468.935035] CPU: 0 PID: 238 Comm: devmem2 Not tainted 5.10.100-g7a7a3af903 #44
    [ 468.942286] Hardware name: Generic DRA72X (Flattened Device Tree)
    [ 468.948424] [<c020f0e8>] (unwind_backtrace) from [<c020a314>] (show_stack+0x10/0x14)
    [ 468.956210] [<c020a314>] (show_stack) from [<c0b3b6f8>] (dump_stack+0x9c/0xb0)
    [ 468.963471] [<c0b3b6f8>] (dump_stack) from [<c022a35c>] (__warn+0xe0/0xe4)
    [ 468.970380] [<c022a35c>] (__warn) from [<c022a3d4>] (warn_slowpath_fmt+0x74/0xb8)
    [ 468.977898] [<c022a3d4>] (warn_slowpath_fmt) from [<c05ef9c0>] (l3_interrupt_handler+0x2a0/0x3c8)
    [ 468.986817] [<c05ef9c0>] (l3_interrupt_handler) from [<c02855d0>] (__handle_irq_event_percpu+0x50/0x120)
    [ 468.996342] [<c02855d0>] (__handle_irq_event_percpu) from [<c02856cc>] (handle_irq_event_percpu+0x2c/0x7c)
    [ 469.006040] [<c02856cc>] (handle_irq_event_percpu) from [<c0285754>] (handle_irq_event+0x38/0x5c)
    [ 469.014955] [<c0285754>] (handle_irq_event) from [<c0289bf0>] (handle_fasteoi_irq+0xb0/0x164)
    [ 469.023520] [<c0289bf0>] (handle_fasteoi_irq) from [<c0284844>] (generic_handle_irq+0x34/0x44)
    [ 469.032171] [<c0284844>] (generic_handle_irq) from [<c0284e14>] (__handle_domain_irq+0x5c/0xb4)
    [ 469.040909] [<c0284e14>] (__handle_domain_irq) from [<c05edcd8>] (gic_handle_irq+0x70/0x84)
    [ 469.049301] [<c05edcd8>] (gic_handle_irq) from [<c0200e24>] (__irq_usr+0x44/0x60)
    [ 469.056815] Exception stack(0xc1647fb0 to 0xc1647ff8)
    [ 469.061888] 7fa0: 000103e3 b6fea960 b6fe7a38 b6feab18
    [ 469.070102] 7fc0: 00000000 00021048 b6fe7e50 b6fe8310 00000000 00000001 00000003 befe3ba0
    [ 469.078314] 7fe0: 000103cc befe3b38 00000017 b6fcceec 200b0030 ffffffff
    [ 469.084957] ---[ end trace 4938819b62d5d8b7 ]---

    Memory mapped at address 0xb6fe6000.
    [ 469.089768] 8<--- cut here ---
    [ 469.096195] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
    [ 469.103536] pgd = d51bda2b
    [ 469.106253] [00000000] *pgd=82400003, *pmd=be5e4003
    Read at address 0x4805902C (0xb6fe602c): 0x00
    root@am57xx-evm:~#

    I have confirmed:

    The clock for l4per-clkctrl:0058:0 is enabled (clk_summary shows enable_count=1).

    root@am57xx-evm:~# cat /sys/kernel/debug/clk/clk_summary | grep l4per-clkctrl:0058
    l4per-clkctrl:0058:0 1 1 0 265920000 0 0 50000
    l4per-clkctrl:0058:8 0 2 0 31475 0 0 50000
    root@am57xx-evm:~#

    but similarly i can access GPIO5(0x4805B02C). there is no diffrence in DTS file configuration on GPIO5 and GPIO4.


    Any suggestions on what to check next or fix in the crash greatly appreciated.

    Thanks,

    Mahesh R

  • Hello Mahesh,

    Due to bandwidth, I will be a little delayed in answering your question.

    Thank you for your patience.

    -Josue

  • Mahesh,

    This thread was resolved by uncommenting the LED Device Tree nodes? Could you confirm?

    Change shared here:  RE: AM5708: Issue with GPIO Interrupt on Custom AM5708 Board after Upgrading to TI SDK 08.02.01.00 

    -Josue

  • Hi Josue,

    yes. its resolved the crash after enabling this node from am571x-idk.dts

    dts:

    idk-leds {
    status = "okay";             ==> status moved to disabled to okay. 
    compatible = "gpio-leds";
    red0-led {
    label = "idk:red0";
    gpios = <&gpio6 19 GPIO_ACTIVE_HIGH>;
    default-state = "off";
    };

    green0-led {
    label = "idk:green0";
    gpios = <&gpio4 0 GPIO_ACTIVE_HIGH>;
    default-state = "off";
    };

    Thanks,
    Mahesh R