TDA4VM: TDA4VM A72 Panic

wang xuepeng

Part Number: TDA4VM
Other Parts Discussed in Thread: SYSBIOS

We had a stuck A72 issue：
The serial output information is as follows：
ERROR: Unhandled External Abort received on 0x80000001 from S-EL1
ERROR: exception reason=0 syndrome=0xbf000000
Unhandled Exception from EL1
x0 = 0x0000021ca06ea007
x1 = 0x000000000000710c
x2 = 0xffff8000112fec50
x3 = 0x0000000000000000
x4 = 0x0000000000000000
x5 = 0xffff00087fa81848
x6 = 0x0000000000000258
x7 = 0xffff800010594898
x8 = 0xffff8000110c7000
x9 = 0x3a676e69636e7973
x10 = 0x702d6b6361747320
x11 = 0x726f746365746f72
x12 = 0x6c656e72654b203a
x13 = 0x69206b6361747320
x14 = 0x707572726f632073
x15 = 0xffff00080de76728
x16 = 0x0000000000000000
x17 = 0x0000000000000000
x18 = 0x0000000000000010
x19 = 0xffff8000110609d8
x20 = 0x0000000000030d41
x21 = 0x0000021ca06e7d1b
x22 = 0xfffffde35f91d105
x23 = 0x0000000000000044
x24 = 0x0000000000418958
x25 = 0xffff8000109bf178
x26 = 0xffff800011a21db0
x27 = 0xffff00080de76838
x28 = 0xffff800019fcfb08
x29 = 0xffff800019fcf970
x30 = 0xffff800010999e20
scr_el3 = 0x000000000000073d
sctlr_el3 = 0x0000000030cd183f
cptr_el3 = 0x0000000000000000
tcr_el3 = 0x0000000080803520
daif = 0x00000000000002c0
mair_el3 = 0x00000000004404ff
spsr_el3 = 0x0000000080000005
elr_el3 = 0xffff800010999e18
ttbr0_el3 = 0x0000000070010b00
esr_el3 = 0x00000000bf000000
far_el3 = 0x0000000000000000
spsr_el1 = 0x0000000080000005
elr_el1 = 0xffff800010999e18
spsr_abt = 0x0000000000000000
spsr_und = 0x0000000000000000
spsr_irq = 0x0000000000000000
spsr_fiq = 0x0000000000000000
sctlr_el1 = 0x0000000034d4d91d
actlr_el1 = 0x0000000000000000
cpacr_el1 = 0x0000000000300000
csselr_el1 = 0x0000000000000000
sp_el1 = 0xffff800019fcf970
esr_el1 = 0x0000000056000000
ttbr0_el1 = 0x000000088abbe800
ttbr1_el1 = 0x0400000080e10000
mair_el1 = 0x0000bbff440c0400
amair_el1 = 0x0000000000000000
tcr_el1 = 0x00000034f5d07590
tpidr_el1 = 0xffff80086ebe0000
tpidr_el0 = 0x0000ffff57b8f890
tpidrro_el0 = 0x0000000000000000
par_el1 = 0x0000000000000000
mpidr_el1 = 0x0000000080000001
afsr0_el1 = 0x0000000000000000
afsr1_el1 = 0x0000000000000000
contextidr_el1 = 0x0000000000000000
vbar_el1 = 0xffff800010081800
cntp_ctl_el0 = 0x0000000000000005
cntp_cval_el0 = 0x0000021cf2424a9e
cntv_ctl_el0 = 0x0000000000000000
cntv_cval_el0 = 0x0000000000000000
cntkctl_el1 = 0x00000000000000d6
sp_el0 = 0x000000007000abd0
isr_el1 = 0x0000000000000040
dacr32_el2 = 0x0000000000000000
ifsr32_el2 = 0x0000000000000000
cpuectlr_el1 = 0x0000001b00000040
cpumerrsr_el1 = 0x0000000000000000
l2merrsr_el1 = 0x0000000000000000

use trace32 attach to a72 get the stack frame:

cpu0 in die:

cpu1 in panic:

over 3 years ago

0 Erick Narvaez over 3 years ago

TI__Mastermind 36307 points

Hello,

Can you give us a bit more information on what you were running:

1) SDK Version you are using

2) OS you are using

3) Any information about applications you are running

Thanks,

Erick

0 wang xuepeng over 3 years ago in reply to Erick Narvaez

Prodigy 40 points

1）SDK Version 7.3

2）Os Linux 5.4.106

0 wang xuepeng over 3 years ago in reply to wang xuepeng

Prodigy 40 points

Added the call stacks information of cpu1:

And the register information of the cpu1:

0 Keerthy J over 3 years ago in reply to wang xuepeng

TI__Guru**** 167700 points

Hi,

Thanks for the details. Unfortunately that does not point to any driver in particular so we still cannot isolate the module responsible for it. Could you please lost out the steps to reproduce?

Also could you try the latest 8.4 SDK? Check if this issue still exists?

What is the use case that causes this? Please share the complete logs as a text file attachment.

Best Regards,

Keerthy

0 wang xuepeng over 3 years ago in reply to Keerthy J

Prodigy 40 points

Hi, update with the latest useful findings.

1、I analyzed the syndrome field of the serial port log(syndrome=0xbf000000), I can confirm that a decode error occurred (external aborts -> SError -> Decode error )

2、 I captured the CBASS Null Error Reporting Registers, finded a CBASS decode error

The exception transaction is to read 64 bytes of address 0x05e1d680, this address is an address with no slave

0 Keerthy J over 3 years ago in reply to wang xuepeng

TI__Guru**** 167700 points

Hi,

Again requesting for the complete logs starting from the first SPL print. That will help us isolate which phase of boot causing this issue. Is this a custom board?

Best Regards,

Keerthy

0 wang xuepeng over 3 years ago in reply to Keerthy J

Prodigy 40 points

Hi，

log as follows :

Fullscreen 56045.log.txt Download

//--------------------------------- mcu island uart log --------------------------------- 

SBL Revision QSPI: 01.00.10.00
Current BootLoader Version: GEELY_EX11_660B04
Current application Version: GEELY_EX11_M6.6.0_B04
Current software BOM number: 6608055908/C
TIFS  ver: 20.8.5-w2020.23-am64x-14-g7409e
current hardware uses new DDR material: EI11100020
Starting Sciserver..... PASSED
Boot App: Started at 107 usec
Boot App: Total Num booted cores = 8
Boot App: Booted Core ID #6 at 394450 usecs
Boot App: Booted Core ID #7 at 394656 usecs
Boot App: Booted Core ID #8 at 490526 usecs
Boot App: Booted Core ID #9 at 490732 usecs
Boot App: Booted Core ID #10 at 490915 usecs
Boot App: Booted Core ID #11 at 491094 usecs
Boot App: Booted Core ID #12 at 491746 usecs
Boot App: Booted Core ID #0 at 597065 usecs

MCU Boot Task started at 106 usecs and finished at 1037100 usecs
log_task start



//--------------------------------- soc island uart log --------------------------------- 

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd080]
[    0.000000] Linux version 5.4.106-g023faefa70 (peichao.zhao@ubuntu-PowerEdge-R740) (gcc version 9.2.1 20191025 (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10))) #54 SMP PREEMPT Wed Oct 19 21:44:57 CST 2022
[    0.000000] Machine model: Texas Instruments K3 J721E SoC
[    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
[    0.000000] printk: bootconsole [ns16550a0] enabled
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a0000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision_apps-r5f-memory@a0100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a1000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a1100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a2000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2100000, size 63 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a2100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a6000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6100000, size 63 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a6100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000aa000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@aa000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000aa100000, size 31 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@aa100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ac000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@ac000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ac100000, size 31 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@ac100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ae000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-dma-memory@ae000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ae100000, size 63 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-memory@ae100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b2000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-dma-memory@b2000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b2100000, size 63 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-memory@b2100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b6000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c71-dma-memory@b6000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b6100000, size 79 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c71-memory@b6100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000be000000, size 48 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-dma-memory@be000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000c1000000, size 16 MiB
[    0.000000] OF: reserved mem: initialized node freetech_shared-memories@c1000000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: initialized node vision_apps_shared-memories, compatible id dma-heap-carveout
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000e2000000, size 415 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-core-heap-memory-lo@e2000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x0000000880000000, size 124 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-core-heap-memory-hi@880000000, compatible id shared-dma-pool
[    0.000000] cma: Failed to reserve 512 MiB
[    0.000000] On node 0 totalpages: 54656
[    0.000000]   DMA zone: 16 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 16384 pages, LIFO batch:3
[    0.000000]   DMA32 zone: 6 pages used for memmap
[    0.000000]   DMA32 zone: 5504 pages, LIFO batch:0
[    0.000000]   Normal zone: 32 pages used for memmap
[    0.000000]   Normal zone: 32768 pages, LIFO batch:3
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.0
[    0.000000] percpu: Embedded 2 pages/cpu s48472 r8192 d74408 u131072
[    0.000000] pcpu-alloc: s48472 r8192 d74408 u131072 alloc=2*65536
[    0.000000] pcpu-alloc: [0] 0 [0] 1 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 54602
[    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000  root=/dev/mmcblk0p5 rw rootfstype=ext4 rootwait
[    0.000000] Dentry cache hash table entries: 524288 (order: 6, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 5, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x9a800000-0x9e800000] (64MB)
[    0.000000] Memory: 2455232K/3497984K available (9662K kernel code, 792K rwdata, 3904K rodata, 1664K init, 2599K bss, 1042752K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
[    0.000000]  Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: no VLPI support, no direct LPI support
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001900000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: allocated 1048576 Devices @888000000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x0000000887cb0000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000887cc0000
[    0.000000] random: get_random_bytes called from start_kernel+0x2b8/0x42c with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000001] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.008364] Console: colour dummy device 80x25
[    0.012927] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.023596] pid_max: default: 32768 minimum: 301
[    0.028347] LSM: Security Framework initializing
[    0.033098] Mount-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.040669] Mountpoint-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.049757] ASID allocator initialised with 32768 entries
[    0.055344] rcu: Hierarchical SRCU implementation.
[    0.060390] Platform MSI: gic-its@1820000 domain created
[    0.066046] PCI/MSI: /bus@100000/interrupt-controller@1800000/gic-its@1820000 domain created
[    0.074870] smp: Bringing up secondary CPUs ...
[    0.080048] Detected PIPT I-cache on CPU1
[    0.080072] GICv3: CPU1: found redistributor 1 region 0:0x0000000001920000
[    0.080082] GICv3: CPU1: using allocated LPI pending table @0x0000000887cd0000
[    0.080113] CPU1: Booted secondary processor 0x0000000001 [0x411fd080]
[    0.080163] smp: Brought up 1 node, 2 CPUs
[    0.109506] SMP: Total of 2 processors activated.
[    0.114310] CPU features: detected: 32-bit EL0 Support
[    0.119563] CPU features: detected: CRC32 instructions
[    0.131270] CPU: All CPU(s) started at EL2
[    0.135465] alternatives: patching kernel code
[    0.140569] devtmpfs: initialized
[    0.148996] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.158965] futex hash table entries: 512 (order: -1, 32768 bytes, linear)
[    0.166296] pinctrl core: initialized pinctrl subsystem
[    0.172070] NET: Registered protocol family 16
[    0.176833] DMA: preallocated 256 KiB pool for atomic allocations
[    0.183328] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.197524] HugeTLB registered 16.0 GiB page size, pre-allocated 0 pages
[    0.204379] HugeTLB registered 512 MiB page size, pre-allocated 0 pages
[    0.211137] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.219138] cryptd: max_cpu_qlen set to 1000
[    0.225332] vsys_3v3: supplied by evm_12v0
[    0.229600] vsys_5v0: supplied by evm_12v0
[    0.233902] vdd_mmc1: supplied by vsys_3v3
[    0.238422] iommu: Default domain type: Translated 
[    0.243570] SCSI subsystem initialized
[    0.247576] mc: Linux media interface: v0.10
[    0.251944] videodev: Linux video capture interface: v2.00
[    0.257554] pps_core: LinuxPPS API ver. 1 registered
[    0.262622] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.271958] PTP clock support registered
[    0.275969] EDAC MC: Ver: 3.0.0
[    0.279672] FPGA manager framework
[    0.283182] Advanced Linux Sound Architecture Driver Initialized.
[    0.289786] clocksource: Switched to clocksource arch_sys_counter
[    0.296104] VFS: Disk quotas dquot_6.6.0
[    0.300158] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.309608] Carveout Heap: Exported 512 MiB at 0x00000000c2000000
[    0.315842] thermal_sys: Registered thermal governor 'step_wise'
[    0.315844] thermal_sys: Registered thermal governor 'power_allocator'
[    0.322264] NET: Registered protocol family 2
[    0.333659] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear)
[    0.342420] TCP established hash table entries: 32768 (order: 2, 262144 bytes, linear)
[    0.350613] TCP bind hash table entries: 32768 (order: 3, 524288 bytes, linear)
[    0.358362] TCP: Hash tables configured (established 32768 bind 32768)
[    0.365097] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.371991] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.379390] NET: Registered protocol family 1
[    0.384113] RPC: Registered named UNIX socket transport module.
[    0.390164] RPC: Registered udp transport module.
[    0.394967] RPC: Registered tcp transport module.
[    0.399770] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.406355] PCI: CLS 0 bytes, default 64
[    0.410679] hw perfevents: enabled with armv8_pmuv3 PMU driver, 7 counters available
[    0.420622] Initialise system trusted keyrings
[    0.425243] workingset: timestamp_bits=46 max_order=16 bucket_order=0
[    0.433882] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.440091] NFS: Registering the id_resolver key type
[    0.445267] Key type id_resolver registered
[    0.449537] Key type id_legacy registered
[    0.453633] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.460570] 9p: Installing v9fs 9p2000 file system support
[    0.473351] Key type asymmetric registered
[    0.477537] Asymmetric key parser 'x509' registered
[    0.482540] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    0.490098] io scheduler mq-deadline registered
[    0.494722] io scheduler kyber registered
[    0.499868] pinctrl-single 4301c000.pinmux: 94 pins, size 376
[    0.505977] pinctrl-single 11c000.pinmux: 173 pins, size 692
[    0.514012] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.520276] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.526609] ti-pat 31010000.pat: Found PAT Rev 1.0 with 16384 pages
[    0.533021] debugfs: Directory '31010000.pat' with parent 'regmap' already present!
[    0.540997] ti-pat 31011000.pat: Found PAT Rev 1.0 with 16384 pages
[    0.547412] debugfs: Directory '31011000.pat' with parent 'regmap' already present!
[    0.555338] ti-pat 31012000.pat: Found PAT Rev 1.0 with 16384 pages
[    0.561752] debugfs: Directory '31012000.pat' with parent 'regmap' already present!
[    0.569671] ti-pat 31013000.pat: Found PAT Rev 1.0 with 2048 pages
[    0.575994] debugfs: Directory '31013000.pat' with parent 'regmap' already present!
[    0.583916] ti-pat 31014000.pat: Found PAT Rev 1.0 with 2048 pages
[    0.590239] debugfs: Directory '31014000.pat' with parent 'regmap' already present!
[    0.599573] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[    0.611503] brd: module loaded
[    0.617585] loop: module loaded
[    0.622309] libphy: Fixed MDIO Bus: probed
[    0.626687] tun: Universal TUN/TAP device driver, 1.6
[    0.632096] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
[    0.640104] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    0.646176] sky2: driver version 1.30
[    0.650330] VFIO - User Level meta-driver version: 0.3
[    0.655918] i2c /dev entries driver
[    0.659926] sdhci: Secure Digital Host Controller Interface driver
[    0.666241] sdhci: Copyright(c) Pierre Ossman
[    0.670909] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.677095] ledtrig-cpu: registered to indicate activity on CPUs
[    0.683814] optee: probing for conduit method from DT.
[    0.689089] optee: revision 3.11 (c4def2a8)
[    0.689407] optee: initialized driver
[    0.698236] NET: Registered protocol family 17
[    0.702854] 9pnet: Installing 9P2000 support
[    0.707243] Key type dns_resolver registered
[    0.711762] registered taskstats version 1
[    0.715948] Loading compiled-in X.509 certificates
[    0.723854] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.730177] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.737759] ti-sci 44083000.dmsc: ABI: 3.1 (firmware rev 0x0014 '20.8.5-w2020.23-am64x-14-g7409e')
[    0.757095] random: fast init done
[    0.768944] ti-sci-intr bus@100000:bus@28380000:interrupt-controller2: Interrupt Router 137 domain created
[    0.778918] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 131 domain created
[    0.787691] ti-sci-intr bus@100000:navss@30000000:interrupt-controller1: Interrupt Router 213 domain created
[    0.797842] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain -1 created
[    0.815873] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,20] sci-dev-id:235
[    0.825762] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
[    0.832521] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    0.841468] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:1024, gp-rings[440,150] sci-dev-id:211
[    0.851619] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
[    0.858384] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    0.866218] printk: console [ttyS2] disabled
[    0.870602] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 11, base_baud = 3000000) is a 8250
[    0.879343] printk: console [ttyS2] enabled
[    0.887778] printk: bootconsole [ns16550a0] disabled
[    0.898135] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 12, base_baud = 3000000) is a 8250
[    0.906946] 2840000.serial: ttyS6 at MMIO 0x2840000 (irq = 13, base_baud = 3000000) is a 8250
[    0.915678] arm-smmu-v3 36600000.smmu: ias 48-bit, oas 48-bit (features 0x00001faf)
[    0.924984] arm-smmu-v3 36600000.smmu: allocated 524288 entries for cmdq
[    0.934965] arm-smmu-v3 36600000.smmu: allocated 524288 entries for evtq
[    0.942752] arm-smmu-v3 36600000.smmu: msi_domain absent - falling back to wired irqs
[    0.951448] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vdd-hba-supply regulator, assuming enabled
[    0.961967] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vcc-supply regulator, assuming enabled
[    0.972119] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vccq-supply regulator, assuming enabled
[    0.982358] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vccq2-supply regulator, assuming enabled
[    0.992923] scsi host0: ufshcd
[    0.999012] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010a, freq:200000000, add_val:4 pps:0
[    1.007524] mmc0: CQHCI version 5.10
[    1.051926] mmc0: SDHCI controller on 4f80000.sdhci [4f80000.sdhci] using ADMA 64-bit
[    1.064940] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc7100
[    1.071752] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc7100
[    1.078535] omap-mailbox 31f82000.mailbox: omap mailbox rev 0x66fc7100
[    1.085291] omap-mailbox 31f83000.mailbox: omap mailbox rev 0x66fc7100
[    1.092035] omap-mailbox 31f84000.mailbox: omap mailbox rev 0x66fc7100
[    1.099741] ti-udma 285c0000.dma-controller: Channels: 26 (tchan: 13, rchan: 13, gp-rflow: 8)
[    1.109732] ti-udma 31150000.dma-controller: Channels: 84 (tchan: 42, rchan: 42, gp-rflow: 16)
[    1.121705] spi spi2.0: setup: ignoring unsupported mode bits 200
[    1.145973] spi-nor spi2.0: n25q128a11 (16384 Kbytes)
[    1.151038] 4 fixed-partitions partitions found on MTD device 47040000.spi.0
[    1.158072] Creating 4 MTD partitions on "47040000.spi.0":
[    1.163553] 0x000000100000-0x000000600000 : "ospi.applicationA"
[    1.170009] 0x000000600000-0x000000b00000 : "ospi.applicationB"
[    1.176404] 0x000000e00000-0x000000e20000 : "ospi.ESS"
[    1.181955] 0x000000000000-0x000000100000 : "ospi.SBL"
[    1.192934] mmc1: CQHCI version 5.10
[    1.203802] mmc0: Command Queue Engine enabled
[    1.208243] mmc0: new HS200 MMC card at address 0001
[    1.213461] mmcblk0: mmc0:0001 G1J37E 29.6 GiB 
[    1.218107] mmcblk0boot0: mmc0:0001 G1J37E partition 1 31.5 MiB
[    1.224134] mmcblk0boot1: mmc0:0001 G1J37E partition 2 31.5 MiB
[    1.230124] mmcblk0rpmb: mmc0:0001 G1J37E partition 3 4.00 MiB, chardev (240:0)
[    1.239289]  mmcblk0: p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11 p12 p13 p14 p15 p16 p17 p18 p19
[    1.403888] cdns-ufshcd 4e84000.ufs: link startup failed 1
[    1.409370] cdns-ufshcd 4e84000.ufs: UFS Host state=0
[    1.414408] cdns-ufshcd 4e84000.ufs: lrb in use=0x0, outstanding reqs=0x0 tasks=0x0
[    1.422046] cdns-ufshcd 4e84000.ufs: saved_err=0x0, saved_uic_err=0x0
[    1.428470] cdns-ufshcd 4e84000.ufs: Device power mode=1, UIC link state=0
[    1.435328] cdns-ufshcd 4e84000.ufs: PM in progress=0, sys. suspended=0
[    1.441924] cdns-ufshcd 4e84000.ufs: Auto BKOPS=0, Host self-block=0
[    1.448262] cdns-ufshcd 4e84000.ufs: Clk gate=1
[    1.452778] cdns-ufshcd 4e84000.ufs: error handling flags=0x0, req. abort count=0
[    1.460243] cdns-ufshcd 4e84000.ufs: Host capabilities=0x1587031f, caps=0x0
[    1.467187] cdns-ufshcd 4e84000.ufs: quirks=0x0, dev. quirks=0x0
[    1.473179] cdns-ufshcd 4e84000.ufs: ufshcd_print_pwr_info:[RX, TX]: gear=[0, 0], lane[0, 0], pwr[INVALID MODE, INVALID MODE], rate = 0
[    1.485339] host_regs: 00000000: 1587031f 00000000 00000210 00000000
[    1.491678] host_regs: 00000010: 00000000 00000000 00000000 00000000
[    1.498015] host_regs: 00000020: 00000000 00000470 00000000 00000000
[    1.504352] host_regs: 00000030: 00000008 00000001 00000000 00000000
[    1.510690] host_regs: 00000040: 00000000 00000000 00000000 00000000
[    1.517028] host_regs: 00000050: 00000000 00000000 00000000 00000000
[    1.523366] host_regs: 00000060: 00000000 00000000 00000000 00000000
[    1.529702] host_regs: 00000070: 00000000 00000000 00000000 00000000
[    1.536039] host_regs: 00000080: 00000000 00000000 00000000 00000000
[    1.542375] host_regs: 00000090: 00000000 00000000 00000000 00000000
[    1.548713] cdns-ufshcd 4e84000.ufs: hba->ufs_version = 0x210, hba->capabilities = 0x1587031f
[    1.557217] cdns-ufshcd 4e84000.ufs: hba->outstanding_reqs = 0x0, hba->outstanding_tasks = 0x0
[    1.565808] cdns-ufshcd 4e84000.ufs: last_hibern8_exit_tstamp at 0 us, hibern8_exit_cnt = 0
[    1.574138] cdns-ufshcd 4e84000.ufs: No record of pa_err errors
[    1.580043] cdns-ufshcd 4e84000.ufs: No record of dl_err errors
[    1.585947] cdns-ufshcd 4e84000.ufs: No record of nl_err errors
[    1.591850] cdns-ufshcd 4e84000.ufs: No record of tl_err errors
[    1.597754] cdns-ufshcd 4e84000.ufs: No record of dme_err errors
[    1.603744] cdns-ufshcd 4e84000.ufs: No record of auto_hibern8_err errors
[    1.610516] cdns-ufshcd 4e84000.ufs: No record of fatal_err errors
[    1.616681] cdns-ufshcd 4e84000.ufs: link_startup_fail[0] = 0x1 at 1326107 us
[    1.623797] cdns-ufshcd 4e84000.ufs: No record of resume_fail errors
[    1.630135] cdns-ufshcd 4e84000.ufs: No record of suspend_fail errors
[    1.636559] cdns-ufshcd 4e84000.ufs: No record of dev_reset errors
[    1.642722] cdns-ufshcd 4e84000.ufs: No record of host_reset errors
[    1.648973] cdns-ufshcd 4e84000.ufs: No record of task_abort errors
[    1.655223] cdns-ufshcd 4e84000.ufs: clk: core_clk, rate: 250000000
[    1.661473] cdns-ufshcd 4e84000.ufs: clk: phy_clk, rate: 19200000
[    1.667551] cdns-ufshcd 4e84000.ufs: clk: ref_clk, rate: 19200000
[    2.261419] mmc1: SDHCI controller on 4fb0000.sdhci [4fb0000.sdhci] using ADMA 64-bit
[    2.271822] debugfs: Directory 'pd:242' with parent 'pm_genpd' already present!
[    2.279241] debugfs: Directory 'pd:241' with parent 'pm_genpd' already present!
[    2.286554] debugfs: Directory 'pd:240' with parent 'pm_genpd' already present!
[    2.293898] debugfs: Directory 'pd:239' with parent 'pm_genpd' already present!
[    2.301907] pinctrl-single 4301c000.pinmux: Invalid number of rows: 0
[    2.308346] pinctrl-single 4301c000.pinmux: no pins entries for sw11_button_pins_default
[    2.316431] gpio-keys: probe of gpio-keys failed with error -22
[    2.322386] hctosys: unable to open rtc device (rtc0)
[    2.332119] ALSA device list:
[    2.335101]   No soundcards found.
[    2.340254] Waiting for root device /dev/mmcblk0p6...
[    2.370888] EXT4-fs (mmcblk0p6): recovery complete
[    2.376055] EXT4-fs (mmcblk0p6): mounted filesystem with ordered data mode. Opts: (null)
[    2.384173] VFS: Mounted root (ext4 filesystem) on device 179:6.
[    2.390489] devtmpfs: mounted
[    2.393994] Freeing unused kernel memory: 1664K
[    2.398587] Run /sbin/init as init process
[    2.512111] EXT4-fs (mmcblk0p6): re-mounted. Opts: (null)
[    2.643734] random: dd: uninitialized urandom read (512 bytes read)
[    2.769489] platform 41000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    2.781338] platform 41000000.r5f: configured R5F for IPC-only mode
[    2.787698] platform 41000000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a0000000
[    2.796894] remoteproc remoteproc0: 41000000.r5f is available
[    2.802847] platform 41400000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    2.814606] remoteproc remoteproc0: Direct firmware load for j7-mcu-r5f0_0-fw failed with error -2
[    2.823571] remoteproc remoteproc0: powering up 41000000.r5f
[    2.829239] remoteproc remoteproc0: Direct firmware load for j7-mcu-r5f0_0-fw failed with error -2
[    2.829251] platform 41400000.r5f: configured R5F for IPC-only mode
[    2.838181] remoteproc remoteproc0: request_firmware failed: -2
[    2.850370] platform 41400000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a1000000
[    2.859574] remoteproc remoteproc1: 41400000.r5f is available
[    2.859632] remoteproc remoteproc1: Direct firmware load for j7-mcu-r5f0_1-fw failed with error -2
[    2.866233] platform 5c00000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    2.874262] remoteproc remoteproc1: powering up 41400000.r5f
[    2.886557] platform 5c00000.r5f: configured R5F for IPC-only mode
[    2.891552] remoteproc remoteproc1: Direct firmware load for j7-mcu-r5f0_1-fw failed with error -2
[    2.897810] platform 5c00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a2000000
[    2.906644] remoteproc remoteproc1: request_firmware failed: -2
[    2.921808] remoteproc remoteproc2: 5c00000.r5f is available
[    2.927634] platform 5d00000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    2.939530] platform 5d00000.r5f: configured R5F for IPC-only mode
[    2.946176] platform 5d00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a6000000
[    2.956145] remoteproc remoteproc3: 5d00000.r5f is available
[    2.964326] platform 5e00000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    2.977336] platform 5e00000.r5f: configured R5F for IPC-only mode
[    2.984426] platform 5e00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@aa000000
[    2.994202] remoteproc remoteproc3: powering up 5d00000.r5f
[    3.000289] remoteproc remoteproc4: 5e00000.r5f is available
[    3.000666] remoteproc remoteproc3: Booting fw image j7-main-r5f0_1-fw, size 2009152
[    3.013729] platform 5f00000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    3.013828] remoteproc remoteproc2: powering up 5c00000.r5f
[    3.031070] remoteproc remoteproc4: powering up 5e00000.r5f
[    3.031162] platform 5d00000.r5f: R5F core initialized in IPC-only mode
[    3.036717] remoteproc remoteproc4: Booting fw image j7-main-r5f1_0-fw, size 153520
[    3.043242] remoteproc remoteproc2: Booting fw image j7-main-r5f0_0-fw, size 5351832
[    3.050916] platform 5f00000.r5f: configured R5F for IPC-only mode
[    3.058608]  remoteproc3#vdev0buffer: assigned reserved memory node vision-apps-r5f-dma-memory@a6000000
[    3.064839] platform 5f00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@ac000000
[    3.074205] platform 5c00000.r5f: R5F core initialized in IPC-only mode
[    3.083284] platform 5e00000.r5f: R5F core initialized in IPC-only mode
[    3.090208] virtio_rpmsg_bus virtio0: rpmsg host is online
[    3.096412]  remoteproc4#vdev0buffer: assigned reserved memory node vision-apps-r5f-dma-memory@aa000000
[    3.101842]  remoteproc2#vdev0buffer: assigned reserved memory node vision-apps-r5f-dma-memory@a2000000
[    3.111344] remoteproc remoteproc5: 5f00000.r5f is available
[    3.120589]  remoteproc3#vdev0buffer: registered virtio0 (type 7)
[    3.126641] virtio_rpmsg_bus virtio1: rpmsg host is online
[    3.132314] remoteproc remoteproc3: remote processor 5d00000.r5f is now up
[    3.138167]  remoteproc4#vdev0buffer: registered virtio1 (type 7)
[    3.145016] virtio_rpmsg_bus virtio2: rpmsg host is online
[    3.151225] remoteproc remoteproc4: remote processor 5e00000.r5f is now up
[    3.156466]  remoteproc2#vdev0buffer: registered virtio2 (type 7)
[    3.169234] remoteproc remoteproc2: remote processor 5c00000.r5f is now up
[    3.176204] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xd
[    3.176293] remoteproc remoteproc5: powering up 5f00000.r5f
[    3.183449] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0xd
[    3.196221] remoteproc remoteproc5: Booting fw image j7-main-r5f1_1-fw, size 153520
[    3.196460] virtio_rpmsg_bus virtio2: creating channel rpmsg_chrdev addr 0xd
[    3.203934] k3-dsp-rproc 4d80800000.dsp: assigned reserved memory node vision-apps-c66-dma-memory@b2000000
[    3.220671] platform 5f00000.r5f: R5F core initialized in IPC-only mode
[    3.225924] k3-dsp-rproc 4d80800000.dsp: configured DSP for IPC-only mode
[    3.227282]  remoteproc5#vdev0buffer: assigned reserved memory node vision-apps-r5f-dma-memory@ac000000
[    3.234130] remoteproc remoteproc6: 4d80800000.dsp is available
[    3.243800] virtio_rpmsg_bus virtio3: rpmsg host is online
[    3.250424] virtio_rpmsg_bus virtio3: creating channel rpmsg_chrdev addr 0xd
[    3.254801]  remoteproc5#vdev0buffer: registered virtio3 (type 7)
[    3.254805] remoteproc remoteproc5: remote processor 5f00000.r5f is now up
[    3.254896] k3-dsp-rproc 4d81800000.dsp: assigned reserved memory node vision-apps-c66-dma-memory@ae000000
[    3.268313] remoteproc remoteproc6: powering up 4d80800000.dsp
[    3.290306] remoteproc remoteproc6: Booting fw image j7-c66_0-fw, size 1579184
[    3.297668] k3-dsp-rproc 4d80800000.dsp: DSP initialized in IPC-only mode
[    3.297752] k3-dsp-rproc 4d81800000.dsp: configured DSP for IPC-only mode
[    3.304457]  remoteproc6#vdev0buffer: assigned reserved memory node vision-apps-c66-dma-memory@b2000000
[    3.311323] remoteproc remoteproc7: 4d81800000.dsp is available
[    3.320986] virtio_rpmsg_bus virtio4: rpmsg host is online
[    3.332026]  remoteproc6#vdev0buffer: registered virtio4 (type 7)
[    3.338165] remoteproc remoteproc6: remote processor 4d80800000.dsp is now up
[    3.338665] k3-dsp-rproc 64800000.dsp: assigned reserved memory node vision-apps-c71-dma-memory@b6000000
[    3.345380] virtio_rpmsg_bus virtio4: creating channel rpmsg_chrdev addr 0xd
[    3.355394] remoteproc remoteproc7: powering up 4d81800000.dsp
[    3.367661] remoteproc remoteproc7: Booting fw image j7-c66_1-fw, size 1579184
[    3.374914] k3-dsp-rproc 64800000.dsp: configured DSP for IPC-only mode
[    3.375246] k3-dsp-rproc 4d81800000.dsp: DSP initialized in IPC-only mode
[    3.381624] remoteproc remoteproc8: 64800000.dsp is available
[    3.388441]  remoteproc7#vdev0buffer: assigned reserved memory node vision-apps-c66-dma-memory@ae000000
[    3.404088] virtio_rpmsg_bus virtio5: rpmsg host is online
[    3.407671] virtio_rpmsg_bus virtio5: creating channel rpmsg_chrdev addr 0xd
[    3.409608]  remoteproc7#vdev0buffer: registered virtio5 (type 7)
[    3.422685] remoteproc remoteproc7: remote processor 4d81800000.dsp is now up
[    3.438559] pvrsrvkm: loading out-of-tree module taints kernel.
[    3.466258] PVR_K:  259: Read BVNC 22.104.208.318 from HW device registers
[    3.473886] PVR_K:  259: RGX Device registered with BVNC 22.104.208.318
[    3.480922] [drm] Initialized pvr 1.13.5776728 20170530 for 4e20000000.gpu on minor 0
[    3.489251] remoteproc remoteproc8: powering up 64800000.dsp
[    3.494955] remoteproc remoteproc8: Booting fw image j7-c71_0-fw, size 10277016
[    3.502455] k3-dsp-rproc 64800000.dsp: DSP initialized in IPC-only mode
[    3.509081]  remoteproc8#vdev0buffer: assigned reserved memory node vision-apps-c71-dma-memory@b6000000
[    3.518973] virtio_rpmsg_bus virtio6: rpmsg host is online
[    3.524550]  remoteproc8#vdev0buffer: registered virtio6 (type 7)
[    3.530662] remoteproc remoteproc8: remote processor 64800000.dsp is now up
[    3.537738] virtio_rpmsg_bus virtio6: creating channel rpmsg_chrdev addr 0xd
[    3.544955] virtio_rpmsg_bus virtio6: creating channel rpmsg_chrdev addr 0x15
[    3.552283] virtio_rpmsg_bus virtio6: creating channel ti.ipc4.ping-pong addr 0xe
[    3.559842] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0x15
[    3.567147] virtio_rpmsg_bus virtio3: creating channel rpmsg_chrdev addr 0x15
[    3.574405] virtio_rpmsg_bus virtio3: creating channel ti.ipc4.ping-pong addr 0xe
[    3.581968] virtio_rpmsg_bus virtio4: creating channel rpmsg_chrdev addr 0x15
[    3.589235] virtio_rpmsg_bus virtio4: creating channel ti.ipc4.ping-pong addr 0xe
[    3.596838] virtio_rpmsg_bus virtio5: creating channel rpmsg_chrdev addr 0x15
[    3.604123] virtio_rpmsg_bus virtio5: creating channel ti.ipc4.ping-pong addr 0xe
[    3.611704] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0x15
[    3.618984] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xe
[    3.626546] virtio_rpmsg_bus virtio2: creating channel rpmsg_chrdev addr 0x15
[    3.641245] usbcore: registered new interface driver usbfs
[    3.646752] usbcore: registered new interface driver hub
[    3.652077] usbcore: registered new device driver usb
[    3.658252] virtio_rpmsg_bus virtio2: creating channel ti.ethfw.notifyservice addr 0x1e
[    3.666358] virtio_rpmsg_bus virtio2: creating channel rpmsg-kdrv addr 0x1a
[    3.673950] rpmsg-kdrv-eth-switch rpmsg-kdrv-2-mpu_1_0_ethswitch-device-0: Device info: permissions: 07FFFFFF uart_id: 2
[    3.685135] rpmsg-kdrv-eth-switch rpmsg-kdrv-2-mpu_1_0_ethswitch-device-0: FW ver 0.1 (rev 1) 31/Aug/2022 SHA:
[    3.698855] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: virt_cpsw_nuss mac loaded
[    3.706772] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: rdev_features:00000003 rdev_mtu:1522 flow_id:172 tx_psil_dst_id:4A00
[    3.718403] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: local_mac_addr:86:60:b2:7b:3c:74 rdev_mac_addr:70:ff:76:1d:92:c1
[    3.736790] cdns-usb3 6000000.usb: DRD version v1 (ID: 0004024e, rev: 00000200)
[    3.744324] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    3.749824] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
[    3.757905] xhci-hcd xhci-hcd.0.auto: hcc params 0x200073c9 hci version 0x100 quirks 0x0000000000010010
[    3.767359] xhci-hcd xhci-hcd.0.auto: irq 575, io mem 0x06010000
[    3.772717] virtio_rpmsg_bus virtio2: creating channel ti.ipc4.ping-pong addr 0xe
[    3.773496] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[    3.789080] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.796294] usb usb1: Product: xHCI Host Controller
[    3.801162] usb usb1: Manufacturer: Linux 5.4.106-g023faefa70 xhci-hcd
[    3.807677] usb usb1: SerialNumber: xhci-hcd.0.auto
[    3.812732] hub 1-0:1.0: USB hub found
[    3.816489] hub 1-0:1.0: 1 port detected
[    3.820844] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    3.826570] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
[    3.834280] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
[    3.840836] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    3.848947] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04
[    3.857196] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.864403] usb usb2: Product: xHCI Host Controller
[    3.869270] usb usb2: Manufacturer: Linux 5.4.106-g023faefa70 xhci-hcd
[    3.875782] usb usb2: SerialNumber: xhci-hcd.0.auto
[    3.880857] hub 2-0:1.0: USB hub found
[    3.884608] hub 2-0:1.0: 1 port detected
[    3.894927] usbcore: registered new interface driver cp210x
[    3.900513] usbserial: USB Serial support registered for cp210x
[    3.913154] 8021q: 802.1Q VLAN Support v1.8
[    3.938462] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: virt_cpsw_nuss mac started
[    3.976058] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: register_ipv4 rpmsg - fail -5
[    3.985177] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: unregister_ipv4 rpmsg - fail -5
[    3.994137] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: register_ipv4 rpmsg - fail -5
[    4.127000] NET: Registered protocol family 10
[    4.132266] Segment Routing with IPv6
[    4.143829] EXT4-fs (mmcblk0p7): recovery complete
[    4.148944] EXT4-fs (mmcblk0p7): mounted filesystem with ordered data mode. Opts: (null)
[    4.163689] EXT4-fs (mmcblk0p8): recovery complete
[    4.168788] EXT4-fs (mmcblk0p8): mounted filesystem with ordered data mode. Opts: (null)
[    4.183325] EXT4-fs (mmcblk0p9): recovery complete
[    4.188786] EXT4-fs (mmcblk0p9): mounted filesystem with ordered data mode. Opts: (null)
[    4.220214] EXT4-fs (mmcblk0p10): recovery complete
[    4.225098] EXT4-fs (mmcblk0p10): mounted filesystem with ordered data mode. Opts: (null)
[    4.239155] EXT4-fs (mmcblk0p11): recovery complete
[    4.244336] EXT4-fs (mmcblk0p11): mounted filesystem with ordered data mode. Opts: (null)
[    4.259644] EXT4-fs (mmcblk0p12): recovery complete
[    4.264897] EXT4-fs (mmcblk0p12): mounted filesystem with ordered data mode. Opts: (null)
[    4.280903] EXT4-fs (mmcblk0p13): recovery complete
[    4.286170] EXT4-fs (mmcblk0p13): mounted filesystem with ordered data mode. Opts: (null)
[    4.303475] EXT4-fs (mmcblk0p14): recovery complete
[    4.308358] EXT4-fs (mmcblk0p14): mounted filesystem with ordered data mode. Opts: (null)
[    4.319631] EXT4-fs (mmcblk0p17): mounted filesystem with ordered data mode. Opts: (null)
[    4.334952] EXT4-fs (mmcblk0p16): recovery complete
[    4.340164] EXT4-fs (mmcblk0p16): mounted filesystem with ordered data mode. Opts: (null)
[    4.350990] EXT4-fs (mmcblk0p19): mounted filesystem with ordered data mode. Opts: (null)
[    4.532128] virtio_rpmsg_bus virtio1: creating channel ti.ipc4.ping-pong addr 0xe
[    4.769470] ft_spinlock_open! num:0 
[    4.773175] ft_spinlock_ioctl: spinlock_index:3 base_phy:30e0080c base_virt:ffff8000143e080c
[    4.776360] ft_memdev_open! num:0 
[    4.833717] random: TDA4_A72_demo_a: uninitialized urandom read (4 bytes read)
[    6.570915] ft_spinlock_open! num:0 
[    6.575794] ft_spinlock_ioctl: spinlock_index:3 base_phy:30e0080c base_virt:ffff8000149e080c
[    6.577104] ft_spinlock_open! num:0 
[    6.581057] ft_memdev_open! num:0 
[    6.584691] ft_spinlock_ioctl: spinlock_index:3 base_phy:30e0080c base_virt:ffff800016e1080c
[    6.585960] ft_memdev_open! num:0 
[    6.592363] random: hikauto: uninitialized urandom read (4 bytes read)
[    6.619360] random: TDA4_A72_demo_c: uninitialized urandom read (4 bytes read)
[    6.650628] ft_spinlock_open! num:0 
[    6.660612] ft_spinlock_ioctl: spinlock_index:3 base_phy:30e0080c base_virt:ffff80001986080c
[    6.663107] ft_memdev_open! num:0 
[    6.674572] random: crng init done
[    7.728913] PVR_K:  792: RGX Firmware image 'rgx.fw.22.104.208.318' loaded
[   62.101817] hrtimer: interrupt took 32265 ns

this a custom board, use the SBL boot mode .

Looking forward to your reply,

Best Regards.

0 Keerthy J over 3 years ago in reply to wang xuepeng

TI__Guru**** 167700 points

Hi Wang,

This has almost booted to the Linux kernel. Can you rename the /lib/modules of the target file system to something like /lib/modules_bk

So that none of the modules get loaded. Let me know if you still see that crash after that. Then we can start isolating which module causes that.

Best Regards,

Keerthy

0 wang xuepeng over 3 years ago in reply to Keerthy J

Prodigy 40 points

Hi,

Complete and supplement the problem phenomenon background.

This is not a device startup error, this is a board stability test problem on a real car.
So I couldn't reproduce the problem without loading any of the modules

0 Richard Woodruff over 3 years ago in reply to wang xuepeng

TI__Mastermind 24925 points

Hello,

Is this a one time issue you have caught or is this a recurring issue?

Is this issue seen only on 1 system or is it seen on multiple systems?

Is the error signature always the same address as seen in the CBASS decode?

The RoutID 4, and the size indicates one of the A72 cores made a cache access to a space which it had MMU access to but its invalid. Some driver would have done a MMAP to this bad range then done an access. If no MMU table entry existed then the error would been synchronous and the stack frame dump would have been effective. If you do an mmu.info + scan with your lauterbach on this address you can see if a table entry exists. If so you should attempt to find who created this entry and size it so it only points to valid memory.

The cache access could happen 'speculatively' to a bad mapping (a mmap which maps an illegal address hole as normal memory) or by an errant driver access. Chances are some mmap got a bad address, opened a map, and the processor tried to fetch there thinking data might be useful. The processor is free to spontaneously fetch from any normal memory with the ex attribute... this mapping could be from a driver not being careful or even in some user space code doing an unsafe dev2mem type access.

Regards,

Richard W.

0 wang xuepeng over 3 years ago in reply to Richard Woodruff

Prodigy 40 points

Hi,

Is this a one time issue you have caught or is this a recurring issue?

--This a recurring issue（low frequency recurrence）
Is this issue seen only on 1 system or is it seen on multiple systems?

--At present, Linux and sysbios on the TAD4VM platform we use have been stuck
Is the error signature always the same address as seen in the CBASS decode?

--In an address range（memory hole：0x5e17fff - 0x5f00000 [R5FSS1_CORE0_BTCM's end - R5FSS1_CORE1_ATCM's begin]）

---

about RoutID :
Can you explain the meaning of RoutID or related documents in detail？
The RoutID explain we found in the chip manual is in this range（In NAVSS0）,Could you provide a more detailed breakdown about RoutID （0-255
2560-3071）

"The RoutID 4, and the size indicates one of the A72 cores made a cache access to a space which it had MMU access to but its invalid. "

--your meanings "RoutID=4 and size=64Byte" indicates one of the A72 cores made a cache access to a space which it had MMU access to but its invalid? Can we confirm that this is the only possibility?

We constructed a similar problem using UDMA,as follows:

Forcing a change board-support\linux-5.4.106+gitAUTOINC+023faefa70-g023faefa70\drivers\net\ethernet\ti\j721e-cpsw-virt-mac.c

This change will trigger the sililar CABSS_RC0_ERR [RoutID=0xA9(also in NAVSS0) ,size=64Byte]

So I understand that UDMA is going to cause 64bytes size CABSS_RC0_ERR record

we need to know which master each RoutID points to?

CABSS_RC0_ERR Register data

0 wang xuepeng over 3 years ago in reply to wang xuepeng

Prodigy 40 points

Hi,

Add some information:

About question：

Is this issue seen only on 1 system or is it seen on multiple systems?

--At present, Linux and sysbios on the TAD4VM platform we use have been stuck

A similar phenomenon also occurs on C66/R5F，The detailed information:

e2e.ti.com/.../tda4vm-tda4-cbass-rc0-error-and-what-special-module-is-of-the-route-id-4-sdk7-3
e2e.ti.com/.../4407504

0 Richard Woodruff over 3 years ago in reply to wang xuepeng

TI__Mastermind 24925 points

Hello Wang,

Sorry for some delay as we were out of office on a US holiday. Below are comments/answers/questions to your comments.

--This a recurring issue（low frequency recurrence）

Does anything modulate the frequency
What is this frequency, 1 per hour, 1per day, ?

-- At present, Linux and sysbios on the TAD4VM platform we use have been stuck

Does this just mean 1 board?

--In an address range（memory hole：0x5e17fff - 0x5f00000 [R5FSS1_CORE0_BTCM's end - R5FSS1_CORE1_ATCM's begin]）

Since the A72 issued the transaction, a MMU-scan with the debugger might show a virtual mapping to this physical address. The setting of a hardware break point on that virtual handle might be a way to catch it and get context.
Perhaps a CPTracer with a filter can also be used to catch and better understand the conditions of the issue

--Can you explain the meaning of RoutID or related documents in detail？

Routid will uniquely identify a path from a given initiator start point to an routing point.
The A72 start point on this path is assigned a 4 as in your dump.
Your constructed issue with a route id of 0xA9 (169) maps to udmap0.mem1 169

From the docs I have listed of route ids. I will attach a TRACE32-CMM script which can tell about active routes in a use case

;;;;;;;;;;;;;;;;;;;;;;;;;;

; TRM's list of RouteIDs

;;;;;;;;;;;;;;;;;;;;;;;;;;

A72-CORE0 0

A72-CORE1 1

A72-L2Cache 4

C7x-CORE0 8

C7x-Cache 12

DRU0 104

DRU1 105

IOMMU 108

MSMC 112

proxy0 160

sec_proxy0 216

ringacc0.dst 200

udmap0.mem0 168

udmap0.mem1 169

udmap0.umemw 170

udmap0.umemr 171

https://e2e.ti.com/cfs-file/__key/communityserver-discussions-components-files/791/map_5F00_active_5F00_bus_5F00_routes.cmm

It appears some task on your A72 has permission to write to the address hole. This mapping is either by accident or because of overmapping in a mmap or ioremap. Sometimes it makes an illegal write to the hole and this serror is generated. If at run time you can review your mmu map (Lauterbach with mmu.list.pagetable or mmu.info <address>) with the debugger and try to identify the code. Since the address is consistent you may also be able to use a 'range virtual watchpoint' to halt the CPU when before it launches the access. You will need to find the virtual handle in use for this to work. Other methods like removing drivers one at a time might also identify the culprit. Of course, if the frequency is very slow it can take a long time using this type of elimination method.

Regards,

Richard W.

Processors

Processors forum

TDA4VM: TDA4VM A72 Panic