TDA4VE-Q1: PCIe Switch causes nvme timeouts

Part Number: TDA4VE-Q1
Other Parts Discussed in Thread: TDA4VM

My setup is the Phytec Izar Development Board with a TI Jacinto TDA4VE SoC (Arm Cortex A72 cores): phyBOARD-Izar | PHYTEC

I connected a Microchip PCI1005 Switch to the board with the goal to connect more than one ssd.

On the SoC we run embedded linux, Kernel Version 6.12. 

We experience the following behaviour:

  • TDA4VM Eval Board: up to 3 SSD work fine, the 4th produces a nvme timeout during boot
  • TDA4VE Izar Board: with the switch no SSD works fine, also 1 produces a nvme timeout
  • TDA4VE Izar Board and one SSD directly to the Board works fine
  • TDA4VE Izar Board with switch and network cards works fine

The nvme timeouts are blocking the processor for approximatly 10mins. After that the ssd is listed under lspci, but is not accessible.

log.txt 

The problem seems to be pcie switch + nvme SSDs.

In the TRM i found Address Translation Services (ATS)  under not supported features for the TDA4VE; the TDA4VM supports it. Could this be a reason?

Does anyone has other ideas?

Thank you for your support. 

  • Hi Philipp,

    Before I comment about the ATS suspicion, can I get the output from "lspci -vvv"?

    Otherwise, for TDA4VM, there is a known issue with PCIe switches. TDA4VE, there are no known issue, as a silicon errata that affected TDA4VM has been fixed for TDA4VE. For reference, errata for TDA4VM mentioned in this FAQ if you would like details:  [FAQ] J721EXSOMXEVM: How to work around errata i2086 for PCIe switches and multifunction devices for J721E/TDA4VM/DRA829?  

    Regards,

    Takuma

  • Hi Takuma, 

    attached is the lspci log.

    log_lspci.txt

    I stumbled across the TDA4VM errata when I first tested some switches with it. 

    Regards,

    Philipp

  • Hi Philipp,

    Thanks for the logs. It looks like ATS capabilities are not advertised for the NVMe as well as the PCIe switch, and the ATS capabilities of the SoC is disabled. So, I don't expect ATS to be causing an issue.

    Instead, it looks like ErrorSrc for the uncorrectable error is 0220 (bus 2, device 4) which corresponds to one of the PCIe switch device, and that particular PCIe switch instance has a HeaderLog from bus 5, which corresponds to the NVMe device. And the error that is flagged at the PCIe switch is a "UnsupReq+", so this is being propagated up to the PCIe controller. 

    So, this issue looks similar to the errata i2086 for TDA4VM, but different in the sense that it is not triggering a bus error. Which means the workaround in the FAQ will probably not have much effect. However, since the error is being flagged as part of the AER, perhaps we can ignore this error trigger. As a side note, the Unsupported Request is common when probing the PCIe bus to see which addresses are populated when a PCIe switch is connected, but what is not common is for it to be flagged as an uncorrectable error. 

    • As an experiment, could you try adding "pci=noaer" in Linux kernel commandline?

    Regards,

    Takuma

  • Hi Takuma,

    thank you for the detailed explanation. I tried setting pci=noaer but i think it did not have any effect, log is attached.

    Starting kernel ...
    
    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd080]
    [    0.000000] Linux version 6.12.49 (aarch64-buildroot-linux-gnu-gcc.br_real (Buildroot PIIT_delivery_2023-04-13-104-gf320c2fa-dirty) 14.3.0, GNU ld (GNU Binutils) 2.44) #7 SMP PREEMPT Wed Aug  5 17:04:58 CEST 2026
    [    0.000000] KASLR disabled due to lack of seed
    [    0.000000] Machine model: PHYTEC phyBOARD-Izar-AM68x
    [    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002880000 (options '')
    [    0.000000] printk: legacy bootconsole [ns16550a0] enabled
    [    0.000000] efi: UEFI not found.
    [    0.000000] Reserved memory: created CMA memory pool at 0x00000008e0000000, size 512 MiB
    [    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000008e0000000..0x00000008ffffffff (524288 KiB) map reusable linux,cma
    [    0.000000] OF: reserved mem: 0x000000009e800000..0x000000009fffffff (24576 KiB) nomap non-reusable optee@9e800000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a0000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a0000000..0x00000000a00fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a0000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a0100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a0100000..0x00000000a0ffffff (15360 KiB) nomap non-reusable r5f-memory@a0100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a1000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a1000000..0x00000000a10fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a1000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a1100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a1100000..0x00000000a1ffffff (15360 KiB) nomap non-reusable r5f-memory@a1100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a2000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a2000000..0x00000000a20fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a2000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a2100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a2100000..0x00000000a2ffffff (15360 KiB) nomap non-reusable r5f-memory@a2100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a3000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a3000000..0x00000000a30fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a3000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a3100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a3100000..0x00000000a3ffffff (15360 KiB) nomap non-reusable r5f-memory@a3100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a4000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a4000000..0x00000000a40fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a4000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a4100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a4100000..0x00000000a4ffffff (15360 KiB) nomap non-reusable r5f-memory@a4100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a5000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a5000000..0x00000000a50fffff (1024 KiB) nomap non-reusable r5f-dma-memory@a5000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a5100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a5100000..0x00000000a5ffffff (15360 KiB) nomap non-reusable r5f-memory@a5100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node c71-dma-memory@a6000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a6000000..0x00000000a60fffff (1024 KiB) nomap non-reusable c71-dma-memory@a6000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node c71-memory@a6100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a6100000..0x00000000a6ffffff (15360 KiB) nomap non-reusable c71-memory@a6100000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node c71-dma-memory@a7000000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a7000000..0x00000000a70fffff (1024 KiB) nomap non-reusable c71-dma-memory@a7000000
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node c71-memory@a7100000, compatible id shared-dma-pool
    [    0.000000] OF: reserved mem: 0x00000000a7100000..0x00000000a7ffffff (15360 KiB) nomap non-reusable c71-memory@a7100000
    [    0.000000] OF: reserved mem: 0x00000000a8000000..0x00000000a9bfffff (28672 KiB) nomap non-reusable ipc-memories@a8000000
    [    0.000000] Zone ranges:
    [    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
    [    0.000000]   DMA32    empty
    [    0.000000]   Normal   [mem 0x0000000100000000-0x00000008ffffffff]
    [    0.000000] Movable zone start for each node
    [    0.000000] Early memory node ranges
    [    0.000000]   node   0: [mem 0x0000000080000000-0x000000009e7fffff]
    [    0.000000]   node   0: [mem 0x000000009e800000-0x00000000a9bfffff]
    [    0.000000]   node   0: [mem 0x00000000a9c00000-0x00000000ffffffff]
    [    0.000000]   node   0: [mem 0x0000000880000000-0x00000008ffffffff]
    [    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000008ffffffff]
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.4
    [    0.000000] percpu: Embedded 22 pages/cpu s52120 r8192 d29800 u90112
    [    0.000000] Detected PIPT I-cache on CPU0
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] CPU features: detected: Spectre-v3a
    [    0.000000] CPU features: detected: Spectre-BHB
    [    0.000000] CPU features: detected: ARM erratum 1742098
    [    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
    [    0.000000] alternatives: applying boot alternatives
    [    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02880000 root=/dev/mmcblk1p2 rw rootfstype=ext4 rootwait pci=noaer
    [    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1048576
    [    0.000000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
    [    0.000000] software IO TLB: area num 2.
    [    0.000000] software IO TLB: mapped [mem 0x00000000f8d11000-0x00000000fcd11000] (64MB)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu:     RCU event tracing is enabled.
    [    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2.
    [    0.000000]  Trampoline variant of Tasks RCU enabled.
    [    0.000000]  Tracing variant of Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
    [    0.000000] RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2.
    [    0.000000] RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2.
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 960 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] Root IRQ handler: gic_handle_irq
    [    0.000000] GICv3: GICv3 features: 16 PPIs
    [    0.000000] GICv3: GICD_CTRL.DS=0, SCR_EL3.FIQ=1
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001900000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @880800000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x0000000880040000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000880050000
    [    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0x3ffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000000] sched_clock: 58 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.008467] Console: colour dummy device 80x25
    [    0.013044] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.023717] pid_max: default: 32768 minimum: 301
    [    0.028476] LSM: initializing lsm=capability
    [    0.032917] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.040489] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.049710] rcu: Hierarchical SRCU implementation.
    [    0.054632] rcu:     Max phase no-delay instances is 1000.
    [    0.060091] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level
    [    0.068659] EFI services will not be available.
    [    0.073416] smp: Bringing up secondary CPUs ...
    I/TC: Secondary CPU 1 initializing
    I/TC: Secondary CPU 1 switching to normal world boot
    [    0.086489] Detected PIPT I-cache on CPU1
    [    0.086545] GICv3: CPU1: found redistributor 1 region 0:0x0000000001920000
    [    0.086559] GICv3: CPU1: using allocated LPI pending table @0x0000000880060000
    [    0.086597] CPU1: Booted secondary processor 0x0000000001 [0x411fd080]
    [    0.086694] smp: Brought up 1 node, 2 CPUs
    [    0.116047] SMP: Total of 2 processors activated.
    [    0.120852] CPU: All CPU(s) started at EL2
    [    0.125040] CPU features: detected: 32-bit EL0 Support
    [    0.130289] CPU features: detected: CRC32 instructions
    [    0.135557] alternatives: applying system-wide alternatives
    [    0.141535] Memory: 3307212K/4194304K available (14336K kernel code, 1336K rwdata, 5656K rodata, 1600K init, 655K bss, 354700K reserved, 524288K cma-reserved)
    [    0.156576] devtmpfs: initialized
    [    0.165723] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.175712] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
    [    0.189951] 26816 pages in range for non-PLT usage
    [    0.189965] 518336 pages in range for PLT usage
    [    0.195066] pinctrl core: initialized pinctrl subsystem
    [    0.205395] DMI not present or invalid.
    [    0.210696] NET: Registered PF_NETLINK/PF_ROUTE protocol family
    [    0.217364] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
    [    0.224678] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [    0.232684] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [    0.241053] thermal_sys: Registered thermal governor 'bang_bang'
    [    0.241057] thermal_sys: Registered thermal governor 'step_wise'
    [    0.247200] thermal_sys: Registered thermal governor 'power_allocator'
    [    0.253371] cpuidle: using governor menu
    [    0.264136] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
    [    0.271102] ASID allocator initialised with 65536 entries
    [    0.280908] /bus@100000/interrupt-controller@1800000: Fixed dependency cycle(s) with /bus@100000/interrupt-controller@1800000
    [    0.298495] /bus@100000/pcie@2910000: Fixed dependency cycle(s) with /bus@100000/pcie@2910000/interrupt-controller
    [    0.311108] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
    [    0.318048] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page
    [    0.324457] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
    [    0.331393] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
    [    0.337795] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
    [    0.344730] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
    [    0.351132] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
    [    0.358067] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
    [    0.365523] ACPI: Interpreter disabled.
    [    0.369789] k3-chipinfo 43000014.chipid: Family:J721S2 rev:SR1.0 JTAGID[0x0bb7502f] Detected
    [    0.378752] iommu: Default domain type: Translated
    [    0.383707] iommu: DMA domain TLB invalidation policy: strict mode
    [    0.390306] SCSI subsystem initialized
    [    0.394350] usbcore: registered new interface driver usbfs
    [    0.399979] usbcore: registered new interface driver hub
    [    0.405422] usbcore: registered new device driver usb
    [    0.410895] pps_core: LinuxPPS API ver. 1 registered
    [    0.415972] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.425312] PTP clock support registered
    [    0.429489] EDAC MC: Ver: 3.0.0
    [    0.432850] scmi_core: SCMI protocol bus registered
    [    0.438006] FPGA manager framework
    [    0.441531] Advanced Linux Sound Architecture Driver Initialized.
    [    0.448214] vgaarb: loaded
    [    0.451167] clocksource: Switched to clocksource arch_sys_counter
    [    0.457548] VFS: Disk quotas dquot_6.6.0
    [    0.461574] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [    0.468691] pnp: PnP ACPI: disabled
    [    0.475924] NET: Registered PF_INET protocol family
    [    0.481070] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
    [    0.490134] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
    [    0.498902] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
    [    0.506829] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [    0.515037] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)
    [    0.523077] TCP: Hash tables configured (established 32768 bind 32768)
    [    0.529851] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
    [    0.536772] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
    [    0.544208] NET: Registered PF_UNIX/PF_LOCAL protocol family
    [    0.550338] RPC: Registered named UNIX socket transport module.
    [    0.556403] RPC: Registered udp transport module.
    [    0.561208] RPC: Registered tcp transport module.
    [    0.566011] RPC: Registered tcp-with-tls transport module.
    [    0.571622] RPC: Registered tcp NFSv4.1 backchannel transport module.
    [    0.578207] NET: Registered PF_XDP protocol family
    [    0.583113] PCI: CLS 0 bytes, default 64
    [    0.587979] Initialise system trusted keyrings
    [    0.592669] workingset: timestamp_bits=46 max_order=20 bucket_order=0
    [    0.599440] squashfs: version 4.0 (2009/01/31) Phillip Lougher
    [    0.605560] NFS: Registering the id_resolver key type
    [    0.610740] Key type id_resolver registered
    [    0.615015] Key type id_legacy registered
    [    0.619123] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
    [    0.625973] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
    [    0.654243] Key type asymmetric registered
    [    0.658431] Asymmetric key parser 'x509' registered
    [    0.663448] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
    [    0.671103] io scheduler mq-deadline registered
    [    0.675747] io scheduler kyber registered
    [    0.679861] io scheduler bfq registered
    [    0.686127] pinctrl-single 4301c000.pinctrl: 13 pins, size 52
    [    0.692170] pinctrl-single 4301c038.pinctrl: 11 pins, size 44
    [    0.698201] pinctrl-single 4301c068.pinctrl: 72 pins, size 288
    [    0.704359] pinctrl-single 4301c190.pinctrl: 1 pins, size 4
    [    0.710196] pinctrl-single 11c000.pinctrl: 72 pins, size 288
    [    0.716341] pinctrl-single 104200.pinctrl: 20 pins, size 80
    [    0.722101] pinctrl-single 104280.pinctrl: 8 pins, size 32
    [    0.729100] ledtrig-cpu: registered to indicate activity on CPUs
    [    0.736237] switchtec: loaded.
    [    0.743646] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
    [    0.757389] brd: module loaded
    [    0.762761] loop: module loaded
    [    0.766713] megasas: 07.727.03.00-rc1
    [    0.773658] tun: Universal TUN/TAP device driver, 1.6
    [    0.779540] VFIO - User Level meta-driver version: 0.3
    [    0.786084] usbcore: registered new interface driver usb-storage
    [    0.792694] i2c_dev: i2c /dev entries driver
    [    0.798286] sdhci: Secure Digital Host Controller Interface driver
    [    0.804630] sdhci: Copyright(c) Pierre Ossman
    [    0.809259] sdhci-pltfm: SDHCI platform and OF driver helper
    [    0.815531] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [    0.822660] usbcore: registered new interface driver usbhid
    [    0.828365] usbhid: USB HID core driver
    [    0.833152] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 (0,8000003f) counters available
    [    0.843117] optee: probing for conduit method.
    I/TC: Reserved shared memory is enabled
    I/TC: Dynamic shared memory is enabled
    I/TC: Normal World virtualization support is disabled
    I/TC: Asynchronous notifications are disabled
    [    0.847700] optee: revision 4.5
    [    0.864170] optee: dynamic shared memory is enabled
    [    0.872805] optee: initialized driver
    [    0.876546] random: crng init done
    [    0.881521] Initializing XFRM netlink socket
    [    0.885915] NET: Registered PF_PACKET protocol family
    [    0.891121] Key type dns_resolver registered
    [    0.900112] registered taskstats version 1
    [    0.904373] Loading compiled-in X.509 certificates
    [    0.916984] ti-sci 44083000.system-controller: ABI: 4.0 (firmware rev 0x000b '11.1.8--v11.01.08 (Fancy Rat)')
    [    0.984236] omap_i2c 42120000.i2c: bus 0 rev0.12 at 400 kHz
    [    0.990659] omap_i2c 40b10000.i2c: bus 1 rev0.12 at 100 kHz
    [    0.997041] omap_i2c 2000000.i2c: bus 2 rev0.12 at 100 kHz
    [    1.003375] omap_i2c 2020000.i2c: bus 3 rev0.12 at 100 kHz
    [    1.009221] ti-sci-intr 42200000.interrupt-controller: Interrupt Router 125 domain created
    [    1.018019] ti-sci-intr bus@100000:interrupt-controller@a00000: Interrupt Router 148 domain created
    [    1.027390] ti-sci-intr 310e0000.interrupt-controller: Interrupt Router 227 domain created
    [    1.036066] ti-sci-inta 33d00000.msi-controller: Interrupt Aggregator domain 265 created
    [    1.047558] ti-udma 311a0000.dma-controller: Number of rings: 48
    [    1.054530] ti-udma 311a0000.dma-controller: Channels: 24 (bchan: 0, tchan: 8, rchan: 16)
    [    1.064002] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,20] sci-dev-id:272
    [    1.073901] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
    [    1.080667] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66349100, num_proxies:64
    [    1.090093] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:1024, gp-rings[878,128] sci-dev-id:259
    [    1.100274] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
    [    1.107051] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66349100, num_proxies:64
    [    1.115346] 40a00000.serial: ttyS0 at MMIO 0x40a00000 (irq = 230, base_baud = 6000000) is a 8250
    [    1.125260] 2810000.serial: ttyS1 at MMIO 0x2810000 (irq = 231, base_baud = 3000000) is a 8250
    [    1.134831] 2820000.serial: ttyS3 at MMIO 0x2820000 (irq = 232, base_baud = 3000000) is a 8250
    [    1.144409] 2880000.serial: ttyS2 at MMIO 0x2880000 (irq = 233, base_baud = 3000000) is a 8250
    [    1.153267] printk: legacy console [ttyS2] enabled
    [    1.153267] printk: legacy console [ttyS2] enabled
    [    1.162984] printk: legacy bootconsole [ns16550a0] disabled
    [    1.162984] printk: legacy bootconsole [ns16550a0] disabled
    [    1.177173] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [    1.190469] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
    [    1.231177] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.241088] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [    1.249422] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
    [    1.256632] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64, Policers 8
    [    1.264014] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:500000000, add_val:1 pps:0
    [    1.274218] am65-cpsw-nuss c200000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [    1.287301] davinci_mdio c200f00.mdio: Configuring MDIO in manual mode
    [    1.327174] davinci_mdio c200f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.336915] davinci_mdio c200f00.mdio: phy[0]: device c200f00.mdio:00, driver TI DP83867
    [    1.345078] am65-cpsw-nuss c200000.ethernet: initialized cpsw ale version 1.4
    [    1.352203] am65-cpsw-nuss c200000.ethernet: ALE Table size 64, Policers 8
    [    1.359482] am65-cpsw-nuss c200000.ethernet: CPTS ver 0x4e8a010b, freq:250000000, add_val:3 pps:0
    [    1.370326] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010c, freq:200000000, add_val:4 pps:0
    [    1.380648] mmc0: CQHCI version 5.10
    [    1.419199] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
    [    1.578221] mmc0: Command Queue Engine enabled
    [    1.582681] mmc0: new HS400 MMC card at address 0001
    [    1.587987] mmcblk0: mmc0:0001 00032G 28.8 GiB
    [    1.593321] mmcblk0boot0: mmc0:0001 00032G 31.5 MiB
    [    1.598844] mmcblk0boot1: mmc0:0001 00032G 31.5 MiB
    [    1.604318] mmcblk0rpmb: mmc0:0001 00032G 4.00 MiB, chardev (236:0)
    [    1.655303] tps6594-rtc tps6594-rtc.4.auto: registered as rtc0
    [    1.675906] pcf857x 3-0020: probed
    [    1.679450] pca953x 3-0022: supply vcc not found, using dummy regulator
    [    1.686136] pca953x 3-0022: using AI
    [    1.693960] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
    [    1.701462] j721e-pcie 2910000.pcie:       IO 0x4100001000..0x4100100fff -> 0x0000001000
    [    1.709553] j721e-pcie 2910000.pcie:      MEM 0x4100101000..0x41ffffffff -> 0x0000101000
    [    1.717639] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
    [    1.931449] j721e-pcie 2910000.pcie: Link up
    [    1.936025] j721e-pcie 2910000.pcie: PCI host bridge to bus 0000:00
    [    1.942302] pci_bus 0000:00: root bus resource [bus 00-ff]
    [    1.947779] pci_bus 0000:00: root bus resource [io  0x0000-0xfffff] (bus address [0x1000-0x100fff])
    [    1.956808] pci_bus 0000:00: root bus resource [mem 0x4100101000-0x41ffffffff] (bus address [0x00101000-0xffffffff])
    [    1.967354] pci 0000:00:00.0: [104c:b013] type 01 class 0x060400 PCIe Root Port
    [    1.974684] pci 0000:00:00.0: PCI bridge to [bus 00]
    [    1.979643] pci 0000:00:00.0:   bridge window [io  0x0000-0x0fff]
    [    1.985724] pci 0000:00:00.0:   bridge window [mem 0x00000000-0x000fffff]
    [    1.992504] pci 0000:00:00.0:   bridge window [mem 0x00000000-0x000fffff 64bit pref]
    [    2.000312] pci 0000:00:00.0: supports D1
    [    2.004313] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
    [    2.011555] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.019908] pci 0000:01:00.0: [1055:1005] type 01 class 0x060400 PCIe Switch Upstream Port
    [    2.028570] pci 0000:01:00.0: PCI bridge to [bus 00]
    [    2.033958] pci 0000:01:00.0: enabling Extended Tags
    [    2.041268] pci 0000:01:00.0: PME# supported from D0 D3hot
    [    2.048340] pci 0000:01:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0000:00:00.0 (capable of 63.012 Gb/s with 16.0 GT/s PCIe x4 link)
    [    2.065478] pci 0000:01:00.1: [1055:1005] type 00 class 0x058000 PCIe Endpoint
    [    2.073085] pci 0000:01:00.1: BAR 0 [mem 0x00000000-0x003fffff 64bit pref]
    [    2.080496] pci 0000:01:00.1: enabling Extended Tags
    [    2.086840] pci 0000:01:00.1: PME# supported from D0 D3hot
    [    2.099269] pci 0000:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.108401] pci 0000:02:00.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.117212] pci 0000:02:00.0: PCI bridge to [bus 00]
    [    2.122757] pci 0000:02:00.0: enabling Extended Tags
    [    2.130348] pci 0000:02:00.0: PME# supported from D0 D3hot
    [    2.139757] pci 0000:02:01.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.148557] pci 0000:02:01.0: PCI bridge to [bus 00]
    [    2.154114] pci 0000:02:01.0: enabling Extended Tags
    [    2.161694] pci 0000:02:01.0: PME# supported from D0 D3hot
    [    2.171102] pci 0000:02:02.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.179902] pci 0000:02:02.0: PCI bridge to [bus 00]
    [    2.185447] pci 0000:02:02.0: enabling Extended Tags
    [    2.193039] pci 0000:02:02.0: PME# supported from D0 D3hot
    [    2.202460] pci 0000:02:03.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.211263] pci 0000:02:03.0: PCI bridge to [bus 00]
    [    2.216816] pci 0000:02:03.0: enabling Extended Tags
    [    2.224383] pci 0000:02:03.0: PME# supported from D0 D3hot
    [    2.233935] pci 0000:02:04.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.242749] pci 0000:02:04.0: PCI bridge to [bus 00]
    [    2.248236] pci 0000:02:04.0: enabling Extended Tags
    [    2.255805] pci 0000:02:04.0: PME# supported from D0 D3hot
    [    2.265342] pci 0000:02:05.0: [1055:1005] type 01 class 0x060400 PCIe Switch Downstream Port
    [    2.274145] pci 0000:02:05.0: PCI bridge to [bus 00]
    [    2.279582] pci 0000:02:05.0: enabling Extended Tags
    [    2.287111] pci 0000:02:05.0: PME# supported from D0 D3hot
    [    2.297882] pci 0000:02:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.305955] pci 0000:02:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.314020] pci 0000:02:02.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.322083] pci 0000:02:03.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.330145] pci 0000:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.338207] pci 0000:02:05.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.347012] pci_bus 0000:03: busn_res: [bus 03-ff] end is updated to 03
    [    2.354493] pci_bus 0000:04: busn_res: [bus 04-ff] end is updated to 04
    [    2.362139] pci 0000:05:00.0: [1dd4:0020] type 00 class 0x010802 PCIe Endpoint
    [    2.369658] pci 0000:05:00.0: BAR 0 [mem 0x00000000-0x00003fff 64bit]
    [    2.379215] pci 0000:05:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0000:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
    [    2.395939] pci_bus 0000:05: busn_res: [bus 05-ff] end is updated to 05
    [    2.403353] pci_bus 0000:06: busn_res: [bus 06-ff] end is updated to 06
    [    2.410855] pci_bus 0000:07: busn_res: [bus 07-ff] end is updated to 07
    [    2.418253] pci_bus 0000:08: busn_res: [bus 08-ff] end is updated to 08
    [    2.424910] pci_bus 0000:02: busn_res: [bus 02-ff] end is updated to 08
    [    2.431637] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 08
    [    2.438243] pci 0000:02:00.0: bridge window [io  0x1000-0x0fff] to [bus 03] add_size 1000
    [    2.446405] pci 0000:02:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 03] add_size 200000 add_align 100000
    [    2.457859] pci 0000:02:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 03] add_size 200000 add_align 100000
    [    2.468360] pci 0000:02:01.0: bridge window [io  0x1000-0x0fff] to [bus 04] add_size 1000
    [    2.476526] pci 0000:02:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 04] add_size 200000 add_align 100000
    [    2.487980] pci 0000:02:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 04] add_size 200000 add_align 100000
    [    2.498481] pci 0000:02:02.0: bridge window [io  0x1000-0x0fff] to [bus 05] add_size 1000
    [    2.506641] pci 0000:02:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 05] add_size 200000 add_align 100000
    [    2.518098] pci 0000:02:02.0: bridge window [mem 0x00100000-0x001fffff] to [bus 05] add_size 100000 add_align 100000
    [    2.528599] pci 0000:02:03.0: bridge window [io  0x1000-0x0fff] to [bus 06] add_size 1000
    [    2.536765] pci 0000:02:03.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 06] add_size 200000 add_align 100000
    [    2.548221] pci 0000:02:03.0: bridge window [mem 0x00100000-0x000fffff] to [bus 06] add_size 200000 add_align 100000
    [    2.558722] pci 0000:02:04.0: bridge window [io  0x1000-0x0fff] to [bus 07] add_size 1000
    [    2.566882] pci 0000:02:04.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 200000 add_align 100000
    [    2.578336] pci 0000:02:04.0: bridge window [mem 0x00100000-0x000fffff] to [bus 07] add_size 200000 add_align 100000
    [    2.588837] pci 0000:02:05.0: bridge window [io  0x1000-0x0fff] to [bus 08] add_size 1000
    [    2.596999] pci 0000:02:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 08] add_size 200000 add_align 100000
    [    2.608454] pci 0000:02:05.0: bridge window [mem 0x00100000-0x000fffff] to [bus 08] add_size 200000 add_align 100000
    [    2.618958] pci 0000:01:00.0: bridge window [io  0x1000-0x0fff] to [bus 02-08] add_size 6000
    [    2.627381] pci 0000:01:00.0: bridge window [mem 0x00100000-0x006fffff 64bit pref] to [bus 02-08] add_size c00000 add_align 100000
    [    2.639097] pci 0000:01:00.0: bridge window [mem 0x00100000-0x006fffff] to [bus 02-08] add_size b00000 add_align 100000
    [    2.649859] pci 0000:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01-08] add_size 6000
    [    2.658283] pci 0000:00:00.0: bridge window [mem 0x00400000-0x00ffffff 64bit pref] to [bus 01-08] add_size c00000 add_align 400000
    [    2.669998] pci 0000:00:00.0: bridge window [mem 0x00100000-0x006fffff] to [bus 01-08] add_size b00000 add_align 100000
    [    2.680765] pci 0000:00:00.0: bridge window [mem 0x4100400000-0x4101bfffff 64bit pref]: assigned
    [    2.689534] pci 0000:00:00.0: bridge window [mem 0x4101c00000-0x4102cfffff]: assigned
    [    2.697348] pci 0000:00:00.0: bridge window [io  0x1000-0x6fff]: assigned
    [    2.704125] pci 0000:01:00.1: BAR 0 [mem 0x4100400000-0x41007fffff 64bit pref]: assigned
    [    2.712341] pci 0000:01:00.0: bridge window [mem 0x4101c00000-0x4102cfffff]: assigned
    [    2.720158] pci 0000:01:00.0: bridge window [mem 0x4100800000-0x41019fffff 64bit pref]: assigned
    [    2.728925] pci 0000:01:00.0: bridge window [io  0x1000-0x6fff]: assigned
    [    2.735707] pci 0000:02:00.0: bridge window [mem 0x4101c00000-0x4101dfffff]: assigned
    [    2.743523] pci 0000:02:00.0: bridge window [mem 0x4100800000-0x41009fffff 64bit pref]: assigned
    [    2.752290] pci 0000:02:01.0: bridge window [mem 0x4101e00000-0x4101ffffff]: assigned
    [    2.760103] pci 0000:02:01.0: bridge window [mem 0x4100a00000-0x4100bfffff 64bit pref]: assigned
    [    2.768870] pci 0000:02:02.0: bridge window [mem 0x4102000000-0x41021fffff]: assigned
    [    2.776683] pci 0000:02:02.0: bridge window [mem 0x4100c00000-0x4100dfffff 64bit pref]: assigned
    [    2.785452] pci 0000:02:03.0: bridge window [mem 0x4102200000-0x41023fffff]: assigned
    [    2.793266] pci 0000:02:03.0: bridge window [mem 0x4100e00000-0x4100ffffff 64bit pref]: assigned
    [    2.802034] pci 0000:02:04.0: bridge window [mem 0x4102400000-0x41025fffff]: assigned
    [    2.809848] pci 0000:02:04.0: bridge window [mem 0x4101000000-0x41011fffff 64bit pref]: assigned
    [    2.818615] pci 0000:02:05.0: bridge window [mem 0x4102600000-0x41027fffff]: assigned
    [    2.826429] pci 0000:02:05.0: bridge window [mem 0x4101200000-0x41013fffff 64bit pref]: assigned
    [    2.835195] pci 0000:02:00.0: bridge window [io  0x1000-0x1fff]: assigned
    [    2.841968] pci 0000:02:01.0: bridge window [io  0x2000-0x2fff]: assigned
    [    2.848744] pci 0000:02:02.0: bridge window [io  0x3000-0x3fff]: assigned
    [    2.855517] pci 0000:02:03.0: bridge window [io  0x4000-0x4fff]: assigned
    [    2.862290] pci 0000:02:04.0: bridge window [io  0x5000-0x5fff]: assigned
    [    2.869063] pci 0000:02:05.0: bridge window [io  0x6000-0x6fff]: assigned
    [    2.875841] pci 0000:02:00.0: PCI bridge to [bus 03]
    [    2.880809] pci 0000:02:00.0:   bridge window [io  0x1000-0x1fff]
    [    2.886928] pci 0000:02:00.0:   bridge window [mem 0x4101c00000-0x4101dfffff]
    [    2.894096] pci 0000:02:00.0:   bridge window [mem 0x4100800000-0x41009fffff 64bit pref]
    [    2.902275] pci 0000:02:01.0: PCI bridge to [bus 04]
    [    2.907254] pci 0000:02:01.0:   bridge window [io  0x2000-0x2fff]
    [    2.913382] pci 0000:02:01.0:   bridge window [mem 0x4101e00000-0x4101ffffff]
    [    2.920551] pci 0000:02:01.0:   bridge window [mem 0x4100a00000-0x4100bfffff 64bit pref]
    [    2.928734] pci 0000:05:00.0: BAR 0 [mem 0x4102000000-0x4102003fff 64bit]: assigned
    [    2.936478] pci 0000:02:02.0: PCI bridge to [bus 05]
    [    2.941447] pci 0000:02:02.0:   bridge window [io  0x3000-0x3fff]
    [    2.947565] pci 0000:02:02.0:   bridge window [mem 0x4102000000-0x41021fffff]
    [    2.954734] pci 0000:02:02.0:   bridge window [mem 0x4100c00000-0x4100dfffff 64bit pref]
    [    2.962906] pci 0000:02:03.0: PCI bridge to [bus 06]
    [    2.967875] pci 0000:02:03.0:   bridge window [io  0x4000-0x4fff]
    [    2.973994] pci 0000:02:03.0:   bridge window [mem 0x4102200000-0x41023fffff]
    [    2.981164] pci 0000:02:03.0:   bridge window [mem 0x4100e00000-0x4100ffffff 64bit pref]
    [    2.989335] pci 0000:02:04.0: PCI bridge to [bus 07]
    [    2.994321] pci 0000:02:04.0:   bridge window [io  0x5000-0x5fff]
    [    3.000442] pci 0000:02:04.0:   bridge window [mem 0x4102400000-0x41025fffff]
    [    3.007612] pci 0000:02:04.0:   bridge window [mem 0x4101000000-0x41011fffff 64bit pref]
    [    3.015784] pci 0000:02:05.0: PCI bridge to [bus 08]
    [    3.020750] pci 0000:02:05.0:   bridge window [io  0x6000-0x6fff]
    [    3.026868] pci 0000:02:05.0:   bridge window [mem 0x4102600000-0x41027fffff]
    [    3.034037] pci 0000:02:05.0:   bridge window [mem 0x4101200000-0x41013fffff 64bit pref]
    [    3.042210] pci 0000:01:00.0: PCI bridge to [bus 02-08]
    [    3.047435] pci 0000:01:00.0:   bridge window [io  0x1000-0x6fff]
    [    3.053551] pci 0000:01:00.0:   bridge window [mem 0x4101c00000-0x4102cfffff]
    [    3.060790] pci 0000:01:00.0:   bridge window [mem 0x4100800000-0x41019fffff 64bit pref]
    [    3.069098] pci 0000:00:00.0: PCI bridge to [bus 01-08]
    [    3.074312] pci 0000:00:00.0:   bridge window [io  0x1000-0x6fff]
    [    3.080410] pci 0000:00:00.0:   bridge window [mem 0x4101c00000-0x4102cfffff]
    [    3.087548] pci 0000:00:00.0:   bridge window [mem 0x4100400000-0x4101bfffff 64bit pref]
    [    3.095628] pci_bus 0000:00: resource 4 [io  0x0000-0xfffff]
    [    3.101276] pci_bus 0000:00: resource 5 [mem 0x4100101000-0x41ffffffff]
    [    3.107875] pci_bus 0000:01: resource 0 [io  0x1000-0x6fff]
    [    3.113434] pci_bus 0000:01: resource 1 [mem 0x4101c00000-0x4102cfffff]
    [    3.120034] pci_bus 0000:01: resource 2 [mem 0x4100400000-0x4101bfffff 64bit pref]
    [    3.127587] pci_bus 0000:02: resource 0 [io  0x1000-0x6fff]
    [    3.133146] pci_bus 0000:02: resource 1 [mem 0x4101c00000-0x4102cfffff]
    [    3.139745] pci_bus 0000:02: resource 2 [mem 0x4100800000-0x41019fffff 64bit pref]
    [    3.147298] pci_bus 0000:03: resource 0 [io  0x1000-0x1fff]
    [    3.152858] pci_bus 0000:03: resource 1 [mem 0x4101c00000-0x4101dfffff]
    [    3.159459] pci_bus 0000:03: resource 2 [mem 0x4100800000-0x41009fffff 64bit pref]
    [    3.167013] pci_bus 0000:04: resource 0 [io  0x2000-0x2fff]
    [    3.172571] pci_bus 0000:04: resource 1 [mem 0x4101e00000-0x4101ffffff]
    [    3.179171] pci_bus 0000:04: resource 2 [mem 0x4100a00000-0x4100bfffff 64bit pref]
    [    3.186723] pci_bus 0000:05: resource 0 [io  0x3000-0x3fff]
    [    3.192281] pci_bus 0000:05: resource 1 [mem 0x4102000000-0x41021fffff]
    [    3.198880] pci_bus 0000:05: resource 2 [mem 0x4100c00000-0x4100dfffff 64bit pref]
    [    3.206433] pci_bus 0000:06: resource 0 [io  0x4000-0x4fff]
    [    3.211993] pci_bus 0000:06: resource 1 [mem 0x4102200000-0x41023fffff]
    [    3.218592] pci_bus 0000:06: resource 2 [mem 0x4100e00000-0x4100ffffff 64bit pref]
    [    3.226147] pci_bus 0000:07: resource 0 [io  0x5000-0x5fff]
    [    3.231707] pci_bus 0000:07: resource 1 [mem 0x4102400000-0x41025fffff]
    [    3.238306] pci_bus 0000:07: resource 2 [mem 0x4101000000-0x41011fffff 64bit pref]
    [    3.245858] pci_bus 0000:08: resource 0 [io  0x6000-0x6fff]
    [    3.251418] pci_bus 0000:08: resource 1 [mem 0x4102600000-0x41027fffff]
    [    3.258017] pci_bus 0000:08: resource 2 [mem 0x4101200000-0x41013fffff 64bit pref]
    [    3.265660] irq: no irq domain found for interrupt-controller !
    [    3.271576] pcieport 0000:00:00.0: enabling device (0000 -> 0003)
    [    3.277892] pcieport 0000:00:00.0: PME: Signaling with IRQ 495
    [    3.283945] pcieport 0000:01:00.0: enabling device (0000 -> 0003)
    [    3.292190] switchtec 0000:01:00.1: enabling device (0000 -> 0002)
    [    3.301070] switchtec switchtec0: Management device registered.
    [    3.307274] pcieport 0000:02:00.0: enabling device (0000 -> 0003)
    [    3.314691] pcieport 0000:02:00.0: pciehp: Slot #1 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.330302] pcieport 0000:02:01.0: enabling device (0000 -> 0003)
    [    3.337743] pcieport 0000:02:01.0: pciehp: Slot #2 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.353321] pcieport 0000:02:02.0: enabling device (0000 -> 0003)
    [    3.360736] pcieport 0000:02:02.0: pciehp: Slot #3 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.376326] pcieport 0000:02:03.0: enabling device (0000 -> 0003)
    [    3.383697] pcieport 0000:02:03.0: pciehp: Slot #4 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.399253] pcieport 0000:02:04.0: enabling device (0000 -> 0003)
    [    3.406717] pcieport 0000:02:04.0: pciehp: Slot #5 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.422256] pcieport 0000:02:05.0: enabling device (0000 -> 0003)
    [    3.429724] pcieport 0000:02:05.0: pciehp: Slot #6 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
    [    3.445292] irq: no irq domain found for interrupt-controller !
    [    3.451464] nvme nvme0: pci function 0000:05:00.0
    [    3.456201] nvme 0000:05:00.0: enabling device (0000 -> 0002)
    [   64.623219] nvme nvme0: I/O tag 0 (1000) QID 0 timeout, completion polled
    [  126.063212] nvme nvme0: I/O tag 1 (1001) QID 0 timeout, completion polled
    [  126.063217] nvme nvme0: D3 entry latency set to 6 seconds
    [  187.503208] nvme nvme0: I/O tag 2 (1002) QID 0 timeout, completion polled
    [  187.503431] hwmon hwmon0: temp1_input not attached to any thermal zone
    [  187.516577] hwmon hwmon0: temp2_input not attached to any thermal zone
    [  187.523141] hwmon hwmon0: temp3_input not attached to any thermal zone
    [  187.541158] nvme nvme0: allocated 64 MiB host memory buffer.
    [  248.943230] nvme nvme0: I/O tag 3 (1003) QID 0 timeout, completion polled
    [  310.383206] nvme nvme0: I/O tag 16 (1010) QID 0 timeout, completion polled
    [  371.823223] nvme nvme0: I/O tag 17 (1011) QID 0 timeout, completion polled
    [  433.263205] nvme nvme0: I/O tag 18 (1012) QID 0 timeout, completion polled
    [  494.703208] nvme nvme0: I/O tag 19 (1013) QID 0 timeout, completion polled
    [  556.143207] nvme nvme0: I/O tag 16 (2010) QID 0 timeout, completion polled
    [  556.143228] nvme nvme0: 2/0/0 default/read/poll queues
    [  617.583217] nvme nvme0: I/O tag 17 (2011) QID 0 timeout, completion polled
    [  679.023197] nvme nvme0: I/O tag 18 (2012) QID 0 timeout, completion polled
    [  740.463208] nvme nvme0: I/O tag 16 (3010) QID 0 timeout, completion polled
    [  801.903208] nvme nvme0: I/O tag 17 (3011) QID 0 timeout, completion polled
    [  863.343205] nvme nvme0: I/O tag 19 (2013) QID 0 timeout, completion polled
    [  924.783204] nvme nvme0: I/O tag 16 (4010) QID 0 timeout, completion polled
    [  955.503231] nvme nvme0: I/O tag 16 (1010) QID 2 timeout, completion polled
    [  955.504495] ti-udma 285c0000.dma-controller: Channels: 26 (tchan: 13, rchan: 13, gp-rflow: 8)
    [  955.520627] ti-udma 31150000.dma-controller: Channels: 60 (tchan: 30, rchan: 30, gp-rflow: 16)
    [  955.537209] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [  955.550409] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
    [  955.591174] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [  955.601038] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [  955.609372] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
    [  955.616583] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64, Policers 8
    [  955.623933] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:500000000, add_val:1 pps:0
    [  955.639851] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
    [  955.649416] am65-cpsw-nuss c200000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [  955.662436] davinci_mdio c200f00.mdio: Configuring MDIO in manual mode
    [  955.703182] davinci_mdio c200f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [  955.712946] davinci_mdio c200f00.mdio: phy[0]: device c200f00.mdio:00, driver TI DP83867
    [  955.721136] am65-cpsw-nuss c200000.ethernet: initialized cpsw ale version 1.4
    [  955.728262] am65-cpsw-nuss c200000.ethernet: ALE Table size 64, Policers 8
    [  955.735517] am65-cpsw-nuss c200000.ethernet: CPTS ver 0x4e8a010b, freq:250000000, add_val:3 pps:0
    [  955.752236] am65-cpsw-nuss c200000.ethernet: set new flow-id-base 82
    [  955.762382] clk: Disabling unused clocks
    [  955.766568] mmc1: CQHCI version 5.10
    [  955.777902] PM: genpd: Disabling unused power domains
    [  955.783041] ALSA device list:
    [  955.786066]   No soundcards found.
    [  955.813552] mmc1: SDHCI controller on 4fb0000.mmc [4fb0000.mmc] using ADMA 64-bit
    [  955.821174] md: Waiting for all devices to be available before autodetect
    [  955.827953] md: If you don't use raid, use raid=noautodetect
    [  955.833598] md: Autodetecting RAID arrays.
    [  955.837692] md: autorun ...
    [  955.840479] md: ... autorun DONE.
    [  955.843869] Waiting for root device /dev/mmcblk1p2...
    [  955.861752] mmc1: new high speed SDHC card at address 59b4
    [  955.867679] mmcblk1: mmc1:59b4 CACTU 7.56 GiB
    [  955.873365]  mmcblk1: p1 p2
    [  955.884826] EXT4-fs (mmcblk1p2): warning: mounting unchecked fs, running e2fsck is recommended
    [  955.912536] EXT4-fs (mmcblk1p2): mounted filesystem 34a00cb4-000f-4ecb-88d5-187ce64f3da6 r/w without journal. Quota mode: none.
    [  955.924034] VFS: Mounted root (ext4 filesystem) on device 179:98.
    [  955.930571] devtmpfs: mounted
    [  955.934110] Freeing unused kernel memory: 1600K
    [  955.938738] Run /sbin/init as init process
    [  956.127458] EXT4-fs (mmcblk1p2): re-mounted 34a00cb4-000f-4ecb-88d5-187ce64f3da6.
    Starting syslogd: OK
    Starting klogd: OK
    Running sysctl: OK
    Starting haveged: haveged: command socket is listening at fd 3
    OK
    Starting rpcbind: [  956.413095] NET: Registered PF_INET6 protocol family
    [  956.418750] Segment Routing with IPv6
    [  956.422440] In-situ OAM (IOAM) with IPv6
    OK
    Starting network: OK
    Starting crond: OK
    Starting dropbear sshd: OK
    
    Welcome to Buildroot
    AM68x_Izar login:

    Do you have other ideas to solve the issue? Perhaps ignoring the error via a kernel patch?

    Regards,

    Philipp

  • Hi Philipp,

    Can you also post the "lspci -vvv" output again with the "pci=noaer" in place?

    Regards,

    Takuma

  • Hi Takuma, 

    log is attached.


    log_lspci_noaer.txt

    Regards,

    Philipp

  • Hi Philipp,

    Thanks for the logs. Looking through them, it looks like at the PCIe controller level, the errors look clean (that is, errors are not propagated), but the error still happens at the switch and NVMe level. Although ATS is not available for J721S2, perhaps the issue is still related to some address translation.

    As an experiment, can you try also putting the "iommu.passthrough=1" in kernel argument as well?

    Additionally, do you have other NVMe devices that you could test to see if this is an issue with the specific NVMe device from Swissbit, or an issue with other NVMe devices as well (preferably a NVMe card from a different vendor)?

    Regards,

    Takuma