This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

DRA829V: ITS queue timeout occurred during rescan

Part Number: DRA829V
Other Parts Discussed in Thread: DRA829, TDA4VM

Hi experts,

Previously, I asked a question about PCIe SW(PI7C9X3G1632GP) connection in the thread below.
e2e.ti.com/.../dra829v-connection-between-dra829-and-pcie-sw-pi7c9x3g1632gp-again

By using the solution patch
Communication is possible with TDA4VM + PCIe SW(PI7C9X3G1632GP) + DRA829.

If PCI is removed and rescanned in the above configuration, communication will not be possible.
When I run pcitest.sh, MSI/MSI-X is Not OKEY.

Is the procedure wrong for remove and rescan?

・Procedures taken
1. BOOT of TDA4VM_EVM(RC) + PCIe SW(PI7C9X3G1632GP) + DRA829(EP)
2.Run pcitest.sh on RC (terminates in the middle of MSI-X)
3.Run pci remove on RC
    echo 1 > /sys/bus/pci/devices/0001\:00\:00.0/remove
4.Run pci rescan in RC
    echo 1 > /sys/bus/pci/rescan
5. Run pcitest,sh on RC

U-Boot SPL 2021.01-g44a87e3ab8 (Sep 06 2022 - 07:31:49 +0000)
Model: Texas Instruments K3 J721E SoC
Board: J721EX-PM2-SOM rev A
SYSFW ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
Trying to boot from MMC2
spl_load_fit_image: Skip load 'dm': image size is 0!
Starting ATF on ARM64 core...

NOTICE:  BL31: v2.5(release):08.01.00.006-dirty
NOTICE:  BL31: Built : 00:07:53, Aug  2 2023

U-Boot SPL 2021.01-dirty (Aug 02 2023 - 00:57:18 +0000)
Model: Texas Instruments K3 J721E SoC
Board: J721EX-PM2-SOM rev A
SYSFW ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
Detected: J7X-BASE-CPB rev E3
Detected: J7X-VSC8514-ETH rev E2
Trying to boot from MMC2


U-Boot 2021.01-g44a87e3ab8 (Mar 29 2023 - 04:13:35 +0000)

SoC:   J721E SR1.1
Model: Texas Instruments K3 J721E SoC
DRAM:  4 GiB
Flash: 0 Bytes
MMC:   sdhci@4f80000: 0, sdhci@4fb0000: 1
In:    serial@2800000
Out:   serial@2800000
Err:   serial@2800000
am65_cpsw_nuss ethernet@46000000: K3 CPSW: nuss_ver: 0x6BA00101 cpsw_ver: 0x6BA80100 ale_ver: 0x00293904 Ports:1 mdio_freq:1000000
Net:   eth0: ethernet@46000000port@1
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc1 is current device
SD/MMC found on device 1
Failed to load 'boot.scr'
Failed to load 'uEnv.txt'
20236800 bytes read in 843 ms (22.9 MiB/s)
102282 bytes read in 14 ms (7 MiB/s)
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 000000008fee4000, end 000000008fffffff ... OK

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd080]
[    0.000000] Linux version 5.10.100-g7a7a3af903 (oe-user@oe-host) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #1 SMP PREEMPT Tue Aug 1 01:28:31 UTC 2023
[    0.000000] Machine model: Texas Instruments K3 J721E SoC
[    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
[    0.000000] printk: bootconsole [ns16550a0] enabled
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a0000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a0100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a1000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a1100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a2000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a2100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a3000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a3100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a4000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a4100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a5000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a5100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node c66-dma-memory@a6000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node c66-memory@a6100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node c66-dma-memory@a7000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node c66-memory@a7100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a8000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node c71-dma-memory@a8000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a8100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node c71-memory@a8100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ac000000, size 2 MiB
[    0.000000] OF: reserved mem: initialized node r5f-virtual-eth-queues@ac000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000ac200000, size 30 MiB
[    0.000000] OF: reserved mem: initialized node r5f-virtual-eth-buffers@ac200000, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000008ffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000009e7fffff]
[    0.000000]   node   0: [mem 0x000000009e800000-0x00000000a8ffffff]
[    0.000000]   node   0: [mem 0x00000000a9000000-0x00000000a9ffffff]
[    0.000000]   node   0: [mem 0x00000000aa000000-0x00000000abbfffff]
[    0.000000]   node   0: [mem 0x00000000abc00000-0x00000000abffffff]
[    0.000000]   node   0: [mem 0x00000000ac000000-0x00000000adffffff]
[    0.000000]   node   0: [mem 0x00000000ae000000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000880000000-0x00000008ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000008ffffffff]
[    0.000000] cma: Reserved 512 MiB at 0x00000000e0000000
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 2 pages/cpu s50776 r8192 d72104 u131072
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 65472
[    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 mtdparts=47040000.spi.0:512k(ospi.tiboot3),2m(ospi.tispl),4m(ospi.u-boot),256k(ospi.env),1m(ospi.sysfw),256k(ospi.env.backup),57088k@8m(ospi.rootfs),256k(ospi.phypattern);47034000.hyperbus:512k(hbmc.tiboot3),2m(hbmc.tispl),4m(hbmc.u-boot),256k(hbmc.env),1m(hbmc.sysfw),-@8m(hbmc.rootfs) root=PARTUUID=f2fdac57-02 rw rootfstype=ext4 rootwait
[    0.000000] Dentry cache hash table entries: 524288 (order: 6, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 5, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x00000000dc000000-0x00000000e0000000] (64MB)
[    0.000000] Memory: 3338176K/4194304K available (11392K kernel code, 1330K rwdata, 4608K rodata, 1984K init, 752K bss, 331840K reserved, 524288K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001900000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: allocated 1048576 Devices @880800000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x00000008800b0000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x00000008800c0000
[    0.000000] random: get_random_bytes called from start_kernel+0x31c/0x4cc with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000001] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.008381] Console: colour dummy device 80x25
[    0.012943] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.023612] pid_max: default: 32768 minimum: 301
[    0.028360] LSM: Security Framework initializing
[    0.033103] Mount-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.040670] Mountpoint-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.049605] rcu: Hierarchical SRCU implementation.
[    0.054664] Platform MSI: msi-controller@1820000 domain created
[    0.060906] PCI/MSI: /bus@100000/interrupt-controller@1800000/msi-controller@1820000 domain created
[    0.070208] EFI services will not be available.
[    0.074954] smp: Bringing up secondary CPUs ...
[    0.080187] Detected PIPT I-cache on CPU1
[    0.080208] GICv3: CPU1: found redistributor 1 region 0:0x0000000001920000
[    0.080219] GICv3: CPU1: using allocated LPI pending table @0x00000008800d0000
[    0.080253] CPU1: Booted secondary processor 0x0000000001 [0x411fd080]
[    0.080303] smp: Brought up 1 node, 2 CPUs
[    0.109649] SMP: Total of 2 processors activated.
[    0.114453] CPU features: detected: 32-bit EL0 Support
[    0.119709] CPU features: detected: CRC32 instructions
[    0.133514] CPU: All CPU(s) started at EL2
[    0.137709] alternatives: patching kernel code
[    0.142694] devtmpfs: initialized
[    0.151011] KASLR disabled due to lack of seed
[    0.155670] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.165632] futex hash table entries: 512 (order: -1, 32768 bytes, linear)
[    0.173278] pinctrl core: initialized pinctrl subsystem
[    0.178864] DMI not present or invalid.
[    0.183086] NET: Registered protocol family 16
[    0.190499] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[    0.197801] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.205803] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.214104] thermal_sys: Registered thermal governor 'step_wise'
[    0.214106] thermal_sys: Registered thermal governor 'power_allocator'
[    0.220551] cpuidle: using governor menu
[    0.231349] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.238308] ASID allocator initialised with 65536 entries
[    0.261672] HugeTLB registered 16.0 GiB page size, pre-allocated 0 pages
[    0.268531] HugeTLB registered 512 MiB page size, pre-allocated 0 pages
[    0.275289] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.283224] cryptd: max_cpu_qlen set to 1000
[    0.288977] ACPI: Interpreter disabled.
[    0.293110] k3-chipinfo 43000014.chipid: Family:J721E rev:SR2.0 JTAGID[0x1bb6402f] Detected
[    0.301909] vsys_3v3: supplied by evm_12v0
[    0.306270] vsys_5v0: supplied by evm_12v0
[    0.311013] iommu: Default domain type: Translated
[    0.316156] SCSI subsystem initialized
[    0.320279] mc: Linux media interface: v0.10
[    0.324662] videodev: Linux video capture interface: v2.00
[    0.330289] pps_core: LinuxPPS API ver. 1 registered
[    0.335362] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.344698] PTP clock support registered
[    0.348717] EDAC MC: Ver: 3.0.0
[    0.352496] FPGA manager framework
[    0.356011] Advanced Linux Sound Architecture Driver Initialized.
[    0.362613] clocksource: Switched to clocksource arch_sys_counter
[    0.369048] VFS: Disk quotas dquot_6.6.0
[    0.373095] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.380405] pnp: PnP ACPI: disabled
[    0.386317] NET: Registered protocol family 2
[    0.390902] IP idents hash table entries: 65536 (order: 3, 524288 bytes, linear)
[    0.399502] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear)
[    0.408269] TCP established hash table entries: 32768 (order: 2, 262144 bytes, linear)
[    0.416467] TCP bind hash table entries: 32768 (order: 3, 524288 bytes, linear)
[    0.424400] TCP: Hash tables configured (established 32768 bind 32768)
[    0.431157] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.438050] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.445439] NET: Registered protocol family 1
[    0.450132] RPC: Registered named UNIX socket transport module.
[    0.456193] RPC: Registered udp transport module.
[    0.460997] RPC: Registered tcp transport module.
[    0.465801] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.472386] PCI: CLS 0 bytes, default 64
[    0.476753] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    0.487048] Initialise system trusted keyrings
[    0.491655] workingset: timestamp_bits=46 max_order=16 bucket_order=0
[    0.499900] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.506097] NFS: Registering the id_resolver key type
[    0.511270] Key type id_resolver registered
[    0.515541] Key type id_legacy registered
[    0.519658] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.526506] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.534145] 9p: Installing v9fs 9p2000 file system support
[    0.558886] Key type asymmetric registered
[    0.563073] Asymmetric key parser 'x509' registered
[    0.568070] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    0.575628] io scheduler mq-deadline registered
[    0.580253] io scheduler kyber registered
[    0.585567] pinctrl-single 4301c000.pinctrl: 94 pins, size 376
[    0.591743] pinctrl-single 11c000.pinctrl: 173 pins, size 692
[    0.598142] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.605976] switchtec: loaded.
[    0.610726] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.616987] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.624779] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[    0.632941] arm-smmu-v3 36600000.iommu: ias 48-bit, oas 48-bit (features 0x00001faf)
[    0.641906] arm-smmu-v3 36600000.iommu: allocated 524288 entries for cmdq
[    0.650760] arm-smmu-v3 36600000.iommu: allocated 524288 entries for evtq
[    0.658474] arm-smmu-v3 36600000.iommu: msi_domain absent - falling back to wired irqs
[    0.671655] brd: module loaded
[    0.677412] loop: module loaded
[    0.681328] megasas: 07.714.04.00-rc1
[    0.686934] tun: Universal TUN/TAP device driver, 1.6
[    0.692399] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    0.698806] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    0.704878] sky2: driver version 1.30
[    0.709192] VFIO - User Level meta-driver version: 0.3
[    0.714891] i2c /dev entries driver
[    0.718772] Error: Driver 'k3-soc-thermal' is already registered, aborting...
[    0.726428] sdhci: Secure Digital Host Controller Interface driver
[    0.732745] sdhci: Copyright(c) Pierre Ossman
[    0.737453] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.743818] ledtrig-cpu: registered to indicate activity on CPUs
[    0.750131] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.757309] optee: probing for conduit method.
[    0.761866] optee: revision 3.12 (3d47a131)
[    0.762106] optee: initialized driver
[    0.771503] NET: Registered protocol family 17
[    0.776111] 9pnet: Installing 9P2000 support
[    0.780496] Key type dns_resolver registered
[    0.785003] Loading compiled-in X.509 certificates
[    0.794598] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.800948] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.809104] ti-sci 44083000.dmsc: ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
[    0.839177] random: fast init done
[    0.872571] davinci-mcasp 2ba0000.mcasp: IRQ common not found
[    0.880255] omap_i2c 40b00000.i2c: bus 0 rev0.12 at 100 kHz
[    0.886325] omap_i2c 40b10000.i2c: bus 1 rev0.12 at 100 kHz
[    0.892369] omap_i2c 42120000.i2c: bus 2 rev0.12 at 100 kHz
[    0.898825] pca953x 3-0020: supply vcc not found, using dummy regulator
[    0.905634] pca953x 3-0020: using no AI
[    0.931424] pca953x 3-0022: supply vcc not found, using dummy regulator
[    0.938223] pca953x 3-0022: using AI
[    0.942493] gpio-480 (CTRL_PM_I2C_OE): hogged as output/high
[    0.948467] gpio-481 (MCASP/TRACE_MUX_S0): hogged as output/low
[    0.954708] gpio-482 (MCASP/TRACE_MUX_S1): hogged as output/high
[    0.961196] omap_i2c 2000000.i2c: bus 3 rev0.12 at 400 kHz
[    0.967609] omap_i2c 2010000.i2c: bus 4 rev0.12 at 400 kHz
[    0.977638] omap_i2c 2020000.i2c: bus 5 rev0.12 at 400 kHz
[    0.983939] pca953x 6-0020: supply vcc not found, using dummy regulator
[    0.990758] pca953x 6-0020: using no AI
[    1.019294] omap_i2c 2030000.i2c: bus 6 rev0.12 at 400 kHz
[    1.025367] omap_i2c 2040000.i2c: bus 7 rev0.12 at 100 kHz
[    1.031325] omap_i2c 2050000.i2c: bus 8 rev0.12 at 100 kHz
[    1.037569] pca953x 9-0020: supply vcc not found, using dummy regulator
[    1.044382] pca953x 9-0020: using no AI
[    1.070934] omap_i2c 2060000.i2c: bus 9 rev0.12 at 400 kHz
[    1.077364] ti-sci-intr bus@100000:bus@28380000:interrupt-controller2: Interrupt Router 137 domain created
[    1.087349] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 131 domain created
[    1.096154] ti-sci-intr bus@100000:main-navss:interrupt-controller1: Interrupt Router 213 domain created
[    1.105994] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain 209 created
[    1.128290] j721e-pcie 2900000.pcie: J721E PROBE
[    1.133030] j721e-pcie 2900000.pcie: pcie->mode 0
[    1.137939] j721e-pcie 2900000.pcie: host bridge /bus@100000/pcie@2900000 ranges:
[    1.145603] j721e-pcie 2900000.pcie:       IO 0x0010001000..0x0010010fff -> 0x0010001000
[    1.153877] j721e-pcie 2900000.pcie:      MEM 0x0010011000..0x0017ffffff -> 0x0010011000
[    1.162155] j721e-pcie 2900000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
[    2.173516] j721e-pcie 2900000.pcie: PCI host bridge to bus 0000:00
[    2.179939] pci_bus 0000:00: root bus resource [bus 00-ff]
[    2.185551] pci_bus 0000:00: root bus resource [io  0x0000-0xffff] (bus address [0x10001000-0x10010fff])
[    2.195242] pci_bus 0000:00: root bus resource [mem 0x10011000-0x17ffffff]
[    2.202294] pci 0000:00:00.0: [104c:b00d] type 01 class 0x060400
[    2.208433] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[    2.218302] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[    2.228191] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0xe8 may corrupt adjacent RW1C bits
[    2.238150] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[    2.248118] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x92 may corrupt adjacent RW1C bits
[    2.258078] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0xb2 may corrupt adjacent RW1C bits
[    2.268062] pci 0000:00:00.0: supports D1
[    2.272156] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[    2.278027] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x84 may corrupt adjacent RW1C bits
[    2.288016] pci 0000:00:00.0: DPC: DPC init
[    2.293978] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 0
[    2.300831] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.309015] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[    2.318974] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[    2.328934] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 1
[    2.335784] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[    2.345781] pci 0000:00:00.0: write PRIMARY_BUS  00ff0100, busn_res.end 0x02x is_cardbus
[    2.355530] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    2.362300] pci 0000:00:00.0: PCI bridge to [bus 01]
[    2.367585] pcieport 0000:00:00.0: PME: Signaling with IRQ 61
[    2.373619] pcieport 0000:00:00.0: AER: enabled with IRQ 61
[    2.379432] j721e-pcie 2900000.pcie: PCI RC End
[    2.384382] j721e-pcie 2910000.pcie: J721E PROBE
[    2.389105] j721e-pcie 2910000.pcie: pcie->mode 0
[    2.394003] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
[    2.401666] j721e-pcie 2910000.pcie:       IO 0x0018001000..0x0018010fff -> 0x0018001000
[    2.409940] j721e-pcie 2910000.pcie:      MEM 0x0018011000..0x001fffffff -> 0x0018011000
[    2.418217] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
[    2.529401] j721e-pcie 2910000.pcie: Link up
[    2.533815] j721e-pcie 2910000.pcie: PCI host bridge to bus 0001:00
[    2.540221] pci_bus 0001:00: root bus resource [bus 00-ff]
[    2.545826] pci_bus 0001:00: root bus resource [io  0x10000-0x1ffff] (bus address [0x18001000-0x18010fff])
[    2.555693] pci_bus 0001:00: root bus resource [mem 0x18011000-0x1fffffff]
[    2.562740] pci 0001:00:00.0: [104c:b00d] type 01 class 0x060400
[    2.568940] pci 0001:00:00.0: supports D1
[    2.573034] pci 0001:00:00.0: PME# supported from D0 D1 D3hot
[    2.578937] pci 0001:00:00.0: DPC: DPC init
[    2.584847] pci 0001:00:00.0: scanning [bus 00-00] behind bridge, pass 0
[    2.591702] pci 0001:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.599888] pci 0001:00:00.0: scanning [bus 00-00] behind bridge, pass 1
[    2.606772] pci 0001:00:00.0: write PRIMARY_BUS  00ff0100, busn_res.end 0x02x is_cardbus
[    2.615094] pci 0001:01:00.0: [12d8:c232] type 01 class 0x060400
[    2.621251] pci 0001:01:00.0: reg 0x10: [mem 0x00000000-0x0007ffff]
[    2.627869] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[    2.634244] pci 0001:01:00.0: DPC: DPC init
[    2.638540] pci 0001:01:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0001:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[    2.664130] pci 0001:01:00.0: scanning [bus 00-00] behind bridge, pass 0
[    2.670982] pci 0001:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.679175] pci 0001:01:00.0: scanning [bus 00-00] behind bridge, pass 1
[    2.686110] pci 0001:01:00.0: write PRIMARY_BUS  00ff0201, busn_res.end 0x02x is_cardbus
[    2.694633] pci 0001:02:04.0: [12d8:c232] type 01 class 0x060400
[    2.701007] pci 0001:02:04.0: PME# supported from D0 D3hot D3cold
[    2.707370] pci 0001:02:04.0: DPC: DPC init
[    2.711654] pci 0001:02:04.0: DPC: dpc->cap 0x2a0
[    2.716674] pci 0001:02:06.0: [12d8:c232] type 01 class 0x060400
[    2.723052] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[    2.729413] pci 0001:02:06.0: DPC: DPC init
[    2.733698] pci 0001:02:06.0: DPC: dpc->cap 0x2a0
[    2.738751] pci 0001:02:09.0: [12d8:c232] type 01 class 0x060400
[    2.745076] pci 0001:02:09.0: PME# supported from D0 D3hot D3cold
[    2.751375] pci 0001:02:09.0: DPC: DPC init
[    2.756832] pci 0001:02:04.0: scanning [bus 00-00] behind bridge, pass 0
[    2.763681] pci 0001:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.771873] pci 0001:02:06.0: scanning [bus 00-00] behind bridge, pass 0
[    2.778719] pci 0001:02:06.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.786914] pci 0001:02:09.0: scanning [bus 00-00] behind bridge, pass 0
[    2.793761] pci 0001:02:09.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.801952] pci 0001:02:04.0: scanning [bus 00-00] behind bridge, pass 1
[    2.808877] pci 0001:02:04.0: write PRIMARY_BUS  00ff0302, busn_res.end 0x02x is_cardbus
[    2.818627] pci_bus 0001:03: busn_res: [bus 03-ff] end is updated to 03
[    2.825394] pci 0001:02:06.0: scanning [bus 00-00] behind bridge, pass 1
[    2.832320] pci 0001:02:06.0: write PRIMARY_BUS  00ff0402, busn_res.end 0x02x is_cardbus
[    2.842065] pci_bus 0001:04: busn_res: [bus 04-ff] end is updated to 04
[    2.848837] pci 0001:02:09.0: scanning [bus 00-00] behind bridge, pass 1
[    2.855763] pci 0001:02:09.0: write PRIMARY_BUS  00ff0502, busn_res.end 0x02x is_cardbus
[    2.864069] pci 0001:05:00.0: [12d8:c232] type 01 class 0x060400
[    2.870396] pci 0001:05:00.0: PME# supported from D0 D3hot D3cold
[    2.876694] pci 0001:05:00.0: DPC: DPC init
[    2.880981] pci 0001:05:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0001:00:00.0 (capable of 126.016 Gb/s with 8.0 GT/s PCIe x16 link)
[    2.898128] pci 0001:05:00.0: scanning [bus 00-00] behind bridge, pass 0
[    2.904976] pci 0001:05:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    2.913171] pci 0001:05:00.0: scanning [bus 00-00] behind bridge, pass 1
[    2.920109] pci 0001:05:00.0: write PRIMARY_BUS  00ff0605, busn_res.end 0x02x is_cardbus
[    2.928433] pci 0001:06:00.0: [12d8:c232] type 01 class 0x060400
[    2.934820] pci 0001:06:00.0: PME# supported from D0 D3hot D3cold
[    2.941189] pci 0001:06:00.0: DPC: DPC init
[    2.945475] pci 0001:06:00.0: DPC: dpc->cap 0x2a0
[    2.950494] pci 0001:06:02.0: [12d8:c232] type 01 class 0x060400
[    2.956880] pci 0001:06:02.0: PME# supported from D0 D3hot D3cold
[    2.963247] pci 0001:06:02.0: DPC: DPC init
[    2.967532] pci 0001:06:02.0: DPC: dpc->cap 0x2a0
[    2.972554] pci 0001:06:04.0: [12d8:c232] type 01 class 0x060400
[    2.978941] pci 0001:06:04.0: PME# supported from D0 D3hot D3cold
[    2.985309] pci 0001:06:04.0: DPC: DPC init
[    2.989594] pci 0001:06:04.0: DPC: dpc->cap 0x2a0
[    2.994620] pci 0001:06:06.0: [12d8:c232] type 01 class 0x060400
[    3.001004] pci 0001:06:06.0: PME# supported from D0 D3hot D3cold
[    3.007372] pci 0001:06:06.0: DPC: DPC init
[    3.011656] pci 0001:06:06.0: DPC: dpc->cap 0x2a0
[    3.017806] pci 0001:06:00.0: scanning [bus 00-00] behind bridge, pass 0
[    3.024654] pci 0001:06:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    3.032849] pci 0001:06:02.0: scanning [bus 00-00] behind bridge, pass 0
[    3.039696] pci 0001:06:02.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    3.047887] pci 0001:06:04.0: scanning [bus 00-00] behind bridge, pass 0
[    3.054734] pci 0001:06:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    3.062926] pci 0001:06:06.0: scanning [bus 00-00] behind bridge, pass 0
[    3.069772] pci 0001:06:06.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    3.077964] pci 0001:06:00.0: scanning [bus 00-00] behind bridge, pass 1
[    3.084905] pci 0001:06:00.0: write PRIMARY_BUS  00ff0706, busn_res.end 0x02x is_cardbus
[    3.094668] pci_bus 0001:07: busn_res: [bus 07-ff] end is updated to 07
[    3.101436] pci 0001:06:02.0: scanning [bus 00-00] behind bridge, pass 1
[    3.108364] pci 0001:06:02.0: write PRIMARY_BUS  00ff0806, busn_res.end 0x02x is_cardbus
[    3.116716] pci 0001:08:00.0: [104c:b00d] type 00 class 0xff0000
[    3.122881] pci 0001:08:00.0: reg 0x10: [mem 0x00000000-0x000001ff]
[    3.129296] pci 0001:08:00.0: reg 0x14: [mem 0x00000000-0x000001ff]
[    3.135712] pci 0001:08:00.0: reg 0x18: [mem 0x00000000-0x000003ff]
[    3.142126] pci 0001:08:00.0: reg 0x1c: [mem 0x00000000-0x00003fff]
[    3.148541] pci 0001:08:00.0: reg 0x20: [mem 0x00000000-0x0001ffff]
[    3.154959] pci 0001:08:00.0: reg 0x24: [mem 0x00000000-0x000fffff]
[    3.161678] pci 0001:08:00.0: supports D1
[    3.165771] pci 0001:08:00.0: PME# supported from D0 D1 D3hot
[    3.171729] pci 0001:08:00.0: reg 0x224: [mem 0x00000000-0x003fffff 64bit]
[    3.178755] pci 0001:08:00.0: VF(n) BAR0 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR0 for 4 VFs)
[    3.188950] pci 0001:08:00.0: DPC: DPC init
[    3.194878] pci_bus 0001:08: busn_res: [bus 08-ff] end is updated to 08
[    3.201647] pci 0001:06:04.0: scanning [bus 00-00] behind bridge, pass 1
[    3.208575] pci 0001:06:04.0: write PRIMARY_BUS  00ff0906, busn_res.end 0x02x is_cardbus
[    3.218333] pci_bus 0001:09: busn_res: [bus 09-ff] end is updated to 09
[    3.225101] pci 0001:06:06.0: scanning [bus 00-00] behind bridge, pass 1
[    3.232028] pci 0001:06:06.0: write PRIMARY_BUS  00ff0a06, busn_res.end 0x02x is_cardbus
[    3.241781] pci_bus 0001:0a: busn_res: [bus 0a-ff] end is updated to 0a
[    3.248547] pci_bus 0001:06: busn_res: [bus 06-ff] end is updated to 0a
[    3.255312] pci_bus 0001:05: busn_res: [bus 05-ff] end is updated to 0a
[    3.262076] pci_bus 0001:02: busn_res: [bus 02-ff] end is updated to 0a
[    3.268840] pci_bus 0001:01: busn_res: [bus 01-ff] end is updated to 0a
[    3.275626] pci 0001:00:00.0: BAR 14: assigned [mem 0x18100000-0x195fffff]
[    3.282653] pci 0001:00:00.0: BAR 15: assigned [mem 0x19600000-0x197fffff 64bit pref]
[    3.290655] pci 0001:00:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[    3.297149] pci 0001:01:00.0: BAR 14: assigned [mem 0x18200000-0x195fffff]
[    3.304174] pci 0001:01:00.0: BAR 15: assigned [mem 0x19600000-0x197fffff 64bit pref]
[    3.312176] pci 0001:01:00.0: BAR 0: assigned [mem 0x18100000-0x1817ffff]
[    3.319116] pci 0001:01:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[    3.325609] pci 0001:02:09.0: BAR 14: assigned [mem 0x18200000-0x195fffff]
[    3.332635] pci 0001:02:09.0: BAR 15: assigned [mem 0x19600000-0x197fffff 64bit pref]
[    3.340639] pci 0001:02:09.0: BAR 13: assigned [io  0x10000-0x10fff]
[    3.347132] pci 0001:02:04.0: PCI bridge to [bus 03]
[    3.352220] pci 0001:02:06.0: PCI bridge to [bus 04]
[    3.357310] pci 0001:05:00.0: BAR 14: assigned [mem 0x18200000-0x195fffff]
[    3.364336] pci 0001:05:00.0: BAR 15: assigned [mem 0x19600000-0x197fffff 64bit pref]
[    3.372338] pci 0001:05:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[    3.378832] pci 0001:06:02.0: BAR 14: assigned [mem 0x18200000-0x193fffff]
[    3.385858] pci 0001:06:04.0: BAR 14: assigned [mem 0x19400000-0x195fffff]
[    3.392882] pci 0001:06:04.0: BAR 15: assigned [mem 0x19600000-0x197fffff 64bit pref]
[    3.400886] pci 0001:06:04.0: BAR 13: assigned [io  0x10000-0x10fff]
[    3.407378] pci 0001:06:00.0: PCI bridge to [bus 07]
[    3.412469] pci 0001:08:00.0: BAR 7: assigned [mem 0x18400000-0x193fffff 64bit]
[    3.419947] pci 0001:08:00.0: BAR 5: assigned [mem 0x18200000-0x182fffff]
[    3.426888] pci 0001:08:00.0: BAR 4: assigned [mem 0x18300000-0x1831ffff]
[    3.433830] pci 0001:08:00.0: BAR 3: assigned [mem 0x18320000-0x18323fff]
[    3.440771] pci 0001:08:00.0: BAR 2: assigned [mem 0x18324000-0x183243ff]
[    3.447712] pci 0001:08:00.0: BAR 0: assigned [mem 0x18324400-0x183245ff]
[    3.454653] pci 0001:08:00.0: BAR 1: assigned [mem 0x18324600-0x183247ff]
[    3.461596] pci 0001:06:02.0: PCI bridge to [bus 08]
[    3.466673] pci 0001:06:02.0:   bridge window [mem 0x18200000-0x193fffff]
[    3.473621] pci 0001:06:04.0: PCI bridge to [bus 09]
[    3.478693] pci 0001:06:04.0:   bridge window [io  0x10000-0x10fff]
[    3.485101] pci 0001:06:04.0:   bridge window [mem 0x19400000-0x195fffff]
[    3.492041] pci 0001:06:04.0:   bridge window [mem 0x19600000-0x197fffff 64bit pref]
[    3.499962] pci 0001:06:06.0: PCI bridge to [bus 0a]
[    3.505050] pci 0001:05:00.0: PCI bridge to [bus 06-0a]
[    3.510389] pci 0001:05:00.0:   bridge window [io  0x10000-0x10fff]
[    3.516797] pci 0001:05:00.0:   bridge window [mem 0x18200000-0x195fffff]
[    3.523738] pci 0001:05:00.0:   bridge window [mem 0x19600000-0x197fffff 64bit pref]
[    3.531660] pci 0001:02:09.0: PCI bridge to [bus 05-0a]
[    3.536998] pci 0001:02:09.0:   bridge window [io  0x10000-0x10fff]
[    3.543406] pci 0001:02:09.0:   bridge window [mem 0x18200000-0x195fffff]
[    3.550346] pci 0001:02:09.0:   bridge window [mem 0x19600000-0x197fffff 64bit pref]
[    3.558266] pci 0001:01:00.0: PCI bridge to [bus 02-0a]
[    3.563605] pci 0001:01:00.0:   bridge window [io  0x10000-0x10fff]
[    3.570013] pci 0001:01:00.0:   bridge window [mem 0x18200000-0x195fffff]
[    3.576953] pci 0001:01:00.0:   bridge window [mem 0x19600000-0x197fffff 64bit pref]
[    3.584875] pci 0001:00:00.0: PCI bridge to [bus 01-0a]
[    3.590212] pci 0001:00:00.0:   bridge window [io  0x10000-0x10fff]
[    3.596615] pci 0001:00:00.0:   bridge window [mem 0x18100000-0x195fffff]
[    3.603551] pci 0001:00:00.0:   bridge window [mem 0x19600000-0x197fffff 64bit pref]
[    3.611560] pcieport 0001:00:00.0: enabling device (0000 -> 0003)
[    3.617907] pcieport 0001:00:00.0: PME: Signaling with IRQ 64
[    3.623956] pcieport 0001:00:00.0: AER: enabled with IRQ 64
[    3.629814] pcieport 0001:01:00.0: enabling device (0000 -> 0003)
[    3.637115] pcieport 0001:02:04.0: DPC: DPC probe
[    3.642013] pcieport 0001:02:04.0: DPC: enabled with IRQ 70
[    3.647712] pcieport 0001:02:04.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.661043] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.668260] pcieport 0001:02:06.0: DPC: DPC probe
[    3.673139] pcieport 0001:02:06.0: DPC: enabled with IRQ 74
[    3.678854] pcieport 0001:02:06.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.692183] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.698957] pcieport 0001:02:09.0: enabling device (0000 -> 0003)
[    3.705734] pcieport 0001:05:00.0: enabling device (0000 -> 0003)
[    3.712513] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.719723] pcieport 0001:06:00.0: DPC: DPC probe
[    3.724621] pcieport 0001:06:00.0: DPC: enabled with IRQ 80
[    3.730324] pcieport 0001:06:00.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.743692] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.750484] pcieport 0001:06:02.0: enabling device (0000 -> 0002)
[    3.757151] pcieport 0001:06:02.0: DPC: DPC probe
[    3.762038] pcieport 0001:06:02.0: DPC: enabled with IRQ 84
[    3.767733] pcieport 0001:06:02.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.781070] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.787843] pcieport 0001:06:04.0: enabling device (0000 -> 0003)
[    3.794548] pcieport 0001:06:04.0: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+
[    3.808453] pcieport 0001:06:04.0: pciehp: Slot(0): Card present
[    3.808470] pcieport 0001:06:04.0: DPC: DPC probe
[    3.819476] pcieport 0001:06:04.0: DPC: enabled with IRQ 88
[    3.825174] pcieport 0001:06:04.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.838522] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.845740] pcieport 0001:06:06.0: DPC: DPC probe
[    3.850630] pcieport 0001:06:06.0: DPC: enabled with IRQ 92
[    3.856327] pcieport 0001:06:06.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[    3.869695] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[    3.876472] pci-endpoint-test 0001:08:00.0: enabling device (0000 -> 0002)
[    3.883612] j721e-pcie 2910000.pcie: PCI RC End
[    3.888562] j721e-pcie 2920000.pcie: J721E PROBE
[    3.893284] j721e-pcie 2920000.pcie: pcie->mode 0
[    3.898183] j721e-pcie 2920000.pcie: host bridge /bus@100000/pcie@2920000 ranges:
[    3.905853] j721e-pcie 2920000.pcie:       IO 0x4400001000..0x4400010fff -> 0x0000001000
[    3.914129] j721e-pcie 2920000.pcie:      MEM 0x4400011000..0x4407ffffff -> 0x0000011000
[    3.922408] j721e-pcie 2920000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
[    4.033748] j721e-pcie 2920000.pcie: Link up
[    4.038167] j721e-pcie 2920000.pcie: PCI host bridge to bus 0002:00
[    4.044574] pci_bus 0002:00: root bus resource [bus 00-ff]
[    4.050178] pci_bus 0002:00: root bus resource [io  0x20000-0x2ffff] (bus address [0x1000-0x10fff])
[    4.059424] pci_bus 0002:00: root bus resource [mem 0x4400011000-0x4407ffffff] (bus address [0x00011000-0x07ffffff])
[    4.070201] pci 0002:00:00.0: [104c:b00d] type 01 class 0x060400
[    4.076402] pci 0002:00:00.0: supports D1
[    4.080496] pci 0002:00:00.0: PME# supported from D0 D1 D3hot
[    4.086400] pci 0002:00:00.0: DPC: DPC init
[    4.092329] pci 0002:00:00.0: scanning [bus 00-00] behind bridge, pass 0
[    4.099185] pci 0002:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    4.107370] pci 0002:00:00.0: scanning [bus 00-00] behind bridge, pass 1
[    4.114257] pci 0002:00:00.0: write PRIMARY_BUS  00ff0100, busn_res.end 0x02x is_cardbus
[    4.122564] pci 0002:01:00.0: [2646:500d] type 00 class 0x010802
[    4.128733] pci 0002:01:00.0: reg 0x10: [mem 0x00000000-0x00003fff 64bit]
[    4.135946] pci 0002:01:00.0: DPC: DPC init
[    4.140235] pci 0002:01:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0002:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[    4.168131] pci_bus 0002:01: busn_res: [bus 01-ff] end is updated to 01
[    4.174907] pci 0002:00:00.0: BAR 14: assigned [mem 0x4400100000-0x44001fffff]
[    4.182289] pci 0002:01:00.0: BAR 0: assigned [mem 0x4400100000-0x4400103fff 64bit]
[    4.190128] pci 0002:00:00.0: PCI bridge to [bus 01]
[    4.195201] pci 0002:00:00.0:   bridge window [mem 0x4400100000-0x44001fffff]
[    4.202584] pcieport 0002:00:00.0: enabling device (0000 -> 0002)
[    4.208928] pcieport 0002:00:00.0: PME: Signaling with IRQ 97
[    4.214956] pcieport 0002:00:00.0: AER: enabled with IRQ 97
[    4.220792] j721e-pcie 2920000.pcie: PCI RC End
[    4.226224] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,20] sci-dev-id:235
[    4.236101] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
[    4.242859] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    4.251773] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:1024, gp-rings[440,150] sci-dev-id:211
[    4.261922] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
[    4.268680] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    4.276630] 40a00000.serial: ttyS1 at MMIO 0x40a00000 (irq = 15, base_baud = 6000000) is a 8250
[    4.285998] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 33, base_baud = 3000000) is a 8250
[    4.294746] printk: console [ttyS2] enabled
[    4.294746] printk: console [ttyS2] enabled
[    4.303183] printk: bootconsole [ns16550a0] disabled
[    4.303183] printk: bootconsole [ns16550a0] disabled
[    4.313636] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 34, base_baud = 3000000) is a 8250
[    4.322566] 2840000.serial: ttyS6 at MMIO 0x2840000 (irq = 35, base_baud = 3000000) is a 8250
[    4.332677] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vdd-hba-supply regulator, assuming enabled
[    4.343185] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vcc-supply regulator, assuming enabled
[    4.353336] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vccq-supply regulator, assuming enabled
[    4.363575] cdns-ufshcd 4e84000.ufs: ufshcd_populate_vreg: Unable to find vccq2-supply regulator, assuming enabled
[    4.374445] scsi host0: ufshcd
[    4.396404] cdns-ufshcd 4e84000.ufs: ufshcd_print_pwr_info:[RX, TX]: gear=[1, 1], lane[1, 1], pwr[SLOWAUTO_MODE, SLOWAUTO_MODE], rate = 0
[    4.418617] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    4.427578] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    4.435876] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00101, cpsw version 0x6BA80100 Ports: 2 quirks:00000000
[    4.449627] cdns-ufshcd 4e84000.ufs: ufshcd_print_pwr_info:[RX, TX]: gear=[3, 3], lane[2, 2], pwr[FAST MODE, FAST MODE], rate = 2
[    4.461308] cdns-ufshcd 4e84000.ufs: ufshcd_find_max_sup_active_icc_level: Regulator capability was not set, actvIccLevel=0
[    4.461499] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010a, freq:200000000, add_val:4 pps:0
[    4.472602] scsi 0:0:0:49488: Well-known LUN    TOSHIBA  THGAF8G8T23BAILB 0300 PQ: 0 ANSI: 6
[    4.489038] davinci-mcasp 2ba0000.mcasp: IRQ common not found
[    4.490853] mmc0: CQHCI version 5.10
[    4.498532] scsi 0:0:0:49476: Well-known LUN    TOSHIBA  THGAF8G8T23BAILB 0300 PQ: 0 ANSI: 6
[    4.507404] cdns-ufshcd 4e84000.ufs: ufshcd_scsi_add_wlus: BOOT WLUN not found
[    4.514839] scsi 0:0:0:0: Direct-Access     TOSHIBA  THGAF8G8T23BAILB 0300 PQ: 0 ANSI: 6
[    4.523141] sd 0:0:0:0: Power-on or device reset occurred
[    4.528794] scsi 0:0:0:1: Direct-Access     TOSHIBA  THGAF8G8T23BAILB 0300 PQ: 0 ANSI: 6
[    4.536997] sd 0:0:0:0: [sda] 8192 4096-byte logical blocks: (33.6 MB/32.0 MiB)
[    4.538689] sd 0:0:0:1: Power-on or device reset occurred
[    4.544349] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
[    4.549878] sd 0:0:0:1: [sdb] 7808000 4096-byte logical blocks: (32.0 GB/29.8 GiB)
[    4.557309] sd 0:0:0:0: [sda] Write Protect is off
[    4.564827] sd 0:0:0:1: [sdb] Write Protect is off
[    4.574382] sd 0:0:0:1: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    4.574385] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    4.582927] sd 0:0:0:1: [sdb] Optimal transfer size 65536 bytes
[    4.597335] sd 0:0:0:0: [sda] Optimal transfer size 65536 bytes
[    4.604549] sd 0:0:0:1: [sdb] Attached SCSI disk
[    4.610711] vdd_mmc1: supplied by vsys_3v3
[    4.614691] sd 0:0:0:0: [sda] Attached SCSI disk
[    4.620179] pca953x 4-0020: supply vcc not found, using dummy regulator
[    4.626849] pca953x 4-0020: using no AI
[    4.655635] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc7100
[    4.662486] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc7100
[    4.669356] omap-mailbox 31f82000.mailbox: omap mailbox rev 0x66fc7100
[    4.676196] omap-mailbox 31f83000.mailbox: omap mailbox rev 0x66fc7100
[    4.682995] omap-mailbox 31f84000.mailbox: omap mailbox rev 0x66fc7100
[    4.693457] ti-udma 285c0000.dma-controller: Channels: 26 (tchan: 13, rchan: 13, gp-rflow: 8)
[    4.704043] ti-udma 31150000.dma-controller: Channels: 122 (tchan: 61, rchan: 61, gp-rflow: 16)
[    4.718565] spi-nor spi0.0: mt35xu512aba (65536 Kbytes)
[    4.723848] 8 cmdlinepart partitions found on MTD device 47040000.spi.0
[    4.730481] Creating 8 MTD partitions on "47040000.spi.0":
[    4.735992] 0x000000000000-0x000000080000 : "ospi.tiboot3"
[    4.742163] 0x000000080000-0x000000280000 : "ospi.tispl"
[    4.748124] 0x000000280000-0x000000680000 : "ospi.u-boot"
[    4.753633] mmc0: Command Queue Engine enabled
[    4.758073] mmc0: new HS200 MMC card at address 0001
[    4.763448] 0x000000680000-0x0000006c0000 : "ospi.env"
[    4.768722] mmcblk0: mmc0:0001 S0J56X 14.8 GiB
[    4.773353] mmcblk0boot0: mmc0:0001 S0J56X partition 1 31.5 MiB
[    4.779503] mmcblk0boot1: mmc0:0001 S0J56X partition 2 31.5 MiB
[    4.785763] 0x0000006c0000-0x0000007c0000 : "ospi.sysfw"
[    4.791103] mmcblk0rpmb: mmc0:0001 S0J56X partition 3 4.00 MiB, chardev (236:0)
[    4.798741] 0x0000007c0000-0x000000800000 : "ospi.env.backup"
[    4.805320] 0x000000800000-0x000003fc0000 : "ospi.rootfs"
[    4.812165] 0x000003fc0000-0x000004000000 : "ospi.phypattern"
[    4.820963] spi-nor spi1.0: mt25qu512a (65536 Kbytes)
[    4.866623] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    4.875439] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    4.883731] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00101, cpsw version 0x6BA80100 Ports: 2 quirks:00000000
[    4.897316] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
[    4.904295] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    4.911505] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    4.917813] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010a, freq:500000000, add_val:1 pps:0
[    4.928128] davinci-mcasp 2ba0000.mcasp: IRQ common not found
[    4.928503] mmc1: CQHCI version 5.10
[    4.945534] debugfs: Directory 'pd:27' with parent 'pm_genpd' already present!
[    4.952780] debugfs: Directory 'pd:26' with parent 'pm_genpd' already present!
[    4.960965] debugfs: Directory 'pd:242' with parent 'pm_genpd' already present!
[    4.968286] debugfs: Directory 'pd:241' with parent 'pm_genpd' already present!
[    4.975590] debugfs: Directory 'pd:240' with parent 'pm_genpd' already present!
[    4.982898] debugfs: Directory 'pd:239' with parent 'pm_genpd' already present!
[    4.991077] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[    5.011747] ALSA device list:
[    5.014713]   No soundcards found.
[    5.882620] pcieport 0001:06:04.0: pciehp: Slot(0): No link
[    5.998812] mmc1: SDHCI controller on 4fb0000.mmc [4fb0000.mmc] using ADMA 64-bit
[    6.006574] Waiting for root device PARTUUID=f2fdac57-02...
[    6.055904] mmc1: new ultra high speed DDR50 SDHC card at address 5048
[    6.062733] mmcblk1: mmc1:5048 SDCIT 15.0 GiB
[    6.069934]  mmcblk1: p1 p2
[    6.422110] EXT4-fs (mmcblk1p2): recovery complete
[    6.429181] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
[    6.437290] VFS: Mounted root (ext4 filesystem) on device 179:98.
[    6.444297] devtmpfs: mounted
[    6.447571] Freeing unused kernel memory: 1984K
[    6.452120] Run /sbin/init as init process
[    6.601622] systemd[1]: System time before build time, advancing clock.
[    6.654316] NET: Registered protocol family 10
[    6.659220] Segment Routing with IPv6
[    6.675050] systemd[1]: systemd 244 running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
[    6.696532] systemd[1]: Detected architecture arm64.

Welcome to Arago 2021.09!

[    6.727583] systemd[1]: Set hostname to <j7-evm>.
[    6.904326] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly.
[    6.967444] random: systemd: uninitialized urandom read (16 bytes read)
[    6.974153] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[    6.986478] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[    6.996419] systemd[1]: Created slice system-getty.slice.
[  OK  ] Created slice system-getty.slice.
[    7.018695] random: systemd: uninitialized urandom read (16 bytes read)
[    7.025944] systemd[1]: Created slice system-serial\x2dgetty.slice.
[  OK  ] Created slice system-serial\x2dgetty.slice.
[    7.046682] random: systemd: uninitialized urandom read (16 bytes read)
[    7.053882] systemd[1]: Created slice system-serial\x2dgetty9600.slice.
[  OK  ] Created slice system-serial\x2dgetty9600.slice.
[    7.075312] systemd[1]: Created slice User and Session Slice.
[  OK  ] Created slice User and Session Slice.
[    7.098802] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Dispatch Password …ts to Console Directory Watch.
[    7.122729] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[  OK  ] Started Forward Password R…uests to Wall Directory Watch.
[    7.146735] systemd[1]: Reached target Paths.
[  OK  ] Reached target Paths.
[    7.162665] systemd[1]: Reached target Remote File Systems.
[  OK  ] Reached target Remote File Systems.
[    7.182661] systemd[1]: Reached target Slices.
[  OK  ] Reached target Slices.
[    7.198668] systemd[1]: Reached target Swap.
[  OK  ] Reached target Swap.
[    7.216241] systemd[1]: Listening on RPCbind Server Activation Socket.
[  OK  ] Listening on RPCbind Server Activation Socket.
[    7.238694] systemd[1]: Reached target RPC Port Mapper.
[  OK  ] Reached target RPC Port Mapper.
[    7.261299] systemd[1]: Listening on Process Core Dump Socket.
[  OK  ] Listening on Process Core Dump Socket.
[    7.282786] systemd[1]: Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[    7.314473] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
[    7.322798] systemd[1]: Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket (/dev/log).
[    7.342880] systemd[1]: Listening on Journal Socket.
[  OK  ] Listening on Journal Socket.
[    7.358929] systemd[1]: Listening on Network Service Netlink Socket.
[  OK  ] Listening on Network Service Netlink Socket.
[    7.382857] systemd[1]: Listening on udev Control Socket.
[  OK  ] Listening on udev Control Socket.
[    7.402760] systemd[1]: Listening on udev Kernel Socket.
[  OK  ] Listening on udev Kernel Socket.
[    7.425297] systemd[1]: Mounting Huge Pages File System...
         Mounting Huge Pages File System...
[    7.444763] systemd[1]: Mounting POSIX Message Queue File System...
         Mounting POSIX Message Queue File System...
[    7.468751] systemd[1]: Mounting Kernel Debug File System...
         Mounting Kernel Debug File System...
[    7.490179] systemd[1]: Mounting Temporary Directory (/tmp)...
         Mounting Temporary Directory (/tmp)...
[    7.508943] systemd[1]: Starting Create list of static device nodes for the current kernel...
         Starting Create list of st…odes for the current kernel...
[    7.537405] systemd[1]: Starting Start psplash boot splash screen...
         Starting Start psplash boot splash screen...
[    7.561490] systemd[1]: Starting RPC Bind...
         Starting RPC Bind...
[    7.578815] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[    7.590546] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    7.614974] systemd[1]: Starting Load Kernel Modules...
         Starting Load Kernel Modules...
[    7.628994] systemd[1]: Starting Remount Root and Kernel File Systems...
         Starting Remount Root and Kernel File Systems...
[    7.646347] EXT4-fs (mmcblk1p2): re-mounted. Opts: (null)
[    7.647113] cryptodev: loading out-of-tree module taints kernel.
[    7.661057] systemd[1]: Starting udev Coldplug all Devices...
         Starting udev Coldplug all Devices...[    7.672714] cryptodev: driver 1.10 loaded.

[    7.689281] systemd[1]: Started RPC Bind.
[  OK  ] Started RPC Bind.
[    7.707087] systemd[1]: Mounted Huge Pages File System.
[  OK  ] Mounted Huge Pages File System.
[    7.727030] systemd[1]: Mounted POSIX Message Queue File System.
[  OK  ] Mounted POSIX Message Queue File System.
[    7.755076] systemd[1]: Mounted Kernel Debug File System.
[  OK  ] Mounted Kernel Debug File System.
[    7.778977] systemd[1]: Mounted Temporary Directory (/tmp).
[  OK  ] Mounted Temporary Directory (/tmp).
[    7.802947] systemd[1]: Started Journal Service.
[  OK  ] Started Journal Service.
[  OK  ] Started Create list of sta… nodes for the current kernel.
[FAILED] Failed to start Start psplash boot splash screen.
See 'systemctl status psplash-start.service' for details.
[DEPEND] Dependency failed for Star…progress communication helper.
[  OK  ] Started Load Kernel Modules.
[  OK  ] Started Remount Root and Kernel File Systems.
         Mounting Kernel Configuration File System...
         Starting Flush Journal to Persistent Storage...
[    7.954785] systemd-journald[186]: Received client request to flush runtime journal.
         Starting Apply Kernel Variables...
         Starting Create Static Device Nodes in /dev...
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Started Flush Journal to Persistent Storage.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
         Mounting /media/ram...
         Mounting /var/volatile...
         Starting udev Kernel Device Manager...
[  OK  ] Started udev Coldplug all Devices.
[  OK  ] Mounted /media/ram.
[  OK  ] Mounted /var/volatile.
         Starting udev Wait for Complete Device Initialization...
         Starting Load/Save Random Seed...
[  OK  ] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
[  OK  ] Started udev Kernel Device Manager.
[  OK  ] Started Create Volatile Files and Directories.
         Starting Network Time Synchronization...
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Started Update UTMP about System Boot/Shutdown.
[  OK  ] Started Network Time Synchronization.
[  OK  ] Reached target System Time Set.
[  OK  ] Reached target System Time Synchronized.
[    8.409525] CAN device driver interface
[    8.590965] ina2xx 5-0040: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.606004] ina2xx 5-0041: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.631347] ina2xx 5-0042: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.640001] ina2xx 5-0043: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.647389] ina2xx 5-0044: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.656376] ina2xx 5-0045: power monitor ina226 (Rshunt = 5000 uOhm)
[    8.665462] ina2xx 5-0046: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.673498] ina2xx 5-0047: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.685401] ina2xx 5-0048: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.693675] ina2xx 5-0049: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.716262] ina2xx 5-004a: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.725034] ina2xx 5-004b: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.733113] ina2xx 5-004c: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.742877] ina2xx 5-004d: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.754535] ina2xx 5-004e: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.781067] ina2xx 5-004f: power monitor ina226 (Rshunt = 10000 uOhm)
[    8.789656] nvme nvme0: pci function 0002:01:00.0
[    8.795298] nvme 0002:01:00.0: enabling device (0000 -> 0002)
[    8.808597] nvme nvme0: missing or invalid SUBNQN field.
[    8.817858] nvme nvme0: 2/0/0 default/read/poll queues
[    8.850719] img_enc 4200000.video-encoder: vxe_enc_probe: using heap 1 for internal alloc
[    8.928095] img_enc 4200000.video-encoder: encoder registered as /dev/video0
[    8.983642] k3-dsp-rproc 4d80800000.dsp: assigned reserved memory node c66-dma-memory@a7000000
[    9.079167] k3-dsp-rproc 4d80800000.dsp: configured DSP for remoteproc mode
[    9.092163] PVR_K:  222: Read BVNC 22.104.208.318 from HW device registers
[    9.131693] [drm] Initialized tidss 1.0.0 20180215 for 4a00000.dss on minor 1
[    9.138879] tidss 4a00000.dss: [drm] Cannot find any crtc or sizes
[    9.166926] img_dec 4300000.video-decoder: decoder registered as /dev/video1
[    9.178849] PVR_K:  222: RGX Device registered with BVNC 22.104.208.318
[    9.214850] platform 41000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[    9.299118] k3-dsp-rproc 4d80800000.dsp: local reset is deasserted for device
[    9.310268] [drm] Initialized pvr 1.13.5776728 20170530 for 4e20000000.gpu on minor 0
[    9.411322] remoteproc remoteproc0: 4d80800000.dsp is available
[    9.431387] platform 41000000.r5f: configured R5F for IPC-only mode
[    9.454971] remoteproc remoteproc0: powering up 4d80800000.dsp
[    9.461128] k3-dsp-rproc 4d81800000.dsp: assigned reserved memory node c66-dma-memory@a6000000
[    9.461349] remoteproc remoteproc0: Booting fw image j7-c66_0-fw, size 144692
[    9.481794] k3-dsp-rproc 4d80800000.dsp: booting DSP core using boot addr = 0xa6200400
[    9.494788]  remoteproc0#vdev0buffer: assigned reserved memory node c66-dma-memory@a7000000
[    9.506019] platform 41000000.r5f: assigned reserved memory node r5f-dma-memory@a0000000
[    9.506903] virtio_rpmsg_bus virtio0: rpmsg host is online
[    9.519614]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
[    9.520858] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
[    9.525701] remoteproc remoteproc0: remote processor 4d80800000.dsp is now up
[    9.539479] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
[    9.548157] k3-dsp-rproc 4d81800000.dsp: configured DSP for remoteproc mode
[    9.569392] remoteproc remoteproc1: 41000000.r5f is available
[    9.573864] k3-dsp-rproc 4d81800000.dsp: local reset is deasserted for device
[    9.575196] remoteproc remoteproc1: attaching to 41000000.r5f
[    9.588137] platform 41000000.r5f: R5F core initialized in IPC-only mode
[    9.594850]  remoteproc1#vdev0buffer: assigned reserved memory node r5f-dma-memory@a0000000
[    9.606578] virtio_rpmsg_bus virtio1: rpmsg host is online
[    9.614852]  remoteproc1#vdev0buffer: registered virtio1 (type 7)
[    9.623660] virtio_rpmsg_bus virtio1: creating channel ti.ipc4.ping-pong addr 0xd
[    9.631284] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0xe
[    9.672181] remoteproc remoteproc1: remote processor 41000000.r5f is now attached
[    9.728255] remoteproc remoteproc2: 4d81800000.dsp is available
[    9.754333] platform 5c00000.r5f: configured R5F for remoteproc mode
[    9.765810] remoteproc remoteproc2: powering up 4d81800000.dsp
[    9.771884] remoteproc remoteproc2: Booting fw image j7-c66_1-fw, size 144692
[    9.777097] k3-dsp-rproc 64800000.dsp: assigned reserved memory node c71-dma-memory@a8000000
[    9.787715] k3-dsp-rproc 4d81800000.dsp: booting DSP core using boot addr = 0xa7200400
[    9.797242]  remoteproc2#vdev0buffer: assigned reserved memory node c66-dma-memory@a6000000
[    9.806718] virtio_rpmsg_bus virtio2: rpmsg host is online
[    9.812261]  remoteproc2#vdev0buffer: registered virtio2 (type 7)
[    9.813781] virtio_rpmsg_bus virtio2: creating channel ti.ipc4.ping-pong addr 0xd
[    9.822653] remoteproc remoteproc2: remote processor 4d81800000.dsp is now up
[    9.831248] virtio_rpmsg_bus virtio2: creating channel rpmsg_chrdev addr 0xe
[    9.848685] platform 5c00000.r5f: assigned reserved memory node r5f-dma-memory@a2000000
[    9.857804] k3-dsp-rproc 64800000.dsp: configured DSP for remoteproc mode
[    9.860017] remoteproc remoteproc3: 5c00000.r5f is available
[    9.866724] remoteproc remoteproc4: 64800000.dsp is available
[    9.962837] platform 5d00000.r5f: configured R5F for remoteproc mode
[   10.038716] remoteproc remoteproc3: powering up 5c00000.r5f
[   10.044339] remoteproc remoteproc3: Booting fw image j7-main-r5f0_0-fw, size 626036
[   10.056881]  remoteproc3#vdev0buffer: assigned reserved memory node r5f-dma-memory@a2000000
[   10.066034] platform 5d00000.r5f: assigned reserved memory node r5f-dma-memory@a3000000
[   10.074353] virtio_rpmsg_bus virtio3: rpmsg host is online
[   10.080341]  remoteproc3#vdev0buffer: registered virtio3 (type 7)
[   10.086492] remoteproc remoteproc3: remote processor 5c00000.r5f is now up
[   10.094417] remoteproc remoteproc5: 5d00000.r5f is available
[   10.115239] platform 5e00000.r5f: configured R5F for remoteproc mode
[   10.155884] remoteproc remoteproc5: powering up 5d00000.r5f
[   10.161542] remoteproc remoteproc5: Booting fw image j7-main-r5f0_1-fw, size 98444
[   10.171720]  remoteproc5#vdev0buffer: assigned reserved memory node r5f-dma-memory@a3000000
[   10.182923] virtio_rpmsg_bus virtio4: rpmsg host is online
[   10.188480]  remoteproc5#vdev0buffer: registered virtio4 (type 7)
[   10.189548] platform 5e00000.r5f: assigned reserved memory node r5f-dma-memory@a4000000
[   10.194974] remoteproc remoteproc5: remote processor 5d00000.r5f is now up
[   10.202736] virtio_rpmsg_bus virtio4: creating channel ti.ipc4.ping-pong addr 0xd
[   10.219557] remoteproc remoteproc4: powering up 64800000.dsp
[   10.225213] remoteproc remoteproc4: Booting fw image j7-c71_0-fw, size 10489000
[   10.234682] remoteproc remoteproc4: unsupported resource 65538
[   10.241186] k3-dsp-rproc 64800000.dsp: booting DSP core using boot addr = 0xa8e00000
[   10.245610] virtio_rpmsg_bus virtio4: creating channel rpmsg_chrdev addr 0xe
[   10.256411]  remoteproc4#vdev0buffer: assigned reserved memory node c71-dma-memory@a8000000
[   10.265075] virtio_rpmsg_bus virtio5: rpmsg host is online
[   10.274811]  remoteproc4#vdev0buffer: registered virtio5 (type 7)
[   10.279962] virtio_rpmsg_bus virtio5: creating channel ti.ipc4.ping-pong addr 0xd
[   10.280930] remoteproc remoteproc4: remote processor 64800000.dsp is now up
[   10.290579] virtio_rpmsg_bus virtio5: creating channel rpmsg_chrdev addr 0xe
[   10.436204] remoteproc remoteproc6: 5e00000.r5f is available
[   10.494131] platform 5f00000.r5f: configured R5F for remoteproc mode
[   10.504360] remoteproc remoteproc6: powering up 5e00000.r5f
[   10.509981] remoteproc remoteproc6: Booting fw image j7-main-r5f1_0-fw, size 98444
[   10.521498]  remoteproc6#vdev0buffer: assigned reserved memory node r5f-dma-memory@a4000000
[   10.531781] virtio_rpmsg_bus virtio6: rpmsg host is online
[   10.537358]  remoteproc6#vdev0buffer: registered virtio6 (type 7)
[   10.540224] virtio_rpmsg_bus virtio6: creating channel ti.ipc4.ping-pong addr 0xd
[   10.543446] remoteproc remoteproc6: remote processor 5e00000.r5f is now up
[   10.568180] platform 5f00000.r5f: assigned reserved memory node r5f-dma-memory@a5000000
[   10.576240] random: crng init done
[   10.576245] random: 7 urandom warning(s) missed due to ratelimiting
[  OK  ] Started Load/Save Random Seed.
[   10.638829] remoteproc remoteproc7: 5f00000.r5f is available
[   10.691235] remoteproc remoteproc7: powering up 5f00000.r5f
[   10.696883] remoteproc remoteproc7: Booting fw image j7-main-r5f1_1-fw, size 98444
[   10.710782]  remoteproc7#vdev0buffer: assigned reserved memory node r5f-dma-memory@a5000000
[   10.719506] virtio_rpmsg_bus virtio7: rpmsg host is online
[   10.728224]  remoteproc7#vdev0buffer: registered virtio7 (type 7)
[   10.738226] remoteproc remoteproc7: remote processor 5f00000.r5f is now up
[   10.745516] virtio_rpmsg_bus virtio7: creating channel ti.ipc4.ping-pong addr 0xd
[   10.753743] virtio_rpmsg_bus virtio7: creating channel rpmsg_chrdev addr 0xe
[   10.761416] virtio_rpmsg_bus virtio6: creating channel rpmsg_chrdev addr 0xe
[  OK  ] Created slice system-systemd\x2dfsck.slice.
[  OK  ] Found device THGAF8G8T23BAILB.
         Starting File System Check on /dev/sdb...
[   10.987478] m_can_platform 40528000.can: m_can device registered (irq=23, version=32)
[   11.002517] m_can_platform 2701000.can: m_can device registered (irq=55, version=32)
[   11.018588] m_can_platform 40568000.can: m_can device registered (irq=25, version=32)
[  OK  ] Started File System Check on /dev/s[   11.051898] m_can_platform 2721000.can: m_can device registered (irq=57, version=32)
db.
         Mounting /run/media/sdb...
[   11.133486] EXT4-fs (sdb): mounted filesystem with ordered data mode. Opts: (null)
[  OK  ] Mounted /run/media/sdb.
[   11.372229] virtio_rpmsg_bus virtio3: creating channel ti.ethfw.notifyservice addr 0x1e
[   11.431165] virtio_rpmsg_bus virtio3: creating channel rpmsg-kdrv addr 0x1a
[   11.439068] rpmsg-kdrv-eth-switch rpmsg-kdrv-1-mpu_1_0_ethswitch-device-0: Device info: permissions: 3FFFFFFF uart_id: 2
[   11.460487] rpmsg-kdrv-eth-switch rpmsg-kdrv-1-mpu_1_0_ethswitch-device-0: FW ver 0.2 (rev 0)  2/Feb/2022 SHA:bd5a13f4
[   11.478205] rpmsg-kdrv-eth-switch rpmsg-kdrv-3-mpu_1_0_ethmac-device-1: Device info: permissions: 3FFFFFFF uart_id: 2
[   11.493938] rpmsg-kdrv-eth-switch rpmsg-kdrv-3-mpu_1_0_ethmac-device-1: FW ver 0.2 (rev 0)  2/Feb/2022 SHA:bd5a13f4
[   11.597424] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: rpmsg attach_ext - rx_mtu:1522 features:0000000B tx_mtu[0]:2024 flow_idx:172 tx_cpsw_psil_dst_id:51712 mac_addr:70:ff:76:1d:92:c1 mac-only:0
[   11.632937] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: virt_cpsw_nuss mac loaded
[   11.642727] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: rdev_features:0000000B rdev_mtu:1522 flow_id:172 tx_psil_dst_id:4A00 mac_only:0
[   11.667877] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: local_mac_addr:00:00:00:00:00:00 rdev_mac_addr:70:ff:76:1d:92:c1
[   11.754351] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: rpmsg attach_ext - rx_mtu:1522 features:00000007 tx_mtu[0]:2024 flow_idx:173 tx_cpsw_psil_dst_id:51713 mac_addr:70:ff:76:1d:92:c2 mac-only:1
[   11.800900] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: virt_cpsw_nuss mac loaded
[   11.812563] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: rdev_features:00000007 rdev_mtu:1522 flow_id:173 tx_psil_dst_id:4A01 mac_only:1
[   11.835967] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: local_mac_addr:00:00:00:00:00:00 rdev_mac_addr:70:ff:76:1d:92:c2
[   12.029659] cdns-csi2rx: probe of 4504000.csi-bridge failed with error -22
[   12.049635] cdns-csi2rx: probe of 4514000.csi-bridge failed with error -22
[   12.057989] usbcore: registered new interface driver usbfs
[   12.103662] remoteproc remoteproc8: b034000.pru is available
[   12.126520] usbcore: registered new interface driver hub
[   12.147005] remoteproc remoteproc9: b004000.rtu is available
[   12.152790] omap_rng 4e10000.rng: Random Number Generator ver. 241b34c
[   12.165568] usbcore: registered new device driver usb
[   12.176726] remoteproc remoteproc10: b00a000.txpru is available
[   12.209252] remoteproc remoteproc11: b038000.pru is available
[   12.248915] remoteproc remoteproc12: b006000.rtu is available
[   12.261919] remoteproc remoteproc13: b00c000.txpru is available
[   12.272405] remoteproc remoteproc14: b134000.pru is available
[   12.285655] remoteproc remoteproc15: b104000.rtu is available
[   12.298112] remoteproc remoteproc16: b10a000.txpru is available
[   12.314184] remoteproc remoteproc17: b138000.pru is available
[   12.334882] remoteproc remoteproc18: b106000.rtu is available
[   12.356169] remoteproc remoteproc19: b10c000.txpru is available
[  OK  ] Found device /dev/mmcblk1p1.
         Starting File System Check on /dev/mmcblk1p1...
[  OK  ] Started File System Check on /dev/mmcblk1p1.
         Mounting /run/media/mmcblk1p1...
[  OK  ] Mounted /run/media/mmcblk1p1.
         Starting Start psplash boot splash screen...
[FAILED] Failed to start Start psplash boot splash screen.
See 'systemctl status psplash-start.service' for details.
[DEPEND] Dependency failed for Star…progress communication helper.
[  OK  ] Found device KINGSTON OM8PDP3512B-A01.
         Starting File System Check on /dev/nvme0n1...
[  OK  ] Started File System Check on /dev/nvme0n1.
         Mounting /run/media/nvme0n1...
[   12.959379] EXT4-fs (nvme0n1): mounted filesystem with ordered data mode. Opts: (null)
[  OK  ] Mounted /run/media/nvme0n1.
[   13.012006] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
[   13.017650] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 1
[   13.025846] xhci-hcd xhci-hcd.2.auto: hcc params 0x200073c9 hci version 0x100 quirks 0x0000002000010010
[   13.035312] xhci-hcd xhci-hcd.2.auto: irq 693, io mem 0x06410000
[   13.041496] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[   13.049753] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   13.056963] usb usb1: Product: xHCI Host Controller
[   13.061833] usb usb1: Manufacturer: Linux 5.10.100-g7a7a3af903 xhci-hcd
[   13.068436] usb usb1: SerialNumber: xhci-hcd.2.auto
[   13.073572] hub 1-0:1.0: USB hub found
[   13.077348] hub 1-0:1.0: 1 port detected
[   13.081467] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
[   13.086960] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 2
[   13.094618] xhci-hcd xhci-hcd.2.auto: Host supports USB 3.0 SuperSpeed
[   13.101168] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[   13.109311] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[   13.117563] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   13.124776] usb usb2: Product: xHCI Host Controller
[   13.129644] usb usb2: Manufacturer: Linux 5.10.100-g7a7a3af903 xhci-hcd
[   13.136249] usb usb2: SerialNumber: xhci-hcd.2.auto
[   13.141358] hub 2-0:1.0: USB hub found
[   13.145125] hub 2-0:1.0: 1 port detected
[   13.338631] usb 1-1: new high-speed USB device number 2 using xhci-hcd
[   13.490896] usb 1-1: New USB device found, idVendor=0451, idProduct=8142, bcdDevice= 1.00
[   13.499060] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=1
[   13.506184] usb 1-1: SerialNumber: 7F0600790B90
[   13.511439] hub 1-1:1.0: USB hub found
[   13.515222] hub 1-1:1.0: 4 ports detected
[  OK  ] Started udev Wait for Complete Device Initialization.
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
[  OK  ] Reached target System Initialization.
[  OK  ] Started Daily rotation of log files.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Reached target Timers.
[  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
[  OK  ] Listening on D-Bus System Message Bus Socket.
         Starting Docker Socket for the API.
[  OK  ] Listening on dropbear.socket.
         Starting Reboot and dump vmcore via kexec...
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Started Reboot and dump vmcore via kexec.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
         Starting Save/Restore Sound Card State...
[  OK  ] Started Job spooling tools.
[  OK  ] Started Periodic Command Scheduler.
[  OK  ] Started D-Bus System Message Bus.
         Starting Print notice about GPLv3 packages...
         Starting set host name as per compatible name...
         Starting IPv6 Packet Filtering Framework...
         Starting IPv4 Packet Filtering Framework...
[  OK  ] Started irqbalance daemon.
         Starting Telephony service...
         Starting rc.pvr.service...
         Starting startwlanap...
         Starting startwlansta...
         Starting Login Service...
[  OK  ] Started TEE Supplicant.
         Starting Update weston ini… based on the platform name...
[  OK  ] Started Save/Restore Sound Card State.
[  OK  ] Started IPv6 Packet Filtering Framework.
[  OK  ] Started IPv4 Packet Filtering Framework.
[  OK  ] Reached target Network (Pre).
[  OK  ] Reached target Sound Card.
         Starting Network Service...
[  OK  ] Started startwlansta.
[  OK  ] Started startwlanap.
[  OK  ] Started Telephony service.
[  OK  ] Started set host name as per compatible name.
[  OK  ] Started Update weston ini …ge based on the platform name.
[   14.136111] Bluetooth: Core ver 2.22
[   14.141514] NET: Registered protocol family 31
[   14.147806] Bluetooth: HCI device and connection manager initialized
[   14.158654] Bluetooth: HCI socket layer initialized
[   14.163585] Bluetooth: L2CAP socket layer initialized
[   14.170017] Bluetooth: SCO socket layer initialized
[  OK  ] Started Network Service.
         Starting Wait for Network to be Configured...
         Starting Network Name Resolution...
[  OK  ] Started rc.pvr.service.
[  OK  ] Listening on Load/Save RF …itch Status /dev/rfkill Watch.
         Starting weston.service...
[  OK  ] Started weston.service.
         Starting DEMO...
         Starting telnetd.service...
[  OK  ] Started DEMO.
[  OK  ] Started Login Service.
[  OK  ] Started telnetd.service.
[   14.462896] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: virt_cpsw_nuss mac started
[   14.675812] PVR_K:  1096: RGX Firmware image 'rgx.fw.22.104.208.318' loaded
[   14.821487] j721e-cpsw-virt-mac main_r5fss_cpsw9g_virt_mac0: virt_cpsw_nuss mac started
[  OK  ] Started Network Name Resolution.
[  OK  ] Reached target Network.
[  OK  ] Reached target Host and Network Name Lookups.
         Starting Avahi mDNS/DNS-SD Stack...
         Starting Enable and configure wl18xx bluetooth stack...
[  OK  ] Started NFS status monitor for NFSv2/3 locking..
         Starting Simple Network Ma…ent Protocol (SNMP) Daemon....
         Starting Permit User Sessions...
[  OK  ] Started Avahi mDNS/DNS-SD Stack.
[  OK  ] Started Permit User Sessions.
[  OK  ] Started Getty on tty1.
[  OK  ] Started Serial Getty on ttyS3.
[   14.952183] TI DP83867 46000f00.mdio:00: attached PHY driver [TI DP83867] (mii_bus:phy_addr=46000f00.mdio:00, irq=POLL)

[  OK  ] Reached target Login Prompts.
         Starting Synchronize System and HW clocks...
[  OK  ] Started Enable and configure wl18xx bluetooth stack.
[FAILED] Failed to start Synchronize System and HW clocks.
See 'systemctl status sync-clocks.service' for details.
[   14.997524] am65-cpsw-nuss 46000000.ethernet eth0: Link is Down
[  OK  ] Started Simple Network Man…ement Protocol (SNMP) Daemon..
***************************************************************
***************************************************************
NOTICE: This file system contains the following GPLv3 packages:
        autoconf
        bash-dev
        bash
        bc
        binutils
        cifs-utils
        coreutils-stdbuf
        coreutils
        cpio
        cpp-symlinks
        cpp
        dosfstools
        elfutils
        g++-symlinks
        g++
        gawk
        gcc-symlinks
        gcc
        gdb
        gdbserver
        gettext
        glmark2
        gstreamer1.0-libav-dev
        gstreamer1.0-libav
        gzip
        less
        libasm1
        libbfd
        libdw1
        libelf1
        libgdbm-compat4
        libgdbm-dev
        libgdbm6
        libgettextlib
        libgettextsrc
        libgmp-dev
        libgmp10
        libgmpxx4
        libidn2-0
        libidn2-dev
        libmpc3
        libmpfr6
        libreadline-dev
        libreadline8
        libunistring-dev
        libunistring2
        m4-dev
        m4
        make
        nettle-dev
        nettle
        parted
        python3-rfc3987
        python3-strict-rfc3339
        tar
        which
        zeromq

If you do not wish to distribute GPLv3 components please remove
the above packages prior to distribution.  This can be done using
the opkg remove command.  i.e.:
    opkg remove <package>
Where <package> is the name printed in the list above

NOTE: If the package is a dependency of another package you
      will be notified of the dependent packages.  You should
      use the --force-removal-of-dependent-packages option to
      also remove the dependent packages as well
***************************************************************
***************************************************************
[  OK  ] Started Print notice about GPLv3 packages.

|  _  |___ ___ ___ ___   |  _  |___ ___  |_|___ ___| |_
|     |  _| .'| . | . |  |   __|  _| . | | | -_|  _|  _|
|__|__|_| |__,|_  |___|  |__|  |_| |___|_| |___|___|_|
              |___|                    |___|

Arago Project http://arago-project.org j7-evm ttyS2

Arago 2021.09 j7-evm ttyS2

j7-evm login: root (automatic login)

No directory, logging in with HOME=/
root@j7-evm:/# pcitest.sh
BAR tests

BAR0:           OKAY
BAR1:           OKAY
BAR2:           OKAY
BAR3:           OKAY
BAR4:           OKAY
BAR5:           OKAY

Interrupt tests

[   97.120727] pci-endpoint-test 0001:08:00.0: Failed to get Legacy interrupt
SET IRQ TYPE TO LEGACY:         NOT OKAY
LEGACY IRQ:     NOT OKAY
SET IRQ TYPE TO MSI:            OKAY
MSI1:           OKAY
MSI2:           OKAY
MSI3:           OKAY
MSI4:           OKAY
MSI5:           OKAY
MSI6:           OKAY
MSI7:           OKAY
MSI8:           OKAY
MSI9:           OKAY
MSI10:          OKAY
MSI11:          OKAY
MSI12:          OKAY
MSI13:          OKAY
MSI14:          OKAY
MSI15:          OKAY
MSI16:          OKAY
MSI17:          NOT OKAY
MSI18:          NOT OKAY
MSI19:          NOT OKAY
MSI20:          NOT OKAY
MSI21:          NOT OKAY
MSI22:          NOT OKAY
MSI23:          NOT OKAY
MSI24:          NOT OKAY
MSI25:          NOT OKAY
MSI26:          NOT OKAY
MSI27:          NOT OKAY
MSI28:          NOT OKAY
MSI29:          NOT OKAY
MSI30:          NOT OKAY
MSI31:          NOT OKAY
MSI32:          NOT OKAY

SET IRQ TYPE TO MSI-X:          OKAY
MSI-X1:         OKAY
MSI-X2:         OKAY
MSI-X3:         OKAY
MSI-X4:         OKAY
MSI-X5:         OKAY
MSI-X6:         OKAY
MSI-X7:         OKAY
MSI-X8:         OKAY
MSI-X9:         NOT OKAY
MSI-X10:                NOT OKAY
MSI-X11:                NOT OKAY
MSI-X12:                NOT OKAY
MSI-X13:                NOT OKAY
MSI-X14:                NOT OKAY
MSI-X15:                NOT OKAY
MSI-X16:                NOT OKAY
MSI-X17:                NOT OKAY
MSI-X18:                NOT OKAY
MSI-X19:                NOT OKAY
MSI-X20:                NOT OKAY
MSI-X21:                NOT OKAY
root@j7-evm:/#
root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:00\:00.0/remove
[  280.918653] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x11f8 (issued 277112 msec ago)
[  282.946637] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x01c0 (issued 2020 msec ago)
[  284.395933] ITS queue timeout (19360 19296)
[  284.400109] ITS cmd its_build_inv_cmd failed
[  285.844899] ITS queue timeout (19424 19296)
[  285.849084] ITS cmd its_build_discard_cmd failed
[  287.295319] ITS queue timeout (19488 19296)
[  287.299498] ITS cmd its_build_inv_cmd failed
[  288.744827] ITS queue timeout (19552 19296)
[  288.749011] ITS cmd its_build_discard_cmd failed
[  290.193846] ITS queue timeout (19616 19296)
[  290.198033] ITS cmd its_build_discard_cmd failed
[  291.640580] ITS queue timeout (19680 19296)
[  291.644763] ITS cmd its_build_discard_cmd failed
[  293.086034] ITS queue timeout (19712 19296)
[  293.090217] ITS cmd its_build_mapd_cmd failed
[  294.535174] ITS queue timeout (19776 19296)
[  294.539352] ITS cmd its_build_inv_cmd failed
[  295.977200] ITS queue timeout (19840 19296)
[  295.981382] ITS cmd its_build_discard_cmd failed
[  297.419623] ITS queue timeout (19904 19296)
[  297.423800] ITS cmd its_build_inv_cmd failed
[  298.868372] ITS queue timeout (19968 19296)
[  298.872553] ITS cmd its_build_discard_cmd failed
[  300.327395] ITS queue timeout (20032 19296)
[  300.331570] ITS cmd its_build_inv_cmd failed
[  301.776120] ITS queue timeout (20096 19296)
[  301.780299] ITS cmd its_build_discard_cmd failed
[  303.225171] ITS queue timeout (20160 19296)
[  303.229344] ITS cmd its_build_inv_cmd failed
[  304.667175] ITS queue timeout (20224 19296)
[  304.671354] ITS cmd its_build_discard_cmd failed
[  306.109685] ITS queue timeout (20288 19296)
[  306.113860] ITS cmd its_build_inv_cmd failed
[  307.559349] ITS queue timeout (20352 19296)
[  307.563533] ITS cmd its_build_discard_cmd failed
[  309.009813] ITS queue timeout (20416 19296)
[  309.013988] ITS cmd its_build_inv_cmd failed
[  310.451869] ITS queue timeout (20480 19296)
[  310.456048] ITS cmd its_build_discard_cmd failed
[  311.900948] ITS queue timeout (20544 19296)
[  311.905123] ITS cmd its_build_inv_cmd failed
[  313.349671] ITS queue timeout (20608 19296)
[  313.353850] ITS cmd its_build_discard_cmd failed
[  314.798751] ITS queue timeout (20672 19296)
[  314.802926] ITS cmd its_build_inv_cmd failed
[  316.247657] ITS queue timeout (20736 19296)
[  316.251838] ITS cmd its_build_discard_cmd failed
[  317.693354] ITS queue timeout (20768 19296)
[  317.697538] ITS cmd its_build_mapd_cmd failed
[  319.136018] ITS queue timeout (20832 19296)
[  319.140195] ITS cmd its_build_inv_cmd failed
[  320.577420] ITS queue timeout (20896 19296)
[  320.581601] ITS cmd its_build_discard_cmd failed
[  322.027536] ITS queue timeout (20960 19296)
[  322.031721] ITS cmd its_build_discard_cmd failed
[  323.475009] ITS queue timeout (21024 19296)
[  323.479191] ITS cmd its_build_discard_cmd failed
[  324.918636] ITS queue timeout (21088 19296)
[  324.922832] ITS cmd its_build_discard_cmd failed
[  326.367442] ITS queue timeout (21120 19296)
[  326.371622] ITS cmd its_build_mapd_cmd failed
[  327.816511] ITS queue timeout (21184 19296)
[  327.820688] ITS cmd its_build_inv_cmd failed
[  329.258804] ITS queue timeout (21248 19296)
[  329.262985] ITS cmd its_build_discard_cmd failed
[  330.708846] ITS queue timeout (21312 19296)
[  330.713032] ITS cmd its_build_discard_cmd failed
[  332.157775] ITS queue timeout (21376 19296)
[  332.161957] ITS cmd its_build_discard_cmd failed
[  333.602233] ITS queue timeout (21440 19296)
[  333.606415] ITS cmd its_build_discard_cmd failed
[  335.052146] ITS queue timeout (21472 19296)
[  335.056326] ITS cmd its_build_mapd_cmd failed
[  336.502182] ITS queue timeout (21536 19296)
[  336.506369] ITS cmd its_build_discard_cmd failed
[  337.951982] ITS queue timeout (21568 19296)
[  337.956162] ITS cmd its_build_mapd_cmd failed
[  339.395897] ITS queue timeout (21632 19296)
[  339.400083] ITS cmd its_build_discard_cmd failed
[  340.839721] ITS queue timeout (21664 19296)
[  340.843906] ITS cmd its_build_mapd_cmd failed
[  342.288683] ITS queue timeout (21728 19296)
[  342.292859] ITS cmd its_build_inv_cmd failed
[  343.737454] ITS queue timeout (21792 19296)
[  343.741635] ITS cmd its_build_discard_cmd failed
[  345.185535] ITS queue timeout (21856 19296)
[  345.189720] ITS cmd its_build_discard_cmd failed
[  346.634423] ITS queue timeout (21920 19296)
[  346.638607] ITS cmd its_build_discard_cmd failed
[  348.079495] ITS queue timeout (21984 19296)
[  348.083679] ITS cmd its_build_discard_cmd failed
[  349.526670] ITS queue timeout (22016 19296)
[  349.530851] ITS cmd its_build_mapd_cmd failed
[  350.969055] ITS queue timeout (22080 19296)
[  350.973232] ITS cmd its_build_inv_cmd failed
[  352.417799] ITS queue timeout (22144 19296)
[  352.421980] ITS cmd its_build_discard_cmd failed
[  353.867846] ITS queue timeout (22208 19296)
[  353.872034] ITS cmd its_build_discard_cmd failed
[  355.316858] ITS queue timeout (22272 19296)
[  355.321040] ITS cmd its_build_discard_cmd failed
[  356.763403] ITS queue timeout (22336 19296)
[  356.767587] ITS cmd its_build_discard_cmd failed
[  358.211357] ITS queue timeout (22368 19296)
[  358.215536] ITS cmd its_build_mapd_cmd failed
[  359.661335] ITS queue timeout (22432 19296)
[  359.665521] ITS cmd its_build_discard_cmd failed
[  361.106198] ITS queue timeout (22496 19296)
[  361.110380] ITS cmd its_build_discard_cmd failed
[  362.556119] ITS queue timeout (22560 19296)
[  362.560303] ITS cmd its_build_discard_cmd failed
[  364.006014] ITS queue timeout (22624 19296)
[  364.010198] ITS cmd its_build_discard_cmd failed
[  365.455158] ITS queue timeout (22656 19296)
[  365.459339] ITS cmd its_build_mapd_cmd failed
[  365.463790] pci_generic_config_write32: 2 callbacks suppressed
[  365.463796] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x84 may corrupt adjacent RW1C bits
[  365.479401] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xdc may corrupt adjacent RW1C bits
[  365.489194] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xc8 may corrupt adjacent RW1C bits
[  366.939225] ITS queue timeout (22720 19296)
[  366.943402] ITS cmd its_build_inv_cmd failed
[  366.947745] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x92 may corrupt adjacent RW1C bits
[  366.957465] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x9c may corrupt adjacent RW1C bits
[  368.415424] ITS queue timeout (22784 19296)
[  368.419597] ITS cmd its_build_discard_cmd failed
[  368.424369] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x92 may corrupt adjacent RW1C bits
[  368.434130] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  369.878598] ITS queue timeout (22816 19296)
[  369.882780] ITS cmd its_build_mapd_cmd failed
[  369.887175] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  369.896870] pci_bus 0001:03: busn_res: [bus 03] is released
[  369.902568] pci_bus 0001:04: busn_res: [bus 04] is released
[  369.908271] pci_bus 0001:07: busn_res: [bus 07] is released
[  369.914012] pci_bus 0001:08: busn_res: [bus 08] is released
[  369.919715] pci_bus 0001:09: busn_res: [bus 09] is released
[  369.925395] pci_bus 0001:0a: busn_res: [bus 0a] is released
[  369.931118] pci_bus 0001:06: busn_res: [bus 06-0a] is released
[  369.937066] pci_bus 0001:05: busn_res: [bus 05-0a] is released
[  369.942996] pci_bus 0001:02: busn_res: [bus 02-0a] is released
[  369.948931] pci_bus 0001:01: busn_res: [bus 01-0a] is released
root@j7-evm:/#
root@j7-evm:/#
root@j7-evm:/#
root@j7-evm:/#
root@j7-evm:/# echo 1 > /sys/bus/pci/rescan
[  382.968621] pcieport 0000:00:00.0: scanning [bus 01-01] behind bridge, pass 0
[  382.975775] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  382.985507] pcieport 0000:00:00.0: secondary 1
[  382.991713] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  383.001451] pcieport 0000:00:00.0: scanning [bus 01-01] behind bridge, pass 1
[  383.008576] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  383.018300] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  383.028071] pci 0001:00:00.0: [104c:b00d] type 01 class 0x060400
[  383.034070] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.043710] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.053349] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.062989] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.072624] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.082262] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[  383.091966] pci 0001:00:00.0: supports D1
[  383.095973] pci 0001:00:00.0: PME# supported from D0 D1 D3hot
[  383.101747] pci 0001:00:00.0: DPC: DPC init
[  383.108184] pci 0001:00:00.0: scanning [bus 01-0a] behind bridge, pass 0
[  383.114899] pci 0001:00:00.0: secondary 1
[  383.119081] pci 0001:01:00.0: [12d8:c232] type 01 class 0x060400
[  383.125125] pci 0001:01:00.0: reg 0x10: [mem 0x18100000-0x1817ffff]
[  383.131619] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[  383.137860] pci 0001:01:00.0: DPC: DPC init
[  383.142062] pci 0001:01:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0001:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[  383.168733] pci 0001:01:00.0: scanning [bus 02-0a] behind bridge, pass 0
[  383.175450] pci 0001:01:00.0: secondary 2
[  383.180032] pci 0001:02:04.0: [12d8:c232] type 01 class 0x060400
[  383.186334] pci 0001:02:04.0: PME# supported from D0 D3hot D3cold
[  383.192570] pci 0001:02:04.0: DPC: DPC init
[  383.196799] pci 0001:02:04.0: DPC: dpc->cap 0x2a0
[  383.201913] pci 0001:02:06.0: [12d8:c232] type 01 class 0x060400
[  383.208211] pci 0001:02:06.0: PME# supported from D0 D3hot D3cold
[  383.214446] pci 0001:02:06.0: DPC: DPC init
[  383.218637] pci 0001:02:06.0: DPC: dpc->cap 0x2a0
[  383.223825] pci 0001:02:09.0: [12d8:c232] type 01 class 0x060400
[  383.230100] pci 0001:02:09.0: PME# supported from D0 D3hot D3cold
[  383.236272] pci 0001:02:09.0: DPC: DPC init
[  383.242044] pci 0001:02:04.0: scanning [bus 03-03] behind bridge, pass 0
[  383.248766] pci 0001:02:04.0: secondary 3
[  383.254999] pci 0001:02:06.0: scanning [bus 04-04] behind bridge, pass 0
[  383.261712] pci 0001:02:06.0: secondary 4
[  383.267781] pci 0001:02:09.0: scanning [bus 05-0a] behind bridge, pass 0
[  383.274487] pci 0001:02:09.0: secondary 5
[  383.278664] pci 0001:05:00.0: [12d8:c232] type 01 class 0x060400
[  383.284897] pci 0001:05:00.0: PME# supported from D0 D3hot D3cold
[  383.291095] pci 0001:05:00.0: DPC: DPC init
[  383.295303] pci 0001:05:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0001:00:00.0 (capable of 126.016 Gb/s with 8.0 GT/s PCIe x16 link)
[  383.312693] pci 0001:05:00.0: scanning [bus 06-0a] behind bridge, pass 0
[  383.319419] pci 0001:05:00.0: secondary 6
[  383.323628] pci 0001:06:00.0: [12d8:c232] type 01 class 0x060400
[  383.329921] pci 0001:06:00.0: PME# supported from D0 D3hot D3cold
[  383.336159] pci 0001:06:00.0: DPC: DPC init
[  383.340349] pci 0001:06:00.0: DPC: dpc->cap 0x2a0
[  383.345478] pci 0001:06:02.0: [12d8:c232] type 01 class 0x060400
[  383.351804] pci 0001:06:02.0: PME# supported from D0 D3hot D3cold
[  383.358048] pci 0001:06:02.0: DPC: DPC init
[  383.362238] pci 0001:06:02.0: DPC: dpc->cap 0x2a0
[  383.367380] pci 0001:06:04.0: [12d8:c232] type 01 class 0x060400
[  383.373702] pci 0001:06:04.0: PME# supported from D0 D3hot D3cold
[  383.379941] pci 0001:06:04.0: DPC: DPC init
[  383.384140] pci 0001:06:04.0: DPC: dpc->cap 0x2a0
[  383.389288] pci 0001:06:06.0: [12d8:c232] type 01 class 0x060400
[  383.395588] pci 0001:06:06.0: PME# supported from D0 D3hot D3cold
[  383.401830] pci 0001:06:06.0: DPC: DPC init
[  383.406036] pci 0001:06:06.0: DPC: dpc->cap 0x2a0
[  383.412550] pci 0001:06:00.0: scanning [bus 07-07] behind bridge, pass 0
[  383.419279] pci 0001:06:00.0: secondary 7
[  383.425355] pci 0001:06:02.0: scanning [bus 08-08] behind bridge, pass 0
[  383.432067] pci 0001:06:02.0: secondary 8
[  383.436279] pci 0001:08:00.0: [104c:b00d] type 00 class 0xff0000
[  383.442323] pci 0001:08:00.0: reg 0x10: [mem 0x18324400-0x183245ff]
[  383.448599] pci 0001:08:00.0: reg 0x14: [mem 0x18324600-0x183247ff]
[  383.454885] pci 0001:08:00.0: reg 0x18: [mem 0x18324000-0x183243ff]
[  383.461169] pci 0001:08:00.0: reg 0x1c: [mem 0x18320000-0x18323fff]
[  383.467447] pci 0001:08:00.0: reg 0x20: [mem 0x18300000-0x1831ffff]
[  383.473724] pci 0001:08:00.0: reg 0x24: [mem 0x18200000-0x182fffff]
[  383.480316] pci 0001:08:00.0: supports D1
[  383.484320] pci 0001:08:00.0: PME# supported from D0 D1 D3hot
[  383.490153] pci 0001:08:00.0: reg 0x224: [mem 0x18400000-0x187fffff 64bit]
[  383.497016] pci 0001:08:00.0: VF(n) BAR0 space: [mem 0x18400000-0x193fffff 64bit] (contains BAR0 for 4 VFs)
[  383.506998] pci 0001:08:00.0: DPC: DPC init
[  383.513502] pci 0001:06:04.0: scanning [bus 09-09] behind bridge, pass 0
[  383.520228] pci 0001:06:04.0: secondary 9
[  383.526302] pci 0001:06:06.0: scanning [bus 0a-0a] behind bridge, pass 0
[  383.533018] pci 0001:06:06.0: secondary 10
[  383.539124] pci 0001:06:00.0: scanning [bus 07-07] behind bridge, pass 1
[  383.545835] pci 0001:06:02.0: scanning [bus 08-08] behind bridge, pass 1
[  383.552548] pci 0001:06:04.0: scanning [bus 09-09] behind bridge, pass 1
[  383.559248] pci 0001:06:06.0: scanning [bus 0a-0a] behind bridge, pass 1
[  383.565955] pci 0001:05:00.0: scanning [bus 06-0a] behind bridge, pass 1
[  383.572660] pci 0001:02:04.0: scanning [bus 03-03] behind bridge, pass 1
[  383.579362] pci 0001:02:06.0: scanning [bus 04-04] behind bridge, pass 1
[  383.586069] pci 0001:02:09.0: scanning [bus 05-0a] behind bridge, pass 1
[  383.592787] pci 0001:01:00.0: scanning [bus 02-0a] behind bridge, pass 1
[  383.599491] pci 0001:00:00.0: scanning [bus 01-0a] behind bridge, pass 1
[  383.606200] pci 0001:06:02.0: bridge window [mem 0x00100000-0x002fffff] to [bus 08] add_size 1200000 add_align 400000
[  383.616790] pci 0001:06:04.0: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[  383.624956] pci 0001:06:04.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 09] add_size 200000 add_align 100000
[  383.636411] pci 0001:06:04.0: bridge window [mem 0x00100000-0x000fffff] to [bus 09] add_size 200000 add_align 100000
[  383.646922] pci 0001:05:00.0: bridge window [io  0x1000-0x0fff] to [bus 06-0a] add_size 1000
[  383.655349] pci 0001:05:00.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 06-0a] add_size 200000 add_align 100000
[  383.667068] pci 0001:05:00.0: bridge window [mem 0x00100000-0x003fffff] to [bus 06-0a] add_size 1500000 add_align 400000
[  383.677917] pci 0001:02:09.0: bridge window [io  0x1000-0x0fff] to [bus 05-0a] add_size 1000
[  383.686344] pci 0001:02:09.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 05-0a] add_size 200000 add_align 100000
[  383.698059] pci 0001:02:09.0: bridge window [mem 0x00100000-0x003fffff] to [bus 05-0a] add_size 1500000 add_align 400000
[  383.708915] pci 0001:01:00.0: bridge window [io  0x1000-0x0fff] to [bus 02-0a] add_size 1000
[  383.717346] pci 0001:01:00.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 02-0a] add_size 200000 add_align 100000
[  383.729071] pci 0001:01:00.0: bridge window [mem 0x00100000-0x003fffff] to [bus 02-0a] add_size 1500000 add_align 400000
[  383.739921] pci 0001:00:00.0: bridge window [io  0x1000-0x0fff] to [bus 01-0a] add_size 1000
[  383.748345] pci 0001:00:00.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 01-0a] add_size 200000 add_align 100000
[  383.760061] pci 0001:00:00.0: bridge window [mem 0x00100000-0x004fffff] to [bus 01-0a] add_size 1800000 add_align 400000
[  383.770923] pci 0001:00:00.0: BAR 14: assigned [mem 0x18400000-0x19ffffff]
[  383.777790] pci 0001:00:00.0: BAR 15: assigned [mem 0x18100000-0x183fffff 64bit pref]
[  383.785609] pci 0001:00:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[  383.791956] pci 0001:01:00.0: BAR 14: assigned [mem 0x18400000-0x19bfffff]
[  383.798819] pci 0001:01:00.0: BAR 15: assigned [mem 0x18100000-0x183fffff 64bit pref]
[  383.806652] pci 0001:01:00.0: BAR 0: assigned [mem 0x19c00000-0x19c7ffff]
[  383.813442] pci 0001:01:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[  383.819792] pci 0001:02:09.0: BAR 14: assigned [mem 0x18400000-0x19bfffff]
[  383.826657] pci 0001:02:09.0: BAR 15: assigned [mem 0x18100000-0x183fffff 64bit pref]
[  383.834471] pci 0001:02:09.0: BAR 13: assigned [io  0x10000-0x10fff]
[  383.840821] pci 0001:02:04.0: PCI bridge to [bus 03]
[  383.845796] pci 0001:02:06.0: PCI bridge to [bus 04]
[  383.850773] pci 0001:05:00.0: BAR 14: assigned [mem 0x18400000-0x19bfffff]
[  383.857635] pci 0001:05:00.0: BAR 15: assigned [mem 0x18100000-0x183fffff 64bit pref]
[  383.865452] pci 0001:05:00.0: BAR 13: assigned [io  0x10000-0x10fff]
[  383.871798] pci 0001:06:02.0: BAR 14: assigned [mem 0x18400000-0x197fffff]
[  383.878660] pci 0001:06:04.0: BAR 14: assigned [mem 0x19800000-0x199fffff]
[  383.885522] pci 0001:06:04.0: BAR 15: assigned [mem 0x18100000-0x182fffff 64bit pref]
[  383.893340] pci 0001:06:04.0: BAR 13: assigned [io  0x10000-0x10fff]
[  383.899686] pci 0001:06:00.0: PCI bridge to [bus 07]
[  383.904666] pci 0001:08:00.0: BAR 7: assigned [mem 0x18400000-0x193fffff 64bit]
[  383.911970] pci 0001:08:00.0: BAR 5: assigned [mem 0x19400000-0x194fffff]
[  383.918753] pci 0001:08:00.0: BAR 4: assigned [mem 0x19500000-0x1951ffff]
[  383.925534] pci 0001:08:00.0: BAR 3: assigned [mem 0x19520000-0x19523fff]
[  383.932321] pci 0001:08:00.0: BAR 2: assigned [mem 0x19524000-0x195243ff]
[  383.939116] pci 0001:08:00.0: BAR 0: assigned [mem 0x19524400-0x195245ff]
[  383.945902] pci 0001:08:00.0: BAR 1: assigned [mem 0x19524600-0x195247ff]
[  383.952685] pci 0001:06:02.0: PCI bridge to [bus 08]
[  383.957660] pci 0001:06:02.0:   bridge window [mem 0x18400000-0x197fffff]
[  383.964461] pci 0001:06:04.0: PCI bridge to [bus 09]
[  383.969426] pci 0001:06:04.0:   bridge window [io  0x10000-0x10fff]
[  383.975688] pci 0001:06:04.0:   bridge window [mem 0x19800000-0x199fffff]
[  383.982469] pci 0001:06:04.0:   bridge window [mem 0x18100000-0x182fffff 64bit pref]
[  383.990207] pci 0001:06:06.0: PCI bridge to [bus 0a]
[  383.995181] pci 0001:05:00.0: PCI bridge to [bus 06-0a]
[  384.000398] pci 0001:05:00.0:   bridge window [io  0x10000-0x10fff]
[  384.006662] pci 0001:05:00.0:   bridge window [mem 0x18400000-0x19bfffff]
[  384.013441] pci 0001:05:00.0:   bridge window [mem 0x18100000-0x183fffff 64bit pref]
[  384.021178] pci 0001:02:09.0: PCI bridge to [bus 05-0a]
[  384.026397] pci 0001:02:09.0:   bridge window [io  0x10000-0x10fff]
[  384.032658] pci 0001:02:09.0:   bridge window [mem 0x18400000-0x19bfffff]
[  384.039438] pci 0001:02:09.0:   bridge window [mem 0x18100000-0x183fffff 64bit pref]
[  384.047174] pci 0001:01:00.0: PCI bridge to [bus 02-0a]
[  384.052390] pci 0001:01:00.0:   bridge window [io  0x10000-0x10fff]
[  384.058662] pci 0001:01:00.0:   bridge window [mem 0x18400000-0x19bfffff]
[  384.065443] pci 0001:01:00.0:   bridge window [mem 0x18100000-0x183fffff 64bit pref]
[  384.073179] pci 0001:00:00.0: PCI bridge to [bus 01-0a]
[  384.078394] pci 0001:00:00.0:   bridge window [io  0x10000-0x10fff]
[  384.084661] pci 0001:00:00.0:   bridge window [mem 0x18400000-0x19ffffff]
[  384.091438] pci 0001:00:00.0:   bridge window [mem 0x18100000-0x183fffff 64bit pref]
[  385.541777] ITS queue timeout (22848 19296)
[  385.545962] ITS cmd its_build_mapd_cmd failed
[  386.993621] ITS queue timeout (22912 19296)
[  386.997813] ITS cmd its_build_mapti_cmd failed
[  388.436188] ITS queue timeout (22976 19296)
[  388.440366] ITS cmd its_build_inv_cmd failed
[  388.445608] pcieport 0001:00:00.0: PME: Signaling with IRQ 64
[  388.451363] pci_generic_config_write32: 26 callbacks suppressed
[  388.451368] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xdc may corrupt adjacent RW1C bits
[  388.469622] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xca may corrupt adjacent RW1C bits
[  388.479379] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xdc may corrupt adjacent RW1C bits
[  388.489158] pci_bus 0001:00: 2-byte config write to 0001:00:00.0 offset 0xc8 may corrupt adjacent RW1C bits
[  388.498930] pcieport 0001:00:00.0: AER: enabled with IRQ 64
[  389.946252] ITS queue timeout (23008 19296)
[  389.950434] ITS cmd its_build_mapd_cmd failed
[  391.395088] ITS queue timeout (23072 19296)
[  391.399274] ITS cmd its_build_mapti_cmd failed
[  392.845138] ITS queue timeout (23136 19296)
[  392.849322] ITS cmd its_build_mapti_cmd failed
[  394.295219] ITS queue timeout (23200 19296)
[  394.299402] ITS cmd its_build_mapti_cmd failed
[  395.745208] ITS queue timeout (23264 19296)
[  395.749389] ITS cmd its_build_mapti_cmd failed
[  397.193403] ITS queue timeout (23328 19296)
[  397.197583] ITS cmd its_build_mapti_cmd failed
[  398.643312] ITS queue timeout (23392 19296)
[  398.647492] ITS cmd its_build_mapti_cmd failed
[  400.092169] ITS queue timeout (23456 19296)
[  400.096355] ITS cmd its_build_discard_cmd failed
[  401.542218] ITS queue timeout (23520 19296)
[  401.546399] ITS cmd its_build_discard_cmd failed
[  402.992283] ITS queue timeout (23584 19296)
[  402.996463] ITS cmd its_build_discard_cmd failed
[  404.442451] ITS queue timeout (23648 19296)
[  404.446633] ITS cmd its_build_discard_cmd failed
[  405.886320] ITS queue timeout (23712 19296)
[  405.890498] ITS cmd its_build_discard_cmd failed
[  407.335273] ITS queue timeout (23776 19296)
[  407.339455] ITS cmd its_build_discard_cmd failed
[  408.785346] ITS queue timeout (23808 19296)
[  408.789527] ITS cmd its_build_mapd_cmd failed
[  410.235260] ITS queue timeout (23840 19296)
[  410.239440] ITS cmd its_build_mapd_cmd failed
[  411.685135] ITS queue timeout (23904 19296)
[  411.689319] ITS cmd its_build_mapti_cmd failed
[  413.135175] ITS queue timeout (23968 19296)
[  413.139358] ITS cmd its_build_mapti_cmd failed
[  414.585164] ITS queue timeout (24032 19296)
[  414.589345] ITS cmd its_build_mapti_cmd failed
[  416.035329] ITS queue timeout (24096 19296)
[  416.039511] ITS cmd its_build_mapti_cmd failed
[  417.485694] ITS queue timeout (24128 19296)
[  417.489875] ITS cmd its_build_mapd_cmd failed
[  418.935700] ITS queue timeout (24192 19296)
[  418.939885] ITS cmd its_build_mapti_cmd failed
[  420.385779] ITS queue timeout (24256 19296)
[  420.389964] ITS cmd its_build_mapti_cmd failed
[  421.835718] ITS queue timeout (24320 19296)
[  421.839899] ITS cmd its_build_mapti_cmd failed
[  423.285625] ITS queue timeout (24384 19296)
[  423.289805] ITS cmd its_build_mapti_cmd failed
[  424.735501] ITS queue timeout (24448 19296)
[  424.739682] ITS cmd its_build_mapti_cmd failed
[  426.185369] ITS queue timeout (24512 19296)
[  426.189550] ITS cmd its_build_mapti_cmd failed
[  427.635258] ITS queue timeout (24576 19296)
[  427.639438] ITS cmd its_build_mapti_cmd failed
[  429.085243] ITS queue timeout (24640 19296)
[  429.089423] ITS cmd its_build_mapti_cmd failed
[  430.535168] ITS queue timeout (24704 19296)
[  430.539356] ITS cmd its_build_discard_cmd failed
[  431.985179] ITS queue timeout (24768 19296)
[  431.989359] ITS cmd its_build_discard_cmd failed
[  433.435155] ITS queue timeout (24832 19296)
[  433.439335] ITS cmd its_build_discard_cmd failed
[  434.885059] ITS queue timeout (24896 19296)
[  434.889239] ITS cmd its_build_discard_cmd failed
[  436.335126] ITS queue timeout (24960 19296)
[  436.339307] ITS cmd its_build_discard_cmd failed
[  437.785286] ITS queue timeout (25024 19296)
[  437.789466] ITS cmd its_build_discard_cmd failed
[  439.235241] ITS queue timeout (25088 19296)
[  439.239423] ITS cmd its_build_discard_cmd failed
[  440.685414] ITS queue timeout (25152 19296)
[  440.689594] ITS cmd its_build_discard_cmd failed
[  442.135406] ITS queue timeout (25184 19296)
[  442.139589] ITS cmd its_build_mapd_cmd failed
[  443.585326] ITS queue timeout (25216 19296)
[  443.589507] ITS cmd its_build_mapd_cmd failed
[  445.035192] ITS queue timeout (25280 19296)
[  445.039379] ITS cmd its_build_mapti_cmd failed
[  446.480854] ITS queue timeout (25344 19296)
[  446.485033] ITS cmd its_build_mapti_cmd failed
[  447.924502] ITS queue timeout (25408 19296)
[  447.928684] ITS cmd its_build_mapti_cmd failed
[  449.374345] ITS queue timeout (25472 19296)
[  449.378525] ITS cmd its_build_mapti_cmd failed
[  449.383129] pcieport 0001:02:04.0: DPC: DPC probe
[  450.837328] ITS queue timeout (25536 19296)
[  450.841506] ITS cmd its_build_inv_cmd failed
[  450.845858] pcieport 0001:02:04.0: DPC: enabled with IRQ 70
[  450.851424] pcieport 0001:02:04.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  450.864625] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  452.312698] ITS queue timeout (25568 19296)
[  452.316881] ITS cmd its_build_mapd_cmd failed
[  453.762600] ITS queue timeout (25632 19296)
[  453.766786] ITS cmd its_build_mapti_cmd failed
[  455.208081] ITS queue timeout (25696 19296)
[  455.212263] ITS cmd its_build_mapti_cmd failed
[  456.653968] ITS queue timeout (25760 19296)
[  456.658148] ITS cmd its_build_mapti_cmd failed
[  458.103997] ITS queue timeout (25824 19296)
[  458.108178] ITS cmd its_build_mapti_cmd failed
[  459.553890] ITS queue timeout (25888 19296)
[  459.558073] ITS cmd its_build_mapti_cmd failed
[  461.003991] ITS queue timeout (25952 19296)
[  461.008171] ITS cmd its_build_mapti_cmd failed
[  462.453755] ITS queue timeout (26016 19296)
[  462.457933] ITS cmd its_build_mapti_cmd failed
[  463.902110] ITS queue timeout (26080 19296)
[  463.906290] ITS cmd its_build_mapti_cmd failed
[  465.351239] ITS queue timeout (26144 19296)
[  465.355421] ITS cmd its_build_discard_cmd failed
[  466.798717] ITS queue timeout (26208 19296)
[  466.802900] ITS cmd its_build_discard_cmd failed
[  468.249015] ITS queue timeout (26272 19296)
[  468.253195] ITS cmd its_build_discard_cmd failed
[  469.699015] ITS queue timeout (26336 19296)
[  469.703196] ITS cmd its_build_discard_cmd failed
[  471.149358] ITS queue timeout (26400 19296)
[  471.153540] ITS cmd its_build_discard_cmd failed
[  472.593166] ITS queue timeout (26464 19296)
[  472.597347] ITS cmd its_build_discard_cmd failed
[  474.043427] ITS queue timeout (26528 19296)
[  474.047608] ITS cmd its_build_discard_cmd failed
[  475.493666] ITS queue timeout (26592 19296)
[  475.497846] ITS cmd its_build_discard_cmd failed
[  476.943784] ITS queue timeout (26624 19296)
[  476.947965] ITS cmd its_build_mapd_cmd failed
[  478.393896] ITS queue timeout (26656 19296)
[  478.398077] ITS cmd its_build_mapd_cmd failed
[  479.844096] ITS queue timeout (26720 19296)
[  479.848280] ITS cmd its_build_mapti_cmd failed
[  481.294102] ITS queue timeout (26784 19296)
[  481.298281] ITS cmd its_build_mapti_cmd failed
[  482.737798] ITS queue timeout (26848 19296)
[  482.741979] ITS cmd its_build_mapti_cmd failed
[  484.187899] ITS queue timeout (26912 19296)
[  484.192078] ITS cmd its_build_mapti_cmd failed
[  484.196669] pcieport 0001:02:06.0: DPC: DPC probe
[  485.652312] ITS queue timeout (26976 19296)
[  485.656491] ITS cmd its_build_inv_cmd failed
[  485.660831] pcieport 0001:02:06.0: DPC: enabled with IRQ 74
[  485.666396] pcieport 0001:02:06.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  485.679601] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  487.127790] ITS queue timeout (27008 19296)
[  487.131972] ITS cmd its_build_mapd_cmd failed
[  488.569952] ITS queue timeout (27072 19296)
[  488.574138] ITS cmd its_build_mapti_cmd failed
[  490.013185] ITS queue timeout (27136 19296)
[  490.017367] ITS cmd its_build_mapti_cmd failed
[  491.461934] ITS queue timeout (27200 19296)
[  491.466115] ITS cmd its_build_mapti_cmd failed
[  492.911856] ITS queue timeout (27264 19296)
[  492.916036] ITS cmd its_build_mapti_cmd failed
[  494.362044] ITS queue timeout (27328 19296)
[  494.366224] ITS cmd its_build_mapti_cmd failed
[  495.806777] ITS queue timeout (27392 19296)
[  495.810959] ITS cmd its_build_mapti_cmd failed
[  497.256980] ITS queue timeout (27456 19296)
[  497.261161] ITS cmd its_build_mapti_cmd failed
[  498.706904] ITS queue timeout (27520 19296)
[  498.711091] ITS cmd its_build_mapti_cmd failed
[  500.156977] ITS queue timeout (27584 19296)
[  500.161162] ITS cmd its_build_discard_cmd failed
[  501.600604] ITS queue timeout (27648 19296)
[  501.604785] ITS cmd its_build_discard_cmd failed
[  503.046704] ITS queue timeout (27712 19296)
[  503.050885] ITS cmd its_build_discard_cmd failed
[  504.497086] ITS queue timeout (27776 19296)
[  504.501269] ITS cmd its_build_discard_cmd failed
[  505.947393] ITS queue timeout (27840 19296)
[  505.951575] ITS cmd its_build_discard_cmd failed
[  507.396730] ITS queue timeout (27904 19296)
[  507.400909] ITS cmd its_build_discard_cmd failed
[  508.846981] ITS queue timeout (27968 19296)
[  508.851162] ITS cmd its_build_discard_cmd failed
[  510.290604] ITS queue timeout (28032 19296)
[  510.294785] ITS cmd its_build_discard_cmd failed
[  511.740983] ITS queue timeout (28064 19296)
[  511.745162] ITS cmd its_build_mapd_cmd failed
[  513.191033] ITS queue timeout (28096 19296)
[  513.195214] ITS cmd its_build_mapd_cmd failed
[  514.640914] ITS queue timeout (28160 19296)
[  514.645099] ITS cmd its_build_mapti_cmd failed
[  516.091680] ITS queue timeout (28192 19296)
[  516.095864] ITS cmd its_build_mapd_cmd failed
[  517.541834] ITS queue timeout (28256 19296)
[  517.546019] ITS cmd its_build_mapti_cmd failed
[  518.991875] ITS queue timeout (28320 19296)
[  518.996058] ITS cmd its_build_mapti_cmd failed
[  520.441963] ITS queue timeout (28384 19296)
[  520.446145] ITS cmd its_build_mapti_cmd failed
[  521.892057] ITS queue timeout (28448 19296)
[  521.896240] ITS cmd its_build_mapti_cmd failed
[  523.335321] ITS queue timeout (28512 19296)
[  523.339503] ITS cmd its_build_mapti_cmd failed
[  524.784348] ITS queue timeout (28576 19296)
[  524.788529] ITS cmd its_build_mapti_cmd failed
[  526.234416] ITS queue timeout (28640 19296)
[  526.238597] ITS cmd its_build_mapti_cmd failed
[  527.684589] ITS queue timeout (28704 19296)
[  527.688770] ITS cmd its_build_mapti_cmd failed
[  529.134755] ITS queue timeout (28768 19296)
[  529.138938] ITS cmd its_build_discard_cmd failed
[  530.585012] ITS queue timeout (28832 19296)
[  530.589193] ITS cmd its_build_discard_cmd failed
[  532.035277] ITS queue timeout (28896 19296)
[  532.039462] ITS cmd its_build_discard_cmd failed
[  533.485588] ITS queue timeout (28960 19296)
[  533.489769] ITS cmd its_build_discard_cmd failed
[  534.932923] ITS queue timeout (29024 19296)
[  534.937102] ITS cmd its_build_discard_cmd failed
[  536.382260] ITS queue timeout (29088 19296)
[  536.386442] ITS cmd its_build_discard_cmd failed
[  537.832415] ITS queue timeout (29152 19296)
[  537.836595] ITS cmd its_build_discard_cmd failed
[  539.282503] ITS queue timeout (29216 19296)
[  539.286685] ITS cmd its_build_discard_cmd failed
[  540.732991] ITS queue timeout (29248 19296)
[  540.737170] ITS cmd its_build_mapd_cmd failed
[  542.183063] ITS queue timeout (29280 19296)
[  542.187245] ITS cmd its_build_mapd_cmd failed
[  543.633172] ITS queue timeout (29344 19296)
[  543.637354] ITS cmd its_build_mapti_cmd failed
[  543.642202] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  545.088410] ITS queue timeout (29376 19296)
[  545.092591] ITS cmd its_build_mapd_cmd failed
[  546.538484] ITS queue timeout (29440 19296)
[  546.542671] ITS cmd its_build_mapti_cmd failed
[  547.988709] ITS queue timeout (29504 19296)
[  547.992889] ITS cmd its_build_mapti_cmd failed
[  549.438743] ITS queue timeout (29568 19296)
[  549.442925] ITS cmd its_build_mapti_cmd failed
[  550.883852] ITS queue timeout (29632 19296)
[  550.888032] ITS cmd its_build_mapti_cmd failed
[  552.327531] ITS queue timeout (29696 19296)
[  552.331712] ITS cmd its_build_mapti_cmd failed
[  553.770871] ITS queue timeout (29760 19296)
[  553.775050] ITS cmd its_build_mapti_cmd failed
[  555.219403] ITS queue timeout (29824 19296)
[  555.223584] ITS cmd its_build_mapti_cmd failed
[  556.667730] ITS queue timeout (29888 19296)
[  556.671911] ITS cmd its_build_mapti_cmd failed
[  558.117738] ITS queue timeout (29952 19296)
[  558.121918] ITS cmd its_build_discard_cmd failed
[  559.567904] ITS queue timeout (30016 19296)
[  559.572086] ITS cmd its_build_discard_cmd failed
[  561.018053] ITS queue timeout (30080 19296)
[  561.022236] ITS cmd its_build_discard_cmd failed
[  562.468157] ITS queue timeout (30144 19296)
[  562.472336] ITS cmd its_build_discard_cmd failed
[  563.918373] ITS queue timeout (30208 19296)
[  563.922554] ITS cmd its_build_discard_cmd failed
[  565.368802] ITS queue timeout (30272 19296)
[  565.372983] ITS cmd its_build_discard_cmd failed
[  566.819050] ITS queue timeout (30336 19296)
[  566.823231] ITS cmd its_build_discard_cmd failed
[  568.269302] ITS queue timeout (30400 19296)
[  568.273484] ITS cmd its_build_discard_cmd failed
[  569.719438] ITS queue timeout (30432 19296)
[  569.723619] ITS cmd its_build_mapd_cmd failed
[  571.162873] ITS queue timeout (30464 19296)
[  571.167053] ITS cmd its_build_mapd_cmd failed
[  572.612737] ITS queue timeout (30528 19296)
[  572.616921] ITS cmd its_build_mapti_cmd failed
[  574.062676] ITS queue timeout (30592 19296)
[  574.066856] ITS cmd its_build_mapti_cmd failed
[  575.512741] ITS queue timeout (30656 19296)
[  575.516921] ITS cmd its_build_mapti_cmd failed
[  576.962685] ITS queue timeout (30720 19296)
[  576.966865] ITS cmd its_build_mapti_cmd failed
[  576.971461] pcieport 0001:06:00.0: DPC: DPC probe
[  578.416554] ITS queue timeout (30784 19296)
[  578.420732] ITS cmd its_build_inv_cmd failed
[  578.425076] pcieport 0001:06:00.0: DPC: enabled with IRQ 80
[  578.430655] pcieport 0001:06:00.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  578.443873] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  579.891893] ITS queue timeout (30816 19296)
[  579.896075] ITS cmd its_build_mapd_cmd failed
[  581.335974] ITS queue timeout (30880 19296)
[  581.340160] ITS cmd its_build_mapti_cmd failed
[  582.779354] ITS queue timeout (30944 19296)
[  582.783538] ITS cmd its_build_mapti_cmd failed
[  584.225796] ITS queue timeout (31008 19296)
[  584.229980] ITS cmd its_build_mapti_cmd failed
[  585.675725] ITS queue timeout (31072 19296)
[  585.679904] ITS cmd its_build_mapti_cmd failed
[  587.125900] ITS queue timeout (31136 19296)
[  587.130083] ITS cmd its_build_mapti_cmd failed
[  588.576024] ITS queue timeout (31200 19296)
[  588.580203] ITS cmd its_build_mapti_cmd failed
[  590.026286] ITS queue timeout (31264 19296)
[  590.030467] ITS cmd its_build_mapti_cmd failed
[  591.476465] ITS queue timeout (31328 19296)
[  591.480648] ITS cmd its_build_mapti_cmd failed
[  592.926593] ITS queue timeout (31392 19296)
[  592.930777] ITS cmd its_build_discard_cmd failed
[  594.376767] ITS queue timeout (31456 19296)
[  594.380949] ITS cmd its_build_discard_cmd failed
[  595.825717] ITS queue timeout (31520 19296)
[  595.829900] ITS cmd its_build_discard_cmd failed
[  597.275749] ITS queue timeout (31584 19296)
[  597.279929] ITS cmd its_build_discard_cmd failed
[  598.725258] ITS queue timeout (31648 19296)
[  598.729439] ITS cmd its_build_discard_cmd failed
[  600.175305] ITS queue timeout (31712 19296)
[  600.179485] ITS cmd its_build_discard_cmd failed
[  601.625552] ITS queue timeout (31776 19296)
[  601.629733] ITS cmd its_build_discard_cmd failed
[  603.075729] ITS queue timeout (31840 19296)
[  603.079908] ITS cmd its_build_discard_cmd failed
[  604.526028] ITS queue timeout (31872 19296)
[  604.530209] ITS cmd its_build_mapd_cmd failed
[  605.975923] ITS queue timeout (31904 19296)
[  605.980104] ITS cmd its_build_mapd_cmd failed
[  607.425980] ITS queue timeout (31968 19296)
[  607.430163] ITS cmd its_build_mapti_cmd failed
[  608.876045] ITS queue timeout (32032 19296)
[  608.880228] ITS cmd its_build_mapti_cmd failed
[  610.325983] ITS queue timeout (32096 19296)
[  610.330164] ITS cmd its_build_mapti_cmd failed
[  611.775844] ITS queue timeout (32160 19296)
[  611.780026] ITS cmd its_build_mapti_cmd failed
[  611.784628] pcieport 0001:06:02.0: DPC: DPC probe
[  613.229611] ITS queue timeout (32224 19296)
[  613.233789] ITS cmd its_build_inv_cmd failed
[  613.238139] pcieport 0001:06:02.0: DPC: enabled with IRQ 84
[  613.243706] pcieport 0001:06:02.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  613.256917] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  614.704742] ITS queue timeout (32256 19296)
[  614.708924] ITS cmd its_build_mapd_cmd failed
[  616.152742] ITS queue timeout (32320 19296)
[  616.156929] ITS cmd its_build_mapti_cmd failed
[  617.603029] ITS queue timeout (32384 19296)
[  617.607212] ITS cmd its_build_mapti_cmd failed
[  619.053089] ITS queue timeout (32448 19296)
[  619.057276] ITS cmd its_build_mapti_cmd failed
[  620.503228] ITS queue timeout (32512 19296)
[  620.507411] ITS cmd its_build_mapti_cmd failed
[  621.953338] ITS queue timeout (32576 19296)
[  621.957519] ITS cmd its_build_mapti_cmd failed
[  623.403467] ITS queue timeout (32640 19296)
[  623.407648] ITS cmd its_build_mapti_cmd failed
[  624.850262] ITS queue timeout (32704 19296)
[  624.854444] ITS cmd its_build_mapti_cmd failed
[  626.297780] ITS queue timeout (32768 19296)
[  626.301963] ITS cmd its_build_mapti_cmd failed
[  627.747875] ITS queue timeout (32832 19296)
[  627.752056] ITS cmd its_build_discard_cmd failed
[  629.198011] ITS queue timeout (32896 19296)
[  629.202193] ITS cmd its_build_discard_cmd failed
[  630.648278] ITS queue timeout (32960 19296)
[  630.652457] ITS cmd its_build_discard_cmd failed
[  632.098325] ITS queue timeout (33024 19296)
[  632.102505] ITS cmd its_build_discard_cmd failed
[  633.548426] ITS queue timeout (33088 19296)
[  633.552607] ITS cmd its_build_discard_cmd failed
[  634.998678] ITS queue timeout (33152 19296)
[  635.002861] ITS cmd its_build_discard_cmd failed
[  636.448943] ITS queue timeout (33216 19296)
[  636.453123] ITS cmd its_build_discard_cmd failed
[  637.899125] ITS queue timeout (33280 19296)
[  637.903305] ITS cmd its_build_discard_cmd failed
[  639.349230] ITS queue timeout (33312 19296)
[  639.353409] ITS cmd its_build_mapd_cmd failed
[  640.798909] ITS queue timeout (33344 19296)
[  640.803088] ITS cmd its_build_mapd_cmd failed
[  642.248562] ITS queue timeout (33408 19296)
[  642.252745] ITS cmd its_build_mapti_cmd failed
[  643.698240] ITS queue timeout (33472 19296)
[  643.702419] ITS cmd its_build_mapti_cmd failed
[  645.147904] ITS queue timeout (33536 19296)
[  645.152086] ITS cmd its_build_mapti_cmd failed
[  646.597566] ITS queue timeout (33600 19296)
[  646.601745] ITS cmd its_build_mapti_cmd failed
[  646.606358] pcieport 0001:06:04.0: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+
[  648.068111] ITS queue timeout (33664 19296)
[  648.072287] ITS cmd its_build_inv_cmd failed
[  648.077713] pcieport 0001:06:04.0: pciehp: Slot(0): Card present
[  648.077811] pcieport 0001:06:04.0: DPC: DPC probe
[  649.528738] ITS queue timeout (33728 19296)
[  649.532915] ITS cmd its_build_inv_cmd failed
[  649.537416] pcieport 0001:06:04.0: DPC: enabled with IRQ 88
[  649.542994] pcieport 0001:06:04.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  649.557000] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  651.003438] ITS queue timeout (33760 19296)
[  651.007621] ITS cmd its_build_mapd_cmd failed
[  651.534627] pcieport 0001:06:04.0: pciehp: Slot(0): No link
[  652.453722] ITS queue timeout (33824 19296)
[  652.457907] ITS cmd its_build_mapti_cmd failed
[  653.902337] ITS queue timeout (33888 19296)
[  653.906520] ITS cmd its_build_mapti_cmd failed
[  655.346596] ITS queue timeout (33952 19296)
[  655.350778] ITS cmd its_build_mapti_cmd failed
[  656.792694] ITS queue timeout (34016 19296)
[  656.796874] ITS cmd its_build_mapti_cmd failed
[  658.242972] ITS queue timeout (34080 19296)
[  658.247152] ITS cmd its_build_mapti_cmd failed
[  659.692944] ITS queue timeout (34144 19296)
[  659.697126] ITS cmd its_build_mapti_cmd failed
[  661.142819] ITS queue timeout (34208 19296)
[  661.147000] ITS cmd its_build_mapti_cmd failed
[  662.590653] ITS queue timeout (34272 19296)
[  662.594835] ITS cmd its_build_mapti_cmd failed
[  664.040657] ITS queue timeout (34336 19296)
[  664.044838] ITS cmd its_build_discard_cmd failed
[  665.490962] ITS queue timeout (34400 19296)
[  665.495142] ITS cmd its_build_discard_cmd failed
[  666.938055] ITS queue timeout (34464 19296)
[  666.942235] ITS cmd its_build_discard_cmd failed
[  668.388156] ITS queue timeout (34528 19296)
[  668.392338] ITS cmd its_build_discard_cmd failed
[  669.838248] ITS queue timeout (34592 19296)
[  669.842429] ITS cmd its_build_discard_cmd failed
[  671.288317] ITS queue timeout (34656 19296)
[  671.292499] ITS cmd its_build_discard_cmd failed
[  672.738478] ITS queue timeout (34720 19296)
[  672.742660] ITS cmd its_build_discard_cmd failed
[  674.188824] ITS queue timeout (34784 19296)
[  674.193007] ITS cmd its_build_discard_cmd failed
[  675.638933] ITS queue timeout (34816 19296)
[  675.643113] ITS cmd its_build_mapd_cmd failed
[  677.087059] ITS queue timeout (34848 19296)
[  677.091240] ITS cmd its_build_mapd_cmd failed
[  678.536901] ITS queue timeout (34912 19296)
[  678.541083] ITS cmd its_build_mapti_cmd failed
[  679.980180] ITS queue timeout (34976 19296)
[  679.984361] ITS cmd its_build_mapti_cmd failed
[  681.429921] ITS queue timeout (35040 19296)
[  681.434103] ITS cmd its_build_mapti_cmd failed
[  682.879801] ITS queue timeout (35104 19296)
[  682.883983] ITS cmd its_build_mapti_cmd failed
[  682.888587] pcieport 0001:06:06.0: DPC: DPC probe
[  684.333687] ITS queue timeout (35168 19296)
[  684.337866] ITS cmd its_build_inv_cmd failed
[  684.342216] pcieport 0001:06:06.0: DPC: enabled with IRQ 92
[  684.347784] pcieport 0001:06:06.0: DPC: error containment capabilities: Int Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
[  684.361040] pcieport 0001:00:00.0: of_irq_parse_pci: failed with rc=-22
[  684.369792] pcieport 0002:00:00.0: scanning [bus 01-01] behind bridge, pass 0
[  684.376944] pci_bus 0002:00: 2-byte config write to 0002:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  684.386671] pcieport 0002:00:00.0: secondary 1
[  684.392889] pci_bus 0002:00: 2-byte config write to 0002:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  684.402621] pcieport 0002:00:00.0: scanning [bus 01-01] behind bridge, pass 1
[  684.409747] pci_bus 0002:00: 2-byte config write to 0002:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
[  684.419471] pci_bus 0002:00: 2-byte config write to 0002:00:00.0 offset 0x3e may corrupt adjacent RW1C bits
root@j7-evm:/# pcitest.sh
BAR tests

BAR0:           OKAY
BAR1:           OKAY
BAR2:           OKAY
BAR3:           OKAY
BAR4:           OKAY
BAR5:           OKAY

Interrupt tests

[  691.558929] pci-endpoint-test 0001:08:00.0: Failed to get Legacy interrupt
SET IRQ TYPE TO LEGACY:         NOT OKAY
LEGACY IRQ:     NOT OKAY
[  694.009467] ITS queue timeout (35200 19296)
[  694.013653] ITS cmd its_build_mapd_cmd failed
[  695.459382] ITS queue timeout (35264 19296)
[  695.463570] ITS cmd its_build_mapti_cmd failed
[  696.904747] ITS queue timeout (35328 19296)
[  696.908935] ITS cmd its_build_mapti_cmd failed
[  698.351248] ITS queue timeout (35392 19296)
[  698.355433] ITS cmd its_build_mapti_cmd failed
[  699.800936] ITS queue timeout (35456 19296)
[  699.805119] ITS cmd its_build_mapti_cmd failed
[  701.249233] ITS queue timeout (35520 19296)
[  701.253415] ITS cmd its_build_mapti_cmd failed
[  702.692563] ITS queue timeout (35584 19296)
[  702.696746] ITS cmd its_build_mapti_cmd failed
[  704.138111] ITS queue timeout (35648 19296)
[  704.142293] ITS cmd its_build_mapti_cmd failed
[  705.587818] ITS queue timeout (35712 19296)
[  705.592000] ITS cmd its_build_mapti_cmd failed
[  707.035562] ITS queue timeout (35776 19296)
[  707.039746] ITS cmd its_build_mapti_cmd failed
[  708.482818] ITS queue timeout (35840 19296)
[  708.486999] ITS cmd its_build_mapti_cmd failed
[  709.927860] ITS queue timeout (35904 19296)
[  709.932043] ITS cmd its_build_mapti_cmd failed
[  711.373131] ITS queue timeout (35968 19296)
[  711.377312] ITS cmd its_build_mapti_cmd failed
[  712.823212] ITS queue timeout (36032 19296)
[  712.827399] ITS cmd its_build_mapti_cmd failed
[  714.267673] ITS queue timeout (36096 19296)
[  714.271856] ITS cmd its_build_mapti_cmd failed
[  715.717394] ITS queue timeout (36160 19296)
[  715.721575] ITS cmd its_build_mapti_cmd failed
[  717.161158] ITS queue timeout (36224 19296)
[  717.165338] ITS cmd its_build_mapti_cmd failed
[  718.610087] ITS queue timeout (36288 19296)
[  718.614261] ITS cmd its_build_inv_cmd failed
[  720.059073] ITS queue timeout (36352 19296)
[  720.063251] ITS cmd its_build_inv_cmd failed
[  721.501337] ITS queue timeout (36416 19296)
[  721.505511] ITS cmd its_build_inv_cmd failed
[  722.943723] ITS queue timeout (36480 19296)
[  722.947900] ITS cmd its_build_inv_cmd failed
[  724.386078] ITS queue timeout (36544 19296)
[  724.390255] ITS cmd its_build_inv_cmd failed
[  725.828360] ITS queue timeout (36608 19296)
[  725.832536] ITS cmd its_build_inv_cmd failed
[  727.285377] ITS queue timeout (36672 19296)
[  727.289554] ITS cmd its_build_inv_cmd failed
[  728.727656] ITS queue timeout (36736 19296)
[  728.731830] ITS cmd its_build_inv_cmd failed
[  730.169902] ITS queue timeout (36800 19296)
[  730.174076] ITS cmd its_build_inv_cmd failed
[  731.618595] ITS queue timeout (36864 19296)
[  731.622770] ITS cmd its_build_inv_cmd failed
[  733.077844] ITS queue timeout (36928 19296)
[  733.082019] ITS cmd its_build_inv_cmd failed
[  734.526805] ITS queue timeout (36992 19296)
[  734.530984] ITS cmd its_build_inv_cmd failed
[  735.975625] ITS queue timeout (37056 19296)
[  735.979802] ITS cmd its_build_inv_cmd failed
[  737.417904] ITS queue timeout (37120 19296)
[  737.422079] ITS cmd its_build_inv_cmd failed
[  738.860205] ITS queue timeout (37184 19296)
[  738.864382] ITS cmd its_build_inv_cmd failed
[  740.309019] ITS queue timeout (37248 19296)
[  740.313196] ITS cmd its_build_inv_cmd failed
SET IRQ TYPE TO MSI:            OKAY
MSI1:           NOT OKAY
MSI2:           NOT OKAY
MSI3:           NOT OKAY
MSI4:           NOT OKAY
MSI5:           NOT OKAY
MSI6:           NOT OKAY
MSI7:           NOT OKAY
MSI8:           NOT OKAY
MSI9:           NOT OKAY
MSI10:          NOT OKAY
MSI11:          NOT OKAY
MSI12:          NOT OKAY
MSI13:          NOT OKAY
MSI14:          NOT OKAY
MSI15:          NOT OKAY
MSI16:          NOT OKAY
MSI17:          NOT OKAY
MSI18:          NOT OKAY
MSI19:          NOT OKAY
MSI20:          NOT OKAY
MSI21:          NOT OKAY
MSI22:          NOT OKAY
MSI23:          NOT OKAY
MSI24:          NOT OKAY
MSI25:          NOT OKAY
MSI26:          NOT OKAY
MSI27:          NOT OKAY
MSI28:          NOT OKAY
MSI29:          NOT OKAY
MSI30:          NOT OKAY
MSI31:          NOT OKAY
MSI32:          NOT OKAY

[  774.526601] ITS queue timeout (37312 19296)
[  774.530782] ITS cmd its_build_inv_cmd failed
[  775.978844] ITS queue timeout (37376 19296)
[  775.983026] ITS cmd its_build_discard_cmd failed
[  777.438867] ITS queue timeout (37440 19296)
[  777.443046] ITS cmd its_build_inv_cmd failed
[  778.881148] ITS queue timeout (37504 19296)
[  778.885328] ITS cmd its_build_discard_cmd failed
[  780.323837] ITS queue timeout (37568 19296)
[  780.328013] ITS cmd its_build_inv_cmd failed
[  781.772631] ITS queue timeout (37632 19296)
[  781.776810] ITS cmd its_build_discard_cmd failed
[  783.221707] ITS queue timeout (37696 19296)
[  783.225883] ITS cmd its_build_inv_cmd failed
[  784.664227] ITS queue timeout (37760 19296)
[  784.668410] ITS cmd its_build_discard_cmd failed
[  786.113293] ITS queue timeout (37824 19296)
[  786.117470] ITS cmd its_build_inv_cmd failed
[  787.555871] ITS queue timeout (37888 19296)
[  787.560054] ITS cmd its_build_discard_cmd failed
[  788.998490] ITS queue timeout (37952 19296)
[  789.002667] ITS cmd its_build_inv_cmd failed
[  790.440759] ITS queue timeout (38016 19296)
[  790.444939] ITS cmd its_build_discard_cmd failed
[  791.883360] ITS queue timeout (38080 19296)
[  791.887536] ITS cmd its_build_inv_cmd failed
[  793.332084] ITS queue timeout (38144 19296)
[  793.336262] ITS cmd its_build_discard_cmd failed
[  794.774834] ITS queue timeout (38208 19296)
[  794.779011] ITS cmd its_build_inv_cmd failed
[  796.217164] ITS queue timeout (38272 19296)
[  796.221345] ITS cmd its_build_discard_cmd failed
[  797.659832] ITS queue timeout (38336 19296)
[  797.664008] ITS cmd its_build_inv_cmd failed
[  799.108557] ITS queue timeout (38400 19296)
[  799.112735] ITS cmd its_build_discard_cmd failed
[  800.557639] ITS queue timeout (38464 19296)
[  800.561815] ITS cmd its_build_inv_cmd failed
[  802.006356] ITS queue timeout (38528 19296)
[  802.010535] ITS cmd its_build_discard_cmd failed
[  803.455437] ITS queue timeout (38592 19296)
[  803.459614] ITS cmd its_build_inv_cmd failed
[  804.904151] ITS queue timeout (38656 19296)
[  804.908329] ITS cmd its_build_discard_cmd failed
[  806.353192] ITS queue timeout (38720 19296)
[  806.357366] ITS cmd its_build_inv_cmd failed
[  807.801921] ITS queue timeout (38784 19296)
[  807.806100] ITS cmd its_build_discard_cmd failed
[  809.244517] ITS queue timeout (38848 19296)
[  809.248692] ITS cmd its_build_inv_cmd failed
[  810.686764] ITS queue timeout (38912 19296)
[  810.690942] ITS cmd its_build_discard_cmd failed
[  812.129346] ITS queue timeout (38976 19296)
[  812.133520] ITS cmd its_build_inv_cmd failed
[  813.578046] ITS queue timeout (39040 19296)
[  813.582222] ITS cmd its_build_discard_cmd failed
[  815.020641] ITS queue timeout (39104 19296)
[  815.024816] ITS cmd its_build_inv_cmd failed
[  816.469373] ITS queue timeout (39168 19296)
[  816.473552] ITS cmd its_build_discard_cmd failed
[  817.918486] ITS queue timeout (39232 19296)
[  817.922661] ITS cmd its_build_inv_cmd failed
[  819.367206] ITS queue timeout (39296 19296)
[  819.371385] ITS cmd its_build_discard_cmd failed
[  820.817283] ITS queue timeout (39328 19296)
[  820.821464] ITS cmd its_build_mapd_cmd failed
[  822.265575] ITS queue timeout (39360 19296)
[  822.269757] ITS cmd its_build_mapd_cmd failed
[  823.711844] ITS queue timeout (39424 19296)
[  823.716029] ITS cmd its_build_mapti_cmd failed
[  825.160622] ITS queue timeout (39488 19296)
[  825.164804] ITS cmd its_build_mapti_cmd failed
[  826.610355] ITS queue timeout (39552 19296)
[  826.614538] ITS cmd its_build_mapti_cmd failed
[  828.060053] ITS queue timeout (39616 19296)
[  828.064239] ITS cmd its_build_mapti_cmd failed
[  829.507217] ITS queue timeout (39680 19296)
[  829.511398] ITS cmd its_build_mapti_cmd failed
[  830.951320] ITS queue timeout (39744 19296)
[  830.955503] ITS cmd its_build_mapti_cmd failed
[  832.397867] ITS queue timeout (39808 19296)
[  832.402048] ITS cmd its_build_mapti_cmd failed
[  833.847552] ITS queue timeout (39872 19296)
[  833.851735] ITS cmd its_build_mapti_cmd failed
[  835.289946] ITS queue timeout (39936 19296)
[  835.294120] ITS cmd its_build_inv_cmd failed
[  836.732169] ITS queue timeout (40000 19296)
[  836.736345] ITS cmd its_build_inv_cmd failed
[  838.174354] ITS queue timeout (40064 19296)
[  838.178529] ITS cmd its_build_inv_cmd failed
[  839.616557] ITS queue timeout (40128 19296)
[  839.620732] ITS cmd its_build_inv_cmd failed
[  841.065296] ITS queue timeout (40192 19296)
[  841.069471] ITS cmd its_build_inv_cmd failed
[  842.507492] ITS queue timeout (40256 19296)
[  842.511668] ITS cmd its_build_inv_cmd failed
[  843.949714] ITS queue timeout (40320 19296)
[  843.953888] ITS cmd its_build_inv_cmd failed
[  845.398465] ITS queue timeout (40384 19296)
[  845.402639] ITS cmd its_build_inv_cmd failed
SET IRQ TYPE TO MSI-X:          OKAY
MSI-X1:         NOT OKAY
MSI-X2:         NOT OKAY
MSI-X3:         NOT OKAY
MSI-X4:         NOT OKAY
MSI-X5:         NOT OKAY
MSI-X6:         NOT OKAY
MSI-X7:         NOT OKAY
MSI-X8:         NOT OKAY
MSI-X9:         NOT OKAY
MSI-X10:                NOT OKAY
MSI-X11:                NOT OKAY


The SDK is using 8.06.1.2.

Best regards,
Takumi

  • Hi Takumi,

    For the procedures taken, is step 2 always necessary to reproduce the error? For example, is the error reproducible on the system when you do:

    1. BOOT of TDA4VM_EVM(RC) + PCIe SW(PI7C9X3G1632GP) + DRA829(EP)
    2.Run pci remove on RC
        echo 1 > /sys/bus/pci/devices/0001\:00\:00.0/remove
    3.Run pci rescan in RC
        echo 1 > /sys/bus/pci/rescan

    Main purpose of this question is to see if rescan is causing the issue, or if pcitest.sh is leaving the system in a bad state and this is causing the issue instead of rescan.

    Regards,

    Takuma

  • Hi Takuma-san,


    Step 2 is not required.
    It also happens with the steps presented.

    Best regards,
    Takumi

  • Hi Takumi-san,

    If wanting to remove and rescan the PCIe switch device, running remove on the PCIe SW device instead of the TI device and rescanning looks to work on my system. For example, here is my lspci output with the switch "ASMedia Technology Inc. Device 2812" connected:

    root@j7-evm:~# /usr/sbin/lspci
    0000:00:00.0 PCI bridge: Texas Instruments Device b00d
    0001:00:00.0 PCI bridge: Texas Instruments Device b00d
    0001:01:00.0 PCI bridge: ASMedia Technology Inc. Device 2812 (rev 01)
    0001:02:00.0 PCI bridge: ASMedia Technology Inc. Device 2812 (rev 01)
    0001:02:08.0 PCI bridge: ASMedia Technology Inc. Device 2812 (rev 01)
    0001:04:00.0 Non-Volatile memory controller: Phison Electronics Corporation Device 5013 (rev 01)
    0002:00:00.0 PCI bridge: Texas Instruments Device b00d
    root@j7-evm:~#

    In this case, running remove+rescan on 0001:00:00.0 (PCI bridge: Texas Instruments Device b00d) also gave me the error messages you were seeing. However, running remove on 0001:01:00.0 (PCI bridge: ASMedia Technology Inc. Device 2812 (rev 01)) will remove the PCIe switch and rescanning does not cause the error logs to appear, so with this method I can successfully remove/rescan the PCIe switch after Linux has fully booted up.

    I am not sure if this fully answers the original question, since I do see that there is also mentions of MSI/MSI-X error logs from pcitest.sh. However, can you confirm if running remove/rescan on the switch device PI7C9X3G1632GP will work for your intended usecase, or whether there is a reason for running remove/rescan on the TI PCI bridge device?

    Regards,

    Takuma

  • Hi Takuma-san,

    There is no problem if you can execute the use case you presented.
    However, when I tried removing 0001:01:00.0 of PCIeSW in the same way, an ITS queue Timeout error occurred.

    root@j7-evm:/# /usr/sbin/lspci -vvt
    -+-[0002:00]---00.0-[01]----00.0  Kingston Technology Company, Inc. Device 500d
     +-[0001:00]---00.0-[01-0a]----00.0-[02-0a]--+-04.0-[03]--
     |                                           +-06.0-[04]--
     |                                           \-09.0-[05-0a]----00.0-[06-0a]--+-00.0-[07]--
     |                                                                           +-02.0-[08]--
     |                                                                           +-04.0-[09]--
     |                                                                           \-06.0-[0a]--
     \-[0000:00]---00.0-[01]--
    root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:01\:00.0/remove
    [   53.038720] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x11f8 (issued 49372 msec ago)
    [   55.070696] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x01c0 (issued 2024 msec ago)
    [   56.514408] ITS queue timeout (14912 14848)
    [   56.518587] ITS cmd its_build_inv_cmd failed
    [   57.956739] ITS queue timeout (14976 14848)
    [   57.960919] ITS cmd its_build_discard_cmd failed
    [   59.406845] ITS queue timeout (15040 14848)
    [   59.411029] ITS cmd its_build_discard_cmd failed
    [   60.856827] ITS queue timeout (15104 14848)
    [   60.861007] ITS cmd its_build_discard_cmd failed
    [   62.307031] ITS queue timeout (15168 14848)
    [   62.311220] ITS cmd its_build_discard_cmd failed
    [   63.757010] ITS queue timeout (15200 14848)
    [   63.761188] ITS cmd its_build_mapd_cmd failed
    [   65.205830] ITS queue timeout (15264 14848)
    [   65.210017] ITS cmd its_build_discard_cmd failed
    [   66.657587] ITS queue timeout (15296 14848)
    [   66.661763] ITS cmd its_build_mapd_cmd failed
    [   68.100996] ITS queue timeout (15360 14848)
    [   68.105184] ITS cmd its_build_discard_cmd failed
    [   69.543057] ITS queue timeout (15392 14848)
    [   69.547237] ITS cmd its_build_mapd_cmd failed
    [   70.992011] ITS queue timeout (15456 14848)
    [   70.996187] ITS cmd its_build_inv_cmd failed
    [   72.432804] ITS queue timeout (15520 14848)
    [   72.436983] ITS cmd its_build_discard_cmd failed
    [   73.882726] ITS queue timeout (15584 14848)
    [   73.886908] ITS cmd its_build_discard_cmd failed
    [   75.332657] ITS queue timeout (15648 14848)
    [   75.336839] ITS cmd its_build_discard_cmd failed
    [   76.781545] ITS queue timeout (15712 14848)
    [   76.785729] ITS cmd its_build_discard_cmd failed
    [   78.231388] ITS queue timeout (15744 14848)
    [   78.235565] ITS cmd its_build_mapd_cmd failed
    [   79.673907] ITS queue timeout (15808 14848)
    [   79.678084] ITS cmd its_build_inv_cmd failed
    [   81.116197] ITS queue timeout (15872 14848)
    [   81.120379] ITS cmd its_build_discard_cmd failed
    [   82.566242] ITS queue timeout (15936 14848)
    [   82.570425] ITS cmd its_build_discard_cmd failed
    [   84.016192] ITS queue timeout (16000 14848)
    [   84.020370] ITS cmd its_build_discard_cmd failed
    [   85.465355] ITS queue timeout (16064 14848)
    [   85.469539] ITS cmd its_build_discard_cmd failed
    [   86.925421] ITS queue timeout (16096 14848)
    [   86.929594] ITS cmd its_build_mapd_cmd failed
    [   88.375358] ITS queue timeout (16160 14848)
    [   88.379545] ITS cmd its_build_discard_cmd failed
    [   89.825203] ITS queue timeout (16224 14848)
    [   89.829376] ITS cmd its_build_discard_cmd failed
    [   91.275204] ITS queue timeout (16288 14848)
    [   91.279390] ITS cmd its_build_discard_cmd failed
    [   92.725108] ITS queue timeout (16352 14848)
    [   92.729282] ITS cmd its_build_discard_cmd failed
    [   94.175094] ITS queue timeout (16384 14848)
    [   94.179274] ITS cmd its_build_mapd_cmd failed
    [   94.183728] pci_bus 0001:03: busn_res: [bus 03] is released
    [   94.189444] pci_bus 0001:04: busn_res: [bus 04] is released
    [   94.195115] pci_bus 0001:07: busn_res: [bus 07] is released
    [   94.200791] pci_bus 0001:08: busn_res: [bus 08] is released
    [   94.206459] pci_bus 0001:09: busn_res: [bus 09] is released
    [   94.212133] pci_bus 0001:0a: busn_res: [bus 0a] is released
    [   94.217802] pci_bus 0001:06: busn_res: [bus 06-0a] is released
    [   94.223733] pci_bus 0001:05: busn_res: [bus 05-0a] is released
    [   94.229663] pci_bus 0001:02: busn_res: [bus 02-0a] is released
    root@j7-evm:/#


    Best regards,
    Takumi

  • Hi Takumi-san,

    Two things I would like from you:

    1. Could I get the output from /usr/sbin/lspci -vvv again? Based off of the newest logs from -vvt, it seems like there are more devices connected/detected than in our previous thread. I would like to understand what kind of devices are connected to PCIe.
    2. Could you try remove/scanning on the child devices on the PCIe bus? For example, in the logs from -vvt, running it on the device getting enumerated as 02.0-[08]. Then, if remove/scanning works on this child device, working up to it's parent (00.0-[06-0a] in the case of 02.0-[08]). I would like to see if the issue is seen on all levels of PCIe bus, or only at the parent device.

    Regards,

    Takuma

  • Hi Takuma-san,

    1. We will inform you of the lspci results.

    root@j7-evm:/# /usr/sbin/lspci -vvv
    0000:00:00.0 PCI bridge: Texas Instruments Device b00d (prog-if 00 [Normal decode])
            Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 61
            Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: fff00000-000fffff [disabled]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [80] Power Management version 3
                    Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [90] MSI: Enable+ Count=1/1 Maskable+ 64bit+
                    Address: 0000000001000000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [b0] MSI-X: Enable- Count=1 Masked-
                    Vector table: BAR=0 offset=00000000
                    PBA: BAR=0 offset=00000008
            Capabilities: [c0] Express (v2) Root Port (Slot+), MSI 00
                    DevCap: MaxPayload 256 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                            MaxPayload 128 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #0, Speed 8GT/s, Width x1, ASPM L1, Exit Latency L1 <8us
                            ClockPM- Surprise- LLActRep- BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x2 (strange)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                            Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd Off, Power+ Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet- Interlock-
                            Changed: MRL- PresDet- LinkState-
                    RootCap: CRSVisible-
                    RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
                    RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                    DevCap2: Completion Timeout: Range B, TimeoutDis+, NROPrPrP-, LTR+
                             10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt+, EETLPPrefix+, MaxEETLPPrefixes 1
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, LN System CLS Not Supported, TPHComp-, ExtTPHComp-, ARIFwd+
                             AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: ReqEn- EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [100 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
                    RootCmd: CERptEn+ NFERptEn+ FERptEn+
                    RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
                             FirstFatal- NonFatalMsg- FatalMsg- IntMsg 0
                    ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
            Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
            Capabilities: [300 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [4c0 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                    VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC2:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=2 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC3:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=3 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
            Capabilities: [5c0 v1] Address Translation Service (ATS)
                    ATSCap: Invalidate Queue Depth: 01
                    ATSCtl: Enable-, Smallest Translation Unit: 00
            Capabilities: [640 v1] Page Request Interface (PRI)
                    PRICtl: Enable- Reset-
                    PRISta: RF- UPRGI- Stopped+
                    Page Request Capacity: 00000001, Page Request Allocation: 00000000
            Capabilities: [900 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                              PortCommonModeRestoreTime=255us PortTPowerOnTime=26us
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                               T_CommonMode=0us LTR1.2_Threshold=0ns
                    L1SubCtl2: T_PwrOn=10us
            Kernel driver in use: pcieport
    
    0001:00:00.0 PCI bridge: Texas Instruments Device b00d (prog-if 00 [Normal decode])
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 64
            Bus: primary=00, secondary=01, subordinate=0a, sec-latency=0
            I/O behind bridge: 18001000-18001fff [size=4K]
            Memory behind bridge: 18100000-195fffff [size=21M]
            Prefetchable memory behind bridge: 0000000019600000-00000000197fffff [size=2M]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [80] Power Management version 3
                    Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [90] MSI: Enable+ Count=1/1 Maskable+ 64bit+
                    Address: 0000000001040000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [b0] MSI-X: Enable- Count=1 Masked-
                    Vector table: BAR=0 offset=00000000
                    PBA: BAR=0 offset=00000008
            Capabilities: [c0] Express (v2) Root Port (Slot+), MSI 00
                    DevCap: MaxPayload 256 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                            MaxPayload 128 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #0, Speed 8GT/s, Width x2, ASPM L1, Exit Latency L1 <8us
                            ClockPM- Surprise- LLActRep- BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt+ ABWMgmt-
                    SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                            Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd Off, Power+ Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet- Interlock-
                            Changed: MRL- PresDet- LinkState-
                    RootCap: CRSVisible-
                    RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
                    RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                    DevCap2: Completion Timeout: Range B, TimeoutDis+, NROPrPrP-, LTR+
                             10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt+, EETLPPrefix+, MaxEETLPPrefixes 1
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, LN System CLS Not Supported, TPHComp-, ExtTPHComp-, ARIFwd+
                             AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: ReqEn- EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [100 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
                    RootCmd: CERptEn+ NFERptEn+ FERptEn+
                    RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
                             FirstFatal- NonFatalMsg- FatalMsg- IntMsg 0
                    ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
            Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
            Capabilities: [300 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [4c0 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                    VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC2:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=2 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC3:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=3 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
            Capabilities: [5c0 v1] Address Translation Service (ATS)
                    ATSCap: Invalidate Queue Depth: 01
                    ATSCtl: Enable-, Smallest Translation Unit: 00
            Capabilities: [640 v1] Page Request Interface (PRI)
                    PRICtl: Enable- Reset-
                    PRISta: RF- UPRGI- Stopped+
                    Page Request Capacity: 00000001, Page Request Allocation: 00000000
            Capabilities: [900 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                              PortCommonModeRestoreTime=255us PortTPowerOnTime=26us
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                               T_CommonMode=0us LTR1.2_Threshold=0ns
                    L1SubCtl2: T_PwrOn=10us
            Kernel driver in use: pcieport
    
    0001:01:00.0 PCI bridge: Pericom Semiconductor Device c232 (rev 07) (prog-if 00 [Normal decode])
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Region 0: Memory at 18100000 (32-bit, non-prefetchable) [size=512K]
            Bus: primary=01, secondary=02, subordinate=0a, sec-latency=0
            I/O behind bridge: 18001000-18001fff [size=4K]
            Memory behind bridge: 18200000-195fffff [size=20M]
            Prefetchable memory behind bridge: 0000000019600000-00000000197fffff [size=2M]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
                    Address: 0000000000000000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [68] Express (v2) Upstream Port, MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ SlotPowerLimit 0.000W
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
                    LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L1 <1us
                            ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (downgraded)
                            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-
                             AtomicOpsCap: Routing+ 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [b0] MSI-X: Enable+ Count=6 Masked-
                    Vector table: BAR=0 offset=0007f000
                    PBA: BAR=0 offset=0007f080
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1b0 v1] Power Budgeting <?>
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:02:04.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 69
            Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: fff00000-000fffff [disabled]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 0000000001040880  Data: 0000
                    Masking: 000000fd  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #4, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x4 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surprise+
                            Slot #4, PowerLimit 25.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet+ Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending+ InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:02:06.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 73
            Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: 18200000-193fffff [size=18M]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 00000000010408c0  Data: 0000
                    Masking: 000000fd  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #6, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (downgraded)
                            TrErr- Train- SlotClk- DLActive+ BWMgmt+ ABWMgmt-
                    SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surprise+
                            Slot #6, PowerLimit 25.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet+ Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd+
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: LaneErr at lane: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:02:09.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 77
            Bus: primary=02, secondary=05, subordinate=0a, sec-latency=0
            I/O behind bridge: 18001000-18001fff [size=4K]
            Memory behind bridge: 19400000-195fffff [size=2M]
            Prefetchable memory behind bridge: 0000000019600000-00000000197fffff [size=2M]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
                    Address: 0000000001040920  Data: 0000
                    Masking: 000000ff  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot-), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #9, Speed 8GT/s, Width x16, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed unknown (downgraded), Width x0 (downgraded)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 2, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Kernel driver in use: pcieport
    
    0001:04:00.0 Unassigned class [ff00]: Texas Instruments Device b00d
            Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 0
            Region 0: Memory at 18324400 (32-bit, non-prefetchable) [size=512]
            Region 1: Memory at 18324600 (32-bit, non-prefetchable) [size=512]
            Region 2: Memory at 18324000 (32-bit, non-prefetchable) [size=1K]
            Region 3: Memory at 18320000 (32-bit, non-prefetchable) [size=16K]
            Region 4: Memory at 18300000 (32-bit, non-prefetchable) [size=128K]
            Region 5: Memory at 18200000 (32-bit, non-prefetchable) [size=1M]
            Capabilities: [80] Power Management version 3
                    Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [90] MSI: Enable- Count=1/16 Maskable- 64bit+
                    Address: 0000000000000000  Data: 0000
            Capabilities: [b0] MSI-X: Enable- Count=8 Masked-
                    Vector table: BAR=0 offset=00000080
                    PBA: BAR=0 offset=000000f0
            Capabilities: [c0] Express (v2) Endpoint, MSI 00
                    DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <1us, L1 <1us
                            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                            MaxPayload 128 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
                    LnkCap: Port #0, Speed 8GT/s, Width x2, ASPM L1, Exit Latency L1 <8us
                            ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Range B, TimeoutDis+, NROPrPrP-, LTR+
                             10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt+, EETLPPrefix+, MaxEETLPPrefixes 1
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, TPHComp-, ExtTPHComp-
                             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                             AtomicOpsCtl: ReqEn-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [100 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [140 v1] Alternative Routing-ID Interpretation (ARI)
                    ARICap: MFVC- ACS-, Next Function: 1
                    ARICtl: MFVC- ACS-, Function Group: 0
            Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
            Capabilities: [160 v1] Power Budgeting <?>
            Capabilities: [1b8 v1] Latency Tolerance Reporting
                    Max snoop latency: 0ns
                    Max no snoop latency: 0ns
            Capabilities: [1c0 v1] Dynamic Power Allocation <?>
            Capabilities: [200 v1] Single Root I/O Virtualization (SR-IOV)
                    IOVCap: Migration-, Interrupt Message Number: 000
                    IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+
                    IOVSta: Migration-
                    Initial VFs: 4, Total VFs: 4, Number of VFs: 0, Function Dependency Link: 00
                    VF offset: 6, stride: 1, Device ID: 0100
                    Supported Page Size: 00000553, System Page Size: 00000010
                    Region 0: Memory at 0000000018400000 (64-bit, non-prefetchable)
                    VF Migration: offset: 00000000, BIR: 0
            Capabilities: [300 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [400 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
            Capabilities: [440 v1] Process Address Space ID (PASID)
                    PASIDCap: Exec+ Priv+, Max PASID Width: 14
                    PASIDCtl: Enable- Exec- Priv-
            Capabilities: [4c0 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                    VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC2:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=2 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC3:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=3 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
            Capabilities: [5c0 v1] Address Translation Service (ATS)
                    ATSCap: Invalidate Queue Depth: 01
                    ATSCtl: Enable-, Smallest Translation Unit: 00
            Capabilities: [640 v1] Page Request Interface (PRI)
                    PRICtl: Enable- Reset-
                    PRISta: RF- UPRGI- Stopped+
                    Page Request Capacity: 00000001, Page Request Allocation: 00000000
            Capabilities: [900 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                              PortCommonModeRestoreTime=255us PortTPowerOnTime=26us
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                               T_CommonMode=0us LTR1.2_Threshold=0ns
                    L1SubCtl2: T_PwrOn=10us
            Capabilities: [a20 v1] Precision Time Measurement
                    PTMCap: Requester:+ Responder:- Root:-
                    PTMClockGranularity: Unimplemented
                    PTMControl: Enabled:- RootSelected:-
                    PTMEffectiveGranularity: Unknown
            Kernel driver in use: pci-endpoint-test
    
    0001:05:00.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin ? routed to IRQ 78
            Bus: primary=05, secondary=06, subordinate=0a, sec-latency=0
            I/O behind bridge: 18001000-18001fff [size=4K]
            Memory behind bridge: 19400000-195fffff [size=2M]
            Prefetchable memory behind bridge: 0000000019600000-00000000197fffff [size=2M]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
                    Address: 0000000001041400  Data: 0000
                    Masking: 000000ff  Pending: 00000000
            Capabilities: [68] Express (v2) Upstream Port, MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ SlotPowerLimit 0.000W
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #30, Speed 8GT/s, Width x16, ASPM L1, Exit Latency L1 <1us
                            ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed unknown (downgraded), Width x0 (downgraded)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [b0] MSI-X: Enable- Count=6 Masked-
                    Vector table: BAR=0 offset=0007f000
                    PBA: BAR=0 offset=0007f080
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 2, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Kernel driver in use: pcieport
    
    0001:06:00.0 PCI bridge: Pericom Semiconductor Device c232 (rev 07) (prog-if 00 [Normal decode])
            Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 79
            Bus: primary=06, secondary=07, subordinate=07, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: fff00000-000fffff [disabled]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 0000000001041800  Data: 0000
                    Masking: 000000fd  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #16, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x4 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surprise+
                            Slot #0, PowerLimit 25.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet+ Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending+ InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:06:02.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 83
            Bus: primary=06, secondary=08, subordinate=08, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: fff00000-000fffff [disabled]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 0000000001041840  Data: 0000
                    Masking: 000000fd  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #18, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x4 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surprise+
                            Slot #2, PowerLimit 25.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet- Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending+ InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:06:04.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 87
            Bus: primary=06, secondary=09, subordinate=09, sec-latency=0
            I/O behind bridge: 18001000-18001fff [size=4K]
            Memory behind bridge: 19400000-195fffff [size=2M]
            Prefetchable memory behind bridge: 0000000019600000-00000000197fffff [size=2M]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 0000000001041880  Data: 0000
                    Masking: 000000fc  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #20, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x4 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+
                            Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet+ CmdCplt+ HPIrq+ LinkChg+
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet+ Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending+ InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0001:06:06.0 PCI bridge: Pericom Semiconductor Device c232 (rev 06) (prog-if 00 [Normal decode])
            Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 91
            Bus: primary=06, secondary=0a, subordinate=0a, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: fff00000-000fffff [disabled]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [40] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [48] MSI: Enable+ Count=4/8 Maskable+ 64bit+
                    Address: 00000000010418c0  Data: 0000
                    Masking: 000000fd  Pending: 00000000
            Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                    DevCap: MaxPayload 512 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                            RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                            MaxPayload 128 bytes, MaxReadReq 128 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #22, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <1us
                            ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 2.5GT/s (downgraded), Width x4 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                    SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug- Surprise+
                            Slot #6, PowerLimit 25.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd On, Power- Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet+ Interlock-
                            Changed: MRL- PresDet- LinkState-
                    DevCap2: Completion Timeout: Not Supported, TimeoutDis-, NROPrPrP-, LTR-
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, ARIFwd+
                             AtomicOpsCap: Routing+
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                             EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
            Capabilities: [a4] Subsystem: Pericom Semiconductor Device c232
            Capabilities: [100 v1] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [130 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=4
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=05 MaxTimeSlots=64 RejSnoopTrans-
                            Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending+ InProgress-
                            Port Arbitration Table <?>
            Capabilities: [1a0 v1] Device Serial Number 08-16-48-96-00-00-12-d8
            Capabilities: [1c0 v1] Access Control Services
                    ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                    ACSCtl: SrcValid+ TransBlk- ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans-
            Capabilities: [1d0 v1] Multicast
                    McastCap: MaxGroups 64, ECRCRegen-
                    McastCtl: NumGroups 1, Enable-
                    McastBAR: IndexPos 0, BaseAddr 0000000000000000
                    McastReceiveVec:      0000000000000000
                    McastBlockAllVec:     0000000000000000
                    McastBlockUntransVec: 0000000000000000
                    McastOverlayBAR: OverlaySize 0 (disabled), BaseAddr 0000000000000000
            Capabilities: [210 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [2a0 v1] Downstream Port Containment
                    DpcCap: INT Msg #1, RPExt- PoisonedTLP- SwTrigger- RP PIO Log 0, DL_ActiveErr-
                    DpcCtl: Trigger:1 Cmpl- INT+ ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
                    DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
                    Source: 0000
            Capabilities: [2b0 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                    L1SubCtl2:
            Capabilities: [300 v1] Vendor Specific Information: ID=0000 Rev=0 Len=560 <?>
            Kernel driver in use: pcieport
    
    0002:00:00.0 PCI bridge: Texas Instruments Device b00d (prog-if 00 [Normal decode])
            Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 97
            Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
            I/O behind bridge: 0000f000-00000fff [disabled]
            Memory behind bridge: 00100000-001fffff [size=1M]
            Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled]
            Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
            BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                    PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
            Capabilities: [80] Power Management version 3
                    Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [90] MSI: Enable+ Count=1/1 Maskable+ 64bit+
                    Address: 0000000001080000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [b0] MSI-X: Enable- Count=1 Masked-
                    Vector table: BAR=0 offset=00000000
                    PBA: BAR=0 offset=00000008
            Capabilities: [c0] Express (v2) Root Port (Slot+), MSI 00
                    DevCap: MaxPayload 256 bytes, PhantFunc 0
                            ExtTag- RBE+
                    DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                            RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                            MaxPayload 128 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #0, Speed 8GT/s, Width x2, ASPM L1, Exit Latency L1 <8us
                            ClockPM- Surprise- LLActRep- BwNot+ ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (ok)
                            TrErr- Train- SlotClk- DLActive- BWMgmt+ ABWMgmt-
                    SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                            Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                    SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                            Control: AttnInd Off, PwrInd Off, Power+ Interlock-
                    SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet- Interlock-
                            Changed: MRL- PresDet- LinkState-
                    RootCap: CRSVisible-
                    RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
                    RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                    DevCap2: Completion Timeout: Range B, TimeoutDis+, NROPrPrP-, LTR+
                             10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt+, EETLPPrefix+, MaxEETLPPrefixes 1
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, LN System CLS Not Supported, TPHComp-, ExtTPHComp-, ARIFwd+
                             AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
                             AtomicOpsCtl: ReqEn- EgressBlck-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [100 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
                    RootCmd: CERptEn+ NFERptEn+ FERptEn+
                    RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
                             FirstFatal- NonFatalMsg- FatalMsg- IntMsg 0
                    ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
            Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
            Capabilities: [300 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Capabilities: [4c0 v1] Virtual Channel
                    Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                    Arb:    Fixed- WRR32- WRR64- WRR128-
                    Ctrl:   ArbSelect=Fixed
                    Status: InProgress-
                    VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                            Status: NegoPending- InProgress-
                    VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC2:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=2 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
                    VC3:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                            Ctrl:   Enable- ID=3 ArbSelect=Fixed TC/VC=00
                            Status: NegoPending- InProgress-
            Capabilities: [5c0 v1] Address Translation Service (ATS)
                    ATSCap: Invalidate Queue Depth: 01
                    ATSCtl: Enable-, Smallest Translation Unit: 00
            Capabilities: [640 v1] Page Request Interface (PRI)
                    PRICtl: Enable- Reset-
                    PRISta: RF- UPRGI- Stopped+
                    Page Request Capacity: 00000001, Page Request Allocation: 00000000
            Capabilities: [900 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                              PortCommonModeRestoreTime=255us PortTPowerOnTime=26us
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                               T_CommonMode=255us LTR1.2_Threshold=458752ns
                    L1SubCtl2: T_PwrOn=220us
            Kernel driver in use: pcieport
    
    0002:01:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. Device 500d (rev 01) (prog-if 02 [NVM Express])
            Subsystem: Kingston Technology Company, Inc. Device 500d
            Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0
            Interrupt: pin A routed to IRQ 96
            Region 0: Memory at 4400100000 (64-bit, non-prefetchable) [size=16K]
            Capabilities: [80] Express (v2) Endpoint, MSI 00
                    DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
                            ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
                    DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                            RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
                            MaxPayload 128 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                    LnkCap: Port #1, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 unlimited
                            ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s (ok), Width x2 (downgraded)
                            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, NROPrPrP-, LTR+
                             10BitTagComp-, 10BitTagReq-, OBFF Not Supported, ExtFmt+, EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS-, TPHComp-, ExtTPHComp-
                             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled
                             AtomicOpsCtl: ReqEn-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance De-emphasis: -6dB
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                             EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
            Capabilities: [d0] MSI-X: Enable+ Count=9 Masked-
                    Vector table: BAR=0 offset=00002000
                    PBA: BAR=0 offset=00003000
            Capabilities: [e0] MSI: Enable- Count=1/8 Maskable+ 64bit+
                    Address: 0000000000000000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [f8] Power Management version 3
                    Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [100 v1] Latency Tolerance Reporting
                    Max snoop latency: 0ns
                    Max no snoop latency: 0ns
            Capabilities: [110 v1] L1 PM Substates
                    L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                              PortCommonModeRestoreTime=10us PortTPowerOnTime=220us
                    L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                               T_CommonMode=0us LTR1.2_Threshold=458752ns
                    L1SubCtl2: T_PwrOn=220us
            Capabilities: [200 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [300 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
                    LaneErrStat: 0
            Kernel driver in use: nvme
            Kernel modules: nvme
    
    root@j7-evm:/#


    2. Child device remove/rescan succeeded without error. ITS queue timeout occurred when removing the parent device.

    Best regards,
    Takumi

  • Hi Takumi-san,

    Thank you for the lspci output. It looks like the complexity of the PCIe bus configuration has increased. I have some additional experiments I would like for you to try out:

    1. Could I get clarification on 2? Is 0001:05:00.0 the parent device causing the ITS error when removing/rescanning? Or this device is fine removing and the error only comes up when removing/rescanning the parent device 0001:01:00.0?
    2. To see if there is some issue with recursively removing child devices when the parent device is removed, can you do the following in order:
      1. first remove the child devices (aka 0001:06:02.0, 0001:06:04.0, 0001:06:06.0).
      2. Then remove 0001:06:00.0.
      3. Remove 0001:05:00.0 
      4. Remove 0001:02:06.0, 0001:02:09.0
      5. Remove 0001:02:04.0
      6. Remove 0001:01:00.0

    For my new question 2, let me know which step fails, and I think this will greatly narrow down which device is causing the issue.

    Regards,

    Takuma

  • Hi Takuma-san,

    1. The error occurs even when removing 0001:05:00.0 and 0001:01:00.0.

    2. As a result of removing in the specified order, an error occurred at 0001:06:00.0.

    root@j7-evm:/# /usr/sbin/lspci -vvt
    -+-[0002:00]---00.0-[01]----00.0  Kingston Technology Company, Inc. Device 500d
     +-[0001:00]---00.0-[01-0a]----00.0-[02-0a]--+-04.0-[03]--
     |                                           +-06.0-[04]----00.0  Texas Instruments Device b00d
     |                                           \-09.0-[05-0a]----00.0-[06-0a]--+-00.0-[07]--
     |                                                                           +-02.0-[08]--
     |                                                                           +-04.0-[09]--
     |                                                                           \-06.0-[0a]--
     \-[0000:00]---00.0-[01]--
    root@j7-evm:/#
    root@j7-evm:/#
    root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:06\:02.0/remove
    [  104.959307] pci_bus 0001:08: busn_res: [bus 08] is released
    root@j7-evm:/#
    root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:06\:04.0/remove
    [  108.014801] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x11f8 (issued 104196 msec ago)
    [  110.042790] pcieport 0001:06:04.0: pciehp: Timeout on hotplug command 0x01c0 (issued 2020 msec ago)
    [  110.052415] pci_bus 0001:09: busn_res: [bus 09] is released
    root@j7-evm:/#
    root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:06\:06.0/remove
    [  117.643382] pci_bus 0001:0a: busn_res: [bus 0a] is released
    root@j7-evm:/#
    root@j7-evm:/# echo 1 > /sys/bus/pci/devices/0001\:06\:00.0/remove
    [  130.367371] ITS queue timeout (14912 14848)
    [  130.371550] ITS cmd its_build_inv_cmd failed
    [  131.826790] ITS queue timeout (14976 14848)
    [  131.830968] ITS cmd its_build_discard_cmd failed
    [  133.279390] ITS queue timeout (15040 14848)
    [  133.283578] ITS cmd its_build_discard_cmd failed
    [  134.757078] ITS queue timeout (15104 14848)
    [  134.761278] ITS cmd its_build_discard_cmd failed
    [  135.123444] Initializing XFRM netlink socket
    [  136.212935] ITS queue timeout (15168 14848)
    [  136.217129] ITS cmd its_build_discard_cmd failed
    [  137.699271] ITS queue timeout (15200 14848)
    [  137.703493] ITS cmd its_build_mapd_cmd failed
    [  137.708310] pci_bus 0001:07: busn_res: [bus 07] is released
    root@j7-evm:/#

    Best regards,
    Takumi

  • Hi Takumi-san,

    So far, I am having some trouble reproducing the issue on my end using the PCIe switch bought during our last E2E thread debug. And based off of experiment 2, it looks like any PCIe switch/bridge device is causing issues, and any child devices do not cause issues. Since I am not seeing this issue despite having a PCIe switch device, I am wondering if the issue is due to having multiple daisy chained PCIe switches, because that looks to be the main difference.

    Experiment #1: On your system, Is it possible to remove some devices from the system for debugging purposes? For example, starting up the system with only the following:

     +-[0002:00]---00.0-[01]----00.0  Kingston Technology Company, Inc. Device 500d
     +-[0001:00]---00.0-[01-0a]----00.0-[02-0a]--+-04.0-[03]--
     |                                                                   +-06.0-[04]----00.0  Texas Instruments Device b00d
     \-[0000:00]---00.0-[01]--

    Experiment #2: And if the above keeps giving errors, try to see if taking out the TI device as well, like the following:

     +-[0002:00]---00.0-[01]----00.0  Kingston Technology Company, Inc. Device 500d
     +-[0001:00]---00.0-[01-0a]----00.0-[02-0a]--+-04.0-[03]--
     |                                                                   +-06.0-[04]--
     \-[0000:00]---00.0-[01]--

    The second experiment is mainly to see if the TI device is causing some issues because of something to do with our hot plug capabilities as documented in our SDK (https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-jacinto7/09_00_00_08/exports/docs/linux/Foundational_Components/Kernel/Kernel_Drivers/PCIe/PCIe_End_Point.html):

    Regards,

    Takuma