J7200XSOMXEVM: paired with the J721EXCP01EVM common processor board, PCIe X 1 LANE/PCIe X2 LANE not working

Part Number: J7200XSOMXEVM

Hi,

I am trying to validate the PCIe interface j7200 EVM board , but its not working with pre-build binaries received through SDK from TI.

Please suggest what changes need to be done w.r.t configure/device tree changes to bring it to working condition.

Also i try to find the respective driver details in Documents folder for TCA9543APWR as per information given in the TI user guide (attached snapshot for reference) but didn't find any .

Regards

Praveen

  • Hi Praveen,

    Could you share with me which Processor SDK Linux version is being used, and also share the output from dmesg? For example, piping the output from dmesg to a text file and sharing it will be great "dmesg > dmesg_output.txt".

    There should not be any need to change device tree when using the TI EVM as a RC device (aka, if the goal is to connect EP devices like a NVMe SSD to TI EVM). With current information, some things that could be causing issues are the following:

    1. There are two slots that take in 4 lane PCIe devices. However, only one slot (the slot that supports x2 lane) is functional, due to reduced features for J7200. Details can be found here:
    2. There is a DIP switch that controls whether the EVM board is in RC or EP device mode. Please ensure the DIP switch is in RC mode if you are trying to use the PCIe interface to connect add-in cards like NVMe SSD cards:

    If the screenshots are too small to see, please reference the EVM user guide here: https://www.ti.com/lit/ug/spruiw7a/spruiw7a.pdf. The relevant sections are 4.11 PCIe Interface, and 3.4 EVM DIP Switches section.

    If we can verify hardware configuration is correct, then we can go through the dmesg logs to see if we can spot any issues software-wise.

    Regards,

    Takuma

  • Hi Takuma,

    Below are the h/w configuration details :


    DIP Switch : SW3.6 -> OFF (Root Complex)

    PCIe ethernet card connected to PCIe x2 Lane port.

    root@j7200-evm:~# lspci
    00:00.0 Class 0604: 104c:b00f
    root@j7200-evm:~# 

    SDK details:

    installation file used to fetch the sources.

    ti-processor-sdk-linux-j7200-evm-08_06_01_02-Linux-x86-Install.bin

    kernel version : Linux version 5.10.162-g76b3e88d56

    Regards

    Praveen

  • 5826.dmesg_output.txt
    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd080]
    [    0.000000] Linux version 5.10.162-g76b3e88d56 (oe-user@oe-host) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #1 SMP PREEMPT Tue May 2 21:46:40 UTC 2023
    [    0.000000] Machine model: Texas Instruments K3 J7200 SoC
    [    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
    [    0.000000] printk: bootconsole [ns16550a0] enabled
    [    0.000000] efi: UEFI not found.
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a0000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a0100000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a1000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a1100000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a2000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a2100000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a3000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a3100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a3100000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5000000, size 2 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-virtual-eth-queues@a5000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a5200000, size 30 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-virtual-eth-buffers@a5200000, compatible id shared-dma-pool
    [    0.000000] Zone ranges:
    [    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
    [    0.000000]   DMA32    empty
    [    0.000000]   Normal   [mem 0x0000000100000000-0x00000008ffffffff]
    [    0.000000] Movable zone start for each node
    [    0.000000] Early memory node ranges
    [    0.000000]   node   0: [mem 0x0000000080000000-0x000000009e7fffff]
    [    0.000000]   node   0: [mem 0x000000009e800000-0x00000000a47fffff]
    [    0.000000]   node   0: [mem 0x00000000a4800000-0x00000000a4ffffff]
    [    0.000000]   node   0: [mem 0x00000000a5000000-0x00000000a6ffffff]
    [    0.000000]   node   0: [mem 0x00000000a7000000-0x00000000ffffffff]
    [    0.000000]   node   0: [mem 0x0000000880000000-0x00000008ffffffff]
    [    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000008ffffffff]
    [    0.000000] On node 0 totalpages: 1048576
    [    0.000000]   DMA zone: 8192 pages used for memmap
    [    0.000000]   DMA zone: 0 pages reserved
    [    0.000000]   DMA zone: 524288 pages, LIFO batch:63
    [    0.000000]   Normal zone: 8192 pages used for memmap
    [    0.000000]   Normal zone: 524288 pages, LIFO batch:63
    [    0.000000] cma: Reserved 512 MiB at 0x00000000e0000000
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.2
    [    0.000000] percpu: Embedded 22 pages/cpu s50392 r8192 d31528 u90112
    [    0.000000] pcpu-alloc: s50392 r8192 d31528 u90112 alloc=22*4096
    [    0.000000] pcpu-alloc: [0] 0 [0] 1 
    [    0.000000] Detected PIPT I-cache on CPU0
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] CPU features: detected: EL2 vector hardening
    [    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
    [    0.000000] CPU features: detected: Spectre-BHB
    [    0.000000] CPU features: detected: ARM erratum 1742098
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1032192
    [    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 mtdparts=47040000.spi.0:1m(ospi.tiboot3),2m(ospi.tispl),4m(ospi.u-boot),256k(ospi.env),256k(ospi.env.backup),57088k@8m(ospi.rootfs),256k(ospi.phypattern);47034000.hyperbus:1m(hbmc.tiboot3),2m(hbmc.tispl),4m(hbmc.u-boot),256k(hbmc.env),-@8m(hbmc.rootfs) root=PARTUUID=4c979f29-02 rw rootfstype=ext4 rootwait
    [    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
    [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [    0.000000] software IO TLB: mapped [mem 0x00000000dc000000-0x00000000e0000000] (64MB)
    [    0.000000] Memory: 3373792K/4194304K available (11200K kernel code, 1160K rwdata, 4300K rodata, 1856K init, 433K bss, 296224K reserved, 524288K cma-reserved)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu: 	RCU event tracing is enabled.
    [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
    [    0.000000] 	Trampoline variant of Tasks RCU enabled.
    [    0.000000] 	Tracing variant of Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 960 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] GICv3: Distributor has no Range Selector support
    [    0.000000] GICv3: 16 PPIs implemented
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001900000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @880800000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x0000000880030000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000880040000
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000002] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.008335] Console: colour dummy device 80x25
    [    0.012894] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.023566] pid_max: default: 32768 minimum: 301
    [    0.028322] LSM: Security Framework initializing
    [    0.033079] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.040657] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.049531] rcu: Hierarchical SRCU implementation.
    [    0.054609] Platform MSI: msi-controller@1820000 domain created
    [    0.060763] PCI/MSI: /bus@100000/interrupt-controller@1800000/msi-controller@1820000 domain created
    [    0.070038] EFI services will not be available.
    [    0.074762] smp: Bringing up secondary CPUs ...
    [    0.087926] Detected PIPT I-cache on CPU1
    [    0.087950] GICv3: CPU1: found redistributor 1 region 0:0x0000000001920000
    [    0.087964] GICv3: CPU1: using allocated LPI pending table @0x0000000880050000
    [    0.088002] CPU1: Booted secondary processor 0x0000000001 [0x411fd080]
    [    0.088053] smp: Brought up 1 node, 2 CPUs
    [    0.117401] SMP: Total of 2 processors activated.
    [    0.122207] CPU features: detected: 32-bit EL0 Support
    [    0.127462] CPU features: detected: CRC32 instructions
    [    0.141552] CPU: All CPU(s) started at EL2
    [    0.145750] alternatives: patching kernel code
    [    0.150786] devtmpfs: initialized
    [    0.157273] KASLR disabled due to lack of seed
    [    0.161933] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.171900] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
    [    0.190079] pinctrl core: initialized pinctrl subsystem
    [    0.195799] DMI not present or invalid.
    [    0.200076] NET: Registered protocol family 16
    [    0.205326] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
    [    0.212634] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [    0.220688] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [    0.229011] thermal_sys: Registered thermal governor 'step_wise'
    [    0.229014] thermal_sys: Registered thermal governor 'power_allocator'
    [    0.235490] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
    [    0.249131] ASID allocator initialised with 65536 entries
    [    0.266731] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
    [    0.273586] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
    [    0.280432] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
    [    0.287278] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
    [    0.294829] cryptd: max_cpu_qlen set to 1000
    [    0.301013] k3-chipinfo 43000014.chipid: Family:J7200 rev:SR2.0 JTAGID[0x1bb6d02f] Detected
    [    0.309830] vsys_3v3: supplied by evm_12v0
    [    0.314208] vsys_5v0: supplied by evm_12v0
    [    0.318816] iommu: Default domain type: Translated 
    [    0.324009] SCSI subsystem initialized
    [    0.328135] mc: Linux media interface: v0.10
    [    0.332516] videodev: Linux video capture interface: v2.00
    [    0.338155] pps_core: LinuxPPS API ver. 1 registered
    [    0.343226] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.352563] PTP clock support registered
    [    0.356584] EDAC MC: Ver: 3.0.0
    [    0.360299] FPGA manager framework
    [    0.363813] Advanced Linux Sound Architecture Driver Initialized.
    [    0.370441] clocksource: Switched to clocksource arch_sys_counter
    [    0.376772] VFS: Disk quotas dquot_6.6.0
    [    0.380808] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [    0.390507] NET: Registered protocol family 2
    [    0.395342] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
    [    0.403990] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
    [    0.412743] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [    0.420972] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
    [    0.428836] TCP: Hash tables configured (established 32768 bind 32768)
    [    0.435703] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
    [    0.442600] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
    [    0.450009] NET: Registered protocol family 1
    [    0.454759] RPC: Registered named UNIX socket transport module.
    [    0.460815] RPC: Registered udp transport module.
    [    0.465618] RPC: Registered tcp transport module.
    [    0.470422] RPC: Registered tcp NFSv4.1 backchannel transport module.
    [    0.477008] NET: Registered protocol family 44
    [    0.481553] PCI: CLS 0 bytes, default 64
    [    0.485927] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
    [    0.496415] Initialise system trusted keyrings
    [    0.501056] workingset: timestamp_bits=46 max_order=20 bucket_order=0
    [    0.509355] squashfs: version 4.0 (2009/01/31) Phillip Lougher
    [    0.515617] NFS: Registering the id_resolver key type
    [    0.520796] Key type id_resolver registered
    [    0.525072] Key type id_legacy registered
    [    0.529198] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
    [    0.536048] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
    [    0.543688] 9p: Installing v9fs 9p2000 file system support
    [    0.569125] Key type asymmetric registered
    [    0.573313] Asymmetric key parser 'x509' registered
    [    0.578314] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
    [    0.585872] io scheduler mq-deadline registered
    [    0.590498] io scheduler kyber registered
    [    0.595856] pinctrl-single 4301c000.pinctrl: 13 pins, size 52
    [    0.601814] pinctrl-single 4301c038.pinctrl: 2 pins, size 8
    [    0.607606] pinctrl-single 4301c068.pinctrl: 59 pins, size 236
    [    0.613643] pinctrl-single 4301c174.pinctrl: 8 pins, size 32
    [    0.619557] pinctrl-single 11c000.pinctrl: 67 pins, size 268
    [    0.625401] pinctrl-single 11c11c.pinctrl: 3 pins, size 12
    [    0.634929] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [    0.647385] brd: module loaded
    [    0.654611] loop: module loaded
    [    0.658268] megasas: 07.714.04.00-rc1
    [    0.663825] tun: Universal TUN/TAP device driver, 1.6
    [    0.669248] igbvf: Intel(R) Gigabit Virtual Function Network Driver
    [    0.675660] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
    [    0.681737] sky2: driver version 1.30
    [    0.686008] VFIO - User Level meta-driver version: 0.3
    [    0.691759] i2c /dev entries driver
    [    0.696106] sdhci: Secure Digital Host Controller Interface driver
    [    0.702438] sdhci: Copyright(c) Pierre Ossman
    [    0.707150] sdhci-pltfm: SDHCI platform and OF driver helper
    [    0.713411] ledtrig-cpu: registered to indicate activity on CPUs
    [    0.719702] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [    0.727000] optee: probing for conduit method.
    [    0.731565] optee: revision 3.20 (8e74d476)
    [    0.747983] optee: dynamic shared memory is enabled
    [    0.757450] optee: initialized driver
    [    0.762322] NET: Registered protocol family 17
    [    0.766954] 9pnet: Installing 9P2000 support
    [    0.771351] Key type dns_resolver registered
    [    0.775817] Loading compiled-in X.509 certificates
    [    0.788105] ti-sci 44083000.dmsc: ABI: 3.1 (firmware rev 0x0008 '8.6.3--v08.06.03 (Chill Capybar')
    [    0.813932] omap_i2c 40b00000.i2c: bus 0 rev0.12 at 100 kHz
    [    0.820147] omap_i2c 40b10000.i2c: bus 1 rev0.12 at 100 kHz
    [    0.826391] omap_i2c 42120000.i2c: bus 2 rev0.12 at 100 kHz
    [    0.832643] pca953x 3-0021: supply vcc not found, using dummy regulator
    [    0.839473] pca953x 3-0021: using no AI
    [    0.866903] pca953x 3-0020: supply vcc not found, using dummy regulator
    [    0.873708] pca953x 3-0020: using no AI
    [    0.878278] pca953x 3-0022: supply vcc not found, using dummy regulator
    [    0.885085] pca953x 3-0022: using AI
    [    0.889383] omap_i2c 2000000.i2c: bus 3 rev0.12 at 400 kHz
    [    0.895587] pca953x 4-0020: supply vcc not found, using dummy regulator
    [    0.902404] pca953x 4-0020: using no AI
    [    0.926769] omap_i2c 2010000.i2c: bus 4 rev0.12 at 400 kHz
    [    0.932797] omap_i2c 2020000.i2c: bus 5 rev0.12 at 100 kHz
    [    0.938782] omap_i2c 2030000.i2c: bus 6 rev0.12 at 100 kHz
    [    0.944753] omap_i2c 2040000.i2c: bus 7 rev0.12 at 100 kHz
    [    0.950730] omap_i2c 2050000.i2c: bus 8 rev0.12 at 100 kHz
    [    0.956689] omap_i2c 2060000.i2c: bus 9 rev0.12 at 100 kHz
    [    0.962826] ti-sci-intr bus@100000:bus@28380000:interrupt-controller2: Interrupt Router 137 domain created
    [    0.972803] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 131 domain created
    [    0.981611] ti-sci-intr bus@100000:bus@30000000:interrupt-controller1: Interrupt Router 213 domain created
    [    0.991641] ti-sci-inta 33d00000.msi-controller: Interrupt Aggregator domain 209 created
    [    1.001322] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
    [    1.009003] j721e-pcie 2910000.pcie:       IO 0x0018001000..0x0018010fff -> 0x0018001000
    [    1.017282] j721e-pcie 2910000.pcie:      MEM 0x0018011000..0x001fffffff -> 0x0018011000
    [    1.025559] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
    [    2.044968] j721e-pcie 2910000.pcie: PCI host bridge to bus 0000:00
    [    2.051393] pci_bus 0000:00: root bus resource [bus 00-0f]
    [    2.057007] pci_bus 0000:00: root bus resource [io  0x0000-0xffff] (bus address [0x18001000-0x18010fff])
    [    2.066699] pci_bus 0000:00: root bus resource [mem 0x18011000-0x1fffffff]
    [    2.073755] pci 0000:00:00.0: [104c:b00f] type 01 class 0x060400
    [    2.079995] pci 0000:00:00.0: supports D1
    [    2.084090] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
    [    2.089981] pci 0000:00:00.0: reg 0x224: [mem 0x00000000-0x003fffff 64bit]
    [    2.097008] pci 0000:00:00.0: VF(n) BAR0 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR0 for 4 VFs)
    [    2.108027] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.117136] pci_bus 0000:01: busn_res: [bus 01-0f] end is updated to 01
    [    2.123909] pci 0000:00:00.0: BAR 7: assigned [mem 0x18400000-0x193fffff 64bit]
    [    2.131384] pci 0000:00:00.0: PCI bridge to [bus 01]
    [    2.136671] pcieport 0000:00:00.0: PME: Signaling with IRQ 43
    [    2.143688] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,32] sci-dev-id:235
    [    2.153579] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
    [    2.160342] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66349100, num_proxies:64
    [    2.169904] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:1024, gp-rings[120,200] sci-dev-id:211
    [    2.180067] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
    [    2.186828] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66349100, num_proxies:64
    [    2.194827] 40a00000.serial: ttyS1 at MMIO 0x40a00000 (irq = 15, base_baud = 6000000) is a 8250
    [    2.204256] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 22, base_baud = 3000000) is a 8250
    [    2.213006] printk: console [ttyS2] enabled
    [    2.221443] printk: bootconsole [ns16550a0] disabled
    [    2.231921] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 23, base_baud = 3000000) is a 8250
    [    2.244312] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
    [    2.418445] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 20000
    [    2.426853] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [    2.435152] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [    2.447992] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
    [    2.455200] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
    [    2.461487] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:500000000, add_val:1 pps:0
    [    2.471830] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
    [    2.581818] mmc0: CQHCI version 5.10
    [    2.589261] vdd_mmc1: supplied by vsys_3v3
    [    2.594099] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc8900
    [    2.600956] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc8900
    [    2.608122] ti-udma 285c0000.dma-controller: Channels: 26 (tchan: 13, rchan: 13, gp-rflow: 8)
    [    2.618058] ti-udma 31150000.dma-controller: Channels: 50 (tchan: 25, rchan: 25, gp-rflow: 8)
    [    2.630192] spi-nor spi7.0: s28hs512t (65536 Kbytes)
    [    2.631213] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
    [    2.635169] 7 cmdlinepart partitions found on MTD device 47040000.spi.0
    [    2.649221] Creating 7 MTD partitions on "47040000.spi.0":
    [    2.654696] 0x000000000000-0x000000100000 : "ospi.tiboot3"
    [    2.660738] 0x000000100000-0x000000300000 : "ospi.tispl"
    [    2.666483] 0x000000300000-0x000000700000 : "ospi.u-boot"
    [    2.672292] 0x000000700000-0x000000740000 : "ospi.env"
    [    2.677832] 0x000000740000-0x000000780000 : "ospi.env.backup"
    [    2.684001] 0x000000800000-0x000003fc0000 : "ospi.rootfs"
    [    2.689838] 0x000003fc0000-0x000004000000 : "ospi.phypattern"
    [    2.701429] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
    [    2.731933] mmc0: Command Queue Engine enabled
    [    2.736383] mmc0: new HS400 MMC card at address 0001
    [    2.741683] mmcblk0: mmc0:0001 S0J56X 14.8 GiB 
    [    2.746356] mmcblk0boot0: mmc0:0001 S0J56X partition 1 31.5 MiB
    [    2.752413] mmcblk0boot1: mmc0:0001 S0J56X partition 2 31.5 MiB
    [    2.758433] mmcblk0rpmb: mmc0:0001 S0J56X partition 3 4.00 MiB, chardev (237:0)
    [    2.766512]  mmcblk0: p1
    [    2.874451] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 20000
    [    2.882940] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [    2.891252] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA02102, cpsw version 0x6BA82102 Ports: 2 quirks:00000000
    [    2.904117] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
    [    2.911326] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
    [    2.917627] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:500000000, add_val:1 pps:0
    [    2.927796] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
    [    2.936173] debugfs: Directory 'pd:240' with parent 'pm_genpd' already present!
    [    2.943649] mmc1: CQHCI version 5.10
    [    2.947906] ALSA device list:
    [    2.950873]   No soundcards found.
    [    2.985013] mmc1: SDHCI controller on 4fb0000.mmc [4fb0000.mmc] using ADMA 64-bit
    [    2.992828] Waiting for root device PARTUUID=4c979f29-02...
    [    3.042564] mmc1: new ultra high speed SDR104 SDHC card at address aaaa
    [    3.049564] mmcblk1: mmc1:aaaa SE32G 29.7 GiB 
    [    3.056813]  mmcblk1: p1 p2
    [    3.295270] EXT4-fs (mmcblk1p2): 1 orphan inode deleted
    [    3.300513] EXT4-fs (mmcblk1p2): recovery complete
    [    3.315222] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
    [    3.323336] VFS: Mounted root (ext4 filesystem) on device 179:98.
    [    3.334630] devtmpfs: mounted
    [    3.338814] Freeing unused kernel memory: 1856K
    [    3.343438] Run /sbin/init as init process
    [    3.347527]   with arguments:
    [    3.347529]     /sbin/init
    [    3.347531]   with environment:
    [    3.347533]     HOME=/
    [    3.347535]     TERM=linux
    [    3.448027] systemd[1]: System time before build time, advancing clock.
    [    3.482792] NET: Registered protocol family 10
    [    3.487753] Segment Routing with IPv6
    [    3.511915] systemd[1]: systemd 244.5+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
    [    3.533679] systemd[1]: Detected architecture arm64.
    [    3.576756] systemd[1]: Set hostname to <j7200-evm>.
    [    3.720223] systemd[1]: /lib/systemd/system/irqbalanced.service:6: Unknown key name 'ConditionCPUs' in section 'Unit', ignoring.
    [    3.743744] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock \xe2\x86\x92 /run/docker.sock; please update the unit file accordingly.
    [    3.809949] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.818383] systemd[1]: Created slice system-getty.slice.
    [    3.838569] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.846018] systemd[1]: Created slice system-serial\x2dgetty.slice.
    [    3.866520] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.873927] systemd[1]: Created slice system-syslog\x2dng.slice.
    [    3.895321] systemd[1]: Created slice User and Session Slice.
    [    3.918675] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
    [    3.942589] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
    [    3.966576] systemd[1]: Reached target Paths.
    [    3.986505] systemd[1]: Reached target Remote File Systems.
    [    4.006500] systemd[1]: Reached target Slices.
    [    4.026508] systemd[1]: Reached target Swap.
    [    4.058612] systemd[1]: Listening on RPCbind Server Activation Socket.
    [    4.082591] systemd[1]: Reached target RPC Port Mapper.
    [    4.106613] systemd[1]: Listening on Process Core Dump Socket.
    [    4.126683] systemd[1]: Listening on initctl Compatibility Named Pipe.
    [    4.152285] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
    [    4.160658] systemd[1]: Listening on Journal Socket (/dev/log).
    [    4.182789] systemd[1]: Listening on Journal Socket.
    [    4.198806] systemd[1]: Listening on Network Service Netlink Socket.
    [    4.222748] systemd[1]: Listening on udev Control Socket.
    [    4.242632] systemd[1]: Listening on udev Kernel Socket.
    [    4.264829] systemd[1]: Mounting Huge Pages File System...
    [    4.284879] systemd[1]: Mounting POSIX Message Queue File System...
    [    4.308850] systemd[1]: Mounting Kernel Debug File System...
    [    4.331430] systemd[1]: Mounting Temporary Directory (/tmp)...
    [    4.349305] systemd[1]: Starting Create list of static device nodes for the current kernel...
    [    4.379223] systemd[1]: Starting RPC Bind...
    [    4.394668] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
    [    4.407233] systemd[1]: Starting Journal Service...
    [    4.430609] systemd[1]: Starting Load Kernel Modules...
    [    4.447998] systemd[1]: Starting Remount Root and Kernel File Systems...
    [    4.458161] cryptodev: loading out-of-tree module taints kernel.
    [    4.470156] cryptodev: driver 1.10 loaded.
    [    4.471549] EXT4-fs (mmcblk1p2): re-mounted. Opts: (null)
    [    4.485052] systemd[1]: Starting udev Coldplug all Devices...
    [    4.513637] systemd[1]: Started RPC Bind.
    [    4.530953] systemd[1]: Started Journal Service.
    [    4.708307] systemd-journald[172]: Received client request to flush runtime journal.
    [    4.839078] random: systemd: uninitialized urandom read (16 bytes read)
    [    4.862553] random: systemd: uninitialized urandom read (16 bytes read)
    [    4.874575] random: systemd-journal: uninitialized urandom read (16 bytes read)
    [    5.287521] random: crng init done
    [    5.290949] random: 65 urandom warning(s) missed due to ratelimiting
    [    5.388451] ti-udma 285c0000.dma-controller: chan1: is running!
    [    5.488066] platform 41000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [    5.501516] platform 41000000.r5f: configured R5F for IPC-only mode
    [    5.514215] platform 41000000.r5f: assigned reserved memory node r5f-dma-memory@a0000000
    [    5.524467] remoteproc remoteproc0: 41000000.r5f is available
    [    5.543047] remoteproc remoteproc0: attaching to 41000000.r5f
    [    5.550668] platform 41000000.r5f: R5F core initialized in IPC-only mode
    [    5.566201]  remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@a0000000
    [    5.575928] virtio_rpmsg_bus virtio0: rpmsg host is online
    [    5.582837] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
    [    5.590514] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [    5.601157]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [    5.607377] remoteproc remoteproc0: remote processor 41000000.r5f is now attached
    [    5.618377] platform 5c00000.r5f: configured R5F for remoteproc mode
    [    5.626248] platform 5c00000.r5f: assigned reserved memory node r5f-dma-memory@a2000000
    [    5.637500] remoteproc remoteproc1: 5c00000.r5f is available
    [    5.643892] platform 5d00000.r5f: configured R5F for remoteproc mode
    [    5.651205] platform 5d00000.r5f: assigned reserved memory node r5f-dma-memory@a3000000
    [    5.662329] remoteproc remoteproc2: 5d00000.r5f is available
    [    5.677052] remoteproc remoteproc1: powering up 5c00000.r5f
    [    5.682777] remoteproc remoteproc1: Booting fw image j7200-main-r5f0_0-fw, size 634196
    [    5.694427] remoteproc remoteproc2: powering up 5d00000.r5f
    [    5.700594] remoteproc remoteproc2: Booting fw image j7200-main-r5f0_1-fw, size 84332
    [    5.708607]  remoteproc1#vdev0buffer: assigned reserved memory node r5f-dma-memory@a2000000
    [    5.718270] virtio_rpmsg_bus virtio1: rpmsg host is online
    [    5.725993]  remoteproc1#vdev0buffer: registered virtio1 (type 7)
    [    5.732161] remoteproc remoteproc1: remote processor 5c00000.r5f is now up
    [    5.739629]  remoteproc2#vdev0buffer: assigned reserved memory node r5f-dma-memory@a3000000
    [    5.748734] virtio_rpmsg_bus virtio2: rpmsg host is online
    [    5.754312]  remoteproc2#vdev0buffer: registered virtio2 (type 7)
    [    5.761883] remoteproc remoteproc2: remote processor 5d00000.r5f is now up
    [    5.769260] virtio_rpmsg_bus virtio2: creating channel ti.ipc4.ping-pong addr 0xd
    [    5.779129] virtio_rpmsg_bus virtio2: creating channel rpmsg_chrdev addr 0xe
    [    5.895163] virtio_rpmsg_bus virtio1: creating channel ti.ethfw.notifyservice addr 0x1e
    [    5.903314] virtio_rpmsg_bus virtio1: creating channel rpmsg-kdrv addr 0x1a
    [    5.913192] virtio_rpmsg_bus virtio1: creating channel rpmsg-kdrv addr 0x1a
    [    5.920198] virtio_rpmsg_bus virtio1: channel rpmsg-kdrv:ffffffff:1a already exist
    [    5.932247] virtio_rpmsg_bus virtio1: rpmsg_create_channel failed
    [    5.938466] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0x15
    [    5.945772] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0x15
    [    5.957999] virtio_rpmsg_bus virtio1: channel rpmsg_chrdev:ffffffff:15 already exist
    [    5.970480] virtio_rpmsg_bus virtio1: rpmsg_create_channel failed
    [    5.976806] rpmsg-kdrv-eth-switch rpmsg-kdrv-1-mpu_1_0_ethswitch-device-0: Device info: permissions: 3FFFFFFF uart_id: 3
    [    5.990262] rpmsg-kdrv-eth-switch rpmsg-kdrv-1-mpu_1_0_ethswitch-device-0: FW ver 0.2 (rev 0) 18/Oct/2022 SHA:71138eee
    [    6.003401] rpmsg-kdrv-eth-switch rpmsg-kdrv-3-mpu_1_0_ethmac-device-1: Device info: permissions: 3FFFFFFF uart_id: 3
    [    6.014026] rpmsg-kdrv-eth-switch rpmsg-kdrv-3-mpu_1_0_ethmac-device-1: FW ver 0.2 (rev 0) 18/Oct/2022 SHA:71138eee
    [    6.027095] j721e-cpsw-virt-mac main_r5fss_cpsw5g_virt_mac0: rpmsg attach_ext - rx_mtu:1522 features:0000000B tx_mtu[0]:2024 flow_idx:84 tx_cpsw_psil_dst_id:51712 mac_addr:70:ff:76:1d:92:c1 mac-only:0
    [    6.053522] j721e-cpsw-virt-mac main_r5fss_cpsw5g_virt_mac0: virt_cpsw_nuss mac loaded
    [    6.061951] j721e-cpsw-virt-mac main_r5fss_cpsw5g_virt_mac0: rdev_features:0000000B rdev_mtu:1522 flow_id:84 tx_psil_dst_id:4A00 mac_only:0
    [    6.076113] j721e-cpsw-virt-mac main_r5fss_cpsw5g_virt_mac0: local_mac_addr:00:00:00:00:00:00 rdev_mac_addr:70:ff:76:1d:92:c1
    [    6.088517] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: rpmsg attach_ext - rx_mtu:1522 features:00000007 tx_mtu[0]:2024 flow_idx:85 tx_cpsw_psil_dst_id:51713 mac_addr:70:ff:76:1d:92:c2 mac-only:1
    [    6.119918] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: virt_cpsw_nuss mac loaded
    [    6.129106] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: rdev_features:00000007 rdev_mtu:1522 flow_id:85 tx_psil_dst_id:4A01 mac_only:1
    [    6.153345] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: local_mac_addr:00:00:00:00:00:00 rdev_mac_addr:70:ff:76:1d:92:c2
    [    6.584570] usbcore: registered new interface driver usbfs
    [    6.636017] usbcore: registered new interface driver hub
    [    6.661452] usbcore: registered new device driver usb
    [    7.211007] Bluetooth: Core ver 2.22
    [    7.216498] NET: Registered protocol family 31
    [    7.225509] Bluetooth: HCI device and connection manager initialized
    [    7.237591] Bluetooth: HCI socket layer initialized
    [    7.247350] Bluetooth: L2CAP socket layer initialized
    [    7.257606] Bluetooth: SCO socket layer initialized
    [    7.405175] j721e-cpsw-virt-mac main-r5fss-cpsw9g-virt-mac1: virt_cpsw_nuss mac started
    [    7.494171] j721e-cpsw-virt-mac main_r5fss_cpsw5g_virt_mac0: virt_cpsw_nuss mac started
    [    7.565325] am65-cpsw-nuss 46000000.ethernet eth0: PHY [46000f00.mdio:00] driver [TI DP83867] (irq=POLL)
    [    7.623534] am65-cpsw-nuss 46000000.ethernet eth0: configuring for phy/rgmii-rxid link mode
    [    9.296039] ext2 filesystem being mounted at /run/media/mmcblk0p1 supports timestamps until 2038 (0x7fffffff)
    [    9.719435] am65-cpsw-nuss 46000000.ethernet eth0: Link is Up - 100Mbps/Full - flow control rx/tx
    [    9.728320] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
    [   23.908880] Initializing XFRM netlink socket
    [   24.938972] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
    [   24.955742] Bridge firewalling registered
    [   25.631258] process 'docker/tmp/qemu-check951605447/check' started with executable stack
    

    Attatched the requested dmesg log 

    Regards

    Praveen

  • Hi Praveen,

    That is very strange... software-wise, it looks like PCIe controller is getting initialized based on these logs:

    [    1.001322] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
    [    1.009003] j721e-pcie 2910000.pcie:       IO 0x0018001000..0x0018010fff -> 0x0018001000
    [    1.017282] j721e-pcie 2910000.pcie:      MEM 0x0018011000..0x001fffffff -> 0x0018011000
    [    1.025559] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
    [    2.044968] j721e-pcie 2910000.pcie: PCI host bridge to bus 0000:00
    [    2.051393] pci_bus 0000:00: root bus resource [bus 00-0f]
    [    2.057007] pci_bus 0000:00: root bus resource [io  0x0000-0xffff] (bus address [0x18001000-0x18010fff])
    [    2.066699] pci_bus 0000:00: root bus resource [mem 0x18011000-0x1fffffff]
    [    2.073755] pci 0000:00:00.0: [104c:b00f] type 01 class 0x060400
    [    2.079995] pci 0000:00:00.0: supports D1
    [    2.084090] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
    [    2.089981] pci 0000:00:00.0: reg 0x224: [mem 0x00000000-0x003fffff 64bit]
    [    2.097008] pci 0000:00:00.0: VF(n) BAR0 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR0 for 4 VFs)
    [    2.108027] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
    [    2.117136] pci_bus 0000:01: busn_res: [bus 01-0f] end is updated to 01
    [    2.123909] pci 0000:00:00.0: BAR 7: assigned [mem 0x18400000-0x193fffff 64bit]
    [    2.131384] pci 0000:00:00.0: PCI bridge to [bus 01]
    [    2.136671] pcieport 0000:00:00.0: PME: Signaling with IRQ 43

    So as of now, it seems issue may be hardware related. To understand what is happening, could you do the following:

    1. Could you test with other PCIe cards? For example, a NVMe SSD card?
    2. What is the PCIe device part number for the PCIe ethernet card? We may try to purchase one on our end to see if we can reproduce the issue.

    Regards,

    Takuma

  • Hi Takuma,

    you can just google the "intel gigabit ct desktop adapter" for reference pci interface ethernet card.

    even i don't have any other pci interface card to try out.

    Attached snapshot also

  • Hi Praveen,

    I see some concerning reviews on the product page for that card. For example:

    https://www.amazon.com/Bulk-Intel-Gigabit-Desktop-Adapter/product-reviews/B00BL4PQ9Y/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews

    Looking through the datasheet and at the form factor, it does seem like a PCI-Express card, but I would recommend you obtain a different cheap PCIe interface card to test if the issue is with the card or the TI board/SDK.

    On my end, I have tested with a PCIe WiFi card (Intel 9260 with adapters to fit the PCIe slot) with 8.6 SDK on J7200 and the card gets detected fine.

    Regards,

    Takuma

  • Hi Takuma,

    Okay, let me arrange different PCIe card to try out this. 

    In mean time , can you please share the details of changes required in dtb also w.r.t driver for this pcie interface, i just curious to have a look once. even if you share reference section in doc also fine , i will go through it.

    Regards

    Praveen

  • Hi Praveen,

    The default TI dts should have PCIe enabled already. You can also confirm here: https://git.ti.com/cgit/ti-linux-kernel/ti-linux-kernel/tree/arch/arm64/boot/dts/ti/k3-j7200-common-proc-board.dts?h=ti-linux-5.10.y#n418.

    Documentation can be found here: https://software-dl.ti.com/jacinto7/esd/processor-sdk-linux-j7200/09_01_00_07/exports/docs/linux/Foundational_Components/Kernel/Kernel_Drivers/PCIe/PCIe_Root_Complex.html

    As a warning, due to holiday I will be out until Tuesday next week, so my responses will be delayed.

    Regards,

    Takuma

  • Hi Takuma,

    Thanks for your inputs, let me go through these links and will come back to you if i have any further queries.

    Regards

    Praveen

  • Hi Praveen,

    Sounds good, and of course, let us know if there are further questions or any extra information you may find.

    Regards,

    Takuma

  • Hello Praveen,

    The driver in Linux corresponding to the Intel PCIe Ethernet Card you are using (Intel® 82574L Gigabit Ethernet Controller) is:
    drivers/net/ethernet/intel/e1000e/82571.c
    Please ensure that the following configs are enabled in the Linux's .config that you are using to build Linux:
    CONFIG_NET_VENDOR_INTEL=y
    CONFIG_E1000E=y

    Regards,
    Siddharth.