This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TMDX654GPEVM: TMDX654GPEVM

Part Number: TMDX654GPEVM

We have this board rev.1 from Ti (www.ti.com/.../TMDX654GPEVM).

When we use Linux 4.19.94 PCIe is working. But not working CMA allocation. 

But when we try to use  Linux 4.5.74 and 2020 Arago CMA is working, but PCIe is not working.

What should we do for working CMA and PCIe ? 

We downloaded the full sdk from here: software-dl.ti.com/.../Release_Specific_Release_Notes.html

  • Andrew, 

    Can you confirm by CMA you meant Continuous Memory Allocator, not the PCIe CMA?

    If so, please further clarify:

    1. What is connected to the PCIe slot?

    2. how did you test CMA?

    3. If you have a boot log, please send to me. 

    4. Please try to rename the "sysfw-am65x-evm.itb" to "sysfw.itb" on your boot media, as you will need to use the sysfw for SR1.0.

    regards

    jian

  • Yes I confirm.
    1. What is connected to the PCIe slot?
    To PCIe slot connected TMDX654GPEVM.

    2. how did you test CMA?
    I call
    void ∗virt_addr = dma_alloc_coherent(my_dev, size_in_bytes, dma_addrp, GFP_KERNEL);
    And this always return NULL for Linux 4.19.94. For linux 5.4 it return valid address, but PCIe is not working.

    3. If you have a boot log, please send to me.
    this is current boot log, arago 2020 (linux 5.4) with replaced sysfw.itb file

    .

    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
    [    0.000000] Linux version 5.4.74-g9574bba32a (oe-user@oe-host) (gcc version 9.2.1 20191025 (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10))) #1 SMP PREEMPT Wed Nov 25 15:56:45 UTC 2020
    [    0.000000] Machine model: Texas Instruments AM654 Base Board
    [    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
    [    0.000000] printk: bootconsole [ns16550a0] enabled
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a0000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a0100000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a1000000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@a1100000, compatible id shared-dma-pool
    [    0.000000] cma: Reserved 512 MiB at 0x00000000c0000000
    [    0.000000] On node 0 totalpages: 56032
    [    0.000000]   DMA zone: 16 pages used for memmap
    [    0.000000]   DMA zone: 0 pages reserved
    [    0.000000]   DMA zone: 15456 pages, LIFO batch:3
    [    0.000000]   DMA32 zone: 8 pages used for memmap
    [    0.000000]   DMA32 zone: 7808 pages, LIFO batch:0
    [    0.000000]   Normal zone: 32 pages used for memmap
    [    0.000000]   Normal zone: 32768 pages, LIFO batch:3
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.0
    [    0.000000] percpu: Embedded 2 pages/cpu s48408 r8192 d74472 u131072
    [    0.000000] pcpu-alloc: s48408 r8192 d74472 u131072 alloc=2*65536
    [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
    [    0.000000] Detected VIPT I-cache on CPU0
    [    0.000000] CPU features: detected: ARM erratum 845719
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 55976
    [    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 mtdparts=47040000.spi.0:512k(ospi.tiboot3),2m(ospi.tispl),4m(ospi.u-boot),128k(ospi.env),128k(ospi.env.backup),1m(ospi.sysfw),-@8m(ospi.rootfs) root=PARTUUID=03181925-02 rw rootfstype=ext4 rootwait
    [    0.000000] Dentry cache hash table entries: 524288 (order: 6, 4194304 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 262144 (order: 5, 2097152 bytes, linear)
    [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [    0.000000] software IO TLB: mapped [mem 0xbbff0000-0xbfff0000] (64MB)
    [    0.000000] Memory: 3515712K/3586048K available (9598K kernel code, 788K rwdata, 3840K rodata, 1664K init, 683K bss, 18446744073709097664K reserved, 524288K cma-reserved)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
    [    0.000000] 	Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 960 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] GICv3: Distributor has no Range Selector support
    [    0.000000] GICv3: 16 PPIs implemented
    [    0.000000] GICv3: no VLPI support, no direct LPI support
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: allocated 1048576 Devices @8c0800000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x00000008c00d0000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x00000008c00e0000
    [    0.000000] random: get_random_bytes called from start_kernel+0x2b8/0x43c with crng_init=0
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000005] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.008632] Console: colour dummy device 80x25
    [    0.013232] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.023921] pid_max: default: 32768 minimum: 301
    [    0.028766] LSM: Security Framework initializing
    [    0.033576] Mount-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
    [    0.041173] Mountpoint-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
    [    0.051571] ASID allocator initialised with 32768 entries
    [    0.057258] rcu: Hierarchical SRCU implementation.
    [    0.062494] Platform MSI: gic-its@1820000 domain created
    [    0.068201] PCI/MSI: /bus@100000/interrupt-controller@1800000/gic-its@1820000 domain created
    [    0.077326] smp: Bringing up secondary CPUs ...
    [    0.083070] Detected VIPT I-cache on CPU1
    [    0.083108] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
    [    0.083121] GICv3: CPU1: using allocated LPI pending table @0x00000008c00f0000
    [    0.083172] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
    [    0.084425] Detected VIPT I-cache on CPU2
    [    0.084466] GICv3: CPU2: found redistributor 100 region 0:0x00000000018c0000
    [    0.084480] GICv3: CPU2: using allocated LPI pending table @0x00000008c0100000
    [    0.084530] CPU2: Booted secondary processor 0x0000000100 [0x410fd034]
    [    0.085749] Detected VIPT I-cache on CPU3
    [    0.085775] GICv3: CPU3: found redistributor 101 region 0:0x00000000018e0000
    [    0.085786] GICv3: CPU3: using allocated LPI pending table @0x00000008c0110000
    [    0.085817] CPU3: Booted secondary processor 0x0000000101 [0x410fd034]
    [    0.085950] smp: Brought up 1 node, 4 CPUs
    [    0.166134] SMP: Total of 4 processors activated.
    [    0.170957] CPU features: detected: 32-bit EL0 Support
    [    0.176240] CPU features: detected: CRC32 instructions
    [    0.193070] CPU: All CPU(s) started at EL2
    [    0.197333] alternatives: patching kernel code
    [    0.203462] devtmpfs: initialized
    [    0.217269] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.227272] futex hash table entries: 1024 (order: 0, 65536 bytes, linear)
    [    0.235866] pinctrl core: initialized pinctrl subsystem
    [    0.242231] NET: Registered protocol family 16
    [    0.253975] DMA: preallocated 256 KiB pool for atomic allocations
    [    0.261117] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
    [    0.290623] HugeTLB registered 16.0 GiB page size, pre-allocated 0 pages
    [    0.297512] HugeTLB registered 512 MiB page size, pre-allocated 0 pages
    [    0.304288] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
    [    0.313677] cryptd: max_cpu_qlen set to 1000
    [    0.324509] iommu: Default domain type: Translated 
    [    0.329919] SCSI subsystem initialized
    [    0.334488] mc: Linux media interface: v0.10
    [    0.338894] videodev: Linux video capture interface: v2.00
    [    0.344539] pps_core: LinuxPPS API ver. 1 registered
    [    0.349623] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.358985] PTP clock support registered
    [    0.363025] EDAC MC: Ver: 3.0.0
    [    0.367375] FPGA manager framework
    [    0.370990] Advanced Linux Sound Architecture Driver Initialized.
    [    0.378237] clocksource: Switched to clocksource arch_sys_counter
    [    0.384722] VFS: Disk quotas dquot_6.6.0
    [    0.388838] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
    [    0.403726] thermal_sys: Registered thermal governor 'step_wise'
    [    0.403730] thermal_sys: Registered thermal governor 'power_allocator'
    [    0.410443] NET: Registered protocol family 2
    [    0.422344] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear)
    [    0.431203] TCP established hash table entries: 32768 (order: 2, 262144 bytes, linear)
    [    0.439624] TCP bind hash table entries: 32768 (order: 3, 524288 bytes, linear)
    [    0.447685] TCP: Hash tables configured (established 32768 bind 32768)
    [    0.454531] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear)
    [    0.461509] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear)
    [    0.469112] NET: Registered protocol family 1
    [    0.474251] RPC: Registered named UNIX socket transport module.
    [    0.480325] RPC: Registered udp transport module.
    [    0.485146] RPC: Registered tcp transport module.
    [    0.489960] RPC: Registered tcp NFSv4.1 backchannel transport module.
    [    0.496564] PCI: CLS 0 bytes, default 64
    [    0.501692] hw perfevents: enabled with armv8_pmuv3 PMU driver, 7 counters available
    [    0.515292] Initialise system trusted keyrings
    [    0.520048] workingset: timestamp_bits=46 max_order=16 bucket_order=0
    [    0.533401] squashfs: version 4.0 (2009/01/31) Phillip Lougher
    [    0.540080] NFS: Registering the id_resolver key type
    [    0.545296] Key type id_resolver registered
    [    0.549583] Key type id_legacy registered
    [    0.553697] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
    [    0.560802] 9p: Installing v9fs 9p2000 file system support
    [    0.585291] Key type asymmetric registered
    [    0.589495] Asymmetric key parser 'x509' registered
    [    0.594526] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
    [    0.602101] io scheduler mq-deadline registered
    [    0.606740] io scheduler kyber registered
    [    0.613399] pinctrl-single 4301c000.pinmux: 70 pins, size 280
    [    0.619858] pinctrl-single 11c000.pinmux: 185 pins, size 740
    [    0.625796] pinctrl-single 11c2e8.pinmux: 9 pins, size 36
    [    0.637297] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
    [    0.643648] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
    [    0.654353] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [    0.678060] brd: module loaded
    [    0.689715] loop: module loaded
    [    0.696793] libphy: Fixed MDIO Bus: probed
    [    0.701602] tun: Universal TUN/TAP device driver, 1.6
    [    0.707585] igbvf: Intel(R) Gigabit Virtual Function Network Driver - version 2.4.0-k
    [    0.715606] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
    [    0.721717] sky2: driver version 1.30
    [    0.726696] VFIO - User Level meta-driver version: 0.3
    [    0.732806] i2c /dev entries driver
    [    0.737637] sdhci: Secure Digital Host Controller Interface driver
    [    0.743971] sdhci: Copyright(c) Pierre Ossman
    [    0.748960] sdhci-pltfm: SDHCI platform and OF driver helper
    [    0.755997] ledtrig-cpu: registered to indicate activity on CPUs
    [    0.762266] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: invalid resource
    [    0.771101] optee: probing for conduit method from DT.
    [    0.776402] optee: revision 3.8 (199fca17)
    [    0.777144] optee: initialized driver
    [    0.786762] NET: Registered protocol family 17
    [    0.791492] 9pnet: Installing 9P2000 support
    [    0.795923] Key type dns_resolver registered
    [    0.800713] registered taskstats version 1
    [    0.804920] Loading compiled-in X.509 certificates
    [    0.819048] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
    [    0.825540] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
    [    0.837388] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: invalid resource
    [    0.844994] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: ABI: 3.1 (firmware rev 0x0014 '20.8.5--v2020.08b (Terrific Lla')
    [    0.904225] omap_i2c 42120000.i2c: bus 0 rev0.12 at 400 kHz
    [    0.910710] omap_i2c 40b00000.i2c: bus 1 rev0.12 at 100 kHz
    [    0.917270] pca953x 2-0021: 2-0021 supply vcc not found, using dummy regulator
    [    0.924750] pca953x 2-0021: using no AI
    [    0.950538] random: fast init done
    [    0.954450] omap_i2c 2000000.i2c: bus 2 rev0.12 at 400 kHz
    [    0.960985] omap_i2c 2010000.i2c: bus 3 rev0.12 at 400 kHz
    [    0.967326] omap_i2c 2020000.i2c: bus 4 rev0.12 at 400 kHz
    [    0.973622] omap_i2c 2030000.i2c: bus 5 rev0.12 at 100 kHz
    [    0.980228] ti-sci-intr bus@100000:bus@28380000:bus@42040000:interrupt-controller2: Interrupt Router 156 domain created
    [    0.991471] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 100 domain created
    [    1.000392] ti-sci-intr bus@100000:navss@30800000:interrupt-controller1: Interrupt Router 182 domain created
    [    1.010800] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain 179 created
    [    1.027813] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,160] sci-dev-id:195
    [    1.037810] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: enabled
    [    1.044497] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66344100, num_proxies:64
    [    1.065933] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:818, gp-rings[304,464] sci-dev-id:187
    [    1.076035] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: enabled
    [    1.082740] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66344100, num_proxies:64
    [    1.091291] 40a00000.serial: ttyS1 at MMIO 0x40a00000 (irq = 8, base_baud = 6000000) is a 8250
    [    1.101153] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 17, base_baud = 3000000) is a 8250
    [    1.109936] printk: console [ttyS2] enabled
    [    1.118392] printk: bootconsole [ns16550a0] disabled
    [    1.129290] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 18, base_baud = 3000000) is a 8250
    [    1.138663] 2820000.serial: ttyS4 at MMIO 0x2820000 (irq = 19, base_baud = 3000000) is a 8250
    [    1.198257] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.205929] libphy: 46000f00.mdio: probed
    [    1.211631] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [    1.219941] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA07100, cpsw version 0x6BA80100 Ports: 2 quirks:00000001
    [    1.232835] am65-cpsw-nuss 46000000.ethernet: Failed to request tx dma channel -517
    [    1.242730] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a2109, freq:200000000, add_val:4 pps:0
    [    1.251492] thermal thermal_zone1: failed to read out thermal zone (-22)
    [    1.259151] mmc0: CQHCI version 5.10
    [    1.303934] mmc0: SDHCI controller on 4f80000.sdhci [4f80000.sdhci] using ADMA 64-bit
    [    1.325439] pca953x 0-0039: 0-0039 supply vcc not found, using dummy regulator
    [    1.332806] pca953x 0-0039: using no AI
    [    1.359663] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc5900
    [    1.366634] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc5900
    [    1.376852] ti-udma 285c0000.dma-controller: Channels: 96 (tchan: 48, rchan: 48, gp-rflow: 48)
    [    1.400388] ti-udma 31150000.dma-controller: Channels: 267 (tchan: 119, rchan: 148, gp-rflow: 150)
    [    1.415957] mmc0: new HS200 MMC card at address 0001
    [    1.421830] mmcblk0: mmc0:0001 R1J56L 14.7 GiB 
    [    1.426753] mmcblk0boot0: mmc0:0001 R1J56L partition 1 8.00 MiB
    [    1.442736] mmcblk0boot1: mmc0:0001 R1J56L partition 2 8.00 MiB
    [    1.449582] mmcblk0rpmb: mmc0:0001 R1J56L partition 3 4.00 MiB, chardev (240:0)
    [    1.482511] cadence-qspi 47040000.spi: PHY calibration failed: -2
    [    1.488629] spi-nor spi7.0: mt35xu512aba (65536 Kbytes)
    [    1.493876] 7 cmdlinepart partitions found on MTD device 47040000.spi.0
    [    1.500487] Creating 7 MTD partitions on "47040000.spi.0":
    [    1.505977] 0x000000000000-0x000000080000 : "ospi.tiboot3"
    [    1.512810] 0x000000080000-0x000000280000 : "ospi.tispl"
    [    1.519523] 0x000000280000-0x000000680000 : "ospi.u-boot"
    [    1.526117] 0x000000680000-0x0000006a0000 : "ospi.env"
    [    1.532638] 0x0000006a0000-0x0000006c0000 : "ospi.env.backup"
    [    1.539611] 0x0000006c0000-0x0000007c0000 : "ospi.sysfw"
    [    1.546209] 0x000000800000-0x000004000000 : "ospi.rootfs"
    [    1.560587] spi-nor spi9.0: n25q128a13 (16384 Kbytes)
    [    1.606268] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.613938] libphy: 46000f00.mdio: probed
    [    1.619378] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
    [    1.627684] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA07100, cpsw version 0x6BA80100 Ports: 2 quirks:00000001
    [    1.641798] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
    [    1.648934] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 57.4
    [    1.656253] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
    [    1.663095] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a2109, freq:200000000, add_val:4 pps:0
    [    1.676339] mmc1: CQHCI version 5.10
    [    2.325651] mmc1: SDHCI controller on 4fa0000.sdhci [4fa0000.sdhci] using ADMA 64-bit
    [    2.334397] debugfs: Directory 'pd:121' with parent 'pm_genpd' already present!
    [    2.341763] debugfs: Directory 'pd:120' with parent 'pm_genpd' already present!
    [    2.351597] input: gpio-keys as /devices/platform/gpio-keys/input/input0
    [    2.358608] hctosys: unable to open rtc device (rtc0)
    [    2.368084] mmc1: new high speed SDHC card at address 0007
    [    2.374538] mmcblk1: mmc1:0007 MB33A 27.8 GiB 
    [    2.384490]  mmcblk1: p1 p2
    [    2.391475] ALSA device list:
    [    2.394479]   No soundcards found.
    [    2.418539] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
    [    2.426713] VFS: Mounted root (ext4 filesystem) on device 179:98.
    [    2.440997] devtmpfs: mounted
    [    2.444753] Freeing unused kernel memory: 1664K
    [    2.449356] Run /sbin/init as init process
    [    2.789094] systemd[1]: System time before build time, advancing clock.
    [    2.892588] NET: Registered protocol family 10
    [    2.898259] Segment Routing with IPv6
    [    2.942898] systemd[1]: systemd 244.3+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
    [    2.965083] systemd[1]: Detected architecture arm64.
    [    3.020314] systemd[1]: Set hostname to <am65xx-evm>.
    [    3.433691] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock \xe2\x86\x92 /run/docker.sock; please update the unit file accordingly.
    [    3.574210] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.581193] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
    [    3.593546] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
    [    3.606105] systemd[1]: Created slice system-getty.slice.
    [    3.622424] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.630888] systemd[1]: Created slice system-serial\x2dgetty.slice.
    [    3.654426] random: systemd: uninitialized urandom read (16 bytes read)
    [    3.662782] systemd[1]: Created slice User and Session Slice.
    [    3.682703] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
    [    3.706524] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
    [    3.730524] systemd[1]: Reached target Paths.
    [    3.746389] systemd[1]: Reached target Remote File Systems.
    [    3.766368] systemd[1]: Reached target Slices.
    [    3.782388] systemd[1]: Reached target Swap.
    [    3.807959] systemd[1]: Listening on RPCbind Server Activation Socket.
    [    3.826429] systemd[1]: Reached target RPC Port Mapper.
    [    3.853996] systemd[1]: Listening on Process Core Dump Socket.
    [    3.870665] systemd[1]: Listening on initctl Compatibility Named Pipe.
    [    3.912147] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
    [    3.920936] systemd[1]: Listening on Journal Socket (/dev/log).
    [    3.942912] systemd[1]: Listening on Journal Socket.
    [    3.959053] systemd[1]: Listening on Network Service Netlink Socket.
    [    3.982806] systemd[1]: Listening on udev Control Socket.
    [    4.002650] systemd[1]: Listening on udev Kernel Socket.
    [    4.028681] systemd[1]: Mounting Huge Pages File System...
    [    4.052342] systemd[1]: Mounting POSIX Message Queue File System...
    [    4.076550] systemd[1]: Mounting Kernel Debug File System...
    [    4.101784] systemd[1]: Mounting Temporary Directory (/tmp)...
    [    4.124976] systemd[1]: Starting Create list of static device nodes for the current kernel...
    [    4.156160] systemd[1]: Starting Start psplash boot splash screen...
    [    4.192102] systemd[1]: Started Hardware RNG Entropy Gatherer Daemon.
    [    4.216609] systemd[1]: Starting RPC Bind...
    [    4.230673] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
    [    4.247391] systemd[1]: Starting Journal Service...
    [    4.283401] systemd[1]: Starting Load Kernel Modules...
    [    4.308949] systemd[1]: Starting Remount Root and Kernel File Systems...
    [    4.328990] cryptodev: loading out-of-tree module taints kernel.
    [    4.345712] EXT4-fs (mmcblk1p2): re-mounted. Opts: (null)
    [    4.352694] systemd[1]: Starting udev Coldplug all Devices...
    [    4.366302] cryptodev: driver 1.10 loaded.
    [    4.381771] systemd[1]: Started RPC Bind.
    [    4.401448] systemd[1]: Started Journal Service.
    [    4.641345] systemd-journald[176]: Received client request to flush runtime journal.
    [    5.766949] [drm] Initialized pvr 1.17.4948957 20110701 for 7000000.gpu on minor 0
    [    5.857212] PVR_K: UM DDK-(4948957) and KM DDK-(4948957) match. [ OK ]
    [    5.990931] ov5640 3-003c: 3-003c supply DOVDD not found, using dummy regulator
    [    6.229331] ov5640 3-003c: 3-003c supply AVDD not found, using dummy regulator
    [    6.249404] ov5640 3-003c: 3-003c supply DVDD not found, using dummy regulator
    [    6.300053] ov5640 3-003c: ov5640_read_reg: error: reg=300a
    [    6.586674] ov5640 3-003c: ov5640_check_chip_id: failed to read chip identifier
    [    6.648373] ov5640: probe of 3-003c failed with error -121
    [    6.787261] davinci_mdio b232400.mdio: davinci mdio revision 1.7, bus freq 1000000
    [    7.024133] libphy: b232400.mdio: probed
    [    7.167213] davinci_mdio b232400.mdio: phy[0]: device b232400.mdio:00, driver TI DP83867
    [    7.230316] random: crng init done
    [    7.233739] random: 7 urandom warning(s) missed due to ratelimiting
    [    7.286354] davinci_mdio b232400.mdio: phy[3]: device b232400.mdio:03, driver TI DP83867
    [    7.697965] TI DP83867 46000f00.mdio:00: attached PHY driver [TI DP83867] (mii_bus:phy_addr=46000f00.mdio:00, irq=POLL)
    [    7.719243] am65-cpsw-nuss 46000000.ethernet eth0: Link is Down
    [    8.129615] platform 41000000.r5f: configured R5F for remoteproc mode
    [    8.279978] platform 41000000.r5f: assigned reserved memory node r5f-dma-memory@a0000000
    [    8.329986] remoteproc remoteproc0: 41000000.r5f is available
    [    8.412084] remoteproc remoteproc0: powering up 41000000.r5f
    [    8.417993] remoteproc remoteproc0: Booting fw image am65x-mcu-r5f0_0-fw, size 85036
    [    8.431618] platform 41000000.r5f: booting R5F core using boot addr = 0x0
    [    8.442420]  remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@a0000000
    [    8.452085] virtio_rpmsg_bus virtio0: rpmsg host is online
    [    8.462118]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [    8.468330] remoteproc remoteproc0: remote processor 41000000.r5f is now up
    [    8.480054] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
    [    8.489119] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [    8.973805] remoteproc remoteproc1: b034000.pru is available
    [    9.130504] pru-rproc b034000.pru: PRU rproc node /bus@100000/icssg@b000000/pru@34000 probed successfully
    [    9.214823] remoteproc remoteproc2: b004000.rtu is available
    [    9.249874] pru-rproc b004000.rtu: PRU rproc node /bus@100000/icssg@b000000/rtu@4000 probed successfully
    [    9.296616] remoteproc remoteproc3: b038000.pru is available
    [    9.308349] pru-rproc b038000.pru: PRU rproc node /bus@100000/icssg@b000000/pru@38000 probed successfully
    [    9.330548] remoteproc remoteproc4: b006000.rtu is available
    [    9.401541] pru-rproc b006000.rtu: PRU rproc node /bus@100000/icssg@b000000/rtu@6000 probed successfully
    [    9.447172] remoteproc remoteproc5: b134000.pru is available
    [    9.585299] pru-rproc b134000.pru: PRU rproc node /bus@100000/icssg@b100000/pru@34000 probed successfully
    [    9.831605] remoteproc remoteproc6: b104000.rtu is available
    [    9.885755] pru-rproc b104000.rtu: PRU rproc node /bus@100000/icssg@b100000/rtu@4000 probed successfully
    [    9.956514] remoteproc remoteproc7: b138000.pru is available
    [   10.064851] pru-rproc b138000.pru: PRU rproc node /bus@100000/icssg@b100000/pru@38000 probed successfully
    [   10.186580] remoteproc remoteproc8: b106000.rtu is available
    [   10.272152] pru-rproc b106000.rtu: PRU rproc node /bus@100000/icssg@b100000/rtu@6000 probed successfully
    [   10.408530] remoteproc remoteproc9: b234000.pru is available
    [   10.492765] pru-rproc b234000.pru: PRU rproc node /bus@100000/icssg@b200000/pru@34000 probed successfully
    [   10.583715] remoteproc remoteproc10: b204000.rtu is available
    [   10.674428] pru-rproc b204000.rtu: PRU rproc node /bus@100000/icssg@b200000/rtu@4000 probed successfully
    [   10.791217] remoteproc remoteproc11: b238000.pru is available
    [   10.824164] pru-rproc b238000.pru: PRU rproc node /bus@100000/icssg@b200000/pru@38000 probed successfully
    [   10.872003] remoteproc remoteproc12: b206000.rtu is available
    [   10.882172] pru-rproc b206000.rtu: PRU rproc node /bus@100000/icssg@b200000/rtu@6000 probed successfully
    [   11.077057] icssg-prueth pruss2_eth: TI PRU ethernet driver initialized: dual EMAC mode
    [   11.171239] dwc3 4030000.usb: Failed to get clk 'ref': -2
    [   11.265025] omap_usb2: disable chrg det
    [   11.444912] OF: graph: no port node found in /bus@100000/phy@4110000
    [   11.803401] am65-cpsw-nuss 46000000.ethernet eth0: Link is Up - 1Gbps/Full - flow control off
    [   11.812011] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
    [   12.441640] usbcore: registered new interface driver usbfs
    [   12.458437] usbcore: registered new interface driver hub
    [   12.470515] usbcore: registered new device driver usb
    [   12.545583] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
    [   12.560318] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 1
    [   12.590580] remoteproc remoteproc9: powering up b234000.pru
    [   12.601351] remoteproc remoteproc9: Booting fw image ti-pruss/am65x-pru0-prueth-fw.elf, size 16740
    [   12.610425] remoteproc remoteproc9: remote processor b234000.pru is now up
    [   12.627318] xhci-hcd xhci-hcd.2.auto: hcc params 0x0298fe6d hci version 0x110 quirks 0x0000000000010010
    [   12.631371] remoteproc remoteproc10: powering up b204000.rtu
    [   12.642414] xhci-hcd xhci-hcd.2.auto: irq 1285, io mem 0x04030000
    [   12.654744] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
    [   12.657685] remoteproc remoteproc10: Booting fw image ti-pruss/am65x-rtu0-prueth-fw.elf, size 15664
    [   12.670284] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [   12.678448] remoteproc remoteproc10: remote processor b204000.rtu is now up
    [   12.685212] usb usb1: Product: xHCI Host Controller
    [   12.687554] TI DP83867 b232400.mdio:00: attached PHY driver [TI DP83867] (mii_bus:phy_addr=b232400.mdio:00, irq=POLL)
    [   12.698276] usb usb1: Manufacturer: Linux 5.4.74-g9574bba32a xhci-hcd
    [   12.706490] net eth1: started
    [   12.710495] usb usb1: SerialNumber: xhci-hcd.2.auto
    [   12.722725] hub 1-0:1.0: USB hub found
    [   12.731525] hub 1-0:1.0: 1 port detected
    [   12.736062] xhci-hcd xhci-hcd.2.auto: xHCI Host Controller
    [   12.746336] xhci-hcd xhci-hcd.2.auto: new USB bus registered, assigned bus number 2
    [   12.758325] xhci-hcd xhci-hcd.2.auto: Host supports USB 3.0 SuperSpeed
    [   12.770455] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
    [   12.779737] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04
    [   12.782643] remoteproc remoteproc11: powering up b238000.pru
    [   12.798296] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [   12.814370] usb usb2: Product: xHCI Host Controller
    [   12.815111] remoteproc remoteproc11: Booting fw image ti-pruss/am65x-pru1-prueth-fw.elf, size 16744
    [   12.821490] usb usb2: Manufacturer: Linux 5.4.74-g9574bba32a xhci-hcd
    [   12.821498] usb usb2: SerialNumber: xhci-hcd.2.auto
    [   12.822299] hub 2-0:1.0: USB hub found
    [   12.842299] remoteproc remoteproc11: remote processor b238000.pru is now up
    [   12.854293] hub 2-0:1.0: 1 port detected
    [   12.858663] remoteproc remoteproc12: powering up b206000.rtu
    [   12.925317] remoteproc remoteproc12: Booting fw image ti-pruss/am65x-rtu1-prueth-fw.elf, size 15664
    [   12.946377] remoteproc remoteproc12: remote processor b206000.rtu is now up
    [   12.964514] TI DP83867 b232400.mdio:03: attached PHY driver [TI DP83867] (mii_bus:phy_addr=b232400.mdio:03, irq=POLL)
    [   12.986573] net eth2: started
    [   27.013929] Initializing XFRM netlink socket
    [   30.795262] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
    [   30.820286] Bridge firewalling registered
    

    4. Please try to rename the "sysfw-am65x-evm.itb" to "sysfw.itb" on your boot media, as you will need to use the sysfw for SR1.0.
    Yes, We tried it, but the same result.

    Best regards, thx

  • Andrew, 

    since you have a board to board setup, can you confirm that the other EVM was using a different device tree where the PCIe is configured as EP, and EP board was brought up first, before RC was brought up. I assume you used the same steps as:

    http://software-dl.ti.com/processor-sdk-linux/esd/AM65X/latest/exports/docs/linux/Foundational_Components/Kernel/Kernel_Drivers/PCIe/PCIe_End_Point.html

    since you mentioned your previous build worked, but just to confirm. also can you confirm the SDK you used for the 5.4 kernel was 07_01_x? 

    regards

    Jian

  • We use just one board. We are connecting a custom board to the pcie. 
    First of all, for this board we tried to use Linux 4.19.94, but func (dma_alloc_coherent) always return NULL.
    After that we install linux 5.4 with 2020 Arago to the our board. Then func (dma_alloc_coherent) return valid value of address, but I can't saw PCIe device (FPGA with bitstream).

  • Andrew, 

    Sorry for the delayed response. I did not see the pcie were brought up in the linux log you sent earlier. Could you confirm which silicon revision you will be using for your final product? If using SR2.x, I suggest you use the SR2.0 IDK and latest SDK (7.03) for testing. 

    There are some power domain changes from SR1 to SR2.x, that should be comprehended by the system firmware. So if you need to test on SR1.0, I would use SDK 6.03.106 for all SR1.0 testing. Later SDKs defaults to SR2.x, you will need to make sure the sysfw are loaded correctly if you want to test on SR1.0. 

    regards

    Jian