This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM625: ETH Tx/Rx interruptions for ~1s

Part Number: AM625

Hi TI!

We're facing the fllowing issue - randomly in the customer car the ETH Tx/Rx stops for a short time (between 0.9 and 1.43s). After this time it fully recovers and works 100% ok again.

 

What we excluded so far is:

  • Autosar problem - our stack is not receiving anything, the incomming messages are not ACKed
  • bus issue - the Rx messages are 100% ok and on time
  • restart of the system = the R5 core handling CAN is 100% ok and shows no glitches

If we simulate a freeze in the netif layer is produces very similar effects in the car.

 

Our system:

  • mcu_plus_sdk_am62x_09_00_00_19
  • i-processor-sdk-linux-rt-am62xx-evm-08.06.00.42
  • ETH running on Linux (A53 cores)
  • AM6252

 

Questions:

  • is this a "known" issue?
  • could newer (preferably the latest) netif layer be backported to our system? Feasibility?

Note:

  • the issue is not possible to reproduce on bench meaning it is either very rare or related to the vehicle only. We see multiple reports from the field though.

Please let us know if you have any questions.

 

Thank you!

 

BR/MK

  • Hi,

    Concerning the question on if there is a known issue of a link interruption, I have not seen any issue where a link pauses unless the PHY goes through a link loss condition. With that in mind the pause and resumption of traffic time measurement could be a link loss event that is occurring since it is similar timing duration assuming the link comes right back.

    For the first step is there a way to access the Linux console? If so could please capture the response to these commands:

    - dmesg (this command will dump the contents of the kernel message, I expect this log to be long so please attach the output, please do not do a cut and paste)

    - ifconfig -S <ethernet interface name>

    - what PHY is being used in this application?

    - There was a data point in the post that mentioned that it is known the packets are be received, how is this data being confirmed.

    This document is what we recommend to review on how to follow the Ethernet packets in a Linux system. This document will only be relevant for the CPSW interface and RT Linux.

    https://www.ti.com/lit/an/spradj8/spradj8.pdf

    Best Regards,

    Schuyler

  • Hi Schuyler,

    Thanks for your response.

    - dmesg and ifconfig is include in this file

    root@am62xx-zdml3:~# dmesg
    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
    [    0.000000] Linux version 5.10.154-rt76-00275-g0a8b6526ddb (root@218d7c593703) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #2 SMP PREEMPT Thu Nov 6 10:03:46 UTC 2025
    [    0.000000] Machine model: ZKW DML3 ECU
    [    0.000000] [Firmware Bug]: Kernel image misaligned at boot, please fix your bootloader!
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009a200000, size 56 MiB
    [    0.000000] OF: reserved mem: initialized node authenticatedboot@9A200000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009f480000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-dma-memory@9F480000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x9f58000000000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-memory@9F580000, compatible id shared-dma-pool
    [    0.000000] Zone ranges:
    [    0.000000]   DMA      [mem 0x0000000080000000-0x000000009fffffff]
    [    0.000000]   DMA32    empty
    [    0.000000]   Normal   empty
    [    0.000000] Movable zone start for each node
    [    0.000000] Early memory node ranges
    [    0.000000]   node   0: [mem 0x0000000080000000-0x000000009a1fffff]
    [    0.000000]   node   0: [mem 0x000000009a200000-0x000000009e6fffff]
    [    0.000000]   node   0: [mem 0x000000009e700000-0x000000009e77ffff]
    [    0.000000]   node   0: [mem 0x000000009e780000-0x000000009e8fffff]
    [    0.000000]   node   0: [mem 0x000000009e900000-0x000000009e9fffff]
    [    0.000000]   node   0: [mem 0x000000009ea00000-0x000000009f57ffff]
    [    0.000000]   node   0: [mem 0x000000009f580000-0x000000009fc7bfff]
    [    0.000000]   node   0: [mem 0x000000009fc7c000-0x000000009fffffff]
    [    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000009fffffff]
    [    0.000000] On node 0 totalpages: 131072
    [    0.000000]   DMA zone: 2048 pages used for memmap
    [    0.000000]   DMA zone: 0 pages reserved
    [    0.000000]   DMA zone: 131072 pages, LIFO batch:31
    [    0.000000] cma: Reserved 144 MiB at 0x0000000090000000
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.2
    [    0.000000] percpu: Embedded 17 pages/cpu s30360 r8192 d31080 u69632
    [    0.000000] pcpu-alloc: s30360 r8192 d31080 u69632 alloc=17*4096
    [    0.000000] pcpu-alloc: [0] 0 [0] 1
    [    0.000000] Detected VIPT I-cache on CPU0
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] CPU features: kernel page table isolation forced ON by KASLR
    [    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 129024
    [    0.000000] Kernel command line: console=ttyS2,115200n8
    [    0.000000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [    0.000000] Memory: 224700K/524288K available (7102K kernel code, 882K rwdata, 1840K rodata, 35904K init, 318K bss, 152132K reserved, 147456K cma-reserved)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
    [    0.000000]  Trampoline variant of Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 256 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] GICv3: Distributor has no Range Selector support
    [    0.000000] GICv3: 16 PPIs implemented
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @83c00000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x0000000083030000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000083040000
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000001] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.000225] Console: colour dummy device 80x25
    [    0.000291] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.000305] pid_max: default: 32768 minimum: 301
    [    0.000400] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [    0.000412] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [    0.002156] rcu: Hierarchical SRCU implementation.
    [    0.002380] Platform MSI: msi-controller@1820000 domain created
    [    0.002666] smp: Bringing up secondary CPUs ...
    [    0.003826] Detected VIPT I-cache on CPU1
    [    0.003870] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
    [    0.003890] GICv3: CPU1: using allocated LPI pending table @0x0000000083050000
    [    0.003959] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
    [    0.004097] smp: Brought up 1 node, 2 CPUs
    [    0.004103] SMP: Total of 2 processors activated.
    [    0.004110] CPU features: detected: 32-bit EL0 Support
    [    0.004116] CPU features: detected: CRC32 instructions
    [    0.009469] CPU: All CPU(s) started at EL2
    [    0.009493] alternatives: patching kernel code
    [    0.010446] devtmpfs: initialized
    [    0.015559] KASLR enabled
    [    0.015712] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.015732] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
    [    0.021121] pinctrl core: initialized pinctrl subsystem
    [    0.025165] NET: Registered protocol family 16
    [    0.026785] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
    [    0.026880] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [    0.026970] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [    0.027562] ASID allocator initialised with 32768 entries
    [    0.043899] cryptd: max_cpu_qlen set to 1000
    [    0.045512] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
    [    0.046036] vcc_5v0: supplied by vmain_pd
    [    0.046362] vcc_3v3_sys: supplied by vmain_pd
    [    0.046641] vcc_1v8: supplied by vcc_3v3_sys
    [    0.046906] iommu: Default domain type: Translated
    [    0.047371] pps_core: LinuxPPS API ver. 1 registered
    [    0.047375] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.047389] PTP clock support registered
    [    0.047709] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
    [    0.048923] clocksource: Switched to clocksource arch_sys_counter
    [    0.049085] VFS: Disk quotas dquot_6.6.0
    [    0.049132] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [    0.054169] NET: Registered protocol family 2
    [    0.054355] IP idents hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.055081] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
    [    0.055118] TCP established hash table entries: 4096 (order: 3, 32768 bytes, linear)
    [    0.055153] TCP bind hash table entries: 4096 (order: 4, 65536 bytes, linear)
    [    0.055240] TCP: Hash tables configured (established 4096 bind 4096)
    [    0.055351] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
    [    0.055370] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
    [    0.055484] NET: Registered protocol family 1
    [    0.178755] Initialise system trusted keyrings
    [    0.178914] workingset: timestamp_bits=46 max_order=17 bucket_order=0
    [    0.183007] Key type asymmetric registered
    [    0.183023] Asymmetric key parser 'x509' registered
    [    0.183058] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
    [    0.183066] io scheduler mq-deadline registered
    [    0.183072] io scheduler kyber registered
    [    0.184556] pinctrl-single 4084000.pinctrl: 34 pins, size 136
    [    0.185007] pinctrl-single f4000.pinctrl: 171 pins, size 684
    [    0.185323] =>hw_version_probe
    [    0.185347] hw_version hw-version: hw0 error
    [    0.186655] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [    0.189032] gmsl9277:DONE
    [    0.189069] gmsl9275:DONE
    [    0.189544] tps65219:INIT
    [    0.191020] tun: Universal TUN/TAP device driver, 1.6
    [    0.191716] VFIO - User Level meta-driver version: 0.3
    [    0.191869] i2c /dev entries driver
    [    0.192757] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [    0.194843] NET: Registered protocol family 10
    [    0.195825] Segment Routing with IPv6
    [    0.195886] NET: Registered protocol family 17
    [    0.195898] 8021q: 802.1Q VLAN Support v1.8
    [    0.195968] Key type dns_resolver registered
    [    0.196030] Loading compiled-in X.509 certificates
    [    0.198938] =>hw_version_probe
    [    0.198973] hw_version hw-version: hw0 error
    [    0.201388] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0009 '9.0.5--v09.00.05 (Kool Koala)')
    [    0.230472] ti-sci-clk 44043000.system-controller:clock-controller: recalc-rate failed for dev=70, clk=0, ret=-19
    [    0.260546] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [    0.261605] platform 78000000.r5f: configured R5F for IPC-only mode
    [    0.261700] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
    [    0.261976] remoteproc remoteproc0: 78000000.r5f is available
    [    0.261984] remoteproc remoteproc0: attaching to 78000000.r5f
    [    0.262162] platform 78000000.r5f: R5F core initialized in IPC-only mode
    [    0.262173]  remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@9da00000
    [    0.262603] virtio_rpmsg_bus virtio0: rpmsg host is online
    [    0.262632]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [    0.262638] remoteproc remoteproc0: remote processor 78000000.r5f is now attached
    [    0.267793] tps65219:In i2c probe() function
    [    0.267843] omap_i2c 20000000.i2c: bus 0 rev0.12 at 400 kHz
    [    0.269640] omap_i2c 20010000.i2c: bus 1 rev0.12 at 400 kHz
    [    0.282431] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [    0.284221] omap_i2c 20030000.i2c: bus 2 rev0.12 at 400 kHz
    [    0.285472] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
    [    0.286048] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
    [    0.287229] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
    [    0.287437] =>hw_version_probe
    [    0.287455] hw_version hw-version: hw0 error
    [    0.287813] ti-udma 485c0100.dma-controller: Number of rings: 82
    [    0.291248] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
    [    0.293776] ti-udma 485c0000.dma-controller: Number of rings: 150
    [    0.306604] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
    [    0.309705] printk: console [ttyS2] disabled
    [    0.309792] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 17, base_baud = 3000000) is a 8250
    [    0.310071] printk: console [ttyS2]: printing thread started
    [    0.310082] printk: console [ttyS2] enabled
    [    0.434881] 0x0FC40000: 0xc3083889
    [    0.435339] spi_nor_soft_reset
    [    0.458353] spi-nor spi0.0: s28hs02gt (262144 Kbytes)
    [    0.458365] spi-nor spi0.0: mtd .name = fc40000.spi.0, .size = 0x10000000 (256MiB), .erasesize = 0x00040000 (256KiB) .numeraseregions = 3
    [    0.458375] spi-nor spi0.0: mtd.eraseregions[0] = { .offset = 0x0, .erasesize = 0x00040000 (256KiB), .numblocks = 1023 }
    [    0.458383] spi-nor spi0.0: mtd.eraseregions[1] = { .offset = 0xffc0000, .erasesize = 0x00020000 (128KiB), .numblocks = 1 }
    [    0.458391] spi-nor spi0.0: mtd.eraseregions[2] = { .offset = 0xffe0000, .erasesize = 0x00001000 (4KiB), .numblocks = 32 }
    [    1.421066] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [    1.457007] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.461542] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000002
    [    1.461731] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
    [    1.461737] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
    [    1.494092] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
    [    1.505841] cpu cpu0: dev_pm_opp_set_rate: failed to find current OPP for freq 1250000000 (-34)
    [    1.508858] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 1250000 KHz, changing to: 1000000 KHz
    [    1.551585] =>hw_version_probe
    [    1.551714] zkw_eth_rst_probe ke
    [    1.551732] hw_version are done
    [    1.551751] vmonen are done
    [    1.551754] eth_ctrl are done
    [    1.552183] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [    1.588930] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.593266] davinci_mdio 8000f00.mdio: phy[2]: device 8000f00.mdio:02, driver NXP TJA1101
    [    1.620624] ti-sci-clk 44043000.system-controller:clock-controller: is_prepared failed for dev=70, clk=0, ret=-19
    [    1.634665] Warning: unable to open an initial console.
    [    1.668788] Freeing unused kernel memory: 35904K
    [    1.669130] Run /init as init process
    [    1.669136]   with arguments:
    [    1.669139]     /init
    [    1.669141]   with environment:
    [    1.669143]     HOME=/
    [    1.669146]     TERM=linux
    [    1.927320] am65-cpsw-nuss 8000000.ethernet: down msc_sl e0000000 tmo 0
    [    1.941268] ubi0: attaching mtd32
    [    1.948684] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
    [    1.963621] ubi0 attached mtd32 ("ospi.swc.algo", 17 MiB)
    [    1.963707] ubi1: attaching mtd24
    [    1.979660] ubi1 attached mtd24 ("ospi.d.texture", 7 MiB)
    [    1.981232] ubi2: attaching mtd28
    [    1.998133] ubi2 attached mtd28 ("ospi.d.animation", 11 MiB)
    [    2.023934] am65-cpsw-nuss 8000000.ethernet eth0: PHY [8000f00.mdio:02] driver [NXP TJA1101] (irq=313)
    [    2.024716] am65-cpsw-nuss 8000000.ethernet eth0: configuring for phy/rmii link mode
    [    2.027122] am65-cpsw-nuss 8000000.ethernet eth0: Link is Up - 100Mbps/Full - flow control off
    [    2.029665] 8021q: adding VLAN 0 to HW filter on device eth0
    [    2.037485] am65-cpsw-nuss 8000000.ethernet: Adding vlan 2 to vlan filter
    [    2.046452] UBIFS: ubi(0:0), name "dml_code", R/O mode
    [    2.067310] UBIFS: ubi(1:0), name "textures", R/O mode
    [    2.072067] UBIFS: ubi(2:0), name "animations", R/O mode
    [    2.119421] gmsl9275:reg 0x02: val 0x2F
    [    2.133507] gmsl9275:reg 0x04: val 0x80
    [    2.169329] width=640,height=164,h_total=720, v_total=292,fps=60
    [    2.197915] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
    [    2.200208] tidss 30200000.dss: [drm] fb0: tidssdrmfb frame buffer device
    [    2.234461] pvrsrvkm: loading out-of-tree module taints kernel.
    [    2.281681] PVR_K:  227: Read BVNC 33.15.11.3 from HW device registers
    [    2.282527] PVR_K:  227: RGX Device registered with BVNC 33.15.11.3
    [    2.283524] [drm] Initialized pvr 1.15.6133109 20170530 for fd00000.gpu on minor 1
    [    2.487062] pid = 255
    [    2.487368] pid = 256
    [    2.619541] random: nft: uninitialized urandom read (4 bytes read)
    [    2.644795] random: nft: uninitialized urandom read (4 bytes read)
    [    2.739874] PVR_K:  222: RGX Firmware image 'rgx.fw.33.15.11.3' loaded
    [    2.753929] PVR_K:  222: Shader binary image 'rgx.sh.33.15.11.3' loaded
    [    3.083033] dispc_enable_oldi
    [    3.083058] dispc_vp_enable: video0, ipc=0
    [    3.095261] dispc_vp_enable: video1, ipc=0
    [    8.057075] inv_mpu: whoami= fa
    [    8.057375] inv_mpu: inv_mpu_initialize: initialize result is 0....
    [    8.058387] inv_mpu: failed to create wakeup_source
    [    8.058427] inv-mpu-iio-spi spi1.0: iam20680 ma-kernel-9.1.7 is ready to go!
    [    8.058435] inv_mpu: Data read from FIFO
    [    8.058437] inv_mpu: Timer based batching
    [    9.916963] random: crng init done
    root@am62xx-zdml3:~#
    root@am62xx-zdml3:~# ifconfig -s eth0
    Iface   MTU Met   RX-OK RX-ERR RX-DRP RX-OVR    TX-OK TX-ERR TX-DRP TX-OVR Flg
    eth0       1500 0  35273604      0     63 0       5099012      0      0      0 BMRU
    root@am62xx-zdml3:~#

    - PHY that we are using is TJA1101BHN/0Z

    - We send and receive data by Autosar stack periodic, but we cannot send or received anything for a short time

    Thanks

    Cong.

  • Hi Cong,

    Thank you for attaching the dmesg log. Reviewing the log I only see that it is about 10 seconds long and looks to be from a boot sequence. Is this not receiving sending condition happening during the time covered by the boot log?

    My mistake on the ifconfig command, please run and the attach the results of ethtool -S eth0.

    If possible please attach the dmesg log and ethtool - S during the period after communication appears to be restored.

    Best Regards,

    Schuyler

  • Hi Schuyler
    This receiving/sending issue did not occur during the period covered by the boot log. It is very difficult to reproduce this error; the log I sent you is still from a normal operation period without any errors.
    I have attached the dmesg and ethtool logs below.

    root@am62xx-zdml3:~# ifconfig
    eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500  metric 1
            inet6 fd53:7cb8:383:2::9b  prefixlen 64  scopeid 0x0<global>
            inet6 fe80::3ee0:64ff:fe62:503e  prefixlen 64  scopeid 0x20<link>
            ether 3c:e0:64:62:50:3e  txqueuelen 1000  (Ethernet)
            RX packets 76321  bytes 24757484 (23.6 MiB)
            RX errors 0  dropped 1  overruns 0  frame 0
            TX packets 11009  bytes 2909202 (2.7 MiB)
            TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
    
    eth0.2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500  metric 1
            inet6 fd53:7cb8:383:2::9b  prefixlen 64  scopeid 0x0<global>
            inet6 fe80::7d:faff:fe00:9b00  prefixlen 64  scopeid 0x20<link>
            ether 02:7d:fa:00:9b:00  txqueuelen 1000  (Ethernet)
            RX packets 76317  bytes 23383522 (22.3 MiB)
            RX errors 0  dropped 0  overruns 0  frame 0
            TX packets 10995  bytes 2863986 (2.7 MiB)
            TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
    
    lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536  metric 1
            inet 127.0.0.1  netmask 255.0.0.0
            inet6 ::1  prefixlen 128  scopeid 0x10<host>
            loop  txqueuelen 1000  (Local Loopback)
            RX packets 0  bytes 0 (0.0 B)
            RX errors 0  dropped 0  overruns 0  frame 0
            TX packets 0  bytes 0 (0.0 B)
            TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
    
    root@am62xx-zdml3:~# dmesg
    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
    [    0.000000] Linux version 5.10.154-rt76-00281-g4d1083bf95d (root@9c1e199c3530) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #2 SMP PREEMPT Mon Oct 27 08:00:01 UTC 2025
    [    0.000000] Machine model: ZKW DML3 ECU
    [    0.000000] [Firmware Bug]: Kernel image misaligned at boot, please fix your bootloader!
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009a200000, size 56 MiB
    [    0.000000] OF: reserved mem: initialized node authenticatedboot@9A200000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009f480000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-dma-memory@9F480000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x9f58000000000000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-memory@9F580000, compatible id shared-dma-pool
    [    0.000000] Zone ranges:
    [    0.000000]   DMA      [mem 0x0000000080000000-0x000000009fffffff]
    [    0.000000]   DMA32    empty
    [    0.000000]   Normal   empty
    [    0.000000] Movable zone start for each node
    [    0.000000] Early memory node ranges
    [    0.000000]   node   0: [mem 0x0000000080000000-0x000000009a1fffff]
    [    0.000000]   node   0: [mem 0x000000009a200000-0x000000009e6fffff]
    [    0.000000]   node   0: [mem 0x000000009e700000-0x000000009e77ffff]
    [    0.000000]   node   0: [mem 0x000000009e780000-0x000000009e8fffff]
    [    0.000000]   node   0: [mem 0x000000009e900000-0x000000009e9fffff]
    [    0.000000]   node   0: [mem 0x000000009ea00000-0x000000009f57ffff]
    [    0.000000]   node   0: [mem 0x000000009f580000-0x000000009fc7bfff]
    [    0.000000]   node   0: [mem 0x000000009fc7c000-0x000000009fffffff]
    [    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000009fffffff]
    [    0.000000] On node 0 totalpages: 131072
    [    0.000000]   DMA zone: 2048 pages used for memmap
    [    0.000000]   DMA zone: 0 pages reserved
    [    0.000000]   DMA zone: 131072 pages, LIFO batch:31
    [    0.000000] cma: Reserved 144 MiB at 0x0000000090000000
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.2
    [    0.000000] percpu: Embedded 17 pages/cpu s30360 r8192 d31080 u69632
    [    0.000000] pcpu-alloc: s30360 r8192 d31080 u69632 alloc=17*4096
    [    0.000000] pcpu-alloc: [0] 0 [0] 1
    [    0.000000] Detected VIPT I-cache on CPU0
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] CPU features: kernel page table isolation forced ON by KASLR
    [    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 129024
    [    0.000000] Kernel command line: console=ttyS2,115200n8 initcall_debug=0 quiet
    [    0.000000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [    0.000000] Memory: 224700K/524288K available (7102K kernel code, 882K rwdata, 1840K rodata, 35904K init, 318K bss, 152132K reserved, 147456K cma-reserved)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
    [    0.000000]  Trampoline variant of Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 256 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] GICv3: Distributor has no Range Selector support
    [    0.000000] GICv3: 16 PPIs implemented
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @83c00000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x0000000083030000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000083040000
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000001] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.000226] Console: colour dummy device 80x25
    [    0.000294] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.000306] pid_max: default: 32768 minimum: 301
    [    0.000405] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [    0.000418] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
    [    0.002161] rcu: Hierarchical SRCU implementation.
    [    0.002380] Platform MSI: msi-controller@1820000 domain created
    [    0.002679] smp: Bringing up secondary CPUs ...
    [    0.003801] Detected VIPT I-cache on CPU1
    [    0.003843] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
    [    0.003863] GICv3: CPU1: using allocated LPI pending table @0x0000000083050000
    [    0.003935] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
    [    0.004089] smp: Brought up 1 node, 2 CPUs
    [    0.004095] SMP: Total of 2 processors activated.
    [    0.004101] CPU features: detected: 32-bit EL0 Support
    [    0.004106] CPU features: detected: CRC32 instructions
    [    0.009449] CPU: All CPU(s) started at EL2
    [    0.009471] alternatives: patching kernel code
    [    0.010434] devtmpfs: initialized
    [    0.015462] KASLR enabled
    [    0.015616] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.015635] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
    [    0.021017] pinctrl core: initialized pinctrl subsystem
    [    0.025051] NET: Registered protocol family 16
    [    0.026661] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
    [    0.026753] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [    0.026842] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [    0.027436] ASID allocator initialised with 32768 entries
    [    0.043771] cryptd: max_cpu_qlen set to 1000
    [    0.045395] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
    [    0.045916] vcc_5v0: supplied by vmain_pd
    [    0.046233] vcc_3v3_sys: supplied by vmain_pd
    [    0.046507] vcc_1v8: supplied by vcc_3v3_sys
    [    0.046768] iommu: Default domain type: Translated
    [    0.047230] pps_core: LinuxPPS API ver. 1 registered
    [    0.047234] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.047247] PTP clock support registered
    [    0.047567] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
    [    0.048781] clocksource: Switched to clocksource arch_sys_counter
    [    0.048949] VFS: Disk quotas dquot_6.6.0
    [    0.048995] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [    0.054083] NET: Registered protocol family 2
    [    0.054267] IP idents hash table entries: 8192 (order: 4, 65536 bytes, linear)
    [    0.054987] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
    [    0.055026] TCP established hash table entries: 4096 (order: 3, 32768 bytes, linear)
    [    0.055059] TCP bind hash table entries: 4096 (order: 4, 65536 bytes, linear)
    [    0.055143] TCP: Hash tables configured (established 4096 bind 4096)
    [    0.055259] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
    [    0.055277] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
    [    0.055394] NET: Registered protocol family 1
    [    0.179819] Initialise system trusted keyrings
    [    0.179977] workingset: timestamp_bits=46 max_order=17 bucket_order=0
    [    0.184085] Key type asymmetric registered
    [    0.184102] Asymmetric key parser 'x509' registered
    [    0.184139] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
    [    0.184147] io scheduler mq-deadline registered
    [    0.184151] io scheduler kyber registered
    [    0.185664] pinctrl-single 4084000.pinctrl: 34 pins, size 136
    [    0.186051] pinctrl-single f4000.pinctrl: 171 pins, size 684
    [    0.186338] =>hw_version_probe
    [    0.186368] hw_version hw-version: hw0 error
    [    0.187648] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [    0.190108] gmsl9277:DONE
    [    0.190156] gmsl9275:DONE
    [    0.190627] tps65219:INIT
    [    0.192091] tun: Universal TUN/TAP device driver, 1.6
    [    0.192836] VFIO - User Level meta-driver version: 0.3
    [    0.192996] i2c /dev entries driver
    [    0.193926] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [    0.195613] NET: Registered protocol family 10
    [    0.196538] Segment Routing with IPv6
    [    0.196596] NET: Registered protocol family 17
    [    0.196609] 8021q: 802.1Q VLAN Support v1.8
    [    0.196687] Key type dns_resolver registered
    [    0.196757] Loading compiled-in X.509 certificates
    [    0.199945] =>hw_version_probe
    [    0.199982] hw_version hw-version: hw0 error
    [    0.202391] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0009 '9.0.5--v09.00.05 (Kool Koala)')
    [    0.229008] ti-sci-clk 44043000.system-controller:clock-controller: recalc-rate failed for dev=70, clk=0, ret=-19
    [    0.256686] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [    0.257608] platform 78000000.r5f: configured R5F for IPC-only mode
    [    0.257708] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
    [    0.257981] remoteproc remoteproc0: 78000000.r5f is available
    [    0.257988] remoteproc remoteproc0: attaching to 78000000.r5f
    [    0.258173] platform 78000000.r5f: R5F core initialized in IPC-only mode
    [    0.258185]  remoteproc0#vdev0buffer: assigned reserved memory node r5f-dma-memory@9da00000
    [    0.258619] virtio_rpmsg_bus virtio0: rpmsg host is online
    [    0.258645]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [    0.258652] remoteproc remoteproc0: remote processor 78000000.r5f is now attached
    [    0.263112] tps65219:In i2c probe() function
    [    0.263163] omap_i2c 20000000.i2c: bus 0 rev0.12 at 400 kHz
    [    0.264888] omap_i2c 20010000.i2c: bus 1 rev0.12 at 400 kHz
    [    0.266563] omap_i2c 20030000.i2c: bus 2 rev0.12 at 400 kHz
    [    0.267341] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
    [    0.267809] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
    [    0.269067] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
    [    0.269261] =>hw_version_probe
    [    0.269282] hw_version hw-version: hw0 error
    [    0.269648] ti-udma 485c0100.dma-controller: Number of rings: 82
    [    0.279996] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [    0.283433] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
    [    0.285964] ti-udma 485c0000.dma-controller: Number of rings: 150
    [    0.297785] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
    [    0.300614] printk: console [ttyS2] disabled
    [    0.300697] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 17, base_baud = 3000000) is a 8250
    [    0.301057] printk: console [ttyS2]: printing thread started
    [    0.301070] printk: console [ttyS2] enabled
    [    0.309370] 0x0FC40000: 0xc3083889
    [    0.309827] spi_nor_soft_reset
    [    0.311000] spi-nor spi0.0: s28hs02gt (262144 Kbytes)
    [    0.311012] spi-nor spi0.0: mtd .name = fc40000.spi.0, .size = 0x10000000 (256MiB), .erasesize = 0x00040000 (256KiB) .numeraseregions = 3
    [    0.311022] spi-nor spi0.0: mtd.eraseregions[0] = { .offset = 0x0, .erasesize = 0x00040000 (256KiB), .numblocks = 1023 }
    [    0.311030] spi-nor spi0.0: mtd.eraseregions[1] = { .offset = 0xffc0000, .erasesize = 0x00020000 (128KiB), .numblocks = 1 }
    [    0.311038] spi-nor spi0.0: mtd.eraseregions[2] = { .offset = 0xffe0000, .erasesize = 0x00001000 (4KiB), .numblocks = 32 }
    [    0.341466] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [    0.380792] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    0.385229] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000002
    [    0.385417] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
    [    0.385424] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
    [    0.387021] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
    [    0.390472] cpu cpu0: dev_pm_opp_set_rate: failed to find current OPP for freq 1250000000 (-34)
    [    0.393633] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 1250000 KHz, changing to: 1000000 KHz
    [    0.415252] =>hw_version_probe
    [    0.415379] zkw_eth_rst_probe ke
    [    0.415395] hw_version are done
    [    0.415416] vmonen are done
    [    0.415419] eth_ctrl are done
    [    0.415855] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [    0.452792] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    0.457055] davinci_mdio 8000f00.mdio: phy[2]: device 8000f00.mdio:02, driver NXP TJA1101
    [    0.469310] ti-sci-clk 44043000.system-controller:clock-controller: is_prepared failed for dev=70, clk=0, ret=-19
    [    0.472851] Warning: unable to open an initial console.
    [    0.506882] Freeing unused kernel memory: 35904K
    [    0.507054] Run /init as init process
    [    0.507058]   with arguments:
    [    0.507061]     /init
    [    0.507063]   with environment:
    [    0.507065]     HOME=/
    [    0.507068]     TERM=linux
    [    0.765026] am65-cpsw-nuss 8000000.ethernet: down msc_sl e0000000 tmo 0
    [    0.777098] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
    [    0.781911] ubi0: attaching mtd24
    [    0.789867] ubi0 attached mtd24 ("ospi.d.texture", 7 MiB)
    [    0.789941] ubi1: attaching mtd28
    [    0.797828] ubi1 attached mtd28 ("ospi.d.animation", 11 MiB)
    [    0.832547] UBIFS: ubi(0:0), name "textures", R/O mode
    [    0.840119] UBIFS: ubi(1:0), name "animations", R/O mode
    [    0.846916] am65-cpsw-nuss 8000000.ethernet eth0: PHY [8000f00.mdio:02] driver [NXP TJA1101] (irq=313)
    [    0.850502] am65-cpsw-nuss 8000000.ethernet eth0: configuring for phy/rmii link mode
    [    0.852980] am65-cpsw-nuss 8000000.ethernet eth0: Link is Up - 100Mbps/Full - flow control off
    [    0.855661] 8021q: adding VLAN 0 to HW filter on device eth0
    [    0.865852] am65-cpsw-nuss 8000000.ethernet: Adding vlan 2 to vlan filter
    [    0.871082] gmsl9275:reg 0x02: val 0x2F
    [    0.893250] gmsl9275:reg 0x04: val 0x80
    [    0.911349] width=640,height=164,h_total=720, v_total=292,fps=60
    [    0.926589] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
    [    0.928118] tidss 30200000.dss: [drm] fb0: tidssdrmfb frame buffer device
    [    0.947415] pvrsrvkm: loading out-of-tree module taints kernel.
    [    0.990515] PVR_K:  212: Read BVNC 33.15.11.3 from HW device registers
    [    0.991384] PVR_K:  212: RGX Device registered with BVNC 33.15.11.3
    [    0.992340] [drm] Initialized pvr 1.15.6133109 20170530 for fd00000.gpu on minor 1
    [    0.995668] pid = 226
    [    1.004345] pid = 225
    [    2.784818] random: crng init done
    [    6.436979] inv_mpu: whoami= fa
    [    6.437233] inv_mpu: inv_mpu_initialize: initialize result is 0....
    [    6.437975] inv_mpu: failed to create wakeup_source
    [    6.437990] inv-mpu-iio-spi spi1.0: iam20680 ma-kernel-9.1.7 is ready to go!
    [    6.437996] inv_mpu: Data read from FIFO
    [    6.438009] inv_mpu: Timer based batching
    [   10.975361] dispc_enable_oldi
    [   10.975385] dispc_vp_enable: video0, ipc=0
    [   10.979685] dispc_vp_enable: video1, ipc=0
    root@am62xx-zdml3:~# ethtool -S eth0
    NIC statistics:
         p0_rx_good_frames: 18060
         p0_rx_broadcast_frames: 0
         p0_rx_multicast_frames: 17559
         p0_rx_crc_errors: 0
         p0_rx_oversized_frames: 0
         p0_rx_undersized_frames: 0
         p0_ale_drop: 0
         p0_ale_overrun_drop: 0
         p0_rx_octets: 4860096
         p0_tx_good_frames: 125328
         p0_tx_broadcast_frames: 3
         p0_tx_multicast_frames: 124810
         p0_tx_octets: 41161190
         p0_tx_64B_frames: 0
         p0_tx_65_to_127B_frames: 47119
         p0_tx_128_to_255B_frames: 45313
         p0_tx_256_to_511B_frames: 27678
         p0_tx_512_to_1023B_frames: 10650
         p0_tx_1024B_frames: 12628
         p0_net_octets: 46021286
         p0_rx_bottom_fifo_drop: 0
         p0_rx_port_mask_drop: 0
         p0_rx_top_fifo_drop: 0
         p0_ale_rate_limit_drop: 0
         p0_ale_vid_ingress_drop: 0
         p0_ale_da_eq_sa_drop: 0
         p0_ale_block_drop: 0
         p0_ale_secure_drop: 0
         p0_ale_auth_drop: 0
         p0_ale_unknown_ucast: 501
         p0_ale_unknown_ucast_bytes: 68346
         p0_ale_unknown_mcast: 17545
         p0_ale_unknown_mcast_bytes: 4790458
         p0_ale_unknown_bcast: 0
         p0_ale_unknown_bcast_bytes: 0
         p0_ale_pol_match: 0
         p0_ale_pol_match_red: 0
         p0_ale_pol_match_yellow: 0
         p0_ale_mcast_sa_drop: 0
         p0_ale_dual_vlan_drop: 0
         p0_ale_len_err_drop: 0
         p0_ale_ip_next_hdr_drop: 0
         p0_ale_ipv4_frag_drop: 0
         p0_tx_mem_protect_err: 0
         p0_tx_pri0: 1281
         p0_tx_pri1: 0
         p0_tx_pri2: 0
         p0_tx_pri3: 1
         p0_tx_pri4: 113401
         p0_tx_pri5: 10645
         p0_tx_pri6: 0
         p0_tx_pri7: 0
         p0_tx_pri0_bcnt: 205478
         p0_tx_pri1_bcnt: 0
         p0_tx_pri2_bcnt: 0
         p0_tx_pri3_bcnt: 96
         p0_tx_pri4_bcnt: 34164090
         p0_tx_pri5_bcnt: 6791510
         p0_tx_pri6_bcnt: 0
         p0_tx_pri7_bcnt: 0
         p0_tx_pri0_drop: 0
         p0_tx_pri1_drop: 0
         p0_tx_pri2_drop: 0
         p0_tx_pri3_drop: 0
         p0_tx_pri4_drop: 0
         p0_tx_pri5_drop: 0
         p0_tx_pri6_drop: 0
         p0_tx_pri7_drop: 0
         p0_tx_pri0_drop_bcnt: 0
         p0_tx_pri1_drop_bcnt: 0
         p0_tx_pri2_drop_bcnt: 0
         p0_tx_pri3_drop_bcnt: 0
         p0_tx_pri4_drop_bcnt: 0
         p0_tx_pri5_drop_bcnt: 0
         p0_tx_pri6_drop_bcnt: 0
         p0_tx_pri7_drop_bcnt: 0
         rx_good_frames: 125411
         rx_broadcast_frames: 3
         rx_multicast_frames: 124893
         rx_pause_frames: 0
         rx_crc_errors: 0
         rx_align_code_errors: 0
         rx_oversized_frames: 0
         rx_jabber_frames: 0
         rx_undersized_frames: 0
         rx_fragments: 0
         ale_drop: 83
         ale_overrun_drop: 0
         rx_octets: 41189016
         tx_good_frames: 18060
         tx_broadcast_frames: 0
         tx_multicast_frames: 17559
         tx_pause_frames: 0
         tx_deferred_frames: 0
         tx_collision_frames: 0
         tx_single_coll_frames: 0
         tx_mult_coll_frames: 0
         tx_excessive_collisions: 0
         tx_late_collisions: 0
         rx_ipg_error: 0
         tx_carrier_sense_errors: 0
         tx_octets: 4860096
         tx_64B_frames: 4
         tx_65_to_127B_frames: 47135
         tx_128_to_255B_frames: 45342
         tx_256_to_511B_frames: 27697
         tx_512_to_1023B_frames: 10658
         tx_1024B_frames: 12635
         net_octets: 46049112
         rx_bottom_fifo_drop: 0
         rx_port_mask_drop: 83
         rx_top_fifo_drop: 0
         ale_rate_limit_drop: 0
         ale_vid_ingress_drop: 8
         ale_da_eq_sa_drop: 0
         ale_block_drop: 0
         ale_secure_drop: 0
         ale_auth_drop: 0
         ale_unknown_ucast: 515
         ale_unknown_ucast_bytes: 81020
         ale_unknown_mcast: 124893
         ale_unknown_mcast_bytes: 41107804
         ale_unknown_bcast: 3
         ale_unknown_bcast_bytes: 192
         ale_pol_match: 0
         ale_pol_match_red: 0
         ale_pol_match_yellow: 0
         ale_mcast_sa_drop: 0
         ale_dual_vlan_drop: 0
         ale_len_err_drop: 0
         ale_ip_next_hdr_drop: 0
         ale_ipv4_frag_drop: 0
         iet_rx_assembly_err: 0
         iet_rx_assembly_ok: 0
         iet_rx_smd_err: 0
         iet_rx_frag: 0
         iet_tx_hold: 0
         iet_tx_frag: 0
         tx_mem_protect_err: 0
         tx_pri0: 2526
         tx_pri1: 0
         tx_pri2: 0
         tx_pri3: 0
         tx_pri4: 15534
         tx_pri5: 0
         tx_pri6: 0
         tx_pri7: 0
         tx_pri0_bcnt: 3091764
         tx_pri1_bcnt: 0
         tx_pri2_bcnt: 0
         tx_pri3_bcnt: 0
         tx_pri4_bcnt: 1768332
         tx_pri5_bcnt: 0
         tx_pri6_bcnt: 0
         tx_pri7_bcnt: 0
         tx_pri0_drop: 0
         tx_pri1_drop: 0
         tx_pri2_drop: 0
         tx_pri3_drop: 0
         tx_pri4_drop: 0
         tx_pri5_drop: 0
         tx_pri6_drop: 0
         tx_pri7_drop: 0
         tx_pri0_drop_bcnt: 0
         tx_pri1_drop_bcnt: 0
         tx_pri2_drop_bcnt: 0
         tx_pri3_drop_bcnt: 0
         tx_pri4_drop_bcnt: 0
         tx_pri5_drop_bcnt: 0
         tx_pri6_drop_bcnt: 0
         tx_pri7_drop_bcnt: 0
    root@am62xx-zdml3:~#

    Cong.

  • Hi Cong,

    Thank you for the logs. I reviewed them and I do not see any issues in the MAC level statistics, (ethtool -S). At the moment I am not able to suggest anything for debug. Hopefully you will be able to capture the console sequence when the issue occurs. The first thing to check is if the PHY or the system is reporting a the link as down.

    Best Regards,

    Schuyler 

  • Hi Schuyler!

    Can you answer the backporting question we asked?

    Questions:

    • is this a "known" issue?
    • could newer (preferably the latest) netif layer be backported to our system? Feasibility?

    It might be hard to pinpoint an actual fix that helped in this case since we might never be able to reproduce live. I would try to apply as many kernel / net layer fixes as possible and hope for the best.

  • Hi,

    The only issue that I am aware is the device errata i2329 MDIO: MDIO interface corruption (CPSW and PRU-ICSS). The TI SDK release enables a workaround so this errata should not be encountered. The workaround is using MDIO Bit Bang instead of the device MDIO IP and is enabled in the SDK version that was pointed to earlier in the thread. I would recommend checking the Linux kernel config to make sure these options are enabled:

    CONFIG_TI_DAVINCI_MDIO=y
    CONFIG_MDIO_BITBANG=y
    CONFIG_MDIO_GPIO=y

    The only comment I have is that there are several layers in the netif. TI can only support MDIO and CPSW in these layers. I agree that reproducing this issue live will be difficult since it could be anything not just the SW so even moving to the latest SDK may not fix the issue.

    Best Regards,

    Schuyler

  • Hello Schuyler,

    In our system:

    CONFIG_TI_DAVINCI_MDIO=y
    CONFIG_MDIO_BITBANG=y

    but CONFIG_MDIO_GPIO is not set.
    We will try to enable this config

    Thanks
    Cong.
  • Hi Cong,

    Thanks for letting me know.

    Best Regards,

    Schuyler

  • Hi Schuyler,

    we decided together with Karan that for us to progress we need more debug information.

    Could you provide a few pointers what would you like to see printed? Which info would you find interesting in this case?

    Thanks in advance!

    /MK

  • Hi,

    Based on the problem description an initial debug step would be to look to see if a link loss is reported by the PHY driver. A dmesg log from the vehicle should report a link loss, hopefully this log is persistent after the vehicle is turned off. I would also suggest contacting the PHY manufacturer and checking if there have been reports of link loss with this PHY perhaps under certain conditions.  Also check with the PHY manufacturer if there are error counters that could be read that might indicate link down conditions have occurred. 

    The reason I am suggesting the look at the PHY first is that the problem has the markings of a link loss followed by a link recovery. When the PHY reports a link loss this will cause the CPSW to tear down, a link recovery will cause the CPSW to initialize, this would look like a pause in network traffic.

    Best Regards,

    Schuyler