AM6548: AM65x remoteproc: Kernel Panic (Alignment Fault) when loading PRU Firmware

Hello Tsai,

Are you using the PRU-CGT to generate the PRU firmware?

If you used PRU Software Support Package (PSSP) during your PRU development, what version of PSSP did you use?

I assume your PRU firmware was developed for AM65x SR2.0 (silicon revision 2) instead of AM65x SR1.0, since the PRU subsystem was different in SR1.0 and did not have a TX_PRU core.

The Linux PRU remoteproc driver requirements for resource table in the PRU firmware did change between Linux kernel releases, so it is possible that you will need to update some of the PRU firmware (INTC file and resource table) to get the firmware loading properly.

Regards,

Nick

Thank you for your reply. I am currently using the SR2.0 BSP, but I have not yet recompiled the PRU Firmware, still using the files compiled under the previous Kernel 5.x version. I will try recompiling the PRU Firmware to test if it resolves the issue.

Additionally, I noticed the following log message during the Linux boot phase, which seems to indicate an error with the ICSSG (Ethernet) on the PRU. How should I go about fixing this part?

"[ 11.398143] remoteproc remoteproc16: unsupported resource 5" --> PRU2_1

"[ 11.480978] remoteproc remoteproc13: unsupported resource 5" --> RTU1_0

Log:

[  OK  ] Started TEE Supplicant.
         Starting Telnet Server...
[  OK  ] Finished Telnet Server.
[  OK  ] Finished IPv6 Packet Filtering Framework.
[  OK  ] Finished IPv4 Packet Filtering Framework.
[  OK  ] Reached target Preparation for Network.
         Starting Network Configuration...
[   10.722743] k3_r5_rproc bus@100000:bus@28380000:r5fss@41000000: Timed out waiting for 41000000.r5f core to power up!
[   10.735123] remoteproc remoteproc0: releasing 41000000.r5f
[  OK  ] Started User Login Management.
[  OK  ] Finished Expand the rootfs…full size of the boot device..
[  OK  ] Created slice Slice /system/systemd-fsck.
[  OK  ] Started Network Configuration.
         Starting Network Name Resolution...
[   11.392832] remoteproc remoteproc16: powering up b234000.pru
[   11.398095] remoteproc remoteproc16: Booting fw image ti-pruss/am65x-sr2-pru0-prueth-fw.elf, size 39636
[   11.398143] remoteproc remoteproc16: unsupported resource 5
[   11.398177] remoteproc remoteproc16: remote processor b234000.pru is now up
[   11.398220] remoteproc remoteproc17: powering up b204000.rtu
[   11.400415] remoteproc remoteproc17: Booting fw image ti-pruss/am65x-sr2-rtu0-prueth-fw.elf, size 30444
[   11.400468] remoteproc remoteproc17: remote processor b204000.rtu is now up
[   11.400506] remoteproc remoteproc5: powering up b20a000.txpru
[   11.403097] remoteproc remoteproc5: Booting fw image ti-pruss/am65x-sr2-txpru0-prueth-fw.elf, size 39080
[   11.403157] remoteproc remoteproc5: remote processor b20a000.txpru is now up
[   11.405038] pps pps0: new PPS source ptp2
[   11.480727] remoteproc remoteproc13: powering up b134000.pru
[   11.480952] remoteproc remoteproc13: Booting fw image ti-pruss/am65x-sr2-pru0-prueth-fw.elf, size 39636
[   11.480978] remoteproc remoteproc13: unsupported resource 5
[  OK  ] Found device /dev/mmcblk1p1.
[   11.481011] remoteproc remoteproc13: remote processor b134000.pru is now up
[   11.481045] remoteproc remoteproc14: powering up b104000.rtu
[   11.481186] remoteproc remoteproc14: Booting fw image ti-pruss/am65x-sr2-rtu0-prueth-fw.elf, size 30444
[   11.481219] remoteproc remoteproc14: remote processor b104000.rtu is now up
[   11.481241] remoteproc remoteproc3: powering up b10a000.txpru
[   11.481367] remoteproc remoteproc3: Booting fw image ti-pruss/am65x-sr2-txpru0-prueth-fw.elf, size 39080
[   11.481406] remoteproc remoteproc3: remote processor b10a000.txpru is now up
         Starting File System Check on /dev/mmcblk1p1   11.485838] pps pps1: new PPS source ptp3
0m...
[   11.542730] am65-cpsw-nuss 46000000.ethernet eth0: PHY [46000f00.mdio:03] driver [TI DP83822] (irq=POLL)
[   11.542762] am65-cpsw-nuss 46000000.ethernet eth0: configuring for phy/rmii link mode
[  OK  ] Started Network Name Resolution.
[  OK  ] Reached target Network.
[  OK  ] Reached target Host and Network Name Lookups.
         Starting Avahi mDNS/DNS-SD Stack...
         Starting containerd container runtime...
[  OK  ] Started Netperf Benchmark Server.
[  OK  ] Started NFS status monitor for NFSv2/3 locking..
         Starting Delta AX-564 Startup Service...
         Starting Permit User Sessions...
[  OK  ] Finished Permit User Sessions.

Hello Tsai,

Sounds good. If you tell me more about your PRU development environment (like if you are using a version of PSSP) that will help me to provide better guidance.

"unsupported resource 5" when PRU Ethernet firmware is loaded can be ignored. This message is expected, and does not mean anything.

Regards,

Nick

Hi Nick ,

I have already downloaded TI CGT PRU and TI PSSP, but I am unable to create an AM6548 Project in CCS. How should I proceed?

Hello Tsai,

I am out of office until later this week, so future responses will be delayed.

Until then, please refer to the PRU Getting Started Labs:
https://software-dl.ti.com/processor-sdk-linux/esd/AM65X/09_01_00_01/exports/docs/common/PRU-ICSS/PRU-Getting-Started-Labs.html

Regards,

Nick

Hi Nick , 

I have already downloaded and installed CCS v11 and updated my project to use the include files from PRU_CGT v2.3.3 and PSSP v6.5.0 for my header files.

Following the suggested modifications (to the PRU Firmware Source Code), I have recompiled the firmware, but I am still encountering similar errors, as shown below:

==================== stop PRU FW ====================
[   26.290629] remoteproc remoteproc16: stopped remote processor b204000.rtu
==================== start PRU FW ====================
[   26.311798] remoteproc remoteproc1: powering up b00a000.txpru
[   26.320096] remoteproc remoteproc1: Booting fw image am65x-txpru0_0-fw, size 135576
[   26.320151] Unable to handle kernel paging request at virtual address ffff800008ffd99c
[   26.335722] Mem abort info:
[   26.338520]   ESR = 0x0000000096000061
[   26.340200] am65-cpsw-nuss 46000000.ethernet EtherCAT: Link is Down
[   26.348527]   EC = 0x25: DABT (current EL), IL = 32 bits
[   26.353852]   SET = 0, FnV = 0
[   26.356929]   EA = 0, S1PTW = 0
[   26.360068]   FSC = 0x21: alignment fault
[   26.364097] Data abort info:
[   26.366990]   ISV = 0, ISS = 0x00000061
[   26.370832]   CM = 0, WnR = 1
[   26.373815] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   26.380542] [ffff800008ffd99c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=10000000bfff9003, pte=006800000b001713
[   26.393072] Internal error: Oops: 0000000096000061 [#1] PREEMPT_RT SMP
[   26.393080] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   26.393177] CPU: 0 PID: 677 Comm: sh Tainted: G           O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   26.393186] Hardware name: Texas Instruments AM654 Base Board (DT)
[   26.393190] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   26.393198] pc : 0xffff800008930410
[   26.393201] lr : 0xffff800008964670
[   26.393204] sp : ffff00000b623c30
[   26.393206] x29: ffff00000b623c30 x28: ffff00000b7e9800 x27: 0000000000000000
[   26.393216] x26: 0000000000000000 x25: 0000000000000000 x24: ffff00000842c000
[   26.393225] x23: 0000000000000000 x22: ffff00000842c000 x21: ffff00000308e038
[   26.393234] x20: ffff800008ffd998 x19: ffff00000308e000 x18: ffffffffffffffff
[   26.393243] x17: 0000000000000001 x16: 00009f7232a5a060 x15: ffff800008e9f021
[   26.393252] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000
[   26.393261] x11: ffff800008b35210 x10: ffffffffff65bf8c x9 : 0000000000000018
[   26.393270] x8 : 0101010101010101 x7 : 0000000000000000 x6 : 0000000000000001
[   26.393279] x5 : ffff800008ffd9ac x4 : ffff000008ef7f94 x3 : ffff00000340b880
[   26.393288] x2 : 0000000000000014 x1 : ffff000008ef7f80 x0 : ffff800008ffd998
[   26.393298] Call trace:
[   26.393301]  0xffff800008930410
[   26.393304]  0xffff800008788ff0
[   26.393307]  0xffff80000878b210
[   26.393309]  0xffff80000852fea4
[   26.393312]  0xffff8000081fcd90
[   26.393315]  0xffff8000081fc140
[   26.393317]  0xffff80000816fce8
[   26.393320]  0xffff80000816fed4
[   26.393323]  0xffff80000816ff68
[   26.393325]  0xffff80000801ddec
[   26.393328]  0xffff80000801deec
[   26.393330]  0xffff800008966ef0
[   26.393333]  0xffff800008968484
[   26.393336]  0xffff800008011488
[   26.393343] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)
[   26.594129] ---[ end trace 0000000000000000 ]---
[   26.605463] remoteproc remoteproc2: powering up b00c000.txpru
[   26.624242] remoteproc remoteproc2: Booting fw image am65x-txpru0_1-fw, size 145296
[   26.631952] Unable to handle kernel paging request at virtual address ffff8000090efa5c
[   26.639865] Mem abort info:
[   26.642658]   ESR = 0x0000000096000061
[   26.646403]   EC = 0x25: DABT (current EL), IL = 32 bits
[   26.651711]   SET = 0, FnV = 0
[   26.654769]   EA = 0, S1PTW = 0
[   26.657907]   FSC = 0x21: alignment fault
[   26.661911] Data abort info:
[   26.664787]   ISV = 0, ISS = 0x00000061
[   26.668618]   CM = 0, WnR = 1
[   26.671590] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   26.678290] [ffff8000090efa5c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=100000008000c003, pte=006800000b003713
[   26.690815] Internal error: Oops: 0000000096000061 [#2] PREEMPT_RT SMP
[   26.690822] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   26.690915] CPU: 0 PID: 679 Comm: sh Tainted: G      D    O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   26.690923] Hardware name: Texas Instruments AM654 Base Board (DT)
[   26.690927] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   26.690934] pc : 0xffff800008930410
[   26.690938] lr : 0xffff800008964670
[   26.690940] sp : ffff00000b62bc30
[   26.690942] x29: ffff00000b62bc30 x28: ffff00000b7ebc00 x27: 0000000000000000
[   26.690952] x26: 0000000000000000 x25: 0000000000000000 x24: ffff00000a54e500
[   26.690961] x23: 0000000000000000 x22: ffff00000a54e500 x21: ffff00000308d838
[   26.690970] x20: ffff8000090efa58 x19: ffff00000308d800 x18: ffffffffffffffff
[   26.690979] x17: 0000000000000001 x16: 0000000000000001 x15: 0319414ffeb13c84
[   26.690988] x14: 01f34685f16c3ab8 x13: 0000000000000000 x12: 0000000000000000
[   26.690997] x11: 0000000000002000 x10: ffffffffff513996 x9 : 0000000000000008
[   26.691006] x8 : 0000000000002000 x7 : 0000000000000000 x6 : 0000000000000001
[   26.691014] x5 : ffff8000090efa6c x4 : ffff000008ef7c14 x3 : ffff00000340b880
[   26.691023] x2 : 0000000000000014 x1 : ffff000008ef7c00 x0 : ffff8000090efa58
[   26.691033] Call trace:
[   26.691036]  0xffff800008930410
[   26.691039]  0xffff800008788ff0
[   26.691042]  0xffff80000878b210
[   26.691045]  0xffff80000852fea4
[   26.691047]  0xffff8000081fcd90
[   26.691050]  0xffff8000081fc140
[   26.691052]  0xffff80000816fce8
[   26.691055]  0xffff80000816fed4
[   26.691057]  0xffff80000816ff68
[   26.691060]  0xffff80000801ddec
[   26.691062]  0xffff80000801deec
[   26.691065]  0xffff800008966ef0
[   26.691068]  0xffff800008968484
[   26.691070]  0xffff800008011488
[   26.691077] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)
[   26.891862] ---[ end trace 0000000000000000 ]---
[   26.902864] remoteproc remoteproc7: powering up b134000.pru
[   26.913251] remoteproc remoteproc7: Booting fw image ti-pruss/am65x-sr2-pru0-prueth-fw.elf, size 39636
[   26.922578] remoteproc remoteproc7: unsupported resource 5
[   26.928098] remoteproc remoteproc7: remote processor b134000.pru is now up
[   26.945726] remoteproc remoteproc9: powering up b038000.pru
[   26.959599] remoteproc remoteproc9: Booting fw image am65x-pru0_1-fw, size 150956
[   26.967136] Unable to handle kernel paging request at virtual address ffff8000090ee16c
[   26.975051] Mem abort info:
[   26.977842]   ESR = 0x0000000096000061
[   26.981587]   EC = 0x25: DABT (current EL), IL = 32 bits
[   26.986897]   SET = 0, FnV = 0
[   26.989964]   EA = 0, S1PTW = 0
[   26.993141]   FSC = 0x21: alignment fault
[   26.997185] Data abort info:
[   27.000088]   ISV = 0, ISS = 0x00000061
[   27.003959]   CM = 0, WnR = 1
[   27.006946] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   27.013667] [ffff8000090ee16c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=100000008000c003, pte=006800000b002713
[   27.026226] Internal error: Oops: 0000000096000061 [#3] PREEMPT_RT SMP
[   27.026240] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   27.026346] CPU: 0 PID: 683 Comm: sh Tainted: G      D    O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   27.026355] Hardware name: Texas Instruments AM654 Base Board (DT)
[   27.026360] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   27.026367] pc : 0xffff800008930410
[   27.026371] lr : 0xffff800008964670
[   27.026374] sp : ffff00000b63bc30
[   27.026376] x29: ffff00000b63bc30 x28: ffff00000b7ebc00 x27: 0000000000000000
[   27.026386] x26: 0000000000000000 x25: 0000000000000000 x24: ffff0000097d1b80
[   27.026395] x23: 0000000000000000 x22: ffff0000097d1b80 x21: ffff000005282838
[   27.026404] x20: ffff8000090ee168 x19: ffff000005282800 x18: ffffffffffffffff
[   27.026413] x17: 3120657a6973202c x16: 77662d315f307572 x15: 702d7835366d6120
[   27.026424] x14: 6567616d69207766 x13: 0000000000000000 x12: 0000000000000000
[   27.026433] x11: 0000000000002000 x10: ffffffffff4ed32e x9 : 0000000000000008
[   27.026442] x8 : 0000000000002000 x7 : 0000000000000000 x6 : 0000000000000001
[   27.026451] x5 : ffff8000090ee17c x4 : ffff000008ef7e94 x3 : ffff00000340b880
[   27.026460] x2 : 0000000000000014 x1 : ffff000008ef7e80 x0 : ffff8000090ee168
[   27.026470] Call trace:
[   27.026473]  0xffff800008930410
[   27.026478]  0xffff800008788ff0
[   27.026481]  0xffff80000878b210
[   27.026483]  0xffff80000852fea4
[   27.026486]  0xffff8000081fcd90
[   27.026488]  0xffff8000081fc140
[   27.026491]  0xffff80000816fce8
[   27.026494]  0xffff80000816fed4
[   27.026497]  0xffff80000816ff68
[   27.026499]  0xffff80000801ddec
[   27.026502]  0xffff80000801deec
[   27.026504]  0xffff800008966ef0
[   27.026508]  0xffff800008968484
[   27.026511]  0xffff800008011488
[   27.026519] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)
[   27.227345] ---[ end trace 0000000000000000 ]---
[   27.238351] remoteproc remoteproc10: powering up b006000.rtu
[   27.256890] remoteproc remoteproc10: Booting fw image am65x-rtu0_1-fw, size 145164
[   27.264528] Unable to handle kernel paging request at virtual address ffff8000090ef25c
[   27.272444] Mem abort info:
[   27.275236]   ESR = 0x0000000096000061
[   27.278986]   EC = 0x25: DABT (current EL), IL = 32 bits
[   27.284293]   SET = 0, FnV = 0
[   27.287356]   EA = 0, S1PTW = 0
[   27.290510]   FSC = 0x21: alignment fault
[   27.294514] Data abort info:
[   27.297391]   ISV = 0, ISS = 0x00000061
[   27.301222]   CM = 0, WnR = 1
[   27.304186] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   27.310880] [ffff8000090ef25c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=100000008000c003, pte=006800000b003713
[   27.323405] Internal error: Oops: 0000000096000061 [#4] PREEMPT_RT SMP
[   27.323412] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   27.323506] CPU: 0 PID: 696 Comm: sh Tainted: G      D    O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   27.323514] Hardware name: Texas Instruments AM654 Base Board (DT)
[   27.323518] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   27.323527] pc : 0xffff800008930410
[   27.323530] lr : 0xffff800008964670
[   27.323532] sp : ffff00000b61fc30
[   27.323535] x29: ffff00000b61fc30 x28: ffff00000b7ebc00 x27: 0000000000000000
[   27.323545] x26: 0000000000000000 x25: 0000000000000000 x24: ffff0000097d1900
[   27.323553] x23: 0000000000000000 x22: ffff0000097d1900 x21: ffff000005282038
[   27.323563] x20: ffff8000090ef258 x19: ffff000005282000 x18: ffffffffffffffff
[   27.323572] x17: 20657a6973202c77 x16: 0000000000000008 x15: 0000000000000000
[   27.323581] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000
[   27.323589] x11: 0000000000002000 x10: ffffffffff4c8a0c x9 : 0000000000000018
[   27.323598] x8 : 0000000000002000 x7 : 0000000000000000 x6 : 0000000000000001
[   27.323607] x5 : ffff8000090ef26c x4 : ffff000003751d94 x3 : ffff00000340b880
[   27.323616] x2 : 0000000000000014 x1 : ffff000003751d80 x0 : ffff8000090ef258
[   27.323626] Call trace:
[   27.323630]  0xffff800008930410
[   27.323633]  0xffff800008788ff0
[   27.323635]  0xffff80000878b210
[   27.323638]  0xffff80000852fea4
[   27.323640]  0xffff8000081fcd90
[   27.323643]  0xffff8000081fc140
[   27.323646]  0xffff80000816fce8
[   27.323648]  0xffff80000816fed4
[   27.323651]  0xffff80000816ff68
[   27.323653]  0xffff80000801ddec
[   27.323656]  0xffff80000801deec
[   27.323658]  0xffff800008966ef0
[   27.323661]  0xffff800008968484
[   27.323664]  0xffff800008011488
[   27.323671] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)
[   27.524457] ---[ end trace 0000000000000000 ]---
[   27.535450] remoteproc remoteproc11: powering up b034000.pru
[   27.553542] remoteproc remoteproc11: Booting fw image am65x-pru0_0-fw, size 139224
[   27.561168] Unable to handle kernel paging request at virtual address ffff800008ffc21c
[   27.569084] Mem abort info:
[   27.571874]   ESR = 0x0000000096000061
[   27.575625]   EC = 0x25: DABT (current EL), IL = 32 bits
[   27.580938]   SET = 0, FnV = 0
[   27.583988]   EA = 0, S1PTW = 0
[   27.587124]   FSC = 0x21: alignment fault
[   27.591128] Data abort info:
[   27.594004]   ISV = 0, ISS = 0x00000061
[   27.597834]   CM = 0, WnR = 1
[   27.600799] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   27.607499] [ffff800008ffc21c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=10000000bfff9003, pte=006800000b000713
[   27.620024] Internal error: Oops: 0000000096000061 [#5] PREEMPT_RT SMP
[   27.620031] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   27.620124] CPU: 0 PID: 698 Comm: sh Tainted: G      D    O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   27.620132] Hardware name: Texas Instruments AM654 Base Board (DT)
[   27.620137] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   27.620144] pc : 0xffff800008930410
[   27.620147] lr : 0xffff800008964670
[   27.620150] sp : ffff00000b633c30
[   27.620153] x29: ffff00000b633c30 x28: ffff000008d4b000 x27: 0000000000000000
[   27.620162] x26: 0000000000000000 x25: 0000000000000000 x24: ffff000005001a00
[   27.620171] x23: 0000000000000000 x22: ffff000005001a00 x21: ffff000005281838
[   27.620180] x20: ffff800008ffc218 x19: ffff000005281800 x18: ffffffffffffffff
[   27.620189] x17: 20657a6973202c77 x16: 662d305f30757270 x15: 2d7835366d612065
[   27.620198] x14: 67616d6920776620 x13: 0000000000000000 x12: 0000000000000000
[   27.620206] x11: 0000000000000292 x10: ffffffffff4a5120 x9 : 0000000000000038
[   27.620216] x8 : 0101010101010101 x7 : 0000000000000000 x6 : 0000000000000001
[   27.620224] x5 : ffff800008ffc22c x4 : ffff000003751614 x3 : ffff00000340b880
[   27.620233] x2 : 0000000000000014 x1 : ffff000003751600 x0 : ffff800008ffc218
[   27.620243] Call trace:
[   27.620246]  0xffff800008930410
[   27.620249]  0xffff800008788ff0
[   27.620252]  0xffff80000878b210
[   27.620254]  0xffff80000852fea4
[   27.620257]  0xffff8000081fcd90
[   27.620260]  0xffff8000081fc140
[   27.620262]  0xffff80000816fce8
[   27.620265]  0xffff80000816fed4
[   27.620267]  0xffff80000816ff68
[   27.620270]  0xffff80000801ddec
[   27.620272]  0xffff80000801deec
[   27.620275]  0xffff800008966ef0
[   27.620278]  0xffff800008968484
[   27.620281]  0xffff800008011488
[   27.620288] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)
[   27.821073] ---[ end trace 0000000000000000 ]---
[   27.831930] remoteproc remoteproc16: powering up b204000.rtu
[   27.842414] remoteproc remoteproc16: Booting fw image ti-pruss/am65x-sr2-rtu0-prueth-fw.elf, size 30444
[   27.851840] remoteproc remoteproc16: remote processor b204000.rtu is now up
[   27.869581] remoteproc remoteproc17: powering up b238000.pru
[   27.883057] remoteproc remoteproc17: Booting fw image am65x-pru2_1-fw, size 139168
[   27.890674] Unable to handle kernel paging request at virtual address ffff8000091ee21c
[   27.898590] Mem abort info:
[   27.901387]   ESR = 0x0000000096000061
[   27.905138]   EC = 0x25: DABT (current EL), IL = 32 bits
[   27.910451]   SET = 0, FnV = 0
[   27.913502]   EA = 0, S1PTW = 0
[   27.916638]   FSC = 0x21: alignment fault
[   27.920643] Data abort info:
[   27.923519]   ISV = 0, ISS = 0x00000061
[   27.927351]   CM = 0, WnR = 1
[   27.930315] swapper pgtable: 4k pages, 48-bit VAs, pgdp=0000000082ba8000
[   27.937051] [ffff8000091ee21c] pgd=10000000bffff003, p4d=10000000bffff003, pud=10000000bfffe003, pmd=100000008000c003, pte=006800000b202713
[   27.949577] Internal error: Oops: 0000000096000061 [#6] PREEMPT_RT SMP
[   27.949583] Modules linked in: usb_f_acm u_serial g_serial libcomposite overlay xhci_plat_hcd ti_am335x_adc kfifo_buf irq_pruss_intc dwc3 spidev crct10dif_ce icssg_prueth pru_rproc hsr icss_iep ti_k3_r5_remoteproc virtio_rpmsg_bus rpmsg_ns omap_hwspinlock k3_bandgap m_can_platform m_can rti_wdt can_dev ti_am335x_tscadc pruss sa2ul phy_omap_usb2 dwc3_keystone at24 spi_omap2_mcspi cryptodev(O) fuse drm drm_panel_orientation_quirks ipv6
[   27.949680] CPU: 0 PID: 702 Comm: sh Tainted: G      D    O       6.1.119-rt45-ti-rt-gb0f9de804a16 #1
[   27.949688] Hardware name: Texas Instruments AM654 Base Board (DT)
[   27.949692] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   27.949700] pc : 0xffff800008930410
[   27.949703] lr : 0xffff800008964670
[   27.949705] sp : ffff00000f01fc30
[   27.949708] x29: ffff00000f01fc30 x28: ffff00000b7ea400 x27: 0000000000000000
[   27.949717] x26: 0000000000000000 x25: 0000000000000000 x24: ffff000005339500
[   27.949726] x23: 0000000000000000 x22: ffff000005339500 x21: ffff00000363f838
[   27.949735] x20: ffff8000091ee218 x19: ffff00000363f800 x18: ffffffffffffffff
[   27.949745] x17: 20657a6973202c77 x16: 662d315f32757270 x15: 2d7835366d612065
[   27.949754] x14: 67616d6920776620 x13: 0000000000000000 x12: 0000000000000000
[   27.949763] x11: 0000000000002000 x10: ffffffffff482158 x9 : 0000000000000038
[   27.949771] x8 : 0000000000002000 x7 : 0000000000000000 x6 : 0000000000000001
[   27.949780] x5 : ffff8000091ee22c x4 : ffff000005339414 x3 : ffff000000379080
[   27.949789] x2 : 0000000000000014 x1 : ffff000005339400 x0 : ffff8000091ee218
[   27.949799] Call trace:
[   27.949802]  0xffff800008930410
[   27.949805]  0xffff800008788ff0
[   27.949808]  0xffff80000878b210
[   27.949810]  0xffff80000852fea4
[   27.949813]  0xffff8000081fcd90
[   27.949815]  0xffff8000081fc140
[   27.949817]  0xffff80000816fce8
[   27.949820]  0xffff80000816fed4
[   27.949823]  0xffff80000816ff68
[   27.949825]  0xffff80000801ddec
[   27.949828]  0xffff80000801deec
[   27.949830]  0xffff800008966ef0
[   27.949832]  0xffff800008968484
[   27.949835]  0xffff800008011488
[   27.949842] Code: 540000c3 a9401c26 a97f348c a9001c06 (a93f34ac)

If you require the complete project files for further assistance, could you please provide me with your email address?

Hello,

Ok, based on those boot logs you are using the PRU subsystem for Ethernet... but also generic firmware? I do not understand.
remoteproc7: Booting fw image ti-pruss/am65x-sr2-pru0-prueth-fw.elf, size 39636
remoteproc9: Booting fw image am65x-pru0_1-fw, size 150956

Is this TI-provided firmware? If so, what kind of Ethernet are you using? (e.g. is this the "standard" Ethernet, or a networking protocol?)

Have you made custom changes to the PRU firmware if this is TI-provided firmware?

Regards,

Nick

Hi Nick , 

I am indeed using standard Ethernet, and I have not modified any default firmware. Based on the Device Tree, the default usage for ICSSG should be as follows, leading to the assumption that remoteproc7 and remoteproc9 should be unused?

//PRU1_0 -> remoteproc12
//RTU1_0 -> remoteproc13
//TX_PRU1_0 -> remoteproc3
//PRU1_1 -> remoteproc14
//RTU1_1 -> remoteproc15
//TX_PRU1_1 -> remoteproc4
//PRU2_0 -> remoteproc18
//RTU2_0 -> remoteproc8
//TX_PRU2_0 -> remoteproc5
//TX_PRU2_1 -> remoteproc6

// Not use , For other IO Firmware
//PRU2_1 -> remoteproc16
//RTU2_1 -> remoteproc17

Separately, I compiled additional PRU Firmware and loaded it to run on RP1, RP2, RP7, RP9, RP10, and RP11.

May I contact you via email to provide the relevant files I currently have?

Hello Tsai,

First off, please note that remoteprocX associations are not fixed. They are assigned on a first-come, first-served basis, which means that "remoteproc17" could point to RTU2_1 on one boot, and then a totally different core on the next boot.

PRU Ethernet requires the use of all cores in a slice. e.g., if you had an Ethernet port connected to ICSSG1_PRU0, then Ethernet firmware would also be running on ICSSG1_RTU0, and ICSSG1_TX_PRU0.

So if you are not running Ethernet firmware in ICSSG2 slice1, then you could run something else on ICSSG2_PRU1, ICSSG2_RTU1, and ICSSG2_TX_PRU1. You would want to be very careful to make sure your other code does not interfere with the Ethernet memory, etc.

Please send me a direct message by clicking on my name here.

Regards,

Nick

Hi Nick,

I have sent the relevant files to you via direct message. Could you please take a look and help me figure out a solution? Thank you.

Hello Tsai,

I was going to look over the files today, but I have run out of time in the workday. Please ping the thread if I do not reply on Friday.

Regards,

Nick

Hi Nick,

Are there any new developments on this issue? Thanks!

Still no time, apologies.

I only have one more workday this week. If I have to pick which of your threads gets attention, is this thread more important for you in the short term? Or the watchdog thread?

Regards,

Nick

Hi Nick,

the PRU issue is more critical. We can address the Watchdog issue using alternative solutions. If possible, I hope we can prioritize the PRU Firmware issue. Thank you.