This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM3352: 5.10 kernel is unable to mount Rootfs and hangs there

Part Number: AM3352

Hello,

I have a custom board based on AM335x and currently using 5.4 kernel. I am in processing of migrating from 5.4 to 5.10 kernel but 5.10 kernel seems to be unable to mount rootfs neither over NFS not from EMMC and it hangs there. Could anyone please help me on the issue resolution. Please find full logs below:

Booting from eMMC:

U-Boot SPL 2017.01 ALC (Aug 12 2021 - 17:43:40)
Trying to boot from MMC2
MMC: ****** RCA is set to 1 ******
reading u-boot.img
reading u-boot.img
reading u-boot.img
reading u-boot.img


U-Boot 2017.01 ALC (Aug 12 2021 - 17:43:40 -0400)

CPU  : AM335X-GP rev 2.1
Model: TI AM335x ALC
DRAM:  256 MiB
MMC:   OMAP SD/MMC: 0
MMC Device 1 not found
*** Warning - No MMC card found, using default environment

Device tree fdtfile: am335x-alc_ngzn.dtb
Press and hold recovery switch to enter Recovery Mode
Recovery Switch Set to OFF
Hit any key to stop autoboot:  0
switch to partitions #0, OK
mmc0(part 0) is current device
SD/MMC found on device 0
reading boot.scr
** Unable to read file boot.scr **
reading uEnv.txt
25 bytes read in 4 ms (5.9 KiB/s)
Loaded env from uEnv.txt
Importing environment from mmc0 ...
switch to partitions #0, OK
mmc0(part 0) is current device
Scanning mmc 0:1...
switch to partitions #0, OK
mmc0(part 0) is current device
SD/MMC found on device 0
5455424 bytes read in 626 ms (8.3 MiB/s)
96644 bytes read in 27 ms (3.4 MiB/s)
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 8df31000, end 8df4b983 ... OK

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 5.10.131-alc-gf9344bef79 (oe-user@oe-host) (arm-poky-linux-gnueabi-gcc (GCC) 9.3.0, GNU ld (GNU Binutils) 2.34.0.20200220) #1 PREEMPT Wed Aug 31 13:11:15 UTC 2022
[    0.000000] CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: TI AM335x ALC
[    0.000000] Memory policy: Data cache writeback
[    0.000000] cma: Reserved 24 MiB at 0x8e000000
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000] CPU: All CPU(s) started in SVC mode.
[    0.000000] AM335X ES2.1 (neon)
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 64516
[    0.000000] Kernel command line: console=ttyO0,115200n8 loginShell=allow root=PARTUUID=a946079f-02 rw rootflags=data=ordered,journal_checksum,commit=1,discard rootfstype=ext4 rootwait
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 219816K/260096K available (8192K kernel code, 516K rwdata, 2520K rodata, 1024K init, 254K bss, 15704K reserved, 24576K cma-reserved, 0K highmem)
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] IRQ: Found an INTC at 0x(ptrval) (revision 5.0) with 128 interrupts
[    0.000000] TI gptimer clocksource: always-on /ocp/interconnect@44c00000/segment@200000/target-module@31000
[    0.000015] sched_clock: 32 bits at 24MHz, resolution 41ns, wraps every 89478484971ns
[    0.000044] clocksource: dmtimer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[    0.000562] TI gptimer clockevent: 24000000 Hz at /ocp/interconnect@48000000/segment@0/target-module@40000
[    0.002864] Console: colour dummy device 80x30
[    0.002953] Calibrating delay loop... 597.60 BogoMIPS (lpj=2988032)
[    0.060604] pid_max: default: 32768 minimum: 301
[    0.060790] LSM: Security Framework initializing
[    0.060906] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.060931] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.061993] CPU: Testing write buffer coherency: ok
[    0.062091] CPU0: Spectre v2: using BPIALL workaround
[    0.063460] Setting up static identity map for 0x80100000 - 0x80100078
[    0.063701] rcu: Hierarchical SRCU implementation.
[    0.064469] devtmpfs: initialized
[    0.082752] VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
[    0.083453] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.083494] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[    0.085409] pinctrl core: initialized pinctrl subsystem
[    0.087537] NET: Registered protocol family 16
[    0.093923] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.115719] l3-aon-clkctrl:0000:0: failed to disable
[    0.119104] thermal_sys: Registered thermal governor 'fair_share'
[    0.119121] thermal_sys: Registered thermal governor 'step_wise'
[    0.119142] thermal_sys: Registered thermal governor 'user_space'
[    2.139905] No ATAGs?
[    2.139951] hw-breakpoint: debug architecture 0x4 unsupported.
[    2.241426] Kprobes globally optimized
[    2.257996] SCSI subsystem initialized
[    2.266914] usbcore: registered new interface driver usbfs
[    2.267124] usbcore: registered new interface driver hub
[    2.267331] usbcore: registered new device driver usb
[    2.268904] pps_core: LinuxPPS API ver. 1 registered
[    2.268931] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.269085] PTP clock support registered
[    2.280242] clocksource: Switched to clocksource dmtimer
[    2.280567] VFS: Disk quotas dquot_6.6.0
[    2.281354] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    2.324461] NET: Registered protocol family 2
[    2.324793] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    2.327374] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 4096 bytes, linear)
[    2.327446] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    2.327492] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    2.327532] TCP: Hash tables configured (established 2048 bind 2048)
[    2.327681] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[    2.327715] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[    2.327951] NET: Registered protocol family 1
[    2.328843] RPC: Registered named UNIX socket transport module.
[    2.328870] RPC: Registered udp transport module.
[    2.328883] RPC: Registered tcp transport module.
[    2.328895] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    2.332602] NetWinder Floating Point Emulator V0.97 (double precision)
[    2.333524] hw perfevents: enabled with armv7_cortex_a8 PMU driver, 5 counters available
[    2.339083] Initialise system trusted keyrings
[    2.341471] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[    2.343457] NFS: Registering the id_resolver key type
[    2.343592] Key type id_resolver registered
[    2.343608] Key type id_legacy registered
[    2.494218] NET: Registered protocol family 38
[    2.494254] Key type asymmetric registered
[    2.494270] Asymmetric key parser 'x509' registered
[    2.494308] io scheduler mq-deadline registered
[    2.494324] io scheduler kyber registered
[    2.743066] ti-sysc 44e07000.target-module: dts flag should be at module level for ti,no-reset-on-init
[    3.012453] ti-sysc: probe of 44e31000.target-module failed with error -16
[    3.131515] ti-sysc: probe of 48040000.target-module failed with error -16
[    3.293422] omap-mailbox 480c8000.mailbox: omap mailbox rev 0x400
[    3.626923] debugfs: Directory '49000000.dma' with parent 'dmaengine' already present!
[    3.626982] edma 49000000.dma: TI EDMA DMA engine driver
[    3.711497] pinctrl-single 44e10800.pinmux: 142 pins, size 568
[    3.757986] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    3.762421] omap_uart 44e09000.serial: no wakeirq for uart0
[    3.766112] 44e09000.serial: ttyO0 at MMIO 0x44e09000 (irq = 20, base_baud = 3000000) is a OMAP UART0
[    4.411649] printk: console [ttyO0] enabled
[    4.421410] omap_rng 48310000.rng: Random Number Generator ver. 20
[    4.428350] random: crng init done
[    4.461203] brd: module loaded
[    4.483568] loop: module loaded
[    4.526740] vcan: Virtual CAN interface driver
[    4.537349] slcan: serial line CAN interface driver
[    4.542913] slcan: 10 dynamic interface channels.
[    4.547843] CAN device driver interface
[    4.565509] mdio_bus 4a101000.mdio: mii_bus 4a101000.mdio couldn't get reset GPIO
[    4.576440] cpsw 4a100000.ethernet: initialized cpsw ale version 1.4
[    4.584125] cpsw 4a100000.ethernet: ALE Table size 1024
[    4.589725] cpsw 4a100000.ethernet: cpts: overflow check period 500 (jiffies)
[    4.597566] cpsw 4a100000.ethernet: Detected MACID = 38:0b:3c:95:ed:04
[    4.608154] usbcore: registered new interface driver asix
[    4.617262] usbcore: registered new interface driver ax88179_178a
[    4.624290] usbcore: registered new interface driver cdc_ether
[    4.631027] usbcore: registered new interface driver smsc95xx
[    4.637647] usbcore: registered new interface driver net1080
[    4.644062] usbcore: registered new interface driver rndis_host
[    4.650927] usbcore: registered new interface driver cdc_subset
[    4.657697] usbcore: registered new interface driver zaurus
[    4.663841] usbcore: registered new interface driver cdc_ncm
[    4.672917] am335x-phy-driver 47401300.usb-phy: supply vcc not found, using dummy regulator
[    4.683169] am335x-phy-driver 47401300.usb-phy: dummy supplies not allowed for exclusive requests
[    4.702148] am335x-phy-driver 47401b00.usb-phy: supply vcc not found, using dummy regulator
[    4.712531] am335x-phy-driver 47401b00.usb-phy: dummy supplies not allowed for exclusive requests
[    4.731905] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    4.738741] ehci-omap: OMAP-EHCI Host Controller driver
[    4.746677] usbcore: registered new interface driver cdc_wdm
[    4.753558] usbcore: registered new interface driver usb-storage
[    4.761065] usbcore: registered new interface driver usbserial_generic
[    4.768477] usbserial: USB Serial support registered for generic
[    4.775137] usbcore: registered new interface driver ftdi_sio
[    4.781730] usbserial: USB Serial support registered for FTDI USB Serial Device
[    4.797219] musb-hdrc musb-hdrc.0: MUSB HDRC host driver
[    4.803843] musb-hdrc musb-hdrc.0: new USB bus registered, assigned bus number 1
[    4.812387] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    4.821161] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.828703] usb usb1: Product: MUSB HDRC host driver
[    4.833942] usb usb1: Manufacturer: Linux 5.10.131-alc-gf9344bef79 musb-hcd
[    4.841254] usb usb1: SerialNumber: musb-hdrc.0
[    4.847159] hub 1-0:1.0: USB hub found
[    4.851838] hub 1-0:1.0: 1 port detected
[    4.870049] musb-hdrc musb-hdrc.1: MUSB HDRC host driver
[    4.876927] musb-hdrc musb-hdrc.1: new USB bus registered, assigned bus number 2
[    4.885539] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    4.894387] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.901999] usb usb2: Product: MUSB HDRC host driver
[    4.907186] usb usb2: Manufacturer: Linux 5.10.131-alc-gf9344bef79 musb-hcd
[    4.914501] usb usb2: SerialNumber: musb-hdrc.1
[    4.920481] hub 2-0:1.0: USB hub found
[    4.925051] hub 2-0:1.0: 1 port detected
[    4.943919] i2c /dev entries driver
[    4.954129] omap_wdt: OMAP Watchdog Timer Rev 0x01: initial timeout 60 sec
[    4.969061] ledtrig-cpu: registered to indicate activity on CPUs
[    4.979738] usbcore: registered new interface driver usbhid
[    4.987894] usbhid: USB HID core driver
[    4.993985] Initializing XFRM netlink socket
[    4.998615] NET: Registered protocol family 10
[    5.005641] Segment Routing with IPv6
[    5.009641] NET: Registered protocol family 17
[    5.014500] NET: Registered protocol family 15
[    5.019144] can: controller area network core
[    5.023874] NET: Registered protocol family 29
[    5.028518] can: raw protocol
[    5.031744] can: broadcast manager protocol
[    5.036129] can: netlink gateway - max_hops=1
[    5.040993] Key type dns_resolver registered
[    5.046615] oprofile: using arm/armv7
[    5.051644] ThumbEE CPU extension supported.
[    5.056130] omap_voltage_late_init: Voltage driver support not added
[    5.063572] registered taskstats version 1
[    5.067863] Loading compiled-in X.509 certificates
[    5.090849] OMAP GPIO hardware version 0.1
[    5.134332] vrtc: supplied by vcc_5v0_pmic
[    5.142823] vio: supplied by vcc_5v0_pmic
[    5.149402] vdd_mpu: supplied by vcc_5v0_pmic
[    5.156363] vdd_core: supplied by vcc_5v0_pmic
[    5.164846] vdig1: supplied by vcc_5v0_pmic
[    5.171177] vdig2: supplied by vcc_5v0_pmic
[    5.177331] vpll: supplied by vcc_5v0_pmic
[    5.183481] vdac: supplied by vcc_5v0_pmic
[    5.189543] vaux1: supplied by vcc_5v0_pmic
[    5.195862] vaux2: supplied by vcc_5v0_pmic
[    5.202204] vaux33: supplied by vcc_5v0_pmic
[    5.208595] vmmc: supplied by vcc_5v0_pmic
[    5.215244] vbb: supplied by vcc_5v0_pmic
[    5.225754] rtc-pcf8523 0-0068: registered as rtc0
[    5.231766] rtc-pcf8523 0-0068: setting system clock to 2022-09-06T14:48:32 UTC (1662475712)
[    5.241903] at24 0-0051: supply vcc not found, using dummy regulator
[    5.250886] at24 0-0051: 32768 byte 24c256 EEPROM, writable, 64 bytes/write
[    5.260127] pca953x 0-0022: supply vcc not found, using dummy regulator
[    5.268429] pca953x 0-0022: using AI
[    5.274926] at24 0-0050: supply vcc not found, using dummy regulator
[    5.283855] at24 0-0050: 32768 byte 24c256 EEPROM, writable, 64 bytes/write
[    5.292133] omap_i2c 44e0b000.i2c: bus 0 rev0.11 at 400 kHz
[    5.302364] omap_i2c 4802a000.i2c: bus 1 rev0.11 at 400 kHz
[    5.324784] omap_reset_deassert: timedout waiting for gfx:0
[    5.330877] ti-sysc: probe of 5600fe00.target-module failed with error -110
[    5.400297] davinci_mdio 4a101000.mdio: davinci mdio revision 1.6, bus freq 1000000
[    5.412183] davinci_mdio 4a101000.mdio: phy[0]: device 4a101000.mdio:00, driver TI DP83825S
[    5.421597] davinci_mdio 4a101000.mdio: phy[1]: device 4a101000.mdio:01, driver TI DP83825S
[    5.439792] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    5.455767] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    5.463205] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[    5.473427] Waiting for root device PARTUUID=a946079f-02...
[    5.479310] cfg80211: failed to load regulatory.db

Booting over NFS:

U-Boot 2017.01 ALC (Aug 12 2021 - 17:23:13 -0400)

CPU  : AM335X-GP rev 2.1
Model: TI AM335x ALC
DRAM:  256 MiB
MMC:   OMAP SD/MMC: 0
MMC Device 1 not found
*** Warning - No MMC card found, using default environment

Device tree fdtfile: am335x-alc_ngzn.dtb
<ethaddr> not set. Validating first E-fuse MAC
Press and hold recovery switch to enter Recovery Mode
Recovery Switch Set to OFF
Net:   Enable RMII mode on Ethernet PHY
cpsw, usb_ether
Hit any key to stop autoboot:  0
cpsw Waiting for PHY auto negotiation to complete.. done
link up on port 0, speed 100, full duplex
BOOTP broadcast 1
DHCP client bound to address 169.254.1.6 (61 ms)
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 169.254.1.3; our IP address is 169.254.1.6
Filename 'debrick.scr'.
Load address: 0x80000000
Loading: #
         1.1 MiB/s
done
Bytes transferred = 2224 (8b0 hex)
## Executing script at 80000000

===== U-Boot Settings =====


===== Linux Kernel =====

bootfile=zImage-main.bin

===== Device Tree =====

Enter the target fdtfile (am335x-alc_router.dtb or press enter):
fdtfile=am335x-alc_ngzn.dtb
edit:
fdtfile=am335x-alc_ngzn.dtb

===== NFSroot Path =====

rootpath=/home/user/ng5_mfg/Release-2-0/b5/main/nfsroot

===== NFSvar Path =====

Enter the target NFSvar path:
varpath=/home/user/ng5_mfg/Release-2-0/b5/main/nfsvar
edit:
varpath=/home/user/ng5_mfg/Release-2-0/b5/main/nfsvar

===== Save new definitions =====

ipaddr=169.254.1.6
serverip=169.254.1.3

===== Setting SLC =====

MMC Device 1 not found
no mmc device at slot 1
mmc_reinit: Startup init
mmc_reinit: Complete init
eMMC Capacity: 3.6 GiB

===== Done =====

net_args=setenv bootargs VARPATH=${varpath} console=${console} ${optargs} root=/dev/nfs nfsroot=${serverip}:${rootpath},${nfsopts} rw ip=:::::eth0:dhcp loginShell=allow
Booting from network ...
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 169.254.1.3; our IP address is 169.254.1.6
Filename 'zImage-main.bin'.
Load address: 0x80200000
Loading: #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         ###############################################
         3.7 MiB/s
done
Bytes transferred = 5455776 (533fa0 hex)
link up on port 0, speed 100, full duplex
Using cpsw device
TFTP from server 169.254.1.3; our IP address is 169.254.1.6
Filename 'am335x-alc_ngzn.dtb'.
Load address: 0x88000000
Loading: #######
         3.5 MiB/s
done
Bytes transferred = 96588 (1794c hex)
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 8df1b000, end 8df3594b ... OK

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 5.10.131-alc-g999 (oe-user@oe-host) (arm-poky-linux-gnueabi-gcc (GCC) 9.3.0, GNU ld (GNU Binutils) 2.34.0.20200220) #1 PREEMPT Wed Sep 7 07:01:55 UTC 2022
[    0.000000] CPU: ARMv7 Processor [413fc082] revision 2 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: TI AM335x ALC
[    0.000000] Memory policy: Data cache writeback
[    0.000000] cma: Reserved 24 MiB at 0x8e000000
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000]   HighMem  empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000008fdfffff]
[    0.000000] CPU: All CPU(s) started in SVC mode.
[    0.000000] AM335X ES2.1 (neon)
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 64516
[    0.000000] Kernel command line: VARPATH=/home/user/ng5_mfg/Release-2-0/b5/main/nfsvar console=ttyO0,115200n8 root=/dev/nfs nfsroot=169.254.1.3:/home/user/ng5_mfg/Release-2-0/b5/main/nfsroot,nolock,udp,rsize=8192,wsize=8192,timeo=1,retrans=1 rw ip=:::::eth0:dhcp loginShell=allow
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 219816K/260096K available (8192K kernel code, 516K rwdata, 2520K rodata, 1024K init, 254K bss, 15704K reserved, 24576K cma-reserved, 0K highmem)
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] IRQ: Found an INTC at 0x(ptrval) (revision 5.0) with 128 interrupts
[    0.000000] TI gptimer clocksource: always-on /ocp/interconnect@44c00000/segment@200000/target-module@31000
[    0.000015] sched_clock: 32 bits at 24MHz, resolution 41ns, wraps every 89478484971ns
[    0.000044] clocksource: dmtimer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns
[    0.000549] TI gptimer clockevent: 24000000 Hz at /ocp/interconnect@48000000/segment@0/target-module@40000
[    0.002846] Console: colour dummy device 80x30
[    0.002939] Calibrating delay loop... 597.60 BogoMIPS (lpj=2988032)
[    0.060588] pid_max: default: 32768 minimum: 301
[    0.060777] LSM: Security Framework initializing
[    0.060894] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.060921] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.061983] CPU: Testing write buffer coherency: ok
[    0.062083] CPU0: Spectre v2: using BPIALL workaround
[    0.063437] Setting up static identity map for 0x80100000 - 0x80100078
[    0.063676] rcu: Hierarchical SRCU implementation.
[    0.064438] devtmpfs: initialized
[    0.082704] VFP support v0.3: implementor 41 architecture 3 part 30 variant c rev 3
[    0.083410] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.083450] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[    0.085331] pinctrl core: initialized pinctrl subsystem
[    0.087455] NET: Registered protocol family 16
[    0.093842] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.115687] l3-aon-clkctrl:0000:0: failed to disable
[    0.119081] thermal_sys: Registered thermal governor 'fair_share'
[    0.119100] thermal_sys: Registered thermal governor 'step_wise'
[    0.119121] thermal_sys: Registered thermal governor 'user_space'
[    2.139363] No ATAGs?
[    2.139409] hw-breakpoint: debug architecture 0x4 unsupported.
[    2.231574] Kprobes globally optimized
[    2.262630] SCSI subsystem initialized
[    2.265332] usbcore: registered new interface driver usbfs
[    2.265550] usbcore: registered new interface driver hub
[    2.265751] usbcore: registered new device driver usb
[    2.267477] pps_core: LinuxPPS API ver. 1 registered
[    2.267503] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.268033] PTP clock support registered
[    2.279075] clocksource: Switched to clocksource dmtimer
[    2.279392] VFS: Disk quotas dquot_6.6.0
[    2.279513] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    2.323958] NET: Registered protocol family 2
[    2.324297] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    2.325634] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 4096 bytes, linear)
[    2.325702] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    2.325746] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    2.325787] TCP: Hash tables configured (established 2048 bind 2048)
[    2.325932] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[    2.325966] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[    2.326188] NET: Registered protocol family 1
[    2.326992] RPC: Registered named UNIX socket transport module.
[    2.327018] RPC: Registered udp transport module.
[    2.327031] RPC: Registered tcp transport module.
[    2.327043] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    2.330616] NetWinder Floating Point Emulator V0.97 (double precision)
[    2.331566] hw perfevents: enabled with armv7_cortex_a8 PMU driver, 5 counters available
[    2.335504] Initialise system trusted keyrings
[    2.338555] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[    2.340632] NFS: Registering the id_resolver key type
[    2.340721] Key type id_resolver registered
[    2.340736] Key type id_legacy registered
[    2.492729] NET: Registered protocol family 38
[    2.492771] Key type asymmetric registered
[    2.492787] Asymmetric key parser 'x509' registered
[    2.492827] io scheduler mq-deadline registered
[    2.492844] io scheduler kyber registered
[    2.741684] ti-sysc 44e07000.target-module: dts flag should be at module level for ti,no-reset-on-init
[    3.011048] ti-sysc: probe of 44e31000.target-module failed with error -16
[    3.130153] ti-sysc: probe of 48040000.target-module failed with error -16
[    3.292186] omap-mailbox 480c8000.mailbox: omap mailbox rev 0x400
[    3.627009] debugfs: Directory '49000000.dma' with parent 'dmaengine' already present!
[    3.627067] edma 49000000.dma: TI EDMA DMA engine driver
[    3.708442] pinctrl-single 44e10800.pinmux: 142 pins, size 568
[    3.756275] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    3.761431] omap_uart 44e09000.serial: no wakeirq for uart0
[    3.765033] 44e09000.serial: ttyO0 at MMIO 0x44e09000 (irq = 20, base_baud = 3000000) is a OMAP UART0
[    4.418149] printk: console [ttyO0] enabled
[    4.427769] omap_rng 48310000.rng: Random Number Generator ver. 20
[    4.434551] random: crng init done
[    4.467293] brd: module loaded
[    4.490187] loop: module loaded
[    4.537804] vcan: Virtual CAN interface driver
[    4.545474] slcan: serial line CAN interface driver
[    4.551037] slcan: 10 dynamic interface channels.
[    4.555963] CAN device driver interface
[    4.573414] mdio_bus 4a101000.mdio: mii_bus 4a101000.mdio couldn't get reset GPIO
[    4.583987] cpsw 4a100000.ethernet: initialized cpsw ale version 1.4
[    4.591662] cpsw 4a100000.ethernet: ALE Table size 1024
[    4.597257] cpsw 4a100000.ethernet: cpts: overflow check period 500 (jiffies)
[    4.605036] cpsw 4a100000.ethernet: Detected MACID = 38:0b:3c:95:ed:04
[    4.615584] usbcore: registered new interface driver asix
[    4.624677] usbcore: registered new interface driver ax88179_178a
[    4.631723] usbcore: registered new interface driver cdc_ether
[    4.638442] usbcore: registered new interface driver smsc95xx
[    4.644810] usbcore: registered new interface driver net1080
[    4.651487] usbcore: registered new interface driver rndis_host
[    4.658275] usbcore: registered new interface driver cdc_subset
[    4.664755] usbcore: registered new interface driver zaurus
[    4.671161] usbcore: registered new interface driver cdc_ncm
[    4.680570] am335x-phy-driver 47401300.usb-phy: supply vcc not found, using dummy regulator
[    4.690617] am335x-phy-driver 47401300.usb-phy: dummy supplies not allowed for exclusive requests
[    4.710980] am335x-phy-driver 47401b00.usb-phy: supply vcc not found, using dummy regulator
[    4.721275] am335x-phy-driver 47401b00.usb-phy: dummy supplies not allowed for exclusive requests
[    4.740792] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    4.747626] ehci-omap: OMAP-EHCI Host Controller driver
[    4.755556] usbcore: registered new interface driver cdc_wdm
[    4.762436] usbcore: registered new interface driver usb-storage
[    4.769916] usbcore: registered new interface driver usbserial_generic
[    4.777318] usbserial: USB Serial support registered for generic
[    4.783985] usbcore: registered new interface driver ftdi_sio
[    4.790642] usbserial: USB Serial support registered for FTDI USB Serial Device
[    4.806190] musb-hdrc musb-hdrc.0: MUSB HDRC host driver
[    4.812773] musb-hdrc musb-hdrc.0: new USB bus registered, assigned bus number 1
[    4.821232] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    4.830073] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.837617] usb usb1: Product: MUSB HDRC host driver
[    4.842875] usb usb1: Manufacturer: Linux 5.10.131-alc-g999 musb-hcd
[    4.849571] usb usb1: SerialNumber: musb-hdrc.0
[    4.855470] hub 1-0:1.0: USB hub found
[    4.860157] hub 1-0:1.0: 1 port detected
[    4.878903] musb-hdrc musb-hdrc.1: MUSB HDRC host driver
[    4.885761] musb-hdrc musb-hdrc.1: new USB bus registered, assigned bus number 2
[    4.894349] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    4.903186] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.910794] usb usb2: Product: MUSB HDRC host driver
[    4.915979] usb usb2: Manufacturer: Linux 5.10.131-alc-g999 musb-hcd
[    4.922658] usb usb2: SerialNumber: musb-hdrc.1
[    4.928546] hub 2-0:1.0: USB hub found
[    4.933226] hub 2-0:1.0: 1 port detected
[    4.952740] i2c /dev entries driver
[    4.962689] omap_wdt: OMAP Watchdog Timer Rev 0x01: initial timeout 60 sec
[    4.977625] ledtrig-cpu: registered to indicate activity on CPUs
[    4.988287] usbcore: registered new interface driver usbhid
[    4.996477] usbhid: USB HID core driver
[    5.002580] Initializing XFRM netlink socket
[    5.007210] NET: Registered protocol family 10
[    5.014218] Segment Routing with IPv6
[    5.018216] NET: Registered protocol family 17
[    5.023071] NET: Registered protocol family 15
[    5.027713] can: controller area network core
[    5.032445] NET: Registered protocol family 29
[    5.037091] can: raw protocol
[    5.040308] can: broadcast manager protocol
[    5.044692] can: netlink gateway - max_hops=1
[    5.049549] Key type dns_resolver registered
[    5.055153] oprofile: using arm/armv7
[    5.060213] ThumbEE CPU extension supported.
[    5.064695] omap_voltage_late_init: Voltage driver support not added
[    5.072143] registered taskstats version 1
[    5.076436] Loading compiled-in X.509 certificates
[    5.099289] OMAP GPIO hardware version 0.1
[    5.143121] vrtc: supplied by vcc_5v0_pmic
[    5.151584] vio: supplied by vcc_5v0_pmic
[    5.158192] vdd_mpu: supplied by vcc_5v0_pmic
[    5.165136] vdd_core: supplied by vcc_5v0_pmic
[    5.173599] vdig1: supplied by vcc_5v0_pmic
[    5.179844] vdig2: supplied by vcc_5v0_pmic
[    5.186024] vpll: supplied by vcc_5v0_pmic
[    5.192165] vdac: supplied by vcc_5v0_pmic
[    5.198197] vaux1: supplied by vcc_5v0_pmic
[    5.204546] vaux2: supplied by vcc_5v0_pmic
[    5.210836] vaux33: supplied by vcc_5v0_pmic
[    5.217242] vmmc: supplied by vcc_5v0_pmic
[    5.223844] vbb: supplied by vcc_5v0_pmic
[    5.234830] rtc-pcf8523 0-0068: registered as rtc0
[    5.240945] rtc-pcf8523 0-0068: setting system clock to 2022-09-08T12:38:17 UTC (1662640697)
[    5.251087] at24 0-0051: supply vcc not found, using dummy regulator
[    5.260103] at24 0-0051: 32768 byte 24c256 EEPROM, writable, 64 bytes/write
[    5.269524] pca953x 0-0022: supply vcc not found, using dummy regulator
[    5.277832] pca953x 0-0022: using AI
[    5.284048] at24 0-0050: supply vcc not found, using dummy regulator
[    5.292995] at24 0-0050: 32768 byte 24c256 EEPROM, writable, 64 bytes/write
[    5.301223] omap_i2c 44e0b000.i2c: bus 0 rev0.11 at 400 kHz
[    5.311489] omap_i2c 4802a000.i2c: bus 1 rev0.11 at 400 kHz
[    5.334351] omap_reset_deassert: timedout waiting for gfx:0
[    5.340445] ti-sysc: probe of 5600fe00.target-module failed with error -110
[    5.409123] davinci_mdio 4a101000.mdio: davinci mdio revision 1.6, bus freq 1000000
[    5.420968] davinci_mdio 4a101000.mdio: phy[0]: device 4a101000.mdio:00, driver TI DP83825S
[    5.430410] davinci_mdio 4a101000.mdio: phy[1]: device 4a101000.mdio:01, driver TI DP83825S
[    5.452013] cpsw 4a100000.ethernet: initializing cpsw version 1.12 (0)
[    5.470175] TI DP83825S 4a101000.mdio:00: attached PHY driver [TI DP83825S] (mii_bus:phy_addr=4a101000.mdio:00, irq=POLL)
[    5.484249] net eth0: could not add device link to 4a101000.mdio:01 err -17
[    5.499663] TI DP83825S 4a101000.mdio:01: attached PHY driver [TI DP83825S] (mii_bus:phy_addr=4a101000.mdio:01, irq=POLL)
[    7.610304] cpsw 4a100000.ethernet eth0: Link is Up - 100Mbps/Full - flow control off
[    7.619140] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[    7.649285] Sending DHCP requests ., OK
[    7.693178] IP-Config: Got DHCP answer from 169.254.1.3, my address is 169.254.1.6
[    7.701120] IP-Config: Complete:
[    7.704497]      device=eth0, hwaddr=38:0b:3c:95:ed:04, ipaddr=169.254.1.6, mask=255.255.255.0, gw=169.254.1.2
[    7.714954]      host=169.254.1.6, domain=, nis-domain=(none)
[    7.720971]      bootserver=169.254.1.3, rootserver=169.254.1.3, rootpath=
[    7.720980]      nameserver0=169.254.1.3
[    7.732885] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    7.746680] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    7.753940] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[    7.764414] cfg80211: failed to load regulatory.db
[  103.529246] VFS: Unable to mount root fs via NFS.
[  103.534286] devtmpfs: mounted
[  103.539434] Freeing unused kernel memory: 1024K
[  103.544852] Run /sbin/init as init process
[  103.549509] Run /etc/init as init process
[  103.553886] Run /bin/init as init process
[  103.558235] Run /bin/sh as init process
[  103.562526] Kernel panic - not syncing: No working init found.  Try passing init= option to kernel. See Linux Documentation/admin-guide/init.rst for guidance.
[  103.577329] ---[ end Kernel panic - not syncing: No working init found.  Try passing init= option to kernel. See Linux Documentation/admin-guide/init.rst for guidance. ]---

I compared eMMC related node from am33xx-l4.dtsi and I observed that driver is changed from ti,omap4-hsmmc to ti,am335-sdhci. Can this cause any issue? I am thinking if anything is wrong with eMMC then it should at-least boot over NFS which not happening either.

Regards,

Raxesh

  • HI Raxesh,

    The two issues are not related, each seems due to a different reason.

    I don't see any mmc message in the boot log. Have you compared your eMMC DT node config with any AM335x EVM such as the GPEVM or Beaglebone Black to see if there is anything missing?

    Regarding NFS, does the same config work with kernel v5.4? I believe it doesn't either. Try to add ',v3' to your uboot env variable ${nfsopts}.

  • Thanks for quick reply!

    I don't see any mmc message in the boot log.

    This is because it hangs forever at "Waiting for root device PARTUUID=a946079f-02...". I instrumented logs into init/do_mounts.c file as well but no clue. FYI, ROOT_DEV prints as zero and root_wait prints one here.

        printk("RAX:%s: ROOT_DEV - %d | root_wait - %d \n", __func__, ROOT_DEV, root_wait);
    	if ((ROOT_DEV == 0) && root_wait) {
    		printk(KERN_INFO "Waiting for root device %s...\n",
    			saved_root_name);
    		while (driver_probe_done() != 0 ||
    			(ROOT_DEV = name_to_dev_t(saved_root_name)) == 0)
    			msleep(5);
    		async_synchronize_full();
    	}

    Have you compared your eMMC DT node config with any AM335x EVM such as the GPEVM or Beaglebone Black to see if there is anything missing?

    I did but find nothing suspicious. I posted relevant nodes here please let me know if something is not right.

    vmmc_reg: regulator@12 {
    	regulator-min-microvolt = <1800000>;
    	regulator-max-microvolt = <3300000>;
    	regulator-always-on;
    };
    
    &mmc2 {
    	vmmc-supply = <&vmmc_reg>;
    	pinctrl-names = "default";
    	pinctrl-0 = <&emmc_pins>;
    	bus-width = <8>;
    	non-removable;
    	wp-gpios = <&gpio1 28 GPIO_ACTIVE_LOW>;  /* GPIO1_28 */
    	status = "okay";
    };
    

    Regarding NFS, does the same config work with kernel v5.4? I believe it doesn't either. Try to add ',v3' to your uboot env variable ${nfsopts}.

    It does work seamlessly with kernel v5.4. I added ',v3' to ${nfsopts} but no difference in result.

  • Hi Raxesh,

    My Beaglebone Black has the following messages in the kernel boot log. 'mmc1' is related to the eMMC. I don't see these in your kernel boot log, it basically means either DTS error or related kernel modules are not enabled.

    # dmesg | grep -e 'mmc.:'
    [    2.625885] mmc1: SDHCI controller on 481d8000.mmc [481d8000.mmc] using External DMA
    [    2.717837] mmc1: new high speed MMC card at address 0001
    [    2.733924] mmcblk1: mmc1:0001 M62704 3.56 GiB
    [    2.738789] mmcblk1boot0: mmc1:0001 M62704 partition 1 2.00 MiB
    [    2.753262] mmcblk1boot1: mmc1:0001 M62704 partition 2 2.00 MiB
    [    2.762992] mmcblk1rpmb: mmc1:0001 M62704 partition 3 512 KiB, chardev (246:0)
    [    2.838978] mmc0: SDHCI controller on 48060000.mmc [48060000.mmc] using External DMA
    [    2.886678] mmc0: new high speed SDHC card at address 1234
    [    2.893095] mmcblk0: mmc0:1234 SA04G 3.64 GiB

    Regarding NFS, do you have any other way to boot linux on the board then try manually mount the NFS? I am wondering if you didn't config the kernel properly. Please also try to use the AM335x Processor SDK v8.2 package, then build the kernel with tisdk_am335x-evm_defconfig defconfig.

    https://www.ti.com/tool/download/PROCESSOR-SDK-LINUX-AM335X/08.02.00.24

  • Hi Bin Liu,

    I looked at tisdk_am335x-evm_defconfig and compared MMC related configs, found sdhci related configuration were disabled so enabled them and kernel is able to mount rootfs from emmc now. Thanks!

    Regarding NFS mount, I tried to mount manually and able to do it after removing "udp" parameter from "root=". So "udp" seems to be an issue for NFS mounting. AFAIK, tcp is mandated only on NFSv4 but I think that doesn't seem to be active in my case. Though I am able to mount rootfs over NFS, I have below queries if you could clarify with:

    • Below is the result of mount command and it shows "type nfs" which might means NFSv3/2 but not NFSv4. If that is the case then it should work with "udp" also but it is not.
      169.254.1.3:/home/user/ng5_mfg/Release-2-0/b5/main/nfsroot on / type nfs (rw,relatime,vers=2,rsize=8192,wsize=8192,namlen=255,hard,nolock,proto=tcp,timeo=1,retrans=1,sec=sys,mountaddr=169.254.1.3,mountvers=1,mountproto=tcp,local_lock=all,addr=169.254.1.3)
    • How to choose default NFS version while compiling kernel, is there any kernel config for that?

    Below is the o/p of "nfsstat -o all" command from server side:

    Server packet stats:
    packets    udp        tcp        tcpconn
    21730      0          21730      6       
    
    Server rpc stats:
    calls      badcalls   badclnt    badauth    xdrcall
    21730      0          0          0          0       
    
    Server reply cache:
    hits       misses     nocache
    0          842        20888   
    
    Server file handle cache:
    lookup     anon       ncachedir  ncachedir  stale
    0          0          0          0          0       
    
    Server nfs v2:
    null         getattr      setattr      root         lookup       readlink     
    2         0% 7119     57% 160       1% 0         0% 2044     16% 217       1% 
    read         wrcache      write        create       remove       rename       
    2495     20% 0         0% 149       1% 78        0% 98        0% 28        0% 
    link         symlink      mkdir        rmdir        readdir      fsstat       
    48        0% 0         0% 0         0% 0         0% 29        0% 5         0% 
    
    Server nfs v3:
    null         getattr      setattr      lookup       access       readlink     
    4         0% 6497     70% 80        0% 705       7% 362       3% 112       1% 
    read         write        create       mkdir        symlink      mknod        
    1245     13% 75        0% 39        0% 0         0% 0         0% 0         0% 
    remove       rmdir        rename       link         readdir      readdirplus  
    49        0% 0         0% 14        0% 24        0% 0         0% 27        0% 
    fsstat       fsinfo       pathconf     commit       
    3         0% 8         0% 4         0% 3         0% 
    

  • Hi Raxesh,

    I am not an network/nfs expert, I always add "v3" in the U-Boot nfs parameter. But searching on internet, I found kernel config option CONFIG_NFS_V4. Please try to disable it in kernel to see NFS only talks in V3.