This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM6548: Failure to detect mmc1 sd card partition during booting

Part Number: AM6548
Other Parts Discussed in Thread: PCA9554

meta-ti kirkstone 09.01.00.007

We are currently migrating from linux-5.10.100 to Linux version 6.1.46.
We have used same initramfs.cfg and defconfig which we used in linux-5.10.100 (dunfell).

Below is a part of bootlog for linux-5.10.100

[    0.089782] cryptd: max_cpu_qlen set to 1000
[    0.094508] k3-chipinfo 43000014.chipid: Family:AM65X rev:SR2.0 JTAGID[0x1bb5a02f] Detected
[    0.095187] vcc3v3_io: supplied by evm_12v0
[    0.096614] iommu: Default domain type: Translated 
[    0.097035] SCSI subsystem initialized
[    0.097711] pps_core: LinuxPPS API ver. 1 registered
[    0.097721] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.097742] PTP clock support registered
[    0.097798] EDAC MC: Ver: 3.0.0
[    0.099137] FPGA manager framework
[    0.100318] clocksource: Switched to clocksource arch_sys_counter
[    0.100845] VFS: Disk quotas dquot_6.6.0
[    0.100959] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.108221] NET: Registered protocol family 2
[    0.108598] IP idents hash table entries: 65536 (order: 3, 524288 bytes, linear)
[    0.111268] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear)
[    0.111398] TCP established hash table entries: 32768 (order: 2, 262144 bytes, linear)
[    0.111712] TCP bind hash table entries: 32768 (order: 3, 524288 bytes, linear)
[    0.112388] TCP: Hash tables configured (established 32768 bind 32768)
[    0.112571] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.112688] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.112953] NET: Registered protocol family 1
[    0.113661] RPC: Registered named UNIX socket transport module.
[    0.113675] RPC: Registered udp transport module.
[    0.113682] RPC: Registered tcp transport module.
[    0.113689] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.113706] PCI: CLS 0 bytes, default 64
[    0.193888] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
[    0.199728] Initialise system trusted keyrings
[    0.199942] workingset: timestamp_bits=46 max_order=16 bucket_order=0
[    0.205598] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.206308] NFS: Registering the id_resolver key type
[    0.206342] Key type id_resolver registered
[    0.206350] Key type id_legacy registered
[    0.206432] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.206442] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.206643] fuse: init (API version 7.32)
[    0.206883] 9p: Installing v9fs 9p2000 file system support
[    0.260678] Key type asymmetric registered
[    0.260694] Asymmetric key parser 'x509' registered
[    0.260748] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.260759] io scheduler mq-deadline registered
[    0.260767] io scheduler kyber registered
[    0.263494] pinctrl-single 4301c000.pinctrl: 70 pins, size 280
[    0.264141] pinctrl-single 11c000.pinctrl: 185 pins, size 740
[    0.264355] pinctrl-single 11c2e8.pinctrl: 9 pins, size 36
[    0.270810] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.270924] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.275320] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[    0.288642] brd: module loaded
[    0.296645] loop: module loaded
[    0.297638] megasas: 07.714.04.00-rc1
[    0.301861] tun: Universal TUN/TAP device driver, 1.6
[    0.302684] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    0.302693] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    0.302751] sky2: driver version 1.30
[    0.304092] VFIO - User Level meta-driver version: 0.3
[    0.305027] i2c /dev entries driver
[    0.306712] sdhci: Secure Digital Host Controller Interface driver
[    0.306721] sdhci: Copyright(c) Pierre Ossman
[    0.307232] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.308900] ledtrig-cpu: registered to indicate activity on CPUs
[    0.309007] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: invalid resource
[    0.309208] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.310647] optee: probing for conduit method.
[    0.310681] optee: revision 3.12 (3d47a131)
[    0.311295] optee: initialized driver
[    0.312962] NET: Registered protocol family 17
[    0.313131] 9pnet: Installing 9P2000 support
[    0.313202] Key type dns_resolver registered
[    0.313445] Loading compiled-in X.509 certificates
[    0.322699] k3-ringacc 2b800000.ringacc: Failed to get MSI domain
[    0.322947] k3-ringacc 3c000000.ringacc: Failed to get MSI domain
[    0.329243] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: invalid resource
[    0.329474] ti-sci bus@100000:bus@28380000:bus@42040000:dmsc: ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
[    0.392672] random: fast init done
[    0.401385] pca953x 0-0038: supply vcc not found, using dummy regulator
[    0.401534] pca953x 0-0038: using no AI
[    0.425353] omap_i2c 42120000.i2c: bus 0 rev0.12 at 400 kHz
[    0.426621] omap_i2c 40b00000.i2c: bus 1 rev0.12 at 100 kHz
[    0.428097] pca953x 2-0021: supply vcc not found, using dummy regulator
[    0.428233] pca953x 2-0021: using no AI
[    0.449891] rtc-ds1307 2-0068: SET TIME!
[    0.450658] rtc-ds1307 2-0068: registered as rtc0
[    0.450991] rtc-ds1307 2-0068: setting system clock to 2000-01-01T00:01:27 UTC (946684887)
[    0.451537] omap_i2c 2000000.i2c: bus 2 rev0.12 at 400 kHz
[    0.452733] omap_i2c 2010000.i2c: bus 3 rev0.12 at 400 kHz
[    0.453841] omap_i2c 2020000.i2c: bus 4 rev0.12 at 400 kHz
[    0.456195] omap_i2c 2030000.i2c: bus 5 rev0.12 at 400 kHz
[    0.457503] ti-sci-intr bus@100000:bus@28380000:bus@42040000:interrupt-controller2: Interrupt Router 156 domain created
[    0.457756] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 100 domain created
[    0.457987] ti-sci-intr bus@100000:main-navss:interrupt-controller1: Interrupt Router 182 domain created
[    0.458360] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain 179 created
[    0.464714] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,32] sci-dev-id:195
[    0.464738] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
[    0.464749] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66348100, num_proxies:64
[    0.468248] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:818, gp-rings[304,100] sci-dev-id:187
[    0.468267] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
[    0.468278] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66348100, num_proxies:64
[    0.469587] 42300000.serial: ttyS0 at MMIO 0x42300000 (irq = 15, base_baud = 6000000) is a 8250
[    0.471111] 40a00000.serial: ttyS1 at MMIO 0x40a00000 (irq = 17, base_baud = 6000000) is a 8250
[    0.472552] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 30, base_baud = 3000000) is a 8250
[    0.474222] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 31, base_baud = 3000000) is a 8250
[    1.755463] printk: console [ttyS3] enabled
[    1.761449] 2820000.serial: ttyS4 at MMIO 0x2820000 (irq = 32, base_baud = 3000000) is a 8250
[    1.820382] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.830342] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    1.838753] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00102, cpsw version 0x6BA80102 Ports: 2 quirks:00000000
[    1.854397] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
[    1.863749] clk: failed to reparent clk:130:1 to clk:130:5: -22
[    1.871749] mmc0: CQHCI version 5.10
[    1.888100] vdd_mmc1_sd: supplied by vcc3v3_io
[    1.893492] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc7100
[    1.900571] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc7100
[    1.908938] ti-udma 285c0000.dma-controller: Channels: 28 (tchan: 14, rchan: 14, gp-rflow: 16)
[    1.912961] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
[    1.929566] ti-udma 31150000.dma-controller: Channels: 119 (tchan: 53, rchan: 66, gp-rflow: 64)
[    1.952663] spi-nor spi8.0: cy15b104q (512 Kbytes)
[    1.964590] spi-nor spi9.0: unrecognized JEDEC id bytes: 00 00 00 00 00 00
[    1.971524] spi-nor: probe of spi9.0 failed with error -2
[    2.013206] mmc0: Command Queue Engine enabled
[    2.016345] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    2.017680] mmc0: new HS400 MMC card at address 0001
[    2.027407] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    2.030920] mmcblk0: mmc0:0001 S0J57X 29.6 GiB 
[    2.038755] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00102, cpsw version 0x6BA80102 Ports: 2 quirks:00000000
[    2.043357] mmcblk0boot0: mmc0:0001 S0J57X partition 1 31.5 MiB
[    2.062132] mmcblk0boot1: mmc0:0001 S0J57X partition 2 31.5 MiB
[    2.068363] mmcblk0rpmb: mmc0:0001 S0J57X partition 3 4.00 MiB, chardev (239:0)
[    2.068469] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
[    2.083123] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    2.090389] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    2.097481] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
[    2.110358] mmc1: CQHCI version 5.10
[    2.110380] debugfs: Directory 'pd:121' with parent 'pm_genpd' already present!
[    2.121461] debugfs: Directory 'pd:120' with parent 'pm_genpd' already present!
[    2.131159] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[    2.943716] mmc1: SDHCI controller on 4fa0000.mmc [4fa0000.mmc] using ADMA 64-bit
[    2.953644] Freeing unused kernel memory: 3200K
[    2.964375] Run /init as init process
PX Red initramfs loader
Mounting ext4 filesystem on '/dev/mmcblk1p2'...
[    3.260886] mmc1: new ultra high speed DDR50 SDHC card at address 0001
[    3.268233] mmcblk1: mmc1:0001 N3CCL 15.2 GiB 
[    3.278956]  mmcblk1: p1 p2
Retrying mount of ext4 filesystem on '/dev/mmcblk1p2'...
[    5.383768] EXT4-fs (mmcblk1p2): recovery complete
[    5.389049] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
Umounting '/dev/mmcblk1p2'...
Running fsck on '/dev/mmcblk1p2'...
e2fsck 1.45.6 (20-Mar-2020)
rootfs: clean, 148/522240 files, 100461/2088960 blocks
Mounting ext4 filesystem on '/dev/mmcblk1p2'...
[    5.463531] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
Booting partition 0...

Even though we have had same silicon revision(SR2), defconfig and initramfs earlier we are now not able to see mmc1 specific log messages now (mmc0 are as expected).
I am using the same sd card and same script which used to create the image earlier.

The bootloader is able to detect the files present on SD card on its partition

But the initramfs is not able to get the mmbclk1p2 block which stores the rootfs. Note that initramfs retries 5 times with 1 sec gap for the partition to show-up.

We get below error log now in initramfs loader

Edge Linux initramfs loader
mount of /proc and /sys is successful
partition scan for rootfs_label
Mounting ext4 filesystem on '/dev/mmcblk1p2'...
partition /dev/mmcblk1p2 container_path /container rootfs_type ext4
Failure No such file or directory
Error mounting persistent storage


I found a link where similar issue was observed  where vdd_mmc1_sd was having some invalid parameter. I think its mostly related to migration between SR1 and SR2.

https://e2e.ti.com/support/processors-group/processors/f/processors-forum/940872/am6548-mmc1-not-detected-in-kernel-boot-sdk7

I tried to remove line below line in in k3-am654-base-board.dts

 gpio = <&pca9554 4 GPIO_ACTIVE_HIGH>;

from vdd_mmc1_sd 

But making this change also did not help.

 

Maybe the issue is related to initialisation of vcc3v3_io.

Also I see these messages after initramfs failure just before device goes for reboot

[ 12.005035] platform fixedregulator-sd: deferred probe pending
[ 12.010911] platform 4fa0000.mmc: deferred probe pending

Full boot log when error is observed

U-Boot SPL 2021.01 (Apr 25 2024 - 08:46:52 -0400)
SYSFW ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
i2c_omap i2c@42120000: pinctrl_select_state_full: uclass_get_device_by_phandle_id: err=-19
Reading on-board EEPROM at 0x50 failed -1
Detected: Silicon SR2.0
Trying to boot from MMC2


U-Boot 2021.01 (Apr 25 2024 - 08:46:52 -0400)

SoC:   AM65X SR2.0
Model: Texas Instruments AM654 Base Board
i2c_omap i2c@42120000: pinctrl_select_state_full: uclass_get_device_by_phandle_id: err=-19
Reading on-board EEPROM at 0x50 failed -1
Board: AM6-COMPROCEVM rev E3
DRAM:  4 GiB
MMC:   sdhci@4f80000: 0, sdhci@4fa0000: 1
Loading Environment from MMC... OK
In:    serial
Out:   serial
Err:   serial
am65_cpsw_nuss ethernet@46000000: K3 CPSW: nuss_ver: 0x6BA00102 cpsw_ver: 0x6BA80102 ale_ver: 0x00293904 Ports:1 mdio_freq:1000000
Reading on-board EEPROM at 0x50 failed -1
Detected: Silicon SR2.0
set_Eth_mac_add: I2C EEPROM MAC 6a:f5:5c:d2:20:00
Net:   eth1: icssg2-eth, eth0: ethernet@46000000port@1
Hit any key to stop autoboot:  2  1  0 
996 bytes read in 1 ms (972.7 KiB/s)
1 bytes read in 2 ms (0 Bytes/s)
byte at 0x81600000 (0x0) != byte at 0x81600010 (0x1)
Total of 0 byte(s) were the same
21254656 bytes read in 875 ms (23.2 MiB/s)
69458 bytes read in 5 ms (13.2 MiB/s)
21254656 bytes read in 876 ms (23.1 MiB/s)
## Flattened Device Tree blob at 88000000
   Booting using the fdt blob at 0x88000000
   Loading Device Tree to 000000008ffec000, end 000000008fffff51 ... OK

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 6.1.46-g5da2f861d7 (oe-user@oe-host) (aarch64-none-linux-gcc (GCC) 11.2.1 20220111, GNU ld (GNU Binutils) 2.38.20220708) #1 SMP PREEMPT Thu Nov 30 22:19:30 UTC 2023
[    0.000000] Machine model: Texas Instruments AM654 Base Board
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@a0000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@a0100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b1000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node r5f-dma-memory@b1000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b1100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node r5f-memory@b1100000, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000008ffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000009e7fffff]
[    0.000000]   node   0: [mem 0x000000009e800000-0x00000000b00fffff]
[    0.000000]   node   0: [mem 0x00000000b0100000-0x00000000b0ffffff]
[    0.000000]   node   0: [mem 0x00000000b1000000-0x00000000b21fffff]
[    0.000000]   node   0: [mem 0x00000000b2200000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000880000000-0x00000008ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000008ffffffff]
[    0.000000] cma: Reserved 512 MiB at 0x00000000e0000000
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 2 pages/cpu s34280 r8192 d88600 u131072
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 65472
[    0.000000] Kernel command line: rootdelay=5 root=/dev/mmcblk1p2 rw initlo=/rootfs0.img init=/linuxrc rootfstype=ext4 console=ttyS3,115200n8
[    0.000000] Unknown kernel command line parameters "initlo=/rootfs0.img", will be passed to user space.
[    0.000000] Dentry cache hash table entries: 524288 (order: 6, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 5, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: area num 2.
[    0.000000] software IO TLB: mapped [mem 0x00000000dc000000-0x00000000e0000000] (64MB)
[    0.000000] Memory: 3263616K/4194304K available (10816K kernel code, 1364K rwdata, 3712K rodata, 4416K init, 1302K bss, 406400K reserved, 524288K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: RCU event tracing is enabled.
[    0.000000] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GICv3: GICv3 features: 16 PPIs
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: allocated 1048576 Devices @880800000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x00000008800c0000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x00000008800d0000
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0x3ffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000001] sched_clock: 58 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.000463] Console: colour dummy device 80x25
[    0.000525] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.000540] pid_max: default: 32768 minimum: 301
[    0.000610] LSM: Security Framework initializing
[    0.000732] Mount-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.000759] Mountpoint-cache hash table entries: 8192 (order: 0, 65536 bytes, linear)
[    0.003525] rcu: Hierarchical SRCU implementation.
[    0.003538] rcu: Max phase no-delay instances is 1000.
[    0.004016] Platform MSI: msi-controller@1820000 domain created
[    0.004323] PCI/MSI: /bus@100000/interrupt-controller@1800000/msi-controller@1820000 domain created
[    0.004442] EFI services will not be available.
[    0.004828] smp: Bringing up secondary CPUs ...
[    0.006163] Detected VIPT I-cache on CPU1
[    0.006309] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
[    0.006331] GICv3: CPU1: using allocated LPI pending table @0x00000008800e0000
[    0.006393] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.006545] smp: Brought up 1 node, 2 CPUs
[    0.006558] SMP: Total of 2 processors activated.
[    0.006565] CPU features: detected: 32-bit EL0 Support
[    0.006570] CPU features: detected: CRC32 instructions
[    0.006654] CPU: All CPU(s) started at EL2
[    0.006658] alternatives: applying system-wide alternatives
[    0.008289] devtmpfs: initialized
[    0.019603] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.019634] futex hash table entries: 512 (order: -1, 32768 bytes, linear)
[    0.020891] pinctrl core: initialized pinctrl subsystem
[    0.021549] DMI not present or invalid.
[    0.022468] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.028262] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[    0.028559] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.028796] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.029473] thermal_sys: Registered thermal governor 'step_wise'
[    0.029481] thermal_sys: Registered thermal governor 'power_allocator'
[    0.029781] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.029902] ASID allocator initialised with 65536 entries
[    0.051642] KASLR disabled due to lack of seed
[    0.060203] HugeTLB: registered 16.0 GiB page size, pre-allocated 0 pages
[    0.060216] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 GiB page
[    0.060223] HugeTLB: registered 512 MiB page size, pre-allocated 0 pages
[    0.060228] HugeTLB: 0 KiB vmemmap can be freed for a 512 MiB page
[    0.060235] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.060239] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[    0.061540] cryptd: max_cpu_qlen set to 1000
[    0.063309] k3-chipinfo 43000014.chipid: Family:AM65X rev:SR2.0 JTAGID[0x1bb5a02f] Detected
[    0.065040] iommu: Default domain type: Translated 
[    0.065050] iommu: DMA domain TLB invalidation policy: strict mode 
[    0.065387] SCSI subsystem initialized
[    0.065890] pps_core: LinuxPPS API ver. 1 registered
[    0.065897] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.065913] PTP clock support registered
[    0.065958] EDAC MC: Ver: 3.0.0
[    0.066993] FPGA manager framework
[    0.068220] clocksource: Switched to clocksource arch_sys_counter
[    0.068844] VFS: Disk quotas dquot_6.6.0
[    0.068921] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.077556] NET: Registered PF_INET protocol family
[    0.078134] IP idents hash table entries: 65536 (order: 3, 524288 bytes, linear)
[    0.082699] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear)
[    0.082792] Table-perturb hash table entries: 65536 (order: 2, 262144 bytes, linear)
[    0.082809] TCP established hash table entries: 32768 (order: 2, 262144 bytes, linear)
[    0.083112] TCP bind hash table entries: 32768 (order: 4, 1048576 bytes, linear)
[    0.084612] TCP: Hash tables configured (established 32768 bind 32768)
[    0.084778] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.084904] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear)
[    0.085206] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.085854] RPC: Registered named UNIX socket transport module.
[    0.085865] RPC: Registered udp transport module.
[    0.085869] RPC: Registered tcp transport module.
[    0.085873] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.085884] PCI: CLS 0 bytes, default 64
[    0.093009] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
[    0.095120] Initialise system trusted keyrings
[    0.095488] workingset: timestamp_bits=46 max_order=16 bucket_order=0
[    0.102684] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.103634] NFS: Registering the id_resolver key type
[    0.103675] Key type id_resolver registered
[    0.103680] Key type id_legacy registered
[    0.103759] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.103767] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.103999] fuse: init (API version 7.37)
[    0.104366] 9p: Installing v9fs 9p2000 file system support
[    0.158137] Key type asymmetric registered
[    0.158160] Asymmetric key parser 'x509' registered
[    0.158305] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.158315] io scheduler mq-deadline registered
[    0.158322] io scheduler kyber registered
[    0.163339] pinctrl-single 4301c000.pinctrl: 70 pins, size 280
[    0.164014] pinctrl-single 11c000.pinctrl: 185 pins, size 740
[    0.164358] pinctrl-single 11c2e8.pinctrl: 9 pins, size 36
[    0.175267] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[    0.190342] brd: module loaded
[    0.196358] loop: module loaded
[    0.197409] megasas: 07.719.03.00-rc1
[    0.200740] tun: Universal TUN/TAP device driver, 1.6
[    0.201623] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    0.201631] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    0.201691] sky2: driver version 1.30
[    0.202700] VFIO - User Level meta-driver version: 0.3
[    0.203746] i2c_dev: i2c /dev entries driver
[    0.205663] sdhci: Secure Digital Host Controller Interface driver
[    0.205671] sdhci: Copyright(c) Pierre Ossman
[    0.206073] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.207877] ledtrig-cpu: registered to indicate activity on CPUs
[    0.208088] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.210153] optee: probing for conduit method.
[    0.210184] optee: revision 3.12 (3d47a131)
[    0.210849] optee: initialized driver
[    0.212579] NET: Registered PF_PACKET protocol family
[    0.212747] 9pnet: Installing 9P2000 support
[    0.212855] Key type dns_resolver registered
[    0.213408] Loading compiled-in X.509 certificates
[    0.230923] ti-sci 44083000.system-controller: ABI: 3.1 (firmware rev 0x0016 '22.1.1--v2022.01 (Terrific Llam')
[    0.279060] omap_i2c 40b00000.i2c: bus 1 rev0.12 at 100 kHz
[    0.280388] pca953x 2-0021: supply vcc not found, using dummy regulator
[    0.280522] pca953x 2-0021: using no AI
[    0.306381] rtc-ds1307 2-0068: registered as rtc0
[    0.306706] rtc-ds1307 2-0068: setting system clock to 2000-01-01T00:02:22 UTC (946684942)
[    0.307222] omap_i2c 2000000.i2c: bus 2 rev0.12 at 400 kHz
[    0.308429] omap_i2c 2010000.i2c: bus 3 rev0.12 at 400 kHz
[    0.309445] omap_i2c 2020000.i2c: bus 4 rev0.12 at 400 kHz
[    0.309832] ti-sci-intr 42200000.interrupt-controller: Interrupt Router 156 domain created
[    0.310081] ti-sci-intr bus@100000:interrupt-controller@a00000: Interrupt Router 100 domain created
[    0.310318] ti-sci-intr 310e0000.interrupt-controller: Interrupt Router 182 domain created
[    0.310697] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain 179 created
[    0.313473] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,32] sci-dev-id:195
[    0.313491] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
[    0.313500] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66348100, num_proxies:64
[    0.317155] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:818, gp-rings[304,100] sci-dev-id:187
[    0.317174] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
[    0.317181] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66348100, num_proxies:64
[    0.318305] 42300000.serial: ttyS0 at MMIO 0x42300000 (irq = 152, base_baud = 6000000) is a 8250
[    0.319559] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 153, base_baud = 3000000) is a 8250
[    1.550334] printk: console [ttyS3] enabled
[    1.561178] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
[    1.608237] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.617762] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    1.626113] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00102, cpsw version 0x6BA80102 Ports: 2 quirks:00000000
[    1.639014] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    1.646238] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    1.653327] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
[    1.666158] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
[    1.677856] clk: failed to reparent clk:130:1 to clk:130:5: -22
[    1.686272] mmc0: CQHCI version 5.10
[    1.701183] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc7100
[    1.708259] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc7100
[    1.716662] ti-udma 285c0000.dma-controller: Channels: 28 (tchan: 14, rchan: 14, gp-rflow: 16)
[    1.731663] ti-udma 31150000.dma-controller: Channels: 119 (tchan: 53, rchan: 66, gp-rflow: 64)
[    1.740460] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
[    1.764116] spi-nor spi1.0: cy15b104q (0 Kbytes)
[    1.776603] spi-nor spi2.0: unrecognized JEDEC id bytes: 00 00 00 00 00 00
[    1.785006] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
[    1.828234] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    1.837924] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    1.846302] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00102, cpsw version 0x6BA80102 Ports: 2 quirks:00000000
[    1.859246] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    1.866555] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    1.873579] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010b, freq:200000000, add_val:4 pps:0
[    1.884608] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
[    1.890537] mmc0: Command Queue Engine enabled
[    1.895566] mmc0: new HS400 MMC card at address 0001
[    1.901494] mmcblk0: mmc0:0001 S0J57X 29.6 GiB 
[    1.905292] debugfs: Directory 'pd:121' with parent 'pm_genpd' already present!
[    1.908484] mmcblk0boot0: mmc0:0001 S0J57X 31.5 MiB 
[    1.913544] debugfs: Directory 'pd:120' with parent 'pm_genpd' already present!
[    1.919721] mmcblk0boot1: mmc0:0001 S0J57X 31.5 MiB 
[    1.928094] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[    1.931929] mmcblk0rpmb: mmc0:0001 S0J57X 4.00 MiB, chardev (239:0)
[    1.960404] Freeing unused kernel memory: 4416K
[    1.965083] Run /init as init process

Edge Linux initramfs loader
mount of /proc and /sys is successful..
check container_path /container 
num_tries 0  wait_secs 5  
partition scan for rootfs_label  
num_tries 1  wait_secs 5  
partition scan for rootfs_label  
num_tries 2  wait_secs 5  
partition scan for rootfs_label  
num_tries 3  wait_secs 5  
partition scan for rootfs_label  
num_tries 4  wait_secs 5  
partition scan for rootfs_label  
num_tries 5  wait_secs 5  [    6.985379] /dev/mmcblk1p2: Can't open blockdev

partition scan for rootfs_label  
Mounting ext4 filesystem on '/dev/mmcblk1p2'...
partition /dev/mmcblk1p2 container_path /container rootfs_type ext4 
Failure No such file or directory
Error mounting persistent storage
: No such file or directory
we will return zero always retval -1 


!!! Cannot boot partition 0. Will reboot, trying the other one !!!

Would switch the active partition but the read/write filesystem is not mounted, can't update the file
[   12.005095] platform fixedregulator-sd: deferred probe pending
[   12.010969] platform 4fa0000.mmc: deferred probe pending
[   13.003432] reboot: Restarting system