This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

PROCESSOR-SDK-AM62X: MCU M4F STUCK

Part Number: PROCESSOR-SDK-AM62X

Hi Team, 

We are observing a stuck-on mcu M4f log on mcu M4f uart port after running for some time.

The time is not periodic it varies from 45m hr to 3 hr. It will fail at any time.

Use case: We are sending the data from the Linux to MCU M4f through IPC.

Thanks and Regards,

Aneesh

  • Hi Aneesh,

    Could you please attach the log and details on what software you are using to verify the IPC mechanism on AM62x? 

    Is it Linux SDK or MCU+SDK software?

    This will help route your query to the right expert.

    Best Regards,

    Suren

  • Hi Suren,

    We are using Linux SDK and MCU+ SDK. 

    We are testing the IPC mechanism between A53 and m4f.

    The applications are custom developed for both A53 Linux and M4f freertos based on the TI IPC examples.

    We are not seeing any errors on the MCU log other than freeze. But after the MCU log got freeze we see some IPC errors on A53 side.

    I am attaching the ipc error logs for reference.

    TI_IPC_STUCK_log.txt

    Thanks and Regards,

    Aneesh

  • Hi Aneesh,

    Thanks for the logs. I have routed your query to our expert. You should be receiving a response soon. 

    Best Regards,

    Suren

  • Hello Aneesh,

     Can you please share steps to reproduce the issue ?

    I understand that IPC operations between A53 and M4F cores are not working.

    Is it possible to share your examples? so that I can review and provide my comments.

    Regards,

    S.Anil.

  • Hi Anil, 

    Myself(Vadivel) and Aneesh who created this ticket are working for the same company/project/team.

    We run for 5k cycle and it stuck at randomly.  Sometime at 2k+ cycle and sometime 3k+ cycle; sometime success also. 

    Note: Our code is similar to TI-sample code.

    Regards, 

    Vadivel

  • Hello Vadivel,

    Is it possible to share a reproducible code to me to verify at my end?

    Along with that, could you please share your test procedure to reproduce the issue from my side?

    Regards,

    S.Anil

  • Hello Vadivel,

    Can you please confirm the issue was happening in your custom HW or EVM?

    If it is custom HW, can you please confirm on EVM if the issue was happening on EVM or not?

    Regards,

    S.Anil.

  • Hi Anil,

    Right now, it is happening on custom hardware.  I have made some more code changes to it and re-testing it now.  I will update to you the result. 

    Is there way to enable more logs on m4f-image side? to see where its get stuck.

    Regards, 

    Vadivel

  • #include <drivers/ipc_notify.h>
    #include <drivers/ipc_rpmsg.h>
    
    #define IPC_RPMESSAGE_SERVICE_CHRDEV      "rpmsg_chrdev"
    #define IPC_RPMESSAGE_ENDPT_CHRDEV_PING   (14U)
    
    #define IPC_RPMESSAGE_MAX_MSG_SIZE        (32u)  //512 bytes is the max recommended size and min 4 bytes
    
    
    /* @brief RPMessage object used to recvice messages */
    RPMessage_Object gIpcRecvMsgObject;
    
    /******************************************************************************
    *
    *   @brief service RP Msg init
    *
    ******************************************************************************/
    void ipcInit(void)
    {
        /* This API MUST be called by applications when its ready to talk to Linux */
        int32_t status = RPMessage_waitForLinuxReady(SystemP_WAIT_FOREVER);
        DebugP_assert(status==SystemP_SUCCESS);
    
        RPMessage_CreateParams createParams;
    
        RPMessage_CreateParams_init(&createParams);
        createParams.localEndPt = IPC_RPMESSAGE_ENDPT_CHRDEV_PING;
        status = RPMessage_construct(&gIpcRecvMsgObject, &createParams);
        DebugP_assert(status==SystemP_SUCCESS);
    
        status = RPMessage_announce(CSL_CORE_ID_A53SS0_0, IPC_RPMESSAGE_ENDPT_CHRDEV_PING, IPC_RPMESSAGE_SERVICE_CHRDEV);
        DebugP_assert(status==SystemP_SUCCESS);
    
        IpcNotify_syncAll(SystemP_WAIT_FOREVER);
    }
    
    /******************************************************************************
    *
    *   @brief service RP Msg receive
    *
    ******************************************************************************/
    int32_t ipcReceive(void)
    {
        uint8_t recvMsg[IPC_RPMESSAGE_MAX_MSG_SIZE+1]  = { 0 }; /* +1 for NULL char in worst case */
    
        /* set 'recvMsgSize' to size of recv buffer, after return `recvMsgSize`
        *  contains actual size of valid data in recv buffer
        */
        uint16_t recvMsgSize = IPC_RPMESSAGE_MAX_MSG_SIZE, , remoteCoreId, remoteCoreEndPt;
    	
        int32_t status = RPMessage_recv(&gIpcRecvMsgObject, recvMsg, &recvMsgSize,
            &remoteCoreId, &remoteCoreEndPt, SystemP_WAIT_FOREVER);
        if (SystemP_SUCCESS != status)
        {
            DebugP_logError("RPMessage_recv API call unblocked due to timeout/failure and output parameters should not be used. \r\n\n");
            return (status);
        }
    
        recvMsg[recvMsgSize] = 0; /* add a NULL char at the end of message */
    
        DebugP_log("Received new message (%s) \r\n", recvMsg);
    
        return (status);
    }
    
    /******************************************************************************
     *
     * @brief Main function used to create tasks and start scheduler
     *
     ******************************************************************************/
    int main()
    {
        ipcInit();
        while(1)
        {
           ipcReceive();
        }
    }
    

  • Hi Anil, I have tried the TI IPC_RPMESSAGE_LINUX_ECHO example on both customized and evm boards. I am able to reproduce the stuck issue on both boards.

    I am attaching the logs of both boards for reference.

    
     _____                    _____           _         _   
    |  _  |___ ___ ___ ___   |  _  |___ ___  |_|___ ___| |_ 
    |     |  _| .'| . | . |  |   __|  _| . | | | -_|  _|  _|
    |__|__|_| |__,|_  |___|  |__|  |_| |___|_| |___|___|_|  
                  |___|                    |___|            
    
    Arago Project am62xx-evm ttyS2
    
    Arago 2021.09 am62xx-evm ttyS2
    
    am62xx-evm login: root
    root@am62xx-evm:~# 
    root@am62xx-evm:~# 
    root@am62xx-evm:~# rpmsg_char_simple -r 9 -n 10000[   38.179954] Initializing XFRM netlink socket
    00
    Created endpt device rpmsg-char-9-777, fd = 3 port = 1024
    Exchanging 1000000 messages with rpmsg device ti.ipc4.ping-pong on rproc id 9 ...
    
    Sending message #0: hello there 0!
    Receiving message #0: hello there 0!
    Sending message #1: hello there 1!
    Receiving message #1: hello there 1!
    Sending message #2: hello there 2!
    Receiving message #2: hello there 2!
    Sending message #3: hello there 3!
    Receiving message #3: hello there 3!
    Sending message #4: hello there 4!
    Receiving message #4: hello there 4!
    Sending message #5: hello there 5!
    Receiving message #5: hello there 5!
    Sending message #6: hello there 6!
    Receiving message #6: hello there 6!
    Sending message #7: hello there 7!
    Receiving message #7: hello there 7!
    Sending message #8: hello there 8!
    Receiving message #8: hello there 8!
    Sending message #9: hello there 9!
    Receiving message #9: hello there 9!
    Sending message #10: hello there 10!
    Receiving message #10: hello there 10!
    Sending message #11: hello there 11!
    Receiving message #11: hello there 11!
    Sending message #12: hello there 12!
    Receiving message #12: hello there 12!
    Sending message #13: hello there 13!
    Receiving message #13: hello there 13!
    Sending message #14: hello there 14!
    Receiving message #14: hello there 14!
    Sending message #15: hello there 15!
    Receiving message #15: hello there 15!
    Sending message #16: hello there 16!
    Receiving message #16: hello there 16!
    Sending message #17: hello there 17!
    Receiving message #17: hello there 17!
    Sending message #18: hello there 18!
    Receiving message #18: hello there 18!
    Sending message #19: hello there 19!
    Receiving message #19: hello there 19!
    Sending message #20: hello there 20!
    Receiving message #20: hello there 20!
    Sending message #21: hello there 21!
    Receiving message #21: hello there 21!
    Sending message #22: hello there 22!
    
    [IPC RPMSG ECHO] May 16 2023 13:48:01
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 13 ... !!!
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 14 ... !!!
    hello there 0!
    hello there 1!
    hello there 2!
    hello there 3!
    hello there 4!
    hello there 5!
    hello there 6!
    hello there 7!
    hello there 8!
    hello there 9!
    hello there 10!
    hello there 11!
    hello there 12!
    hello there 13!
    hello there 14!
    hello there 15!
    hello there 16!
    hello there 17!
    hello there 18!
    hello there 19!
    hello there 20!
    hello there 21!
    h
    h��[IPC RPMSG ECHO] May 17 2023 04:52:42
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 13 ... !!!
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 14 ... !!!
    hello there 0!
    hello there 1!
    hello there 2!
    hello there 3!
    hello there 4!
    hello there 5!
    hello there 6!
    hello there 7!
    hello there 8!
    hello there 9!
    hello there 10!
    hello there 11!
    hello there 12!
    hello there 13!
    hello there 14!
    hello there 15!
    hello there 16!
    hello there 17!
    hello there 18!
    hello there 19!
    hello there 20!
    hello there 21!
    hello there 22!
    hello there 23!
    hello there 24!
    hello there 25!
    hello there 26!
    hello there 27!
    hello there 28!
    hello there 29!
    hello there 30!
    hello there 31!
    hello there 32!
    hello there 33!
    hello there 34!
    hello there 35!
    hello there 36!
    hello there 37!
    hello there 38!
    hello there 39!
    hello there 40!
    hello there 41!
    hello there 42!
    hello there 43!
    hello there 44!
    hello there 45!
    hello there 46!
    hello there 47!
    hello there 48!
    hello there 49!
    hello there 50!
    hello there 51!
    hello there 52!
    hello there 53!
    hello there 54!
    hello there 55!
    hello there 56!
    hello there 57!
    hello there 58!
    hello there 59!
    hello there 60!
    hello there 61!
    hello there 62!
    hello there 63!
    hello there 64!
    hello there 65!
    hello there 66!
    hello there 67!
    hello there 68!
    hello there 69!
    hello there 70!
    hello there 71!
    hello there 72!
    hello there 73!
    hello there 74!
    hello there 75!
    hello there 76!
    hello there 77!
    hello there 78!
    hello there 79!
    hello there 80!
    hello there 81!
    hello there 82!
    hello there 83!
    hello there 84!
    hello there 85!
    hello there 86!
    hello there 87!
    hello there 88!
    hello there 89!
    hello there 90!
    hello there 91!
    hello there 92!
    hello there 93!
    hello there 94!
    hello there 95!
    hello there 96!
    hello there 97!
    hello there 98!
    hello there 99!
    hello there 100!
    hello there 101!
    hello there 102!
    hello there 103!
    hello there 104!
    hello there 105!
    hello there 106!
    hello there 107!
    hello there 108!
    hello there 109!
    hello there 110!
    hello there 111!
    hello there 112!
    hello there 113!
    hello there 114!
    hello there 115!
    hello there 116!
    hello there 117!
    hello there 118!
    hello there 119!
    hello there 120!
    hello there 121!
    hello there 122!
    hello there 123!
    hello there 124!
    hello there 125!
    hello there 126!
    hello there 127!
    hello there 128!
    hello there 129!
    hello there 130!
    hello there 131!
    hello there 132!
    hello there 133!
    hello there 134!
    hello there 135!
    hello there 136!
    hello there 137!
    hello there 138!
    hello there 139!
    hello there 140!
    hello there 141!
    hello there 142!
    hello there 143!
    hello there 144!
    hello there 145!
    hello there 146!
    hello there 147!
    hello there 148!
    hello there 149!
    hello there 150!
    hello there 151!
    hello there 152!
    hello there 153!
    hello there 154!
    hello there 155!
    hello there 156!
    hello there 157!
    hello there 158!
    hello there 159!
    hello there 160!
    hello there 161!
    hello there 162!
    hello there 163!
    hello there 164!
    hello there 165!
    hello there 166!
    hello there 167!
    hello there 168!
    hello there 169!
    hello there 170!
    hello there 171!
    hello there 172!
    hello there 173!
    hello there 174!
    hello there 175!
    hello there 176!
    hello there 177!
    hello there 178!
    hello there 179!
    hello there 180!
    hello there 181!
    hello there 182!
    hello there 183!
    hello there 184!
    hello there 185!
    hello there 186!
    hello there 187!
    hello there 188!
    hello there 189!
    hello there 190!
    hello there 191!
    hello there 192!
    hello there 193!
    hello there 194!
    hello there 195!
    hello there 196!
    hello there 197!
    hello there 198!
    hello there 199!
    hello there 200!
    hello there 201!
    hello there 202!
    hello there 203!
    hello there 204!
    hello there 205!
    hello there 206!
    hello there 207!
    hello there 208!
    hello there 209!
    hello there 210!
    hello there 211!
    hello there 212!
    hello there 213!
    hello there 214!
    hello there 215!
    hello there 216!
    hello there 217!
    hello there 218!
    hello there 219!
    hello there 220!
    hello there 221!
    hello there 222!
    hello there 223!
    hello there 224!
    hello there 225!
    hello there 226!
    hello there 227!
    hello there 228!
    hello there 229!
    hello there 230!
    hello there 231!
    hello there 232!
    hello there 233!
    hello there 234!
    hello there 235!
    hello there 236!
    hello there 237!
    hello there 238!
    hello there 239!
    hello there 240!
    hello there 241!
    hello there 242!
    hello there 243!
    hello there 244!
    hello there 245!
    hello there 246!
    hello there 247!
    hello there 248!
    hello there 249!
    hello there 250!
    hello there 251!
    hello there 252!
    hello there 253!
    hello there 254!
    hello there 255!
    hello there 256!
    hello there 257!
    hello there 258!
    h
    ��
    U-Boot SPL 2021.01-g3983bffabc (Feb 01 2023 - 05:52:00 +0000)
    SYSFW ABI: 3.1 (firmware rev 0x0008 '8.5.3--v08.05.03 (Chill Capybar')
    SPL initial stack usage: 13424 bytes
    Trying to boot from MMC2
    Loading Environment from MMC... *** Warning - No MMC card found, using default environment
    
    Starting ATF on ARM64 core...
    
    NOTICE:  BL31: v2.7(release):v2.7.0-359-g1309c6c805-dirty
    NOTICE:  BL31: Built : 05:45:27, Feb  1 2023
    I/TC: 
    I/TC: OP-TEE version: 3.19.0-15-gd6c5d0037 (gcc version 9.2.1 20191025 (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10))) #1 Wed Feb  1 05:45:50 UTC 2023 aarch64
    I/TC: WARNING: This OP-TEE configuration might be insecure!
    I/TC: WARNING: Please check https://optee.readthedocs.io/en/latest/architecture/porting_guidelines.html
    I/TC: Primary CPU initializing
    I/TC: SYSFW ABI: 3.1 (firmware rev 0x0008 '8.5.3--v08.05.03 (Chill Capybar')
    I/TC: HUK Initialized
    I/TC: Activated SA2UL device
    I/TC: Fixing SA2UL firewall owner for GP device
    I/TC: Enabled firewalls for SA2UL TRNG device
    I/TC: SA2UL TRNG initialized
    I/TC: SA2UL Drivers initialized
    I/TC: Primary CPU switching to normal world boot
    
    U-Boot SPL 2021.01-g3983bffabc (Feb 01 2023 - 05:46:14 +0000)
    SYSFW ABI: 3.1 (firmware rev 0x0008 '8.5.3--v08.05.03 (Chill Capybar')
    Trying to boot from MMC2
    
    
    U-Boot 2021.01-g3983bffabc (Feb 01 2023 - 05:46:14 +0000)
    
    SoC:   AM62X SR1.0 GP
    Model: Texas Instruments AM625 SK
    EEPROM not available at 0x50, trying to read at 0x51
    Board: AM62-SKEVM rev E3
    DRAM:  2 GiB
    MMC:   mmc@fa10000: 0, mmc@fa00000: 1, mmc@fa20000: 2
    Loading Environment from MMC... OK
    In:    serial@2800000
    Out:   serial@2800000
    Err:   serial@2800000
    Net:   eth0: ethernet@8000000port@1
    Hit any key to stop autoboot:  2  1  0 
    switch to partitions #0, OK
    mmc1 is current device
    SD/MMC found on device 1
    Failed to load 'boot.scr'
    1490 bytes read in 3 ms (484.4 KiB/s)
    Loaded env from uEnv.txt
    Importing environment from mmc1 ...
    Running uenvcmd ...
    1 bytes read in 2 ms (0 Bytes/s)
    Already setup.
    18608640 bytes read in 206 ms (86.1 MiB/s)
    55468 bytes read in 5 ms (10.6 MiB/s)
    ## Flattened Device Tree blob at 88000000
       Booting using the fdt blob at 0x88000000
       Loading Device Tree to 000000008feef000, end 000000008fffffff ... OK
    
    Starting kernel ...
    
    [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
    [    0.000000] Linux version 5.10.153-g3eee621d16 (oe-user@oe-host) (aarch64-none-linux-gnu-gcc (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 9.2.1 20191025, GNU ld (GNU Toolchain for the A-profile Architecture 9.2-2019.12 (arm-9.10)) 2.33.1.20191209) #1 SMP PREEMPT Wed Feb 1 05:50:25 UTC 2023
    [    0.000000] Machine model: Texas Instruments AM625 SK
    [    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
    [    0.000000] printk: bootconsole [ns16550a0] enabled
    [    0.000000] efi: UEFI not found.
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009c800000, size 3 MiB
    [    0.000000] OF: reserved mem: initialized node ipc-memories@9c800000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009cb00000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-dma-memory@9cb00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009cc00000, size 14 MiB
    [    0.000000] OF: reserved mem: initialized node m4f-memory@9cc00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009da00000, size 1 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-dma-memory@9da00000, compatible id shared-dma-pool
    [    0.000000] Reserved memory: created DMA memory pool at 0x000000009db00000, size 12 MiB
    [    0.000000] OF: reserved mem: initialized node r5f-memory@9db00000, compatible id shared-dma-pool
    [    0.000000] Zone ranges:
    [    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
    [    0.000000]   DMA32    empty
    [    0.000000]   Normal   empty
    [    0.000000] Movable zone start for each node
    [    0.000000] Early memory node ranges
    [    0.000000]   node   0: [mem 0x0000000080000000-0x000000009c7fffff]
    [    0.000000]   node   0: [mem 0x000000009c800000-0x000000009e6fffff]
    [    0.000000]   node   0: [mem 0x000000009e700000-0x000000009e77ffff]
    [    0.000000]   node   0: [mem 0x000000009e780000-0x000000009fffffff]
    [    0.000000]   node   0: [mem 0x00000000a0000000-0x00000000ffffffff]
    [    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000000ffffffff]
    [    0.000000] cma: Reserved 512 MiB at 0x00000000dd000000
    [    0.000000] psci: probing for conduit method from DT.
    [    0.000000] psci: PSCIv1.1 detected in firmware.
    [    0.000000] psci: Using standard PSCI v0.2 function IDs
    [    0.000000] psci: Trusted OS migration not required
    [    0.000000] psci: SMC Calling Convention v1.2
    [    0.000000] percpu: Embedded 22 pages/cpu s50008 r8192 d31912 u90112
    [    0.000000] Detected VIPT I-cache on CPU0
    [    0.000000] CPU features: detected: ARM erratum 845719
    [    0.000000] CPU features: detected: GIC system register CPU interface
    [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 516096
    [    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 root=PARTUUID=3631c5a0-02 rw rootfstype=ext4 rootwait
    [    0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
    [    0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
    [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
    [    0.000000] Memory: 1456352K/2097152K available (10880K kernel code, 1148K rwdata, 4212K rodata, 1792K init, 432K bss, 116512K reserved, 524288K cma-reserved)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
    [    0.000000] rcu: Preemptible hierarchical RCU implementation.
    [    0.000000] rcu: 	RCU event tracing is enabled.
    [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
    [    0.000000] 	Trampoline variant of Tasks RCU enabled.
    [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
    [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
    [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
    [    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
    [    0.000000] GICv3: 256 SPIs implemented
    [    0.000000] GICv3: 0 Extended SPIs implemented
    [    0.000000] GICv3: Distributor has no Range Selector support
    [    0.000000] GICv3: 16 PPIs implemented
    [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001880000
    [    0.000000] ITS [mem 0x01820000-0x0182ffff]
    [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
    [    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
    [    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @80800000 (flat, esz 8, psz 64K, shr 0)
    [    0.000000] ITS: using cache flushing for cmd queue
    [    0.000000] GICv3: using LPI property table @0x0000000080030000
    [    0.000000] GIC: using cache flushing for LPI property table
    [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000080040000
    [    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
    [    0.000004] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
    [    0.008525] Console: colour dummy device 80x25
    [    0.013116] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
    [    0.023799] pid_max: default: 32768 minimum: 301
    [    0.028606] LSM: Security Framework initializing
    [    0.033392] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
    [    0.040972] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
    [    0.050740] rcu: Hierarchical SRCU implementation.
    [    0.055927] Platform MSI: msi-controller@1820000 domain created
    [    0.062248] PCI/MSI: /bus@f0000/interrupt-controller@1800000/msi-controller@1820000 domain created
    [    0.071503] EFI services will not be available.
    [    0.076428] smp: Bringing up secondary CPUs ...
    I/TC: Secondary CPU 1 initializing
    I/TC: Secondary CPU 1 switching to normal world boot
    I/TC: Secondary CPU 2 initializing
    I/TC: Secondary CPU 2 switching to normal world boot
    I/TC: Secondary CPU 3 initializing
    I/TC: Secondary CPU 3 switching to normal world boot
    [    0.089711] Detected VIPT I-cache on CPU1
    [    0.089748] GICv3: CPU1: found redistributor 1 region 0:0x00000000018a0000
    [    0.089763] GICv3: CPU1: using allocated LPI pending table @0x0000000080050000
    [    0.089824] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
    [    0.098483] Detected VIPT I-cache on CPU2
    [    0.098507] GICv3: CPU2: found redistributor 2 region 0:0x00000000018c0000
    [    0.098518] GICv3: CPU2: using allocated LPI pending table @0x0000000080060000
    [    0.098555] CPU2: Booted secondary processor 0x0000000002 [0x410fd034]
    [    0.107179] Detected VIPT I-cache on CPU3
    [    0.107200] GICv3: CPU3: found redistributor 3 region 0:0x00000000018e0000
    [    0.107210] GICv3: CPU3: using allocated LPI pending table @0x0000000080070000
    [    0.107246] CPU3: Booted secondary processor 0x0000000003 [0x410fd034]
    [    0.107318] smp: Brought up 1 node, 4 CPUs
    [    0.187035] SMP: Total of 4 processors activated.
    [    0.191849] CPU features: detected: 32-bit EL0 Support
    [    0.197115] CPU features: detected: CRC32 instructions
    [    0.209796] CPU: All CPU(s) started at EL2
    [    0.214003] alternatives: patching kernel code
    [    0.219714] devtmpfs: initialized
    [    0.230029] KASLR disabled due to lack of seed
    [    0.234790] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
    [    0.244769] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
    [    0.266158] pinctrl core: initialized pinctrl subsystem
    [    0.272197] DMI not present or invalid.
    [    0.276807] NET: Registered protocol family 16
    [    0.283021] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations
    [    0.290362] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
    [    0.298432] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
    [    0.307183] thermal_sys: Registered thermal governor 'step_wise'
    [    0.307188] thermal_sys: Registered thermal governor 'power_allocator'
    [    0.313918] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
    [    0.327638] ASID allocator initialised with 65536 entries
    [    0.358207] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
    [    0.365088] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
    [    0.371951] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
    [    0.378802] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
    [    0.386690] cryptd: max_cpu_qlen set to 1000
    [    0.393896] k3-chipinfo 43000014.chipid: Family:AM62X rev:SR1.0 JTAGID[0x0bb7e02f] Detected
    [    0.403011] vcc_5v0: supplied by vmain_pd
    [    0.407513] vcc_3v3_sys: supplied by vmain_pd
    [    0.412399] vcc_1v8: supplied by vcc_3v3_sys
    [    0.417775] iommu: Default domain type: Translated 
    [    0.423108] SCSI subsystem initialized
    [    0.427355] mc: Linux media interface: v0.10
    [    0.431747] videodev: Linux video capture interface: v2.00
    [    0.437426] pps_core: LinuxPPS API ver. 1 registered
    [    0.442501] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.451850] PTP clock support registered
    [    0.455889] EDAC MC: Ver: 3.0.0
    [    0.459770] omap-mailbox 29000000.mailbox: omap mailbox rev 0x66fc9100
    [    0.466939] FPGA manager framework
    [    0.470513] Advanced Linux Sound Architecture Driver Initialized.
    [    0.477685] clocksource: Switched to clocksource arch_sys_counter
    [    0.484141] VFS: Disk quotas dquot_6.6.0
    [    0.488208] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    [    0.500676] NET: Registered protocol family 2
    [    0.505417] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
    [    0.514150] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)
    [    0.522942] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
    [    0.531145] TCP bind hash table entries: 16384 (order: 6, 262144 bytes, linear)
    [    0.538870] TCP: Hash tables configured (established 16384 bind 16384)
    [    0.545781] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
    [    0.552673] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
    [    0.560157] NET: Registered protocol family 1
    [    0.565107] RPC: Registered named UNIX socket transport module.
    [    0.571183] RPC: Registered udp transport module.
    [    0.576017] RPC: Registered tcp transport module.
    [    0.580831] RPC: Registered tcp NFSv4.1 backchannel transport module.
    [    0.587425] PCI: CLS 0 bytes, default 64
    [    0.592288] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
    [    0.604402] Initialise system trusted keyrings
    [    0.609187] workingset: timestamp_bits=46 max_order=19 bucket_order=0
    [    0.619588] squashfs: version 4.0 (2009/01/31) Phillip Lougher
    [    0.626173] NFS: Registering the id_resolver key type
    [    0.631390] Key type id_resolver registered
    [    0.635667] Key type id_legacy registered
    [    0.639826] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
    [    0.646688] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
    [    0.654441] 9p: Installing v9fs 9p2000 file system support
    [    0.695158] Key type asymmetric registered
    [    0.699358] Asymmetric key parser 'x509' registered
    [    0.704384] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
    [    0.711949] io scheduler mq-deadline registered
    [    0.716580] io scheduler kyber registered
    [    0.722791] pinctrl-single 4084000.pinctrl: 34 pins, size 136
    [    0.729130] pinctrl-single f4000.pinctrl: 171 pins, size 684
    [    0.742461] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
    [    0.762613] brd: module loaded
    [    0.772886] loop: module loaded
    [    0.777081] megasas: 07.714.04.00-rc1
    [    0.784550] tun: Universal TUN/TAP device driver, 1.6
    [    0.790308] igbvf: Intel(R) Gigabit Virtual Function Network Driver
    [    0.796732] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
    [    0.802840] sky2: driver version 1.30
    [    0.807563] VFIO - User Level meta-driver version: 0.3
    [    0.813863] i2c /dev entries driver
    [    0.819115] sdhci: Secure Digital Host Controller Interface driver
    [    0.825452] sdhci: Copyright(c) Pierre Ossman
    [    0.830233] sdhci-pltfm: SDHCI platform and OF driver helper
    [    0.837105] ledtrig-cpu: registered to indicate activity on CPUs
    [    0.843595] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
    [    0.851708] optee: probing for conduit method.
    [    0.856296] optee: revision 3.19 (d6c5d003)
    [    0.856576] optee: dynamic shared memory is enabled
    [    0.866252] optee: initialized driver
    [    0.872055] NET: Registered protocol family 17
    [    0.876778] 9pnet: Installing 9P2000 support
    [    0.881223] Key type dns_resolver registered
    [    0.885821] Loading compiled-in X.509 certificates
    [    0.901380] ti-sci 44043000.system-controller: ti,ctx-memory-region is required for suspend but not provided.
    [    0.911553] ti-sci 44043000.system-controller: ti_sci_init_suspend failed, mem suspend will be non-functional.
    [    0.921795] ti-sci 44043000.system-controller: ABI: 3.1 (firmware rev 0x0008 '8.5.3--v08.05.03 (Chill Capybar')
    [    0.988225] davinci-mcasp 2b10000.mcasp: IRQ common not found
    [    0.996579] omap-gpmc 3b000000.memory-controller: GPMC revision 6.0
    [    1.003024] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
    [    1.012260] omap_i2c 20000000.i2c: bus 0 rev0.12 at 400 kHz
    [    1.019940] omap_i2c 20010000.i2c: bus 1 rev0.12 at 100 kHz
    [    1.026259] ti-sci-intr 4210000.interrupt-controller: Interrupt Router 5 domain created
    [    1.034609] ti-sci-intr bus@f0000:interrupt-controller@a00000: Interrupt Router 3 domain created
    [    1.043862] ti-sci-inta 48000000.interrupt-controller: Interrupt Aggregator domain 28 created
    [    1.053337] ti-udma 485c0100.dma-controller: Number of rings: 82
    [    1.061444] ti-udma 485c0100.dma-controller: Channels: 48 (bchan: 18, tchan: 12, rchan: 18)
    [    1.072525] ti-udma 485c0000.dma-controller: Number of rings: 150
    [    1.082547] ti-udma 485c0000.dma-controller: Channels: 35 (tchan: 20, rchan: 15)
    [    1.092718] printk: console [ttyS2] disabled
    [    1.097170] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 27, base_baud = 3000000) is a 8250
    [    1.105938] printk: console [ttyS2] enabled
    [    1.105938] printk: console [ttyS2] enabled
    [    1.114381] printk: bootconsole [ns16550a0] disabled
    [    1.114381] printk: bootconsole [ns16550a0] disabled
    [    1.129233] spi-nor spi0.0: s28hs512t (65536 Kbytes)
    [    1.134256] 7 fixed-partitions partitions found on MTD device fc40000.spi.0
    [    1.141209] Creating 7 MTD partitions on "fc40000.spi.0":
    [    1.146618] 0x000000000000-0x000000080000 : "ospi.tiboot3"
    [    1.153342] 0x000000080000-0x000000280000 : "ospi.tispl"
    [    1.159737] 0x000000280000-0x000000680000 : "ospi.u-boot"
    [    1.166181] 0x000000680000-0x0000006c0000 : "ospi.env"
    [    1.172392] 0x0000006c0000-0x000000700000 : "ospi.env.backup"
    [    1.179147] 0x000000800000-0x000003fc0000 : "ospi.rootfs"
    [    1.185601] 0x000003fc0000-0x000004000000 : "ospi.phypattern"
    [    1.198521] davinci_mdio 8000f00.mdio: Configuring MDIO in manual mode
    [    1.241688] davinci_mdio 8000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
    [    1.251368] davinci_mdio 8000f00.mdio: phy[0]: device 8000f00.mdio:00, driver TI DP83867
    [    1.259474] davinci_mdio 8000f00.mdio: phy[1]: device 8000f00.mdio:01, driver TI DP83867
    [    1.267655] am65-cpsw-nuss 8000000.ethernet: initializing am65 cpsw nuss version 0x6BA01103, cpsw version 0x6BA81103 Ports: 3 quirks:00000002
    [    1.280585] am65-cpsw-nuss 8000000.ethernet: Use random MAC address
    [    1.286856] am65-cpsw-nuss 8000000.ethernet: initialized cpsw ale version 1.5
    [    1.293980] am65-cpsw-nuss 8000000.ethernet: ALE Table size 512
    [    1.300638] am65-cpsw-nuss 8000000.ethernet: CPTS ver 0x4e8a010c, freq:500000000, add_val:1 pps:0
    [    1.313055] rtc-ti-k3 2b1f0000.rtc: registered as rtc0
    [    1.318249] rtc-ti-k3 2b1f0000.rtc: setting system clock to 1970-01-01T00:00:07 UTC (7)
    [    1.430778] mmc0: CQHCI version 5.10
    [    1.432687] davinci-mcasp 2b10000.mcasp: IRQ common not found
    [    1.452506] pca953x 1-0022: supply vcc not found, using dummy regulator
    [    1.459260] pca953x 1-0022: using AI
    [    1.480394] mmc0: SDHCI controller on fa10000.mmc [fa10000.mmc] using ADMA 64-bit
    [    1.489197] sii902x 1-003b: supply iovcc not found, using dummy regulator
    [    1.496164] sii902x 1-003b: supply cvcc12 not found, using dummy regulator
    [    1.505995] i2c i2c-1: Added multiplexed i2c bus 2
    [    1.512914] [drm] Initialized tidss 1.0.0 20180215 for 30200000.dss on minor 0
    [    1.520652] tidss 30200000.dss: [drm] Cannot find any crtc or sizes
    [    1.529579] vdd_mmc1: supplied by vcc_3v3_sys
    [    1.535849] wlan_lten: supplied by vcc_3v3_sys
    [    1.542023] debugfs: Directory 'pd:53' with parent 'pm_genpd' already present!
    [    1.549337] debugfs: Directory 'pd:52' with parent 'pm_genpd' already present!
    [    1.549357] wlan_en: supplied by wlan_lten
    [    1.556800] debugfs: Directory 'pd:51' with parent 'pm_genpd' already present!
    [    1.556906] mmc1: CQHCI version 5.10
    [    1.560891] mmc2: CQHCI version 5.10
    [    1.568244] debugfs: Directory 'pd:182' with parent 'pm_genpd' already present!
    [    1.592264] mmc0: Command Queue Engine enabled
    [    1.594511] ALSA device list:
    [    1.596747] mmc0: new HS200 MMC card at address 0001
    [    1.596773] mmc1: SDHCI controller on fa00000.mmc [fa00000.mmc] using ADMA 64-bit
    [    1.599683]   No soundcards found.
    [    1.605341] mmcblk0: mmc0:0001 S0J56X 14.8 GiB 
    [    1.611403] mmc2: SDHCI controller on fa20000.mmc [fa20000.mmc] using ADMA 64-bit
    [    1.617032] sdhci-am654 fa20000.mmc: card claims to support voltages below defined range
    [    1.620275] mmcblk0boot0: mmc0:0001 S0J56X partition 1 31.5 MiB
    [    1.639449] mmc2: new high speed SDIO card at address 0001
    [    1.641699] mmcblk0boot1: mmc0:0001 S0J56X partition 2 31.5 MiB
    [    1.653036] mmcblk0rpmb: mmc0:0001 S0J56X partition 3 4.00 MiB, chardev (237:0)
    [    1.659264] mmc1: new ultra high speed SDR104 SDHC card at address aaaa
    [    1.665194]  mmcblk0: p1
    [    1.667660] mmcblk1: mmc1:aaaa SL16G 14.8 GiB 
    [    1.679395]  mmcblk1: p1 p2
    [    1.735532] EXT4-fs (mmcblk1p2): recovery complete
    [    1.740988] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
    [    1.749151] VFS: Mounted root (ext4 filesystem) on device 179:98.
    [    1.761334] devtmpfs: mounted
    [    1.765575] Freeing unused kernel memory: 1792K
    [    1.770199] Run /sbin/init as init process
    [    1.938569] systemd[1]: System time before build time, advancing clock.
    [    1.995780] NET: Registered protocol family 10
    [    2.001378] Segment Routing with IPv6
    [    2.026832] systemd[1]: systemd 244.5+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
    [    2.048965] systemd[1]: Detected architecture arm64.
    
    Welcome to Arago 2021.09!
    
    [    2.097462] systemd[1]: Set hostname to <am62xx-evm>.
    [    2.334862] systemd[1]: /lib/systemd/system/startwlansta.service:7: Unknown key name 'After' in section 'Service', ignoring.
    [    2.349886] systemd[1]: /lib/systemd/system/startwlanap.service:7: Unknown key name 'After' in section 'Service', ignoring.
    [    2.390584] systemd[1]: /lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock ? /run/docker.sock; please update the unit file accordingly.
    [    2.493350] random: systemd: uninitialized urandom read (16 bytes read)
    [    2.500320] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
    [    2.512665] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
    [    2.524507] systemd[1]: Created slice system-getty.slice.
    [  OK  ] Created slice system-getty.slice.
    [    2.545959] random: systemd: uninitialized urandom read (16 bytes read)
    [    2.554274] systemd[1]: Created slice system-serial\x2dgetty.slice.
    [  OK  ] Created slice system-serial\x2dgetty.slice.
    [    2.577859] random: systemd: uninitialized urandom read (16 bytes read)
    [    2.585910] systemd[1]: Created slice User and Session Slice.
    [  OK  ] Created slice User and Session Slice.
    [    2.606192] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
    [  OK  ] Started Dispatch Password �ts to Console Directory Watch.
    [    2.629996] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
    [  OK  ] Started Forward Password R�uests to Wall Directory Watch.
    [    2.654085] systemd[1]: Reached target Paths.
    [  OK  ] Reached target Paths.
    [    2.669840] systemd[1]: Reached target Remote File Systems.
    [  OK  ] Reached target Remote File Systems.
    [    2.689801] systemd[1]: Reached target Slices.
    [  OK  ] Reached target Slices.
    [    2.705825] systemd[1]: Reached target Swap.
    [  OK  ] Reached target Swap.
    [    2.730364] systemd[1]: Listening on RPCbind Server Activation Socket.
    [  OK  ] Listening on RPCbind Server Activation Socket.
    [    2.753936] systemd[1]: Reached target RPC Port Mapper.
    [  OK  ] Reached target RPC Port Mapper.
    [    2.781155] systemd[1]: Listening on Process Core Dump Socket.
    [  OK  ] Listening on Process Core Dump Socket.
    [    2.802200] systemd[1]: Listening on initctl Compatibility Named Pipe.
    [  OK  ] Listening on initctl Compatibility Named Pipe.
    [    2.840572] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
    [    2.849455] systemd[1]: Listening on Journal Socket (/dev/log).
    [  OK  ] Listening on Journal Socket (/dev/log).
    [    2.870450] systemd[1]: Listening on Journal Socket.
    [  OK  ] Listening on Journal Socket.
    [    2.896013] systemd[1]: Listening on Network Service Netlink Socket.
    [  OK  ] Listening on Network Service Netlink Socket.
    [    2.918432] systemd[1]: Listening on udev Control Socket.
    [  OK  ] Listening on udev Control Socket.
    [    2.938219] systemd[1]: Listening on udev Kernel Socket.
    [  OK  ] Listening on udev Kernel Socket.
    [    2.962771] systemd[1]: Mounting Huge Pages File System...
             Mounting Huge Pages File System...
    [    2.982587] systemd[1]: Mounting POSIX Message Queue File System...
             Mounting POSIX Message Queue File System...
    [    3.010389] systemd[1]: Mounting Kernel Debug File System...
             Mounting Kernel Debug File System...
    [    3.036315] systemd[1]: Mounting Temporary Directory (/tmp)...
             Mounting Temporary Directory (/tmp)...
    [    3.058848] systemd[1]: Starting Create list of static device nodes for the current kernel...
             Starting Create list of st�odes for the current kernel...
    [    3.090335] systemd[1]: Starting Start psplash boot splash screen...
             Starting Start psplash boot splash screen...
    [    3.119235] systemd[1]: Starting RPC Bind...
             Starting RPC Bind...
    [    3.134353] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
    [    3.149149] systemd[1]: Starting Journal Service...
             Starting Journal Service...
    [    3.173070] systemd[1]: Starting Load Kernel Modules...
             Starting Load Kernel Modules...
    [    3.195407] cryptodev: loading out-of-tree module taints kernel.
    [    3.195664] systemd[1]: Starting Remount Root and Kernel File Systems...
             Starting Remount Root and Kernel File Systems cryptodev: driver 1.10 loaded.
    [0m...
    [    3.224640] EXT4-fs (mmcblk1p2): re-mounted. Opts: (null)
    [    3.227576] systemd[1]: Starting udev Coldplug all Devices...
             Starting udev Coldplug all Devices...
    [    3.252078] systemd[1]: Started RPC Bind.
    [  OK  ] Started RPC Bind.
    [    3.270579] systemd[1]: Started Journal Service.
    [  OK  ] Started Journal Service.
    [  OK  ] Mounted Huge Pages File System.
    [  OK  ] Mounted POSIX Message Queue File System.
    [  OK  ] Mounted Kernel Debug File System.
    [  OK  ] Mounted Temporary Directory (/tmp).
    [  OK  ] Started Create list of sta� nodes for the current kernel.
    [FAILED] Failed to start Start psplash boot splash screen.
    See 'systemctl status psplash-start.service' for details.
    [DEPEND] Dependency failed for Star�progress communication helper.
    [  OK  ] Started Load Kernel Modules.
    [  OK  ] Started Remount Root and Kernel File Systems.
             Mounting Kernel Configuration File System...
    [    3.495051] random: systemd: uninitialized urandom read (16 bytes read)
             Starting Flush Journal to Persistent Storage    3.507594] random: systemd-journal: uninitialized urandom read (16 bytes read)
    0m...
    [    3.523158] systemd-journald[197]: Received client request to flush runtime journal.
    [    3.531251] random: systemd: uninitialized urandom read (16 bytes read)
             Starting Apply Kernel Variables...
             Starting Create Static Device Nodes in /dev...
    [  OK  ] Mounted Kernel Configuration File System.
    [  OK  ] Started Flush Journal to Persistent Storage.
    [  OK  ] Started Apply Kernel Variables.
    [  OK  ] Started Create Static Device Nodes in /dev.
    [  OK  ] Reached target Local File Systems (Pre).
             Mounting /media/ram...
             Mounting /var/volatile...
             Starting udev Kernel Device Manager...
    [  OK  ] Started udev Coldplug all Devices.
    [  OK  ] Mounted /media/ram.
    [  OK  ] Mounted /var/volatile.
             Starting udev Wait for Complete Device Initialization...
             Starting Load/Save Random Seed...
    [  OK  ] Reached target Local File Systems.
             Starting Create Volatile Files and Directories...
    [  OK  ] Started udev Kernel Device Manager.
    [  OK  ] Started Create Volatile Files and Directories.
             Starting Network Time Synchronization...
             Starting Update UTMP about System Boot/Shutdown...
    [  OK  ] Started Update UTMP about System Boot/Shutdown.
    [  OK  ] Started Network Time Synchronization.
    [  OK  ] Reached target System Time Set.
    [  OK  ] Reached target System Time Synchronized.
    [    4.168992] random: crng init done
    [    4.174382] random: 67 urandom warning(s) missed due to ratelimiting
    [  OK  ] Started Load/Save Random Seed.
    [    4.521566] k3-m4-rproc 5000000.m4fss: assigned reserved memory node m4f-dma-memory@9cb00000
    [    4.535769] k3-m4-rproc 5000000.m4fss: configured M4 for remoteproc mode
    [    4.542723] k3-m4-rproc 5000000.m4fss: local reset is deasserted for device
    [    4.550097] remoteproc remoteproc0: 5000000.m4fss is available
    [    4.562802] remoteproc remoteproc0: powering up 5000000.m4fss
    [    4.569015] remoteproc remoteproc0: Booting fw image am62-mcu-m4f0_0-fw, size 92276
    [    4.579684]  remoteproc0#vdev0buffer: assigned reserved memory node m4f-dma-memory@9cb00000
    [    4.588899]  remoteproc0#vdev0buffer: registered virtio0 (type 7)
    [    4.595174] remoteproc remoteproc0: remote processor 5000000.m4fss is now up
    [    4.639096] virtio_rpmsg_bus virtio0: rpmsg host is online
    [    4.644776] virtio_rpmsg_bus virtio0: creating channel ti.ipc4.ping-pong addr 0xd
    [    4.652794] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xe
    [    4.676002] platform 78000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
    [    4.689538] platform 78000000.r5f: configured R5F for IPC-only mode
    [    4.698667] platform 78000000.r5f: assigned reserved memory node r5f-dma-memory@9da00000
    [    4.718818] remoteproc remoteproc1: 78000000.r5f is available
    [    4.743247] remoteproc remoteproc1: attaching to 78000000.r5f
    [    4.751495] platform 78000000.r5f: R5F core initialized in IPC-only mode
    [    4.759906]  remoteproc1#vdev0buffer: assigned reserved memory node r5f-dma-memory@9da00000
    [    4.769279] virtio_rpmsg_bus virtio1: rpmsg host is online
    [    4.775039] virtio_rpmsg_bus virtio1: creating channel ti.ipc4.ping-pong addr 0xd
    [    4.782861] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0xe
    [    4.815766]  remoteproc1#vdev0buffer: registered virtio1 (type 7)
    [    4.826192] remoteproc remoteproc1: remote processor 78000000.r5f is now attached
    [    4.836017] PVR_K:  232: Read BVNC 33.15.11.3 from HW device registers
    [    4.866534] PVR_K:  232: RGX Device registered with BVNC 33.15.11.3
    [    4.902411] [drm] Initialized pvr 1.15.6133109 20170530 for fd00000.gpu on minor 1
    [    5.956028] cdns-csi2rx: probe of 30101000.csi-bridge failed with error -22
    [    5.973571] remoteproc remoteproc2: 30074000.pru is available
    [    5.981287] remoteproc remoteproc3: 30078000.pru is available
             Starting Start psplash boot splash screen...
    [    6.107483] tps6598x 0-003f: Unable to find the interrupt, switching to polling
    [FAILED] Failed to start Start psplash boot splash screen.
    See 'systemctl status psplash-start.service' for details.
    [    6.151994] cfg80211: Loading compiled-in X.509 certificates for regulatory database
    [DEPEND] Dependency failed for Star�progress communication helper.
    [    6.189373] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
    [  OK  ] Reached target Hardware activated USB gadget.
    [  OK  ] Listening on Load/Save RF �itch Status /dev/rfkill Watch.
    [    6.246161] usbcore: registered new interface driver usbfs
    [    6.252229] usbcore: registered new interface driver hub
    [    6.257915] usbcore: registered new device driver usb
    [    6.281171] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller
    [    6.286860] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 1
    [    6.294939] xhci-hcd xhci-hcd.3.auto: hcc params 0x0258fe6d hci version 0x110 quirks 0x0000002000010010
    [    6.304514] xhci-hcd xhci-hcd.3.auto: irq 481, io mem 0x31100000
    [    6.311037] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
    [    6.319466] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [    6.326917] usb usb1: Product: xHCI Host Controller
    [    6.331891] usb usb1: Manufacturer: Linux 5.10.153-g3eee621d16 xhci-hcd
    [    6.338045] wl18xx_driver wl18xx.2.auto: Direct firmware load for ti-connectivity/wl1271-nvs.bin failed with error -2
    [    6.340218] usb usb1: SerialNumber: xhci-hcd.3.auto
    [    6.356109] hub 1-0:1.0: USB hub found
    [  OK  ] Created slice system-systemd\x2dfsc[    6.361907] hub 1-0:1.0: 1 port detected
    k.slice.
    [    6.372037] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller
    [    6.377729] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 2
    [    6.385511] xhci-hcd xhci-hcd.3.auto: Host supports USB 3.0 SuperSpeed
    [    6.392196] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
    [    6.400632] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
    [    6.409838] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
    [    6.417239] usb usb2: Product: xHCI Host Controller
    [    6.422251] usb usb2: Manufacturer: Linux 5.10.153-g3eee621d16 xhci-hcd
    [    6.429011] usb usb2: SerialNumber: xhci-hcd.3.auto
    [    6.435067] hub 2-0:1.0: USB hub found
    [    6.439121] hub 2-0:1.0: config failed, hub doesn't have any ports! (err -19)
    [  OK  ] Found device /dev/mmcblk0p1.
             Starting File System Check on /dev/mmcblk0p1...
    [  OK  ] Found device /dev/mmcblk1p1.
             Starting File System Check on /dev/mmcblk1p1...
    [  OK  ] Started udev Wait for Complete Device Initialization.
    [  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
    [  OK  ] Reached target System Initialization.
    [  OK  ] Started Daily rotation of log files.
    [  OK  ] Started Daily Cleanup of Temporary Directories.
    [  OK  ] Reached target Timers.
    [  OK  ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket.
    [  OK  ] Listening on D-Bus System Message Bus Socket.
             Starting Docker Socket for the API.
    [  OK  ] Listening on dropbear.socket.
             Starting Reboot and dump vmcore via kexec...
    [  OK  ] Listening on Docker Socket for the API.
    [  OK  ] Reached target Sockets.
    [  OK  ] Reached target Basic System.
             Starting Save/Restore Sound Card State...
    [  OK  ] Started Job spooling tools.
    [  OK  ] Started Periodic Command Scheduler.
    [  OK  ] Started D-Bus System Message Bus.
             Starting Print notice about GPLv3 packages...
             Starting IPv6 Packet Filtering Framework...
             Starting IPv4 Packet Filtering Framework...
    [  OK  ] Started irqbalance daemon.
             Starting     6.694415] wlcore: wl18xx HW: 183x or 180x, PG 2.2 (ROM 0x11)
    9mrc.pvr.service...
             Starting startwlanap...
    [    6.711910] wlcore: loaded
             Starting startwlansta...
             Starting Login Service...
    [  OK  ] Started TEE Supplicant.
    [  OK  ] Started File System Check on /dev/mmcblk0p1.
    [  OK  ] Started Reboot and dump vmcore via kexec.
    [  OK  ] Started Save/Restore Sound Card State.
    [  OK  ] Started IPv6 Packet Filtering Framework.
    [  OK  ] Started IPv4 Packet Filtering Framework.
    [  OK  ] Started startwlanap.
    [  OK  ] Started startwlansta.
    [  OK  ] Reached target Network (Pre).
    [  OK  ] Reached target Sound Card.
             Mounting /run/media/mmcblk0p1...
             Starting Network Service...
             Starting Load/Save RF Kill Switch Status...
    [    6.887479] EXT4-fs (mmcblk0p1): mounted filesystem with ordered data mode. Opts: (null)
    [  OK  ] Started Load/Save RF Kill Switch Status.
    [  OK  ] Mounted /run/media/mmcblk0p1.
    [  OK  ] Started File System Check on /dev/mmcblk1p1.
             Mounting /run/media/mmcblk1p1...
    [  OK  ] Mounted /run/media/mmcblk1p1.
    [  OK  ] Started Network Service.
             Starting Wait for Network to be Configured...
             Starting Network Name Resolution...
    [  OK  ] Started Login Service.
    [    7.591817] wlcore: using inverted interrupt logic: 2
    [    7.660606] wlcore: PHY firmware version: Rev 8.2.0.0.245
    [    7.764882] wlcore: firmware booted (Rev 8.9.0.0.86)
    [  OK  ] Started Network Name Resolution.
    [  OK  ] Reached target Network.
    [  OK  ] Reached target Host and Network Name Lookups.
             Starting Avahi mDNS/DNS-SD Stack...
             Starting Enable and configure wl18xx bluetooth stack...
    [  OK  ] Started A description for your custom service goes here.
    [  OK  ] Started NFS status monitor for NFSv2/3 locking..
             Starting /etc/rc.local Compatibility...
    [    7.864904] am65-cpsw-nuss 8000000.ethernet: down msc_sl e0000000 tmo 0
             Starting Simple Network Ma�ent Protocol (SNMP) Daemon....
             Starting Permit User Sessions...
    [  OK  ] Started Permit User Sessions.
    [  OK  ] Started /etc/rc.local Compatibility.
    [  OK  ] Started Getty on tty1.
    [  OK  ] Started Serial Getty on ttyS2.
    [  OK  ] Reached target Login Prompts.
             Starting Synchronize System and HW clocks...
    [    7.914518] startwlansta.sh[829]: Wi-Fi user configuration file missing, exit
    [  OK  ] Started Enable an[    8.012022] am65-cpsw-nuss 8000000.ethernet: set new flow-id-base 19
    d configure wl18xx bluetooth stack.
    [  OK  ] Started Avahi mDNS/DNS-SD Stack.
    [    8.092635] am65-cpsw-nuss 8000000.ethernet eth1: PHY [8000f00.mdio:01] driver [TI DP83867] (irq=POLL)
    [  OK  ] Started rc.pvr.service.
             Starting weston.service...
    [    8.145808] am65-cpsw-nuss 8000000.ethernet eth1: configuring for phy/rgmii-rxid link mode
    [    8.221897] am65-cpsw-nuss 8000000.ethernet: down msc_sl e0000000 tmo 0
    [    8.258685] am65-cpsw-nuss 8000000.ethernet eth0: PHY [8000f00.mdio:00] driver [TI DP83867] (irq=POLL)
    [    8.270871] am65-cpsw-nuss 8000000.ethernet eth0: configuring for phy/rgmii-rxid link mode
    [    8.236085] startwlanap.sh[932]: adding wlan1 interface
    [  OK  ] Started Synchronize System and HW clocks.
    [    8.367937] startwlanap.sh[936]: Configuration file: /usr/share/wl18xx/hostapd.conf
    [    8.468056] wlcore: down
    [    8.392868] startwlanap.sh[936]: wlan1: interface state UNINITIALIZED->COUNTRY_UPDATE
    [    8.470432] startwlanap.sh[936]: Using interface wlan1 with hwaddr 3c:e4:b0:73:da:e2 and ssid "AM62xSK-AP_b073da"
    [    8.583706] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
    [    8.520117] startwlanap.sh[936]: wlan1: interface state COUNTRY_UPDATE->ENABLED
    [    8.520550] startwlanap.sh[936]: wlan1: AP-ENABLED
    [  OK  ] Started Simple Network Man�ement Protocol (SNMP) Daemon..
    ***************************************************************
    ***************************************************************
    NOTICE: This file system contains the following GPLv3 packages:
    	autoconf
    	bash-dev
    	bash
    	bc
    	binutils
    	cifs-utils
    	coreutils-stdbuf
    	coreutils
    	cpio
    	cpp-symlinks
    	cpp
    	dosfstools
    	elfutils
    	g++-symlinks
    	g++
    	gawk
    	gcc-symlinks
    	gcc
    	gdb
    	gdbserver
    	gettext
    	glmark2
    	gstreamer1.0-libav
    	gzip
    	hidapi
    	less
    	libasm1
    	libbfd
    	libdw1
    	libelf1
    	libgdbm-compat4
    	libgdbm-dev
    	libgdbm6
    	libgettextlib
    	libgettextsrc
    	libgmp10
    	libidn2-0
    	libmpc3
    	libmpfr6
    	libreadline-dev
    	libreadline8
    	libunistring2
    	m4-dev
    	m4
    	make
    	nettle
    	parted
    	tar
    	which
    
    If you do not wish to distribute GPLv3 components please remove
    the above packages prior to distribution.  This can be done using
    the opkg remove command.  i.e.:
        opkg remove <package>
    Where <package> is the name printed in the list above
    
    NOTE: If the package is a dependency of another package you
          will be notified of the dependent packages.  You should
          use the --force-removal-of-dependent-packages option to
          also remove the dependent packages as well
    ***************************************************************
    ***************************************************************
    [  OK  ] Started Print notice about GPLv3 packages.
    [  OK  ] Started weston.service.
             Starting telnetd.service...
    [  OK  ] Started telnetd.service.
             Starting hmi_demo.service...
             Starting LSB: Expand Rootfs of boot device...
    [  OK  ] Started LSB: Expand Rootfs of boot device.
    [   11.615291] PVR_K:  1110: RGX Firmware image 'rgx.fw.33.15.11.3' loaded
    [   11.639578] PVR_K:  1110: Shader binary image 'rgx.sh.33.15.11.3' loaded
    [  OK  ] Started hmi_demo.service.
             Starting start_camera_demo.service...
             Stopping hmi_demo.service...
    [  OK  ] Stopped hmi_demo.service.
    [   12.378474] am65-cpsw-nuss 8000000.ethernet eth0: Link is Up - 1Gbps/Full - flow control off
    [   12.386968] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
    
     _____                    _____           _         _   
    |  _  |___ ___ ___ ___   |  _  |___ ___  |_|___ ___| |_ 
    |     |  _| .'| . | . |  |   __|  _| . | | | -_|  _|  _|
    |__|__|_| |__,|_  |___|  |__|  |_| |___|_| |___|___|_|  
                  |___|                    |___|            
    
    Arago Project am62xx-evm ttyS2
    
    Arago 2021.09 am62xx-evm ttyS2
    
    am62xx-evm login: 
    am62xx-evm login: root
    root@am62xx-evm:~# rpmsg_char_simple -r 9 -n 10000
    Created endpt device rpmsg-char-9-1295, fd = 3 port = 1024
    Exchanging 10000 messages with rpmsg device ti.ipc4.ping-pong on rproc id 9 ...
    
    Sending message #0: hello there 0!
    Receiving message #0: hello there 0!
    Sending message #1: hello there 1!
    Receiving message #1: hello there 1!
    Sending message #2: hello there 2!
    Receiving message #2: hello there 2!
    Sending message #3: hello there 3!
    Receiving message #3: hello there 3!
    Sending message #4: hello there 4!
    Receiving message #4: hello there 4!
    Sending message #5: hello there 5!
    Receiving message #5: hello there 5!
    Sending message #6: hello there 6!
    Receiving message #6: hello there 6!
    Sending message #7: hello there 7!
    Receiving message #7: hello there 7!
    Sending message #8: hello there 8!
    Receiving message #8: hello there 8!
    Sending message #9: hello there 9!
    Receiving message #9: hello there 9!
    Sending message #10: hello there 10!
    Receiving message #10: hello there 10!
    Sending message #11: hello there 11!
    Receiving message #11: hello there 11!
    Sending message #12: hello there 12!
    Receiving message #12: hello there 12!
    Sending message #13: hello there 13!
    Receiving message #13: hello there 13!
    Sending message #14: hello there 14!
    Receiving message #14: hello there 14!
    Sending message #15: hello there 15!
    Receiving message #15: hello there 15!
    Sending message #16: hello there 16!
    Receiving message #16: hello there 16!
    Sending message #17: hello there 17!
    Receiving message #17: hello there 17!
    Sending message #18: hello there 18!
    Receiving message #18: hello there 18!
    Sending message #19: hello there 19!
    Receiving message #19: hello there 19!
    Sending message #20: hello there 20!
    Receiving message #20: hello there 20!
    Sending message #21: hello there 21!
    Receiving message #21: hello there 21!
    Sending message #22: hello there 22!
    Receiving message #22: hello there 22!
    Sending message #23: hello there 23!
    Receiving message #23: hello there 23!
    Sending message #24: hello there 24!
    Receiving message #24: hello there 24!
    Sending message #25: hello there 25!
    Receiving message #25: hello there 25!
    Sending message #26: hello there 26!
    Receiving message #26: hello there 26!
    Sending message #27: hello there 27!
    Receiving message #27: hello there 27!
    Sending message #28: hello there 28!
    Receiving message #28: hello there 28!
    Sending message #29: hello there 29!
    Receiving message #29: hello there 29!
    Sending message #30: hello there 30!
    Receiving message #30: hello there 30!
    Sending message #31: hello there 31!
    Receiving message #31: hello there 31!
    Sending message #32: hello there 32!
    Receiving message #32: hello there 32!
    Sending message #33: hello there 33!
    Receiving message #33: hello there 33!
    Sending message #34: hello there 34!
    Receiving message #34: hello there 34!
    Sending message #35: hello there 35!
    Receiving message #35: hello there 35!
    Sending message #36: hello there 36!
    Receiving message #36: hello there 36!
    Sending message #37: hello there 37!
    Receiving message #37: hello there 37!
    Sending message #38: hello there 38!
    Receiving message #38: hello there 38!
    Sending message #39: hello there 39!
    Receiving message #39: hello there 39!
    Sending message #40: hello there 40!
    Receiving message #40: hello there 40!
    Sending message #41: hello there 41!
    Receiving message #41: hello there 41!
    Sending message #42: hello there 42!
    Receiving message #42: hello there 42!
    Sending message #43: hello there 43!
    Receiving message #43: hello there 43!
    Sending message #44: hello there 44!
    Receiving message #44: hello there 44!
    Sending message #45: hello there 45!
    Receiving message #45: hello there 45!
    Sending message #46: hello there 46!
    Receiving message #46: hello there 46!
    Sending message #47: hello there 47!
    Receiving message #47: hello there 47!
    Sending message #48: hello there 48!
    Receiving message #48: hello there 48!
    Sending message #49: hello there 49!
    Receiving message #49: hello there 49!
    Sending message #50: hello there 50!
    Receiving message #50: hello there 50!
    Sending message #51: hello there 51!
    Receiving message #51: hello there 51!
    Sending message #52: hello there 52!
    Receiving message #52: hello there 52!
    Sending message #53: hello there 53!
    Receiving message #53: hello there 53!
    Sending message #54: hello there 54!
    Receiving message #54: hello there 54!
    Sending message #55: hello there 55!
    Receiving message #55: hello there 55!
    Sending message #56: hello there 56!
    Receiving message #56: hello there 56!
    Sending message #57: hello there 57!
    Receiving message #57: hello there 57!
    Sending message #58: hello there 58!
    Receiving message #58: hello there 58!
    Sending message #59: hello there 59!
    Receiving message #59: hello there 59!
    Sending message #60: hello there 60!
    Receiving message #60: hello there 60!
    Sending message #61: hello there 61!
    Receiving message #61: hello there 61!
    Sending message #62: hello there 62!
    Receiving message #62: hello there 62!
    Sending message #63: hello there 63!
    Receiving message #63: hello there 63!
    Sending message #64: hello there 64!
    Receiving message #64: hello there 64!
    Sending message #65: hello there 65!
    Receiving message #65: hello there 65!
    Sending message #66: hello there 66!
    Receiving message #66: hello there 66!
    Sending message #67: hello there 67!
    Receiving message #67: hello there 67!
    Sending message #68: hello there 68!
    Receiving message #68: hello there 68!
    Sending message #69: hello there 69!
    Receiving message #69: hello there 69!
    Sending message #70: hello there 70!
    Receiving message #70: hello there 70!
    Sending message #71: hello there 71!
    Receiving message #71: hello there 71!
    Sending message #72: hello there 72!
    Receiving message #72: hello there 72!
    Sending message #73: hello there 73!
    Receiving message #73: hello there 73!
    Sending message #74: hello there 74!
    Receiving message #74: hello there 74!
    Sending message #75: hello there 75!
    Receiving message #75: hello there 75!
    Sending message #76: hello there 76!
    Receiving message #76: hello there 76!
    Sending message #77: hello there 77!
    Receiving message #77: hello there 77!
    Sending message #78: hello there 78!
    Receiving message #78: hello there 78!
    Sending message #79: hello there 79!
    Receiving message #79: hello there 79!
    Sending message #80: hello there 80!
    Receiving message #80: hello there 80!
    Sending message #81: hello there 81!
    Receiving message #81: hello there 81!
    Sending message #82: hello there 82!
    Receiving message #82: hello there 82!
    Sending message #83: hello there 83!
    Receiving message #83: hello there 83!
    Sending message #84: hello there 84!
    Receiving message #84: hello there 84!
    Sending message #85: hello there 85!
    Receiving message #85: hello there 85!
    Sending message #86: hello there 86!
    Receiving message #86: hello there 86!
    Sending message #87: hello there 87!
    Receiving message #87: hello there 87!
    Sending message #88: hello there 88!
    Receiving message #88: hello there 88!
    Sending message #89: hello there 89!
    Receiving message #89: hello there 89!
    Sending message #90: hello there 90!
    Receiving message #90: hello there 90!
    Sending message #91: hello there 91!
    Receiving message #91: hello there 91!
    Sending message #92: hello there 92!
    Receiving message #92: hello there 92!
    Sending message #93: hello there 93!
    Receiving message #93: hello there 93!
    Sending message #94: hello there 94!
    Receiving message #94: hello there 94!
    Sending message #95: hello there 95!
    Receiving message #95: hello there 95!
    Sending message #96: hello there 96!
    Receiving message #96: hello there 96!
    Sending message #97: hello there 97!
    Receiving message #97: hello there 97!
    Sending message #98: hello there 98!
    Receiving message #98: hello there 98!
    Sending message #99: hello there 99!
    Receiving message #99: hello there 99!
    Sending message #100: hello there 100!
    Receiving message #100: hello there 100!
    Sending message #101: hello there 101!
    Receiving message #101: hello there 101!
    Sending message #102: hello there 102!
    Receiving message #102: hello there 102!
    Sending message #103: hello there 103!
    Receiving message #103: hello there 103!
    Sending message #104: hello there 104!
    Receiving message #104: hello there 104!
    Sending message #105: hello there 105!
    Receiving message #105: hello there 105!
    Sending message #106: hello there 106!
    Receiving message #106: hello there 106!
    Sending message #107: hello there 107!
    Receiving message #107: hello there 107!
    Sending message #108: hello there 108!
    Receiving message #108: hello there 108!
    Sending message #109: hello there 109!
    Receiving message #109: hello there 109!
    Sending message #110: hello there 110!
    Receiving message #110: hello there 110!
    Sending message #111: hello there 111!
    Receiving message #111: hello there 111!
    Sending message #112: hello there 112!
    Receiving message #112: hello there 112!
    Sending message #113: hello there 113!
    Receiving message #113: hello there 113!
    Sending message #114: hello there 114!
    Receiving message #114: hello there 114!
    Sending message #115: hello there 115!
    Receiving message #115: hello there 115!
    Sending message #116: hello there 116!
    Receiving message #116: hello there 116!
    Sending message #117: hello there 117!
    Receiving message #117: hello there 117!
    Sending message #118: hello there 118!
    Receiving message #118: hello there 118!
    Sending message #119: hello there 119!
    Receiving message #119: hello there 119!
    Sending message #120: hello there 120!
    Receiving message #120: hello there 120!
    Sending message #121: hello there 121!
    Receiving message #121: hello there 121!
    Sending message #122: hello there 122!
    Receiving message #122: hello there 122!
    Sending message #123: hello there 123!
    Receiving message #123: hello there 123!
    Sending message #124: hello there 124!
    Receiving message #124: hello there 124!
    Sending message #125: hello there 125!
    Receiving message #125: hello there 125!
    Sending message #126: hello there 126!
    Receiving message #126: hello there 126!
    Sending message #127: hello there 127!
    Receiving message #127: hello there 127!
    Sending message #128: hello there 128!
    Receiving message #128: hello there 128!
    Sending message #129: hello there 129!
    Receiving message #129: hello there 129!
    Sending message #130: hello there 130!
    Receiving message #130: hello there 130!
    Sending message #131: hello there 131!
    Receiving message #131: hello there 131!
    Sending message #132: hello there 132!
    Receiving message #132: hello there 132!
    Sending message #133: hello there 133!
    Receiving message #133: hello there 133!
    Sending message #134: hello there 134!
    Receiving message #134: hello there 134!
    Sending message #135: hello there 135!
    Receiving message #135: hello there 135!
    Sending message #136: hello there 136!
    Receiving message #136: hello there 136!
    Sending message #137: hello there 137!
    Receiving message #137: hello there 137!
    Sending message #138: hello there 138!
    Receiving message #138: hello there 138!
    Sending message #139: hello there 139!
    Receiving message #139: hello there 139!
    Sending message #140: hello there 140!
    Receiving message #140: hello there 140!
    Sending message #141: hello there 141!
    Receiving message #141: hello there 141!
    Sending message #142: hello there 142!
    Receiving message #142: hello there 142!
    Sending message #143: hello there 143!
    Receiving message #143: hello there 143!
    Sending message #144: hello there 144!
    Receiving message #144: hello there 144!
    Sending message #145: hello there 145!
    Receiving message #145: hello there 145!
    Sending message #146: hello there 146!
    Receiving message #146: hello there 146!
    Sending message #147: hello there 147!
    Receiving message #147: hello there 147!
    Sending message #148: hello there 148!
    Receiving message #148: hello there 148!
    Sending message #149: hello there 149!
    Receiving message #149: hello there 149!
    Sending message #150: hello there 150!
    Receiving message #150: hello there 150!
    Sending message #151: hello there 151!
    Receiving message #151: hello there 151!
    Sending message #152: hello there 152!
    Receiving message #152: hello there 152!
    Sending message #153: hello there 153!
    Receiving message #153: hello there 153!
    Sending message #154: hello there 154!
    Receiving message #154: hello there 154!
    Sending message #155: hello there 155!
    Receiving message #155: hello there 155!
    Sending message #156: hello there 156!
    Receiving message #156: hello there 156!
    Sending message #157: hello there 157!
    Receiving message #157: hello there 157!
    Sending message #158: hello there 158!
    Receiving message #158: hello there 158!
    Sending message #159: hello there 159!
    Receiving message #159: hello there 159!
    Sending message #160: hello there 160!
    Receiving message #160: hello there 160!
    Sending message #161: hello there 161!
    Receiving message #161: hello there 161!
    Sending message #162: hello there 162!
    Receiving message #162: hello there 162!
    Sending message #163: hello there 163!
    Receiving message #163: hello there 163!
    Sending message #164: hello there 164!
    Receiving message #164: hello there 164!
    Sending message #165: hello there 165!
    Receiving message #165: hello there 165!
    Sending message #166: hello there 166!
    Receiving message #166: hello there 166!
    Sending message #167: hello there 167!
    Receiving message #167: hello there 167!
    Sending message #168: hello there 168!
    Receiving message #168: hello there 168!
    Sending message #169: hello there 169!
    Receiving message #169: hello there 169!
    Sending message #170: hello there 170!
    Receiving message #170: hello there 170!
    Sending message #171: hello there 171!
    Receiving message #171: hello there 171!
    Sending message #172: hello there 172!
    Receiving message #172: hello there 172!
    Sending message #173: hello there 173!
    Receiving message #173: hello there 173!
    Sending message #174: hello there 174!
    Receiving message #174: hello there 174!
    Sending message #175: hello there 175!
    Receiving message #175: hello there 175!
    Sending message #176: hello there 176!
    Receiving message #176: hello there 176!
    Sending message #177: hello there 177!
    Receiving message #177: hello there 177!
    Sending message #178: hello there 178!
    Receiving message #178: hello there 178!
    Sending message #179: hello there 179!
    Receiving message #179: hello there 179!
    Sending message #180: hello there 180!
    Receiving message #180: hello there 180!
    Sending message #181: hello there 181!
    Receiving message #181: hello there 181!
    Sending message #182: hello there 182!
    Receiving message #182: hello there 182!
    Sending message #183: hello there 183!
    Receiving message #183: hello there 183!
    Sending message #184: hello there 184!
    Receiving message #184: hello there 184!
    Sending message #185: hello there 185!
    Receiving message #185: hello there 185!
    Sending message #186: hello there 186!
    Receiving message #186: hello there 186!
    Sending message #187: hello there 187!
    Receiving message #187: hello there 187!
    Sending message #188: hello there 188!
    Receiving message #188: hello there 188!
    Sending message #189: hello there 189!
    Receiving message #189: hello there 189!
    Sending message #190: hello there 190!
    Receiving message #190: hello there 190!
    Sending message #191: hello there 191!
    Receiving message #191: hello there 191!
    Sending message #192: hello there 192!
    Receiving message #192: hello there 192!
    Sending message #193: hello there 193!
    Receiving message #193: hello there 193!
    Sending message #194: hello there 194!
    Receiving message #194: hello there 194!
    Sending message #195: hello there 195!
    Receiving message #195: hello there 195!
    Sending message #196: hello there 196!
    Receiving message #196: hello there 196!
    Sending message #197: hello there 197!
    Receiving message #197: hello there 197!
    Sending message #198: hello there 198!
    Receiving message #198: hello there 198!
    Sending message #199: hello there 199!
    Receiving message #199: hello there 199!
    Sending message #200: hello there 200!
    Receiving message #200: hello there 200!
    Sending message #201: hello there 201!
    Receiving message #201: hello there 201!
    Sending message #202: hello there 202!
    Receiving message #202: hello there 202!
    Sending message #203: hello there 203!
    Receiving message #203: hello there 203!
    Sending message #204: hello there 204!
    Receiving message #204: hello there 204!
    Sending message #205: hello there 205!
    Receiving message #205: hello there 205!
    Sending message #206: hello there 206!
    Receiving message #206: hello there 206!
    Sending message #207: hello there 207!
    Receiving message #207: hello there 207!
    Sending message #208: hello there 208!
    Receiving message #208: hello there 208!
    Sending message #209: hello there 209!
    Receiving message #209: hello there 209!
    Sending message #210: hello there 210!
    Receiving message #210: hello there 210!
    Sending message #211: hello there 211!
    Receiving message #211: hello there 211!
    Sending message #212: hello there 212!
    Receiving message #212: hello there 212!
    Sending message #213: hello there 213!
    Receiving message #213: hello there 213!
    Sending message #214: hello there 214!
    Receiving message #214: hello there 214!
    Sending message #215: hello there 215!
    Receiving message #215: hello there 215!
    Sending message #216: hello there 216!
    Receiving message #216: hello there 216!
    Sending message #217: hello there 217!
    Receiving message #217: hello there 217!
    Sending message #218: hello there 218!
    Receiving message #218: hello there 218!
    Sending message #219: hello there 219!
    Receiving message #219: hello there 219!
    Sending message #220: hello there 220!
    Receiving message #220: hello there 220!
    Sending message #221: hello there 221!
    Receiving message #221: hello there 221!
    Sending message #222: hello there 222!
    Receiving message #222: hello there 222!
    Sending message #223: hello there 223!
    Receiving message #223: hello there 223!
    Sending message #224: hello there 224!
    Receiving message #224: hello there 224!
    Sending message #225: hello there 225!
    Receiving message #225: hello there 225!
    Sending message #226: hello there 226!
    Receiving message #226: hello there 226!
    Sending message #227: hello there 227!
    Receiving message #227: hello there 227!
    Sending message #228: hello there 228!
    Receiving message #228: hello there 228!
    Sending message #229: hello there 229!
    Receiving message #229: hello there 229!
    Sending message #230: hello there 230!
    Receiving message #230: hello there 230!
    Sending message #231: hello there 231!
    Receiving message #231: hello there 231!
    Sending message #232: hello there 232!
    Receiving message #232: hello there 232!
    Sending message #233: hello there 233!
    Receiving message #233: hello there 233!
    Sending message #234: hello there 234!
    Receiving message #234: hello there 234!
    Sending message #235: hello there 235!
    Receiving message #235: hello there 235!
    Sending message #236: hello there 236!
    Receiving message #236: hello there 236!
    Sending message #237: hello there 237!
    Receiving message #237: hello there 237!
    Sending message #238: hello there 238!
    Receiving message #238: hello there 238!
    Sending message #239: hello there 239!
    Receiving message #239: hello there 239!
    Sending message #240: hello there 240!
    Receiving message #240: hello there 240!
    Sending message #241: hello there 241!
    Receiving message #241: hello there 241!
    Sending message #242: hello there 242!
    Receiving message #242: hello there 242!
    Sending message #243: hello there 243!
    Receiving message #243: hello there 243!
    Sending message #244: hello there 244!
    Receiving message #244: hello there 244!
    Sending message #245: hello there 245!
    Receiving message #245: hello there 245!
    Sending message #246: hello there 246!
    Receiving message #246: hello there 246!
    Sending message #247: hello there 247!
    Receiving message #247: hello there 247!
    Sending message #248: hello there 248!
    Receiving message #248: hello there 248!
    Sending message #249: hello there 249!
    Receiving message #249: hello there 249!
    Sending message #250: hello there 250!
    Receiving message #250: hello there 250!
    Sending message #251: hello there 251!
    Receiving message #251: hello there 251!
    Sending message #252: hello there 252!
    Receiving message #252: hello there 252!
    Sending message #253: hello there 253!
    Receiving message #253: hello there 253!
    Sending message #254: hello there 254!
    Receiving message #254: hello there 254!
    Sending message #255: hello there 255!
    Receiving message #255: hello there 255!
    Sending message #256: hello there 256!
    Receiving message #256: hello there 256!
    Sending message #257: hello there 257!
    Receiving message #257: hello there 257!
    Sending message #258: hello there 258!
    Receiving message #258: hello there 258!
    Sending message #259: hello there 259!
    

    Please help us with this issue.

    Note: We can also debug this directly on our customized board if we can get on a call. I request you arrange a call or tell us the available timing to arrange one so we can debug this on the customized board directly.

    Thanks and Regards,

    Aneesh

  • Hello Aneesh,

    Thanks for your input.

    Let's discuss at 3:00 PM IST today.

    Please let me know if it works for you.

    Regards,

    S.Anil.

  • Hi Anil,

    The proposed time works with me. Can you please schedule the call?

    Regards,

    Aneesh

  • Hello Aneesh,

    Regards,

    S.Anil.

  • Hi Anil, 

    Thank you for the link, I will join the meeting at 3 pm along with my other colleagues.

    Regards,

    Aneesh

  • Hello Aneesh,

    I have posted your issue to Linux experts and asked them to help debug it further on the Linux side.

    I will post his availability, and based on that, we can have one more debug call. Since the issue mostly belongs to the Linux side and I am not an expert on Linux, So, we can take help from Linux experts as well.

    Regards,

    S.Anil.

  • Sure, Thanks anil . Then I am not joining now.

  • Hello Aneesh,

    Yes, now we don't need to connect.

    I will inform you based on the availability of Linux experts.

    Regards,

    S.Anil.

  • Hello Aneesh,

    Have you connected to the M4F core with CCS to see what the M4F code is doing when it is in a "stuck" state? I am not seeing any Linux error codes, etc that give any Linux-side information.

    Reference this e2e FAQ:
    https://e2e.ti.com/support/processors-group/processors/f/processors-forum/1188177/faq-am62x-am64x-how-to-use-ccs-to-debug-a-running-m4f-core-that-was-started-by-linux

    Regards,

    Nick

  • Hi Nick, 

    I will try that, I have some problems with my setup right now.

    As this is happening on the EVM. Can you please try to reproduce the issue on your side and provide the fix as soon as possible?

    In the mean time, I will try to debug using CCS once my setup is back.

    Note: Please consider this issue as an urgent topic because currently, we are stuck because of this issue.

    Thanks and Regards,

    Aneesh

  • Hi Nick,

    I trying with the on-chip debugger using the UART cable on EVM. When i load and runt the ipc.out file i am only getting below 

    [IPC RPMSG ECHO] Version: REL.MCUSDK.08.06.00.12 (May 19 2023 11:31:13):

    instead of 

    [IPC RPMSG ECHO] Version: REL.MCUSDK.08.06.00.12 (May 19 2023 11:31:13):
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 13 ... !!!
    [IPC RPMSG ECHO] Remote Core waiting for messages at end point 14 ... !!!

    Because of this i am not able to runt the rpmsg example on linux and cannot debug this. 

    As i have requested you yesterday test on your side. If you have tested , Could you please update your experiment results. 

    Thanks and Regards,

    Aneesh

  • We dont have the actual physical debugger with us.

    Regards,

    Aneesh

  • Hi Nick, 

    I am able to debug the ipc example with the help of your FAQs.

    But when the stuck is happening I see the core is in still a running state.

    I need your help to debug this furthermore to fix the issue.

    Thanks and Regards,

    Aneesh

  • Hello Aneesh,

    Can you please share reproducible code on EVM? so that we can better assist you.

    Along with this,  please share the test procedure as well to reproduce the issue.

    Regards,

    S.Anil.

  • Hi Anil, 

    I have mentioned this in our debug session. This is the same TI ipc_rpmsg_linux_echo example. No changes.

    mcu_plus_sdk_am62x_08_05_00_14/examples/drivers/ipc/ipc_rpmsg_echo_linux/am62x-sk/m4fss0-0_freertos/ti-arm-clang

    After our debug session, I thought you are trying to reproduce the issue on your side and I am a little surprised by your question about the code.

    On Linux, i am running this example rpmsg_char_simple -r 9 -n 10000. This is also available in roots by default. (No chnages).

    Please help us in solving this issue as soon as possible. Also, If you have any pointers to debug the m4f furthermore because the status of the m4f core is in running when i saw stuck in the uart log.

    Regards,

    Aneesh

  • Hello Aneesh,

    As mentioned earlier, I am not familiar with the Linux side and will take help from Linux experts to reproduce the issue.

    Actually, I have jumped to another customer issue. So, I could not reproduce it.

    I can try to reproduce the issue next week.

    Regards,

    S.Anil.

  • Hello Aneesh,

    I have followed below steps to reproduce the issue .

    1. Placed the WIC image for the 8.5 version on the SD card.

    2. Kept the HW in SD boot mode.

    3. Given the command rpmsg_char_simple -r 9 -n 10000 on the Linux UART port.

     

    I have verified three times, and three times I am not getting stuck in M4F core . Please see the below image.

     

    Please help me reproduce the issue if I did anything wrong.

    Regards,

    S.Anil.

  • Hello Aneesh,

    Ok, let's pause for a minute.

    Get to a known good state

    First, please go through the steps here without making any changes (this includes creating a fresh SD card). I want to make sure you have a "known good state" to start working from:
    https://dev.ti.com/tirex/explore/node?node=A__ACKtJpWz8b53RwT-PJ4qmA__linux_academy_am62x__XaWts8R__LATEST

    This earlier page also has useful information:
    https://dev.ti.com/tirex/explore/node?node=A__AISILbMWZ4d84U2oSmXcdA__linux_academy_am62x__XaWts8R__LATEST

    Once you have a known good state, you can start making changes to the known good state one at a time until you find the change that caused problems.

    Using CCS to debug the hanging state

    The point of connecting CCS is to attach to the M4F core, is that you can pause the M4F core and see what the core is doing while it is paused.

    See the yellow pause button in the upper left corner of the screen? Click on that, and you will be able to see exactly where the M4F core is and what it is doing.

    This is an important tool when you are debugging your M4F code.

    Regards,

    Nick

  • Hi Anil,

    Thank you for trying it out, to make sure Can you please check for over one lakh iterations? Check the below log

    hello there 10570!
    hello there 10571!
    hello there 10572!
    hello there 10573!
    hello there 10574!
    hello there 10575!
    hello there 10576!
    hello there 10577!
    hello there 10578!
    hello there 10579!
    hello there 10580!
    hello there 10581!
    hello

    Regards,

    Aneesh

  • Hello Aneesh,

    I have tried 5 times for 1 lakh iterations to reproduce the issue and have not faced any issues.

    Please look at the image below.

    Regards,

    S.Anil.

  • Hi Anil,

    Thanks for trying again, It is very confusing now, I have tried this today also it is reproducing on my side. 

    I want to make sure this should not be due to the SOC we have on EVM. We have XAM6254ATCGGAALW.

    I know this point may not be an issue, But can you please confirm, You are also using the same SOC type on your EVM?

    regards,

    Aneesh

  • Hello Aneesh,

    I have the same SOC mounted on my EVM as well, and there is no difference.

    May I know what procedure is different with respect to your test procedure?

    Have you changed any IPC codes? I know you have not updated, but can you please confirm?

    How can I help you here?

    Regards,

    S.Anil.

  • Thanks for confirming it Anil, There is no difference in the code. I have made only one change in the code to see logs on mcu uart.Pleae check the code snippet below.

           
    recvMsgSize = IPC_RPMESSAGE_MAX_MSG_SIZE;
            status = RPMessage_recv(pRpmsgObj,
                recvMsg, &recvMsgSize,
                &remoteCoreId, &remoteCoreEndPt,
                SystemP_WAIT_FOREVER);
            DebugP_assert(status==SystemP_SUCCESS);

            /* echo the same message string as reply */
            #if 1 /* not logging this so that this does not add to the latency of message exchange */
            recvMsg[recvMsgSize] = 0; /* add a NULL char at the end of message */
            DebugP_log("%s\r\n", recvMsg);
            #endif

            /* send ack to sender CPU at the sender end point */
            status = RPMessage_send(
                recvMsg, recvMsgSize,
                remoteCoreId, remoteCoreEndPt,
                RPMessage_getLocalEndPt(pRpmsgObj),
                SystemP_WAIT_FOREVER);
            DebugP_assert(status==SystemP_SUCCESS);
    The highlighted if condition i have changed from if 0 to if 1 to see the logs on mcu uart other than that no change.
    Test procedure:
    Build the code with above change and copy the am62-mcu-m4f0_0-fw to /lib/firmware and run the rpmsg example in linux as you tried it.
    Thanks and Regards,
    Aneesh
  • Hi Anil,

    I have an interesting observation, I think the logs are the issue. If I enable the logs on MCU UART we see the stuck, If we disable the logs then we don't see any stuck.

    Can you try enabling the logs, like I tried before the post and please let me know if you can reproduce the issue.

    Thanks and Regards,
    Aneesh
  • Hello Aneesh,

    Yes , I have also suspected the same thing. since the only difference is enabling MCU UART log.

    Let me check my side, and I will share the test results.

    I suspect the issue comes up in two cases.

    1. The same MCU UART can be used in both cores.

    2. UART log settings

    Regards,

    S.Anil.

  • Hello Aneesh,

    I am able to reproduce the issue and debugging  why the MCU core is getting stuck in the debug log function.

    Please allow me some time to work on it, and after I find the root cause, I will share the details .

    As of now, you will disable the UART log and move forward.

    Regards,

    S.Anil.

  • Hi Anil, 

    Sure,

    Thank you for trying, Please let us know once you have new observations.

    Thanks and Regards,

    Aneesh

  • Hi Anil, 

    If you found any new observations, please let us know. 

    Thanks and Regards,

    Aneesh

  • Hello Aneesh,

    As mentioned above, I have noticed that SOC is hanging in the DebugP_log function, and control is not coming out of that function.

    This is a library function and needs more time to be debugged further. So, I had a discussion with the design team and raised a bug for further check by the design team, and I will update the status once they find the root cause.

    As of now, you will disable the UART log and move forward.

    Regards,

    S.Anil,

  • Hi Anil, 

    Is there any update on this topic, We need logs for debugging because we don't have a debugger for debugging.

    Thanks and Regards,

    Aneesh

  • Hello Aneesh,

    Please try to use UART in polling mode instead of interrupt mode to print logs to see if you face problems or not.

    Regards,

    S.Anil.

  • Hi Anil, 

    Thank you for your reply, I will try on my side, can you also please try from your side?

    Thanks and Regards,

    Aneesh

  • Hello Aneesh,

    I have already tried it, and it is working fine for me.

    So, that is the reason I have asked you to use UART in Polling mode.

    Please try polling mode and share the results.

    Regards,

    S.Anil.