This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM5718-HIREL: AM5718 Sitara UART initialization lock down

Part Number: AM5718-HIREL
Other Parts Discussed in Thread: AM5718

Hello,

we observes Sitara lock down issues from time to time (very low occurrence): Linux never finishes the boot sequence and seems to loop endless during UART3 initialization.

Project use Sitara UART3 at 3 110 400 bits/s, and receive 300 bytes of UART3 data every 90ms during Linux boot.

Please see emulator stack screenshot when this lock down appears.

And a Linux kernel log (not the same issue time than stack screenshot).

Any idea about it?

 Thanks for your help,

Benoît

Linux Kernel log.txt
[   42.261953] INFO: rcu_preempt self-detected stall on CPU
[   42.267099]    0-...: (2100 ticks this GP) idle=ff5/140000000000002/0 softirq=0/0 fqs=0 
[   42.274734]     (t=2100 jiffies g=121 c=120 q=5)
[   42.279035] rcu_preempt kthread starved for 2100 jiffies! g121 c120 f0x0 s3 ->state=0x1
[   42.286755] Task dump for CPU 0:
[   42.289869] main_VAHM       R running      0   390      1 0x00000002
[   42.296019] Backtrace: 
[   42.298408] [<c0013550>] (dump_backtrace) from [<c001374c>] (show_stack+0x18/0x1c)
[   42.305708]  r7:c0a9a884 r6:80080193 r5:00000001 r4:d8396400
[   42.311220] [<c0013734>] (show_stack) from [<c005684c>] (sched_show_task+0xbc/0x110)
[   42.318694] [<c0056790>] (sched_show_task) from [<c0058860>] (dump_cpu_task+0x40/0x48)
[   42.326328]  r5:c0aaa600 r4:00000000
[   42.329805] [<c0058820>] (dump_cpu_task) from [<c007cad4>] (rcu_dump_cpu_stacks+0x94/0xd0)
[   42.337775]  r5:c0aaa600 r4:00000001
[   42.341247] [<c007ca40>] (rcu_dump_cpu_stacks) from [<c0080b88>] (rcu_check_callbacks+0x520/0x8d4)
[   42.349886]  r9:dfd6d1c0 r8:c0aaa600 r7:00000005 r6:c0a9a140 r5:1f2d6000 r4:c0a971c0
[   42.357418] [<c0080668>] (rcu_check_callbacks) from [<c0083c38>] (update_process_times+0x48/0x6c)
[   42.365972]  r10:c009401c r9:00000001 r8:dfd69c0c r7:00000009 r6:00000000 r5:d8396400
[   42.373580]  r4:ffffe000
[   42.376042] [<c0083bf0>] (update_process_times) from [<c0094018>] (tick_sched_handle+0x50/0x54)
[   42.384429]  r7:00000009 r6:d6e47e18 r5:d7045b48 r4:dfd69e88
[   42.389937] [<c0093fc8>] (tick_sched_handle) from [<c0094078>] (tick_sched_timer+0x5c/0xa0)
[   42.397998] [<c009401c>] (tick_sched_timer) from [<c00846b0>] (__hrtimer_run_queues+0x11c/0x1ac)
[   42.406469]  r7:00000000 r6:dfd69c00 r5:dfd69e88 r4:dfd69bc0
[   42.411976] [<c0084594>] (__hrtimer_run_queues) from [<c0084ed4>] (hrtimer_interrupt+0xbc/0x208)
[   42.420446]  r10:dfd69c60 r9:dfd69ce0 r8:dfd69ca0 r7:dfd69bd8 r6:ffffffff r5:00000003
[   42.428051]  r4:dfd69bc0
[   42.430515] [<c0084e18>] (hrtimer_interrupt) from [<c037a7e4>] (arch_timer_handler_virt+0x38/0x40)
[   42.439152]  r10:d7045b48 r9:ddc06000 r8:ddc3af00 r7:ddc04e40 r6:00000013 r5:c0ab0bcc
[   42.446759]  r4:dfd6f840
[   42.449220] [<c037a7ac>] (arch_timer_handler_virt) from [<c0076c64>] (handle_percpu_devid_irq+0x90/0xa8)
[   42.458370] [<c0076bd4>] (handle_percpu_devid_irq) from [<c0072634>] (generic_handle_irq+0x2c/0x3c)
[   42.467091]  r9:ddc06000 r8:00000001 r7:d7045c68 r6:00000013 r5:00000000 r4:c0a941e4
[   42.474621] [<c0072608>] (generic_handle_irq) from [<c007292c>] (__handle_domain_irq+0x84/0xf4)
[   42.483015] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
[   42.491068]  r10:d7045c68 r9:fa213000 r8:fa212000 r7:d7045b48 r6:fa21200c r5:c0a9aac8
[   42.498674]  r4:c0ab0bc8 r3:d7045b48
[   42.502147] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
[   42.509364] Exception stack(0xd7045b48 to 0xd7045b90)
[   42.514240] 5b40:                   00000000 c053a6a4 c0acbb40 00000000 00000002 ffffe000
[   42.522131] 5b60: 00000013 00000000 00000001 ddc06000 d7045c68 d7045bf4 d7045b88 d7045b98
[   42.530018] 5b80: c025c938 c003462c 20080113 ffffffff
[   42.534889]  r9:ddc06000 r8:00000001 r7:d7045b7c r6:ffffffff r5:20080113 r4:c003462c
[   42.542421] [<c0034584>] (__do_softirq) from [<c0034ef8>] (irq_exit+0xc8/0x104)
[   42.549469]  r10:d7045c68 r9:ddc06000 r8:00000001 r7:00000000 r6:00000013 r5:00000000
[   42.557071]  r4:c0a941e4
[   42.559534] [<c0034e30>] (irq_exit) from [<c0072930>] (__handle_domain_irq+0x88/0xf4)
[   42.567084]  r5:00000000 r4:c0a941e4
[   42.570558] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
[   42.578610]  r10:00000001 r9:fa213000 r8:fa212000 r7:d7045c68 r6:fa21200c r5:c0a9aac8
[   42.586214]  r4:c0ab0bc8 r3:d7045c68
[   42.589687] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
[   42.596903] Exception stack(0xd7045c68 to 0xd7045cb0)
[   42.601778] 5c60:                   c0aede34 00000003 00000000 00000005 c0aede34 d82886b8
[   42.609669] 5c80: ddf2b610 00000013 002dc6c0 000a9053 00000001 d7045cc4 d7045cc8 d7045cb8
[   42.617556] 5ca0: c02d6544 c045fdfc a0080013 ffffffff
[   42.622426]  r9:000a9053 r8:002dc6c0 r7:d7045c9c r6:ffffffff r5:a0080013 r4:c045fdfc
[   42.629962] [<c045fdd4>] (_raw_spin_unlock_irq) from [<c02d6544>] (omap_8250_set_termios+0x280/0x388)
[   42.638862] [<c02d62c4>] (omap_8250_set_termios) from [<c02d24e0>] (serial8250_set_termios+0x1c/0x28)
[   42.647751]  r10:00000000 r9:c02b4420 r8:ddc4f260 r7:ddc4f1d0 r6:d8288600 r5:d7045d64
[   42.655354]  r4:c0aede34
[   42.657812] [<c02d24c4>] (serial8250_set_termios) from [<c02cbb14>] (uart_change_speed+0x38/0xdc)
[   42.666371] [<c02cbadc>] (uart_change_speed) from [<c02cc728>] (uart_set_termios+0x7c/0x188)
[   42.674508]  r7:ddc4f1d0 r6:c0aede34 r5:d7045d64 r4:d8288600
[   42.680014] [<c02cc6ac>] (uart_set_termios) from [<c02b7ef4>] (tty_set_termios+0x150/0x1e8)
[   42.688065]  r9:c02b4420 r8:00000005 r7:00000000 r6:00001400 r5:d8288680 r4:d8288600
[   42.695592] [<c02b7da4>] (tty_set_termios) from [<c02b878c>] (set_termios+0x3a8/0x410)
[   42.703227]  r8:d7014c80 r7:00000051 r6:d7014c80 r5:00000008 r4:d8288600
[   42.709748] [<c02b83e4>] (set_termios) from [<c02b8ce0>] (tty_mode_ioctl+0x494/0x5ac)
[   42.717297]  r7:d8288600 r6:d8367840 r5:befb5b64 r4:d8288600
[   42.722805] [<c02b884c>] (tty_mode_ioctl) from [<c02b8e44>] (n_tty_ioctl_helper+0x4c/0x10c)
[   42.730857]  r8:d7014c80 r7:d8288600 r6:d8367840 r5:d8288600 r4:befb5b64
[   42.737379] [<c02b8df8>] (n_tty_ioctl_helper) from [<c02b44c4>] (n_tty_ioctl+0xa4/0x144)
[   42.745181]  r5:00005402 r4:befb5b64
[   42.748654] [<c02b4420>] (n_tty_ioctl) from [<c02b1edc>] (tty_ioctl+0x4dc/0xe8c)
[   42.755785]  r7:befb5b64 r6:d8367840 r5:00005402 r4:d8288600
[   42.761294] [<c02b1a00>] (tty_ioctl) from [<c00f14c8>] (do_vfs_ioctl+0x460/0x6dc)
[   42.768510]  r9:00000007 r8:befb5b64 r7:00000007 r6:d8367840 r5:ddf2a4a8 r4:befb5b64
[   42.776039] [<c00f1068>] (do_vfs_ioctl) from [<c00f17b8>] (SyS_ioctl+0x74/0x84)
[   42.783087]  r10:00000000 r9:00000007 r8:befb5b64 r7:00005402 r6:d8367840 r5:d8367841
[   42.790690]  r4:00000000
[   42.793150] [<c00f1744>] (SyS_ioctl) from [<c000fb60>] (ret_fast_syscall+0x0/0x44)
[   42.800448]  r9:d7044000 r8:c000fd24 r7:00000036 r6:00000000 r5:000018bd r4:00000000

  • Hi Benoit,

    Please confirm if the device you use is AM5718?

  • Hi,

    Yes, full part number is AM5718AZBOXEM

    Benoît

  • Thanks. I am routing your query to AM57x team for comments.

  • Hello Benoît,

    Help me understand the issue better, the problem is with UART3 being initialized by Linux and not UART boot correct?

    Also, could you please share what SDK version yo are developing with?

    -Josue

  • Hi Josue,

    we do not use a SDK, but a toolchain:
     - toolchain : gcc-linaro-5.3-2016.02-x86_64_arm-linux-gnueabihf
     - kernel : linux-processor-sdk-rt/4.4.32+gitAUTOINC+03fcc75507-r7c
     - meta-ti : commit d8aa76970a0ba48762c631dfd79dbed49222373b
     - meta-processor-sdk : commit 3678d672c9c47a646897286281d4260ac4ace960

    From yesterdays tests, it seems that Sitara locks after UART3 initialization (when opening the UART3 port?), but only when Sitara UART3 port is receiving data (at 3Mb/s, 300 bytes every 90ms).

    Thanks,
      Benoît

  • Benoît,

    Is it correct to assume you are building your own custom images for your application using TI Yocto recipes?

    Are you using a custom board or a TI board?

    -Josue

  • Josue,

    you are correct:
    - our own custom image
    - our own custom board

    Benoît

  • Benoît,

    Are you able to share a couple full boot log failures not just the snapshot at the end?

    Quote from our Trace32 expert " the issue could be with the uart, however, chances are pretty low (but not 0) it has anything to do with uart.  The uart likely is just reacting to some other fatal condition.  The RCU was stuck message at the top would seem to imply one of the cores is dead and the opposite core is just dumping its status."

    -Josue

  • Hi Josue,

    please find in embeded file one correct log for a power on cycle, and then the log for a failed power on up to the second rcu_premempt trace log (the log continues with similar rcu_prempt loops up to power off).

    UART_log_2 last power on.txt
    U-Boot SPL 2015.07 (Mar 16 2018 - 15:27:34)
    DRA722 ES2.0
    
    
    U-Boot 2015.07 (Mar 16 2018 - 15:27:34 +0100)
    
    CPU  : DRA722 ES2.0
    Board: VAHM GE9X
    I2C:   ready
    DRAM:  512 MiB
    SF: Detected N25Q512 with page size 256 Bytes, erase size 4 KiB, total 64 MiB, mapped at 5c000000
    Net:   cpsw
    GPIO ProgEn value is 0 
    GPIO GSECONEn value is 1 
    RML conditions: no
    AML conditions: no
    Booting in operational mode
    SF: Detected N25Q512 with page size 256 Bytes, erase size 4 KiB, total 64 MiB, mapped at 5c000000
    sf - SPI flash sub-system
    
    device 0 offset 0x1400000, size 0x17c0000
    SF: 24903680 bytes @ 0x1400000 Read: OK
    device 0 offset 0x2bc0000, size 0x40000
    SF: 262144 bytes @ 0x2bc0000 Read: OK
    Kernel image @ 0x82000000 [ 0x000000 - 0x6cb068 ]
    ## Flattened Device Tree blob at 88000000
       Booting using the fdt blob at 0x88000000
       Loading Device Tree to 8ffe7000, end 8fffff26 ... OK
    
    Starting kernel ...
    
    [    0.000000] Booting Linux on physical CPU 0x0
    [    0.000000] Linux version 4.4.32-rt41+ (SAFRAN-E&D@Massy) () #4 SMP PREEMPT Mon Nov 19 11:00:00 UTC 2018
    [    0.000000] CPU: ARMv7 Processor [412fc0f2] revision 2 (ARMv7), cr=10c5387d
    [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
    [    0.000000] Machine model: TI AM5718 VAHM GE9X
    [    0.000000] debug: ignoring loglevel setting.
    [    0.000000] Reserved memory: created CMA memory pool at 0x99000000, size 64 MiB
    [    0.000000] Reserved memory: initialized node dsp1_cma@99000000, compatible id shared-dma-pool
    [    0.000000] cma: Reserved 24 MiB at 0x9e400000
    [    0.000000] Memory policy: Data cache writealloc
    [    0.000000] OMAP4: Map 0x9fe00000 to fe600000 for dram barrier
    [    0.000000] On node 0 totalpages: 108032
    [    0.000000] free_area_init_node: node 0, pgdat c0acd9c0, node_mem_map de000000
    [    0.000000]   Normal zone: 1024 pages used for memmap
    [    0.000000]   Normal zone: 0 pages reserved
    [    0.000000]   Normal zone: 108032 pages, LIFO batch:31
    [    0.000000] DRA722 ES2.0
    [    0.000000] PERCPU: Embedded 12 pages/cpu @dfd69000 s18176 r8192 d22784 u49152
    [    0.000000] pcpu-alloc: s18176 r8192 d22784 u49152 alloc=12*4096
    [    0.000000] pcpu-alloc: [0] 0 
    [    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 107008
    [    0.000000] Kernel command line: console=ttyS0,115200n8 ignore_loglevel debug root=/dev/ram0 rw
    [    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
    [    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
    [    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
    [    0.000000] Memory: 326324K/432128K available (4455K kernel code, 202K rwdata, 1316K rodata, 5060K init, 169K bss, 15692K reserved, 90112K cma-reserved, 0K highmem)
    [    0.000000] Virtual kernel memory layout:
    [    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    [    0.000000]     fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
    [    0.000000]     vmalloc : 0xe0800000 - 0xff800000   ( 496 MB)
    [    0.000000]     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
    [    0.000000]     pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    [    0.000000]     modules : 0xbf000000 - 0xbfe00000   (  14 MB)
    [    0.000000]       .text : 0xc0008000 - 0xc05aafec   (5772 kB)
    [    0.000000]       .init : 0xc05ab000 - 0xc0a9c000   (5060 kB)
    [    0.000000]       .data : 0xc0a9c000 - 0xc0ace8c0   ( 203 kB)
    [    0.000000]        .bss : 0xc0ace8c0 - 0xc0af8eb4   ( 170 kB)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
    [    0.000000] Preemptible hierarchical RCU implementation.
    [    0.000000] 	Build-time adjustment of leaf fanout to 32.
    [    0.000000] 	RCU restricting CPUs from NR_CPUS=2 to nr_cpu_ids=1.
    [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=32, nr_cpu_ids=1
    [    0.000000] NR_IRQS:16 nr_irqs:16 16
    [    0.000000] ti_dt_clocks_register: failed to lookup clock node gmac_gmii_ref_clk_div
    [    0.000000] OMAP clockevent source: timer1 at 32786 Hz
    [    0.000000] Architected cp15 timer(s) running at 6.14MHz (virt).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x16af5adb9, max_idle_ns: 440795202250 ns
    [    0.000006] sched_clock: 56 bits at 6MHz, resolution 162ns, wraps every 4398046511023ns
    [    0.000020] Switching to timer-based delay loop, resolution 162ns
    [    0.000412] clocksource: 32k_counter: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 58327039986419 ns
    [    0.000422] OMAP clocksource: 32k_counter at 32768 Hz
    [    0.000854] Console: colour dummy device 80x30
    [    0.000880] Calibrating delay loop (skipped), value calculated using timer frequency.. 12.29 BogoMIPS (lpj=61475)
    [    0.000898] pid_max: default: 32768 minimum: 301
    [    0.000989] Security Framework initialized
    [    0.001033] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
    [    0.001046] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
    [    0.001629] CPU: Testing write buffer coherency: ok
    [    0.001890] /cpus/cpu@0 missing clock-frequency property
    [    0.001908] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
    [    0.001965] Setting up static identity map for 0x80008280 - 0x800082d8
    [    0.060169] Brought up 1 CPUs
    [    0.060185] SMP: Total of 1 processors activated (12.29 BogoMIPS).
    [    0.060196] CPU: All CPU(s) started in SVC mode.
    [    0.061414] devtmpfs: initialized
    [    0.110120] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0
    [    0.111693] omap_hwmod: l3_main_2 using broken dt data from ocp
    [    0.382690] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
    [    0.384503] pinctrl core: initialized pinctrl subsystem
    [    0.385583] NET: Registered protocol family 16
    [    0.387267] DMA: preallocated 256 KiB pool for atomic coherent allocations
    [    0.410577] cpuidle: using governor ladder
    [    0.440615] cpuidle: using governor menu
    [    0.453297] OMAP GPIO hardware version 0.1
    [    0.482121] omap-gpmc 50000000.gpmc: could not find pctldev for node /ocp/l4@4a000000/scm@2000/pinmux@1400/gpmc_pins_default, deferring probe
    [    0.488681] omap4_sram_init:Unable to allocate sram needed to handle errata I688
    [    0.488697] omap4_sram_init:Unable to get sram pool needed to handle errata I688
    [    0.488961] OMAP DMA hardware revision 0.0
    [    0.577723] omap-dma-engine 4a056000.dma-controller: OMAP DMA engine driver (LinkedList1/2/3 supported)
    [    0.579099] edma 43300000.edma: memcpy is disabled
    [    0.586848] edma 43300000.edma: TI EDMA DMA engine driver
    [    0.591811] omap-iommu 40d01000.mmu: 40d01000.mmu registered
    [    0.592036] omap-iommu 40d02000.mmu: 40d02000.mmu registered
    [    0.592232] omap-iommu 58882000.mmu: 58882000.mmu registered
    [    0.592869] SCSI subsystem initialized
    [    0.593517] pps_core: LinuxPPS API ver. 1 registered
    [    0.593529] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.593567] PTP clock support registered
    [    0.601894] clocksource: Switched to clocksource arch_sys_counter
    [    0.616660] NET: Registered protocol family 2
    [    0.617375] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
    [    0.617428] TCP bind hash table entries: 4096 (order: 3, 32768 bytes)
    [    0.617514] TCP: Hash tables configured (established 4096 bind 4096)
    [    0.617575] UDP hash table entries: 256 (order: 1, 8192 bytes)
    [    0.617604] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
    [    0.617796] NET: Registered protocol family 1
    [    2.680712] futex hash table entries: 256 (order: 2, 16384 bytes)
    [    2.698680] VFS: Disk quotas dquot_6.6.0
    [    2.698902] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
    [    2.700674] jffs2: version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
    [    2.706454] NET: Registered protocol family 38
    [    2.706534] io scheduler noop registered
    [    2.706555] io scheduler deadline registered
    [    2.706764] io scheduler cfq registered (default)
    [    2.712129] pinctrl-single 4a003400.pinmux: 282 pins at pa fc003400 size 1128
    [    2.712261] pinctrl-single 4a002e8c.pinmux: 1 pins at pa fc002e8c size 4
    [    2.718992] Serial: 8250/16550 driver, 10 ports, IRQ sharing disabled
    [    2.723467] console [ttyS0] disabled
    [    2.723533] 4806a000.serial: ttyS0 at MMIO 0x4806a000 (irq = 299, base_baud = 3000000) is a 8250
    [    3.355786] console [ttyS0] enabled
    [    3.360108] 48020000.serial: ttyS2 at MMIO 0x48020000 (irq = 300, base_baud = 3000000) is a 8250
    [    3.380577] brd: module loaded
    [    3.471196] loop: module loaded
    [    3.475613] mtdoops: mtd device (mtddev=name/number) must be supplied
    [    3.482780] libphy: Fixed MDIO Bus: probed
    [    3.531933] davinci_mdio 48485000.mdio: davinci mdio revision 1.6
    [    3.537820] davinci_mdio 48485000.mdio: detected phy mask fffffff7
    [    3.560917] libphy: 48485000.mdio: probed
    [    3.564895] davinci_mdio 48485000.mdio: phy[3]: device 48485000.mdio:03, driver unknown
    [    3.578104] cpsw 48484000.ethernet: Detected MACID = 98:5d:ad:a7:59:ca
    [    3.584754] cpsw 48484000.ethernet: cpts: overflow check period 800
    [    3.591846] cpsw 48484000.ethernet: cpsw: Detected MACID = 98:5d:ad:a7:59:cb
    [    3.599540] i2c /dev entries driver
    [    3.603887] omap-aes 4b500000.aes: OMAP AES hw accel rev: 3.3
    [    3.610439] omap-aes 4b700000.aes: OMAP AES hw accel rev: 3.3
    [    3.616708] omap-des 480a5000.des: OMAP DES hw accel rev: 2.2
    [    3.623735] omap-sham 4b101000.sham: hw accel on OMAP rev 4.3
    [    3.632128] Initializing XFRM netlink socket
    [    3.636280] NET: Registered protocol family 17
    [    3.640623] NET: Registered protocol family 15
    [    3.645254] omap_voltage_late_init: Voltage driver support not added
    [    3.651751] Power Management for TI OMAP4+ devices.
    [    3.656919] ThumbEE CPU extension supported.
    [    3.661060] Registering SWP/SWPB emulation handler
    [    3.677368] omap-gpmc 50000000.gpmc: GPMC revision 6.0
    [    3.682452] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
    [    3.689979] pbias_mmc_omap5: disabling
    [    3.699601] Freeing unused kernel memory: 5060K (c05ab000 - c0a9c000)
    [    3.753189] spi_slave_rx: size of buffers = 7508 bytes
    [    3.758156] spi_slave_rx: number of buffers = 16
    [    3.767911] mcspi_slave_rx 480b8000.spi: targeted controller is MCSPI3
    [    3.774718] mcspi_slave_rx 480b8000.spi: registered slave rx spi_slave_rx3
    [    3.786371] bus for spi_slave_rx is spi_slave_rx3.0
    [    3.791245] spi_slave_rx spi_slave_rx3.0: setup mode 0, 16 bits/w, 30000000 Hz max --> 1
    [    3.799691] divio spi_slave_rx3.0: driver probed
    [    3.804448] divio divio0: new device created
    [    3.808609] mcspi_slave_rx 480b8000.spi: registered child spi_slave_rx3.0
    Starting mdev...
    [    4.871257] m25p80 spi32766.0: found n25q512ax3, expected n25q512a
    [    4.889372] m25p80 spi32766.0: n25q512ax3 (65536 Kbytes)
    [    4.902083] 9 ofpart partitions found on MTD device spi32766.0
    [    4.907718] Creating 9 MTD partitions on "spi32766.0":
    [    4.915334] 0x000000000000-0x000000020000 : "mtd_hmrs_mlo"
    [    4.932663] 0x000000020000-0x0000000f0000 : "mtd_hmrs_uboot"
    [    4.963358] 0x0000000f0000-0x000000100000 : "mtd_hmrs_env"
    [    5.013432] 0x000000100000-0x000000bc0000 : "mtd_hmrs_zimage"
    [    5.043460] 0x000000bc0000-0x000000c00000 : "mtd_hmrs_dtb"
    [    5.103099] 0x000000c00000-0x000001400000 : "mtd_aml"
    [    5.138256] 0x000001400000-0x000002bc0000 : "mtd_hmos_zimage"
    [    5.167827] 0x000002bc0000-0x000002c00000 : "mtd_hmos_dtb"
    [    5.220622] 0x000002c00000-0x000004000000 : "mtd_loads"
    [    5.253031] omap_rng 48090000.rng: OMAP Random Number Generator ver. 20
    [    5.340950] libata version 3.00 loaded.
    [    5.392389] ahci 4a140000.sata: AHCI 0001.0300 32 slots 1 ports 3 Gbps 0x0 impl platform mode
    [    5.400628] ahci 4a140000.sata: flags: 64bit ncq sntf pm led clo only pmp pio slum part ccc apst 
    [    5.442262] scsi host0: ahci
    [    5.448488] ata1: DUMMY
    Configuring network interfaces... [    5.531576] net eth0: initializing cpsw version 1.15 (0)
    [    5.536977] net eth0: initialized cpsw ale version 1.4
    [    5.541989] net eth0: ALE Table size 1024
    [    5.622076] net eth0: phy found : id is : 0x0
    [    5.626437] cpsw-phy-sel 4a002554.cpsw-phy-sel: RMII External clock is not supported
    [    5.681301] net eth1: initializing cpsw version 1.15 (0)
    [    5.765112] net eth1: phy found : id is : 0x20005c90
    [    5.770059] cpsw-phy-sel 4a002554.cpsw-phy-sel: RMII External clock is not supported
    done.
    root: /etc/rc5.d/S05set-chan-netaddr: eth0 @IP:  192.168.1.20
    root: /etc/rc5.d/S05set-chan-netaddr: eth0 @MAC: FE:FF:FF:FF:FF:1A
    root: /etc/rc5.d/S05set-chan-netaddr: eth1 @IP:  192.168.2.20
    root: /etc/rc5.d/S05set-chan-netaddr: eth1 @MAC: FE:FF:FF:FF:FF:2A
    Starting the NAND kernel module...
    [    5.980938] nand: nand_decode_bbm_options: mtd->writesize=8192
    [    6.008407] nand: nand_decode_bbm_options: chip->options=0x00010200
    [    6.014537] nand: nand_decode_bbm_options: chip->badblockpos=NAND_LARGE_BADBLOCK_POS
    [    6.022306] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x68
    [    6.028437] nand: Micron MT29F32G08ABAAAWP
    [    6.032438] nand: 4096 MiB, SLC, erase size: 1024 KiB, page size: 8192, OOB size: 448
    [    6.039999] omap2-nand 8000000.nand: xfer_type=0
    [    6.044815] omap2-nand 8000000.nand: ecc_opt=6
    [    6.049103] using OMAP_ECC_BCH16_CODE_HW ECC scheme
    [    6.053905] 1 ofpart partitions found on MTD device 8000000.nand
    [    6.059700] Creating 1 MTD partitions on "8000000.nand":
    [    6.065034] 0x000000000000-0x000100000000 : "mtd_nand"
    Creating MTD symbolic links...
    Mounting MTD devices (NAND/UBIFS)...
    [    6.603313] ubi0: attaching mtd9
    [    7.622080] cpsw 48484000.ethernet eth0: Link is Up - 10Mbps/Full - flow control off
    [   14.827259] ubi0: scanning is finished
    [   14.844886] ubi0: attached mtd9 (name "mtd_nand", size 4096 MiB)
    [   14.850689] ubi0: PEB size: 1048576 bytes (1024 KiB), LEB size: 1032192 bytes
    [   14.883481] ubi0: min./max. I/O unit sizes: 8192/8192, sub-page size 8192
    [   14.890041] ubi0: VID header offset: 8192 (aligned 8192), data offset: 16384
    [   14.897029] ubi0: good PEBs: 4093, bad PEBs: 3, corrupted PEBs: 0
    [   14.902955] ubi0: user volume: 2, internal volumes: 1, max. volumes count: 128
    [   14.909925] ubi0: max/mean erase counter: 621/319, WL threshold: 4096, image sequence number: 1352186190
    [   14.919261] ubi0: available PEBs: 0, total reserved PEBs: 4093, PEBs reserved for bad PEB handling: 77
    [   14.928297] ubi0: background thread "ubi_bgt0d" started, PID 341
    [   14.962066] UBIFS (ubi0:0): background thread "ubifs_bgt0_0" started, PID 347
    [   15.207162] UBIFS (ubi0:0): recovery needed
    [   16.075255] UBIFS (ubi0:0): recovery completed
    [   16.079559] UBIFS (ubi0:0): UBIFS: mounted UBI device 0, volume 0, name "log"
    [   16.086468] UBIFS (ubi0:0): LEB size: 1032192 bytes (1008 KiB), min./max. I/O unit sizes: 8192 bytes/8192 bytes
    [   16.096220] UBIFS (ubi0:0): FS size: 94961664 bytes (90 MiB, 92 LEBs), journal size 8257537 bytes (7 MiB, 6 LEBs)
    [   16.106137] UBIFS (ubi0:0): reserved for root: 4485273 bytes (4380 KiB)
    [   16.112542] UBIFS (ubi0:0): media format: w4/r0 (latest is w4/r0), UUID 842951A4-2357-49CA-A5DA-64B20FC56107, small LPT model
    [   16.152053] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 351
    [   16.396370] UBIFS (ubi0:1): recovery needed
    [   17.053969] UBIFS (ubi0:1): recovery completed
    [   17.058272] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "hmfudata"
    [   17.065599] UBIFS (ubi0:1): LEB size: 1032192 bytes (1008 KiB), min./max. I/O unit sizes: 8192 bytes/8192 bytes
    [   17.075352] UBIFS (ubi0:1): FS size: 4025548800 bytes (3839 MiB, 3900 LEBs), journal size 33030144 bytes (31 MiB, 32 LEBs)
    [   17.086022] UBIFS (ubi0:1): reserved for root: 4952683 bytes (4836 KiB)
    [   17.092426] UBIFS (ubi0:1): media format: w4/r0 (latest is w4/r0), UUID 025CE49E-998C-4BC7-9F5E-CAC5EECCC808, small LPT model
    root: /etc/rc5.d/S16ubifsmount: mounting of hmfudata/log (ubifs) done
    Starting syslogd/klogd: done
    Mounting MTD devices (NOR/JFFS2)...
    root: /etc/rc5.d/S25jffs2mount: directory /opt/hmfu/.loads was missing, created
    root: /etc/rc5.d/S25jffs2mount: mounting of /opt/hmfu/.loads (jffs2) done
    root: /etc/rc5.d/S25jffs2mount: mounting of /opt/hmfu/.loads/aml (jffs2) done
    Starting HMAS...
    
    
    health-monitoring 1.0 am57xx-vahm /dev/ttyS0
    
    
    
    am57xx-vahm login: [   20.724223] random: nonblocking pool is initialized
    
    U-Boot SPL 2015.07 (Mar 16 2018 - 15:27:34)
    DRA722 ES2.0
    
    
    U-Boot 2015.07 (Mar 16 2018 - 15:27:34 +0100)
    
    CPU  : DRA722 ES2.0
    Board: VAHM GE9X
    I2C:   ready
    DRAM:  512 MiB
    SF: Detected N25Q512 with page size 256 Bytes, erase size 4 KiB, total 64 MiB, mapped at 5c000000
    Net:   cpsw
    GPIO ProgEn value is 0 
    GPIO GSECONEn value is 1 
    RML conditions: no
    AML conditions: no
    Booting in operational mode
    SF: Detected N25Q512 with page size 256 Bytes, erase size 4 KiB, total 64 MiB, mapped at 5c000000
    sf - SPI flash sub-system
    
    device 0 offset 0x1400000, size 0x17c0000
    SF: 24903680 bytes @ 0x1400000 Read: OK
    device 0 offset 0x2bc0000, size 0x40000
    SF: 262144 bytes @ 0x2bc0000 Read: OK
    Kernel image @ 0x82000000 [ 0x000000 - 0x6cb068 ]
    ## Flattened Device Tree blob at 88000000
       Booting using the fdt blob at 0x88000000
       Loading Device Tree to 8ffe7000, end 8fffff26 ... OK
    
    Starting kernel ...
    
    [    0.000000] Booting Linux on physical CPU 0x0
    [    0.000000] Linux version 4.4.32-rt41+ (SAFRAN-E&D@Massy) () #4 SMP PREEMPT Mon Nov 19 11:00:00 UTC 2018
    [    0.000000] CPU: ARMv7 Processor [412fc0f2] revision 2 (ARMv7), cr=10c5387d
    [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
    [    0.000000] Machine model: TI AM5718 VAHM GE9X
    [    0.000000] debug: ignoring loglevel setting.
    [    0.000000] Reserved memory: created CMA memory pool at 0x99000000, size 64 MiB
    [    0.000000] Reserved memory: initialized node dsp1_cma@99000000, compatible id shared-dma-pool
    [    0.000000] cma: Reserved 24 MiB at 0x9e400000
    [    0.000000] Memory policy: Data cache writealloc
    [    0.000000] OMAP4: Map 0x9fe00000 to fe600000 for dram barrier
    [    0.000000] On node 0 totalpages: 108032
    [    0.000000] free_area_init_node: node 0, pgdat c0acd9c0, node_mem_map de000000
    [    0.000000]   Normal zone: 1024 pages used for memmap
    [    0.000000]   Normal zone: 0 pages reserved
    [    0.000000]   Normal zone: 108032 pages, LIFO batch:31
    [    0.000000] DRA722 ES2.0
    [    0.000000] PERCPU: Embedded 12 pages/cpu @dfd69000 s18176 r8192 d22784 u49152
    [    0.000000] pcpu-alloc: s18176 r8192 d22784 u49152 alloc=12*4096
    [    0.000000] pcpu-alloc: [0] 0 
    [    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 107008
    [    0.000000] Kernel command line: console=ttyS0,115200n8 ignore_loglevel debug root=/dev/ram0 rw
    [    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
    [    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
    [    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
    [    0.000000] Memory: 326324K/432128K available (4455K kernel code, 202K rwdata, 1316K rodata, 5060K init, 169K bss, 15692K reserved, 90112K cma-reserved, 0K highmem)
    [    0.000000] Virtual kernel memory layout:
    [    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    [    0.000000]     fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
    [    0.000000]     vmalloc : 0xe0800000 - 0xff800000   ( 496 MB)
    [    0.000000]     lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
    [    0.000000]     pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
    [    0.000000]     modules : 0xbf000000 - 0xbfe00000   (  14 MB)
    [    0.000000]       .text : 0xc0008000 - 0xc05aafec   (5772 kB)
    [    0.000000]       .init : 0xc05ab000 - 0xc0a9c000   (5060 kB)
    [    0.000000]       .data : 0xc0a9c000 - 0xc0ace8c0   ( 203 kB)
    [    0.000000]        .bss : 0xc0ace8c0 - 0xc0af8eb4   ( 170 kB)
    [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
    [    0.000000] Preemptible hierarchical RCU implementation.
    [    0.000000] 	Build-time adjustment of leaf fanout to 32.
    [    0.000000] 	RCU restricting CPUs from NR_CPUS=2 to nr_cpu_ids=1.
    [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=32, nr_cpu_ids=1
    [    0.000000] NR_IRQS:16 nr_irqs:16 16
    [    0.000000] ti_dt_clocks_register: failed to lookup clock node gmac_gmii_ref_clk_div
    [    0.000000] OMAP clockevent source: timer1 at 32786 Hz
    [    0.000000] Architected cp15 timer(s) running at 6.14MHz (virt).
    [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x16af5adb9, max_idle_ns: 440795202250 ns
    [    0.000006] sched_clock: 56 bits at 6MHz, resolution 162ns, wraps every 4398046511023ns
    [    0.000020] Switching to timer-based delay loop, resolution 162ns
    [    0.000405] clocksource: 32k_counter: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 58327039986419 ns
    [    0.000415] OMAP clocksource: 32k_counter at 32768 Hz
    [    0.000847] Console: colour dummy device 80x30
    [    0.000872] Calibrating delay loop (skipped), value calculated using timer frequency.. 12.29 BogoMIPS (lpj=61475)
    [    0.000890] pid_max: default: 32768 minimum: 301
    [    0.000983] Security Framework initialized
    [    0.001025] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
    [    0.001037] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
    [    0.001619] CPU: Testing write buffer coherency: ok
    [    0.001882] /cpus/cpu@0 missing clock-frequency property
    [    0.001900] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
    [    0.001957] Setting up static identity map for 0x80008280 - 0x800082d8
    [    0.060177] Brought up 1 CPUs
    [    0.060192] SMP: Total of 1 processors activated (12.29 BogoMIPS).
    [    0.060202] CPU: All CPU(s) started in SVC mode.
    [    0.061419] devtmpfs: initialized
    [    0.110124] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0
    [    0.111689] omap_hwmod: l3_main_2 using broken dt data from ocp
    [    0.383545] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
    [    0.385352] pinctrl core: initialized pinctrl subsystem
    [    0.386431] NET: Registered protocol family 16
    [    0.388113] DMA: preallocated 256 KiB pool for atomic coherent allocations
    [    0.410559] cpuidle: using governor ladder
    [    0.440598] cpuidle: using governor menu
    [    0.453297] OMAP GPIO hardware version 0.1
    [    0.482199] omap-gpmc 50000000.gpmc: could not find pctldev for node /ocp/l4@4a000000/scm@2000/pinmux@1400/gpmc_pins_default, deferring probe
    [    0.488794] omap4_sram_init:Unable to allocate sram needed to handle errata I688
    [    0.488809] omap4_sram_init:Unable to get sram pool needed to handle errata I688
    [    0.489075] OMAP DMA hardware revision 0.0
    [    0.577730] omap-dma-engine 4a056000.dma-controller: OMAP DMA engine driver (LinkedList1/2/3 supported)
    [    0.579091] edma 43300000.edma: memcpy is disabled
    [    0.586839] edma 43300000.edma: TI EDMA DMA engine driver
    [    0.591799] omap-iommu 40d01000.mmu: 40d01000.mmu registered
    [    0.592021] omap-iommu 40d02000.mmu: 40d02000.mmu registered
    [    0.592218] omap-iommu 58882000.mmu: 58882000.mmu registered
    [    0.592858] SCSI subsystem initialized
    [    0.593503] pps_core: LinuxPPS API ver. 1 registered
    [    0.593515] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
    [    0.593552] PTP clock support registered
    [    0.601887] clocksource: Switched to clocksource arch_sys_counter
    [    0.616682] NET: Registered protocol family 2
    [    0.617395] TCP established hash table entries: 4096 (order: 2, 16384 bytes)
    [    0.617446] TCP bind hash table entries: 4096 (order: 3, 32768 bytes)
    [    0.617531] TCP: Hash tables configured (established 4096 bind 4096)
    [    0.617592] UDP hash table entries: 256 (order: 1, 8192 bytes)
    [    0.617621] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
    [    0.617813] NET: Registered protocol family 1
    [    2.679196] futex hash table entries: 256 (order: 2, 16384 bytes)
    [    2.697190] VFS: Disk quotas dquot_6.6.0
    [    2.697410] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
    [    2.699183] jffs2: version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
    [    2.704972] NET: Registered protocol family 38
    [    2.705052] io scheduler noop registered
    [    2.705073] io scheduler deadline registered
    [    2.705284] io scheduler cfq registered (default)
    [    2.710578] pinctrl-single 4a003400.pinmux: 282 pins at pa fc003400 size 1128
    [    2.710704] pinctrl-single 4a002e8c.pinmux: 1 pins at pa fc002e8c size 4
    [    2.717495] Serial: 8250/16550 driver, 10 ports, IRQ sharing disabled
    [    2.722049] console [ttyS0] disabled
    [    2.722115] 4806a000.serial: ttyS0 at MMIO 0x4806a000 (irq = 299, base_baud = 3000000) is a 8250
    [    3.354277] console [ttyS0] enabled
    [    3.358615] 48020000.serial: ttyS2 at MMIO 0x48020000 (irq = 300, base_baud = 3000000) is a 8250
    [    3.379089] brd: module loaded
    [    3.469728] loop: module loaded
    [    3.474154] mtdoops: mtd device (mtddev=name/number) must be supplied
    [    3.481285] libphy: Fixed MDIO Bus: probed
    [    3.531926] davinci_mdio 48485000.mdio: davinci mdio revision 1.6
    [    3.537811] davinci_mdio 48485000.mdio: detected phy mask fffffff7
    [    3.561021] libphy: 48485000.mdio: probed
    [    3.565002] davinci_mdio 48485000.mdio: phy[3]: device 48485000.mdio:03, driver unknown
    [    3.578221] cpsw 48484000.ethernet: Detected MACID = 98:5d:ad:a7:59:ca
    [    3.584867] cpsw 48484000.ethernet: cpts: overflow check period 800
    [    3.592038] cpsw 48484000.ethernet: cpsw: Detected MACID = 98:5d:ad:a7:59:cb
    [    3.599641] i2c /dev entries driver
    [    3.603990] omap-aes 4b500000.aes: OMAP AES hw accel rev: 3.3
    [    3.610546] omap-aes 4b700000.aes: OMAP AES hw accel rev: 3.3
    [    3.616819] omap-des 480a5000.des: OMAP DES hw accel rev: 2.2
    [    3.623844] omap-sham 4b101000.sham: hw accel on OMAP rev 4.3
    [    3.632160] Initializing XFRM netlink socket
    [    3.636312] NET: Registered protocol family 17
    [    3.640656] NET: Registered protocol family 15
    [    3.645321] omap_voltage_late_init: Voltage driver support not added
    [    3.651820] Power Management for TI OMAP4+ devices.
    [    3.656894] ThumbEE CPU extension supported.
    [    3.661036] Registering SWP/SWPB emulation handler
    [    3.677438] omap-gpmc 50000000.gpmc: GPMC revision 6.0
    [    3.682542] gpmc_mem_init: disabling cs 0 mapped at 0x0-0x1000000
    [    3.690078] pbias_mmc_omap5: disabling
    [    3.699694] Freeing unused kernel memory: 5060K (c05ab000 - c0a9c000)
    [    3.753120] spi_slave_rx: size of buffers = 7508 bytes
    [    3.758088] spi_slave_rx: number of buffers = 16
    [    3.767822] mcspi_slave_rx 480b8000.spi: targeted controller is MCSPI3
    [    3.774630] mcspi_slave_rx 480b8000.spi: registered slave rx spi_slave_rx3
    [    3.786310] bus for spi_slave_rx is spi_slave_rx3.0
    [    3.791185] spi_slave_rx spi_slave_rx3.0: setup mode 0, 16 bits/w, 30000000 Hz max --> 1
    [    3.799628] divio spi_slave_rx3.0: driver probed
    [    3.804390] divio divio0: new device created
    [    3.808553] mcspi_slave_rx 480b8000.spi: registered child spi_slave_rx3.0
    Starting mdev...
    [    4.861268] m25p80 spi32766.0: found n25q512ax3, expected n25q512a
    [    4.888119] m25p80 spi32766.0: n25q512ax3 (65536 Kbytes)
    [    4.900176] 9 ofpart partitions found on MTD device spi32766.0
    [    4.905882] Creating 9 MTD partitions on "spi32766.0":
    [    4.910849] 0x000000000000-0x000000020000 : "mtd_hmrs_mlo"
    [    4.928152] 0x000000020000-0x0000000f0000 : "mtd_hmrs_uboot"
    [    4.958060] 0x0000000f0000-0x000000100000 : "mtd_hmrs_env"
    [    5.010655] 0x000000100000-0x000000bc0000 : "mtd_hmrs_zimage"
    [    5.040485] 0x000000bc0000-0x000000c00000 : "mtd_hmrs_dtb"
    [    5.093085] 0x000000c00000-0x000001400000 : "mtd_aml"
    [    5.133388] 0x000001400000-0x000002bc0000 : "mtd_hmos_zimage"
    [    5.175569] 0x000002bc0000-0x000002c00000 : "mtd_hmos_dtb"
    [    5.201661] 0x000002c00000-0x000004000000 : "mtd_loads"
    [    5.249294] omap_rng 48090000.rng: OMAP Random Number Generator ver. 20
    [    5.339475] libata version 3.00 loaded.
    [    5.390760] ahci 4a140000.sata: AHCI 0001.0300 32 slots 1 ports 3 Gbps 0x0 impl platform mode
    [    5.407521] ahci 4a140000.sata: flags: 64bit ncq sntf pm led clo only pmp pio slum part ccc apst 
    [    5.442207] scsi host0: ahci
    [    5.446716] ata1: DUMMY
    Configuring network interfaces... [    5.529710] net eth0: initializing cpsw version 1.15 (0)
    [    5.535120] net eth0: initialized cpsw ale version 1.4
    [    5.540082] net eth0: ALE Table size 1024
    [    5.622091] net eth0: phy found : id is : 0x0
    [    5.626451] cpsw-phy-sel 4a002554.cpsw-phy-sel: RMII External clock is not supported
    [    5.681382] net eth1: initializing cpsw version 1.15 (0)
    [    5.765207] net eth1: phy found : id is : 0x20005c90
    [    5.770154] cpsw-phy-sel 4a002554.cpsw-phy-sel: RMII External clock is not supported
    done.
    root: /etc/rc5.d/S05set-chan-netaddr: eth0 @IP:  192.168.1.20
    root: /etc/rc5.d/S05set-chan-netaddr: eth0 @MAC: FE:FF:FF:FF:FF:1A
    root: /etc/rc5.d/S05set-chan-netaddr: eth1 @IP:  192.168.2.20
    root: /etc/rc5.d/S05set-chan-netaddr: eth1 @MAC: FE:FF:FF:FF:FF:2A
    Starting the NAND kernel module...
    [    5.981023] nand: nand_decode_bbm_options: mtd->writesize=8192
    [    6.009345] nand: nand_decode_bbm_options: chip->options=0x00010200
    [    6.015478] nand: nand_decode_bbm_options: chip->badblockpos=NAND_LARGE_BADBLOCK_POS
    [    6.023233] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0x68
    [    6.029365] nand: Micron MT29F32G08ABAAAWP
    [    6.033366] nand: 4096 MiB, SLC, erase size: 1024 KiB, page size: 8192, OOB size: 448
    [    6.040925] omap2-nand 8000000.nand: xfer_type=0
    [    6.045717] omap2-nand 8000000.nand: ecc_opt=6
    [    6.050006] using OMAP_ECC_BCH16_CODE_HW ECC scheme
    [    6.054807] 1 ofpart partitions found on MTD device 8000000.nand
    [    6.060604] Creating 1 MTD partitions on "8000000.nand":
    [    6.065942] 0x000000000000-0x000100000000 : "mtd_nand"
    Creating MTD symbolic links...
    Mounting MTD devices (NAND/UBIFS)...
    [    6.602559] ubi0: attaching mtd9
    [    7.622082] cpsw 48484000.ethernet eth0: Link is Up - 10Mbps/Full - flow control off
    [   14.826678] ubi0: scanning is finished
    [   14.844287] ubi0: attached mtd9 (name "mtd_nand", size 4096 MiB)
    [   14.850090] ubi0: PEB size: 1048576 bytes (1024 KiB), LEB size: 1032192 bytes
    [   14.882951] ubi0: min./max. I/O unit sizes: 8192/8192, sub-page size 8192
    [   14.889510] ubi0: VID header offset: 8192 (aligned 8192), data offset: 16384
    [   14.896499] ubi0: good PEBs: 4093, bad PEBs: 3, corrupted PEBs: 0
    [   14.902425] ubi0: user volume: 2, internal volumes: 1, max. volumes count: 128
    [   14.909395] ubi0: max/mean erase counter: 621/319, WL threshold: 4096, image sequence number: 1352186190
    [   14.918727] ubi0: available PEBs: 0, total reserved PEBs: 4093, PEBs reserved for bad PEB handling: 77
    [   14.927760] ubi0: background thread "ubi_bgt0d" started, PID 341
    [   14.962096] UBIFS (ubi0:0): background thread "ubifs_bgt0_0" started, PID 347
    [   15.209091] UBIFS (ubi0:0): recovery needed
    [   16.074804] UBIFS (ubi0:0): recovery completed
    [   16.079107] UBIFS (ubi0:0): UBIFS: mounted UBI device 0, volume 0, name "log"
    [   16.086015] UBIFS (ubi0:0): LEB size: 1032192 bytes (1008 KiB), min./max. I/O unit sizes: 8192 bytes/8192 bytes
    [   16.095768] UBIFS (ubi0:0): FS size: 94961664 bytes (90 MiB, 92 LEBs), journal size 8257537 bytes (7 MiB, 6 LEBs)
    [   16.105684] UBIFS (ubi0:0): reserved for root: 4485273 bytes (4380 KiB)
    [   16.112088] UBIFS (ubi0:0): media format: w4/r0 (latest is w4/r0), UUID 842951A4-2357-49CA-A5DA-64B20FC56107, small LPT model
    [   16.152045] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 351
    [   16.395894] UBIFS (ubi0:1): recovery needed
    [   17.053910] UBIFS (ubi0:1): recovery completed
    [   17.058215] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "hmfudata"
    [   17.065544] UBIFS (ubi0:1): LEB size: 1032192 bytes (1008 KiB), min./max. I/O unit sizes: 8192 bytes/8192 bytes
    [   17.075298] UBIFS (ubi0:1): FS size: 4025548800 bytes (3839 MiB, 3900 LEBs), journal size 33030144 bytes (31 MiB, 32 LEBs)
    [   17.085969] UBIFS (ubi0:1): reserved for root: 4952683 bytes (4836 KiB)
    [   17.092373] UBIFS (ubi0:1): media format: w4/r0 (latest is w4/r0), UUID 025CE49E-998C-4BC7-9F5E-CAC5EECCC808, small LPT model
    root: /etc/rc5.d/S16ubifsmount: mounting of hmfudata/log (ubifs) done
    Starting syslogd/klogd: done
    Mounting MTD devices (NOR/JFFS2)...
    root: /etc/rc5.d/S25jffs2mount: directory /opt/hmfu/.loads was missing, created
    root: /etc/rc5.d/S25jffs2mount: mounting of /opt/hmfu/.loads (jffs2) done
    root: /etc/rc5.d/S25jffs2mount: mounting of /opt/hmfu/.loads/aml (jffs2) done
    Starting HMAS...
    
    
    health-monitoring 1.0 am57xx-vahm /dev/ttyS0
    
    
    
    am57xx-vahm login: [   19.182988] random: nonblocking pool is initialized
    [   20.951878] sched: RT throttling activated
    [   40.151884] INFO: rcu_preempt self-detected stall on CPU
    [   40.157027] 	0-...: (2100 ticks this GP) idle=b05/140000000000002/0 softirq=0/0 fqs=0 
    [   40.164662] 	 (t=2100 jiffies g=112 c=111 q=6)
    [   40.168963] rcu_preempt kthread starved for 2100 jiffies! g112 c111 f0x0 s3 ->state=0x1
    [   40.176682] Task dump for CPU 0:
    [   40.179795] main_VAHM       R running      0   392      1 0x00000002
    [   40.185944] Backtrace: 
    [   40.188334] [<c0013550>] (dump_backtrace) from [<c001374c>] (show_stack+0x18/0x1c)
    [   40.195633]  r7:c0a9e884 r6:800f0193 r5:00000001 r4:d837d400
    [   40.201145] [<c0013734>] (show_stack) from [<c005684c>] (sched_show_task+0xbc/0x110)
    [   40.208617] [<c0056790>] (sched_show_task) from [<c0058860>] (dump_cpu_task+0x40/0x48)
    [   40.216251]  r5:c0aae600 r4:00000000
    [   40.219727] [<c0058820>] (dump_cpu_task) from [<c007cad4>] (rcu_dump_cpu_stacks+0x94/0xd0)
    [   40.227697]  r5:c0aae600 r4:00000001
    [   40.231172] [<c007ca40>] (rcu_dump_cpu_stacks) from [<c0080b88>] (rcu_check_callbacks+0x520/0x8d4)
    [   40.239810]  r9:dfd6d1c0 r8:c0aae600 r7:00000006 r6:c0a9e140 r5:1f2d3000 r4:c0a9a1c0
    [   40.247343] [<c0080668>] (rcu_check_callbacks) from [<c0083c38>] (update_process_times+0x48/0x6c)
    [   40.255899]  r10:c009401c r9:00000001 r8:dfd69c0c r7:00000009 r6:00000000 r5:d837d400
    [   40.263506]  r4:ffffe000
    [   40.265970] [<c0083bf0>] (update_process_times) from [<c0094018>] (tick_sched_handle+0x50/0x54)
    [   40.274357]  r7:00000009 r6:59207946 r5:d7043b40 r4:dfd69e88
    [   40.279866] [<c0093fc8>] (tick_sched_handle) from [<c0094078>] (tick_sched_timer+0x5c/0xa0)
    [   40.287928] [<c009401c>] (tick_sched_timer) from [<c00846b0>] (__hrtimer_run_queues+0x11c/0x1ac)
    [   40.296399]  r7:00000000 r6:dfd69c00 r5:dfd69e88 r4:dfd69bc0
    [   40.301909] [<c0084594>] (__hrtimer_run_queues) from [<c0084ed4>] (hrtimer_interrupt+0xbc/0x208)
    [   40.310381]  r10:dfd69c60 r9:dfd69ce0 r8:dfd69ca0 r7:dfd69bd8 r6:ffffffff r5:00000003
    [   40.317988]  r4:dfd69bc0
    [   40.320453] [<c0084e18>] (hrtimer_interrupt) from [<c037a7e4>] (arch_timer_handler_virt+0x38/0x40)
    [   40.329091]  r10:d7043b40 r9:ddc06000 r8:ddc3af00 r7:ddc04e40 r6:00000013 r5:c0ab4bcc
    [   40.336695]  r4:dfd6f840
    [   40.339157] [<c037a7ac>] (arch_timer_handler_virt) from [<c0076c64>] (handle_percpu_devid_irq+0x90/0xa8)
    [   40.348306] [<c0076bd4>] (handle_percpu_devid_irq) from [<c0072634>] (generic_handle_irq+0x2c/0x3c)
    [   40.357028]  r9:ddc06000 r8:00000001 r7:d7043c60 r6:00000013 r5:00000000 r4:c0a971e4
    [   40.364558] [<c0072608>] (generic_handle_irq) from [<c007292c>] (__handle_domain_irq+0x84/0xf4)
    [   40.372953] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
    [   40.381005]  r10:d7043c60 r9:fa213000 r8:fa212000 r7:d7043b40 r6:fa21200c r5:c0a9eac8
    [   40.388612]  r4:c0ab4bc8 r3:d7043b40
    [   40.392084] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
    [   40.399301] Exception stack(0xd7043b40 to 0xd7043b88)
    [   40.404180] 3b40: 00000000 c053a6c4 c0acfb40 00000000 00000002 ffffe000 00000013 00000000
    [   40.412072] 3b60: 00000001 ddc06000 d7043c60 d7043bec d7043b80 d7043b90 c025c938 c003462c
    [   40.419959] 3b80: 200f0113 ffffffff
    [   40.423323]  r9:ddc06000 r8:00000001 r7:d7043b74 r6:ffffffff r5:200f0113 r4:c003462c
    [   40.430854] [<c0034584>] (__do_softirq) from [<c0034ef8>] (irq_exit+0xc8/0x104)
    [   40.437901]  r10:d7043c60 r9:ddc06000 r8:00000001 r7:00000000 r6:00000013 r5:00000000
    [   40.445507]  r4:c0a971e4
    [   40.447967] [<c0034e30>] (irq_exit) from [<c0072930>] (__handle_domain_irq+0x88/0xf4)
    [   40.455518]  r5:00000000 r4:c0a971e4
    [   40.458993] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
    [   40.467046]  r10:ddf2f4a8 r9:fa213000 r8:fa212000 r7:d7043c60 r6:fa21200c r5:c0a9eac8
    [   40.474650]  r4:c0ab4bc8 r3:d7043c60
    [   40.478121] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
    [   40.485338] Exception stack(0xd7043c60 to 0xd7043ca8)
    [   40.490214] 3c60: c0af1e34 00000017 00000000 fa020000 0000005c 000000ff c0af1e34 d7005c00
    [   40.498105] 3c80: d7005d5c 00000000 ddf2f4a8 d7043ccc d7043ca0 d7043cb0 c0019984 c02d12d0
    [   40.505992] 3ca0: a00f0013 ffffffff
    [   40.509355]  r9:00000000 r8:d7005d5c r7:d7043c94 r6:ffffffff r5:a00f0013 r4:c02d12d0
    [   40.516888] [<c02d12a0>] (mem_serial_out) from [<c02d5710>] (omap_8250_startup+0x120/0x1ec)
    [   40.524941]  r7:d7005c00 r6:00000000 r5:ddf38610 r4:c0af1e34
    [   40.530448] [<c02d55f0>] (omap_8250_startup) from [<c02d2fb8>] (serial8250_startup+0x1c/0x28)
    [   40.538667]  r6:00000000 r5:ddc4f1d0 r4:c0af1e34
    [   40.543160] [<c02d2f9c>] (serial8250_startup) from [<c02cea4c>] (uart_startup.part.4+0x84/0x194)
    [   40.551637] [<c02ce9c8>] (uart_startup.part.4) from [<c02cf698>] (uart_open+0xc4/0x120)
    [   40.559355]  r9:00400042 r8:00000000 r7:d81a76c0 r6:ddc4f260 r5:d7005c00 r4:ddc4f1d0
    [   40.566885] [<c02cf5d4>] (uart_open) from [<c02b35e4>] (tty_open+0x108/0x6ac)
    [   40.573765]  r9:00400042 r8:d7042000 r7:c0ae4f18 r6:00000100 r5:d81a76c0 r4:d7005c00
    [   40.581294] [<c02b34dc>] (tty_open) from [<c00e4534>] (chrdev_open+0xac/0x180)
    [   40.588257]  r10:d7043f5c r9:00000000 r8:ddf2e6c0 r7:d81a76c0 r6:ddf2f4a8 r5:ddf2e6c0
    [   40.595863]  r4:c048f22c
    [   40.598325] [<c00e4488>] (chrdev_open) from [<c00de444>] (do_dentry_open+0x220/0x318)
    [   40.605874]  r8:c00e4488 r7:d82bfe00 r6:d81a76c8 r5:ddf2f4a8 r4:d81a76c0
    [   40.612398] [<c00de224>] (do_dentry_open) from [<c00df548>] (vfs_open+0x60/0x88)
    [   40.619529]  r10:d7043f5c r9:dd8013b8 r8:00000000 r7:00000000 r6:d7043eb0 r5:d81a76c0
    [   40.627136]  r4:d7043eb0 r3:d82bfe00
    [   40.630608] [<c00df4e8>] (vfs_open) from [<c00ecd10>] (path_openat+0x17c/0xfd0)
    [   40.637656]  r5:00000000 r4:00000102
    [   40.641131] [<c00ecb94>] (path_openat) from [<c00eed48>] (do_filp_open+0x6c/0xd0)
    [   40.648345]  r10:00000000 r9:d7042000 r8:c000fd24 r7:00000001 r6:d7043f5c r5:d7043eb0
    [   40.655949]  r4:00000007
    [   40.658407] [<c00eecdc>] (do_filp_open) from [<c00df8ac>] (do_sys_open+0x118/0x1dc)
    [   40.665789]  r7:fffff000 r6:ddf33000 r5:ffffff9c r4:00000007
    [   40.671292] [<c00df794>] (do_sys_open) from [<c00df990>] (SyS_open+0x20/0x24)
    [   40.678172]  r9:d7042000 r8:c000fd24 r7:00000005 r6:00000000 r5:b6e91d67 r4:b6e91550
    [   40.685702] [<c00df970>] (SyS_open) from [<c000fb60>] (ret_fast_syscall+0x0/0x44)
    [  103.181881] INFO: rcu_preempt self-detected stall on CPU
    [  103.187023] 	0-...: (8350 ticks this GP) idle=b05/140000000000002/0 softirq=0/0 fqs=0 
    [  103.194658] 	 (t=8403 jiffies g=112 c=111 q=6)
    [  103.198958] rcu_preempt kthread starved for 8403 jiffies! g112 c111 f0x0 s3 ->state=0x1
    [  103.206676] Task dump for CPU 0:
    [  103.209789] main_VAHM       R running      0   392      1 0x00000002
    [  103.215939] Backtrace: 
    [  103.218318] [<c0013550>] (dump_backtrace) from [<c001374c>] (show_stack+0x18/0x1c)
    [  103.225618]  r7:c0a9e884 r6:800f0193 r5:00000001 r4:d837d400
    [  103.231125] [<c0013734>] (show_stack) from [<c005684c>] (sched_show_task+0xbc/0x110)
    [  103.238598] [<c0056790>] (sched_show_task) from [<c0058860>] (dump_cpu_task+0x40/0x48)
    [  103.246231]  r5:c0aae600 r4:00000000
    [  103.249703] [<c0058820>] (dump_cpu_task) from [<c007cad4>] (rcu_dump_cpu_stacks+0x94/0xd0)
    [  103.257671]  r5:c0aae600 r4:00000001
    [  103.261144] [<c007ca40>] (rcu_dump_cpu_stacks) from [<c0080b88>] (rcu_check_callbacks+0x520/0x8d4)
    [  103.269783]  r9:dfd6d1c0 r8:c0aae600 r7:00000006 r6:c0a9e140 r5:1f2d3000 r4:c0a9a1c0
    [  103.277308] [<c0080668>] (rcu_check_callbacks) from [<c0083c38>] (update_process_times+0x48/0x6c)
    [  103.285863]  r10:c009401c r9:00000001 r8:dfd69c0c r7:00000018 r6:00000000 r5:d837d400
    [  103.293467]  r4:ffffe000
    [  103.295929] [<c0083bf0>] (update_process_times) from [<c0094018>] (tick_sched_handle+0x50/0x54)
    [  103.304316]  r7:00000018 r6:0601ec3d r5:d7043b40 r4:dfd69e88
    [  103.309824] [<c0093fc8>] (tick_sched_handle) from [<c0094078>] (tick_sched_timer+0x5c/0xa0)
    [  103.317885] [<c009401c>] (tick_sched_timer) from [<c00846b0>] (__hrtimer_run_queues+0x11c/0x1ac)
    [  103.326355]  r7:00000000 r6:dfd69c00 r5:dfd69e88 r4:dfd69bc0
    [  103.331863] [<c0084594>] (__hrtimer_run_queues) from [<c0084ed4>] (hrtimer_interrupt+0xbc/0x208)
    [  103.340335]  r10:dfd69c60 r9:dfd69ce0 r8:dfd69ca0 r7:dfd69bd8 r6:ffffffff r5:00000003
    [  103.347940]  r4:dfd69bc0
    [  103.350403] [<c0084e18>] (hrtimer_interrupt) from [<c037a7e4>] (arch_timer_handler_virt+0x38/0x40)
    [  103.359041]  r10:d7043b40 r9:ddc06000 r8:ddc3af00 r7:ddc04e40 r6:00000013 r5:c0ab4bcc
    [  103.366647]  r4:dfd6f840
    [  103.369107] [<c037a7ac>] (arch_timer_handler_virt) from [<c0076c64>] (handle_percpu_devid_irq+0x90/0xa8)
    [  103.378255] [<c0076bd4>] (handle_percpu_devid_irq) from [<c0072634>] (generic_handle_irq+0x2c/0x3c)
    [  103.386978]  r9:ddc06000 r8:00000001 r7:d7043c60 r6:00000013 r5:00000000 r4:c0a971e4
    [  103.394507] [<c0072608>] (generic_handle_irq) from [<c007292c>] (__handle_domain_irq+0x84/0xf4)
    [  103.402901] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
    [  103.410954]  r10:d7043c60 r9:fa213000 r8:fa212000 r7:d7043b40 r6:fa21200c r5:c0a9eac8
    [  103.418560]  r4:c0ab4bc8 r3:d7043b40
    [  103.422032] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
    [  103.429248] Exception stack(0xd7043b40 to 0xd7043b88)
    [  103.434125] 3b40: 00000000 c053a6c4 c0acfb40 00000000 00000002 ffffe000 00000013 00000000
    [  103.442017] 3b60: 00000001 ddc06000 d7043c60 d7043bec d7043b80 d7043b90 c025c938 c003462c
    [  103.449903] 3b80: 200f0113 ffffffff
    [  103.453265]  r9:ddc06000 r8:00000001 r7:d7043b74 r6:ffffffff r5:200f0113 r4:c003462c
    [  103.460798] [<c0034584>] (__do_softirq) from [<c0034ef8>] (irq_exit+0xc8/0x104)
    [  103.467847]  r10:d7043c60 r9:ddc06000 r8:00000001 r7:00000000 r6:00000013 r5:00000000
    [  103.475453]  r4:c0a971e4
    [  103.477913] [<c0034e30>] (irq_exit) from [<c0072930>] (__handle_domain_irq+0x88/0xf4)
    [  103.485463]  r5:00000000 r4:c0a971e4
    [  103.488937] [<c00728a8>] (__handle_domain_irq) from [<c0009538>] (gic_handle_irq+0x50/0x94)
    [  103.496989]  r10:ddf2f4a8 r9:fa213000 r8:fa212000 r7:d7043c60 r6:fa21200c r5:c0a9eac8
    [  103.504592]  r4:c0ab4bc8 r3:d7043c60
    [  103.508064] [<c00094e8>] (gic_handle_irq) from [<c0014294>] (__irq_svc+0x54/0xa4)
    [  103.515280] Exception stack(0xd7043c60 to 0xd7043ca8)
    [  103.520157] 3c60: c0af1e34 00000017 00000000 fa020000 0000005c 000000ff c0af1e34 d7005c00
    [  103.528048] 3c80: d7005d5c 00000000 ddf2f4a8 d7043ccc d7043ca0 d7043cb0 c0019984 c02d12d0
    [  103.535934] 3ca0: a00f0013 ffffffff
    [  103.539298]  r9:00000000 r8:d7005d5c r7:d7043c94 r6:ffffffff r5:a00f0013 r4:c02d12d0
    [  103.546828] [<c02d12a0>] (mem_serial_out) from [<c02d5710>] (omap_8250_startup+0x120/0x1ec)
    [  103.554879]  r7:d7005c00 r6:00000000 r5:ddf38610 r4:c0af1e34
    [  103.560385] [<c02d55f0>] (omap_8250_startup) from [<c02d2fb8>] (serial8250_startup+0x1c/0x28)
    [  103.568604]  r6:00000000 r5:ddc4f1d0 r4:c0af1e34
    [  103.573095] [<c02d2f9c>] (serial8250_startup) from [<c02cea4c>] (uart_startup.part.4+0x84/0x194)
    [  103.581572] [<c02ce9c8>] (uart_startup.part.4) from [<c02cf698>] (uart_open+0xc4/0x120)
    [  103.589290]  r9:00400042 r8:00000000 r7:d81a76c0 r6:ddc4f260 r5:d7005c00 r4:ddc4f1d0
    [  103.596818] [<c02cf5d4>] (uart_open) from [<c02b35e4>] (tty_open+0x108/0x6ac)
    [  103.603698]  r9:00400042 r8:d7042000 r7:c0ae4f18 r6:00000100 r5:d81a76c0 r4:d7005c00
    [  103.611226] [<c02b34dc>] (tty_open) from [<c00e4534>] (chrdev_open+0xac/0x180)
    [  103.618189]  r10:d7043f5c r9:00000000 r8:ddf2e6c0 r7:d81a76c0 r6:ddf2f4a8 r5:ddf2e6c0
    [  103.625793]  r4:c048f22c
    [  103.628255] [<c00e4488>] (chrdev_open) from [<c00de444>] (do_dentry_open+0x220/0x318)
    [  103.635804]  r8:c00e4488 r7:d82bfe00 r6:d81a76c8 r5:ddf2f4a8 r4:d81a76c0
    [  103.642329] [<c00de224>] (do_dentry_open) from [<c00df548>] (vfs_open+0x60/0x88)
    [  103.649459]  r10:d7043f5c r9:dd8013b8 r8:00000000 r7:00000000 r6:d7043eb0 r5:d81a76c0
    [  103.657064]  r4:d7043eb0 r3:d82bfe00
    [  103.660537] [<c00df4e8>] (vfs_open) from [<c00ecd10>] (path_openat+0x17c/0xfd0)
    [  103.667585]  r5:00000000 r4:00000102
    [  103.671058] [<c00ecb94>] (path_openat) from [<c00eed48>] (do_filp_open+0x6c/0xd0)
    [  103.678273]  r10:00000000 r9:d7042000 r8:c000fd24 r7:00000001 r6:d7043f5c r5:d7043eb0
    [  103.685878]  r4:00000007
    [  103.688335] [<c00eecdc>] (do_filp_open) from [<c00df8ac>] (do_sys_open+0x118/0x1dc)
    [  103.695717]  r7:fffff000 r6:ddf33000 r5:ffffff9c r4:00000007
    [  103.701221] [<c00df794>] (do_sys_open) from [<c00df990>] (SyS_open+0x20/0x24)
    [  103.708102]  r9:d7042000 r8:c000fd24 r7:00000005 r6:00000000 r5:b6e91d67 r4:b6e91550
    [  103.715629] [<c00df970>] (SyS_open) from [<c000fb60>] (ret_fast_syscall+0x0/0x44)
    Safran comment: ... endless rcu_preempt...

    Thanks,
      Benoît

  • Dear Benoît,

    Give me a day or so to look into your error log and I will follow up.

    -Josue

  • Hi Josue,

    many thanks for digging into it!

    For your information, I will be unavaillable from 18 to 30 september. 
    And I am afraid no one in my company will be availlable to follow on this topic, I am sorry for that...

    Regards,
      Benoît

  • Josue,

    Thanks for the notification,

    This kernel is legacy code, so the drivers are not supported like they are on the latest kernel.

    With that being said..

    I have a couple of ideas on how we can make sure we narrow down the culprit. Are you able to set up an SSH connection for output?

    My idea is to disable the UART node in DT and attempt to recreate the issue again. If the issue does not reoccur, then UART is the culprit, if the issue does occur then we have to search elsewhere.

    Can you try this and report the results?

    -Josue

  • Hello Josue,

    I am back again on this topic.

    Indeed, we had such test in mind (disconnect UART link to check if the issue still occurs on Sitara) and launched it 15 days ago, but unfortunately, the issue detection was not reliable enough and stopped for bad reason. I will improve and start again, but due to the low occurence rate and the cycle time, it will take 14 tbc days to confirm.

    Another test is to saturate the UART link (use of 100% UART bandwith instead of current UART link use at ~1%).

    thank you for being so patient...
      Benoît

  • Benoît,

    No worries, from your boot logs, it seems like the crash happens after the kernel finishes booting and the HMAS application starts loading.

     

    Starting HMAS...
    
    
    health-monitoring 1.0 am57xx-vahm /dev/ttyS0
    
    
    
    am57xx-vahm login: [   19.182988] random: nonblocking pool is initialized
    [   20.951878] sched: RT throttling activated

    Is using JTAG and looking around with the emulator not an option? You could also insert many log prints into the driver to try to see where it is at when it crashes.

    I also found this piece of Linux documentation that could be helpful https://www.kernel.org/doc/Documentation/RCU/stallwarn.txt.

    Best,

    Josue

  • Josue,

    yes, we prepared a SW version with added log prints and the complete symbols, to be able to use the emulator more adequately.

    Now waiting for the next issue...

    Regards,
      Benoît

  • Hi Benoît,

    Josue who is looking this issue in on PTO today and will be back tomorrow. So please expect delay in responding to your query.

    Thanks.