This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM3874 Linux console hangs

Other Parts Discussed in Thread: AM3874, ASH, TLC59108

Hello,

We are developing a custom board based on AM3874 processor that operates under Linux 2.6.37.

We have a problem that looks to be very similar to one described here 

serial console periodically hangs, but in our case we have the same behavior for jffs2/nand and for NFS rootfs.

According to top the CPU is not busy at all and there is enough free memory

Mem: 8356K used, 164252K free, 0K shrd, 0K buff, 2576K cached
CPU: 0.0% usr 0.0% sys 0.0% nic 100% idle 0.0% io 0.0% irq 0.0% sirq
Load average: 0.00 0.00 0.00 1/38 72
PID PPID USER STAT VSZ %VSZ CPU %CPU COMMAND
62 1 root S 3284 1.8 0 0.0 -/bin/ash
1 0 root S 3280 1.8 0 0.0 init
59 1 root S 3280 1.8 0 0.0 /sbin/syslogd
61 1 root S 3280 1.8 0 0.0 /usr/sbin/telnetd
72 62 root R 3280 1.8 0 0.0 top -d 1
43 2 root SWN 0 0.0 0 0.0 [jffs2_gcd_mtd8]
3 2 root SW 0 0.0 0 0.0 [ksoftirqd/0]
15 2 root SW 0 0.0 0 0.0 [sync_supers]
66 2 root SW 0 0.0 0 0.0 [kworker/0:1]
2 0 root SW 0 0.0 0 0.0 [kthreadd]
4 2 root SW 0 0.0 0 0.0 [kworker/0:0]
5 2 root SW 0 0.0 0 0.0 [kworker/u:0]
6 2 root SW< 0 0.0 0 0.0 [khelper]
7 2 root SW< 0 0.0 0 0.0 [netns]
8 2 root SW 0 0.0 0 0.0 [irq/72-serial i]
9 2 root SW 0 0.0 0 0.0 [irq/73-serial i]
10 2 root SW 0 0.0 0 0.0 [irq/74-serial i]
11 2 root SW 0 0.0 0 0.0 [irq/44-serial i]
12 2 root SW 0 0.0 0 0.0 [irq/45-serial i]
13 2 root SW 0 0.0 0 0.0 [irq/46-serial i]

Does anyone have any idea what could be wrong?

Thanks,

Anatoly

  • Hi Anatoly,

    Anatoly Goldstein said:
    serial console periodically hangs

    Can you provide more details regarding this hang issue? I am using NFS rootfs and I do not observe console hang in the DM814x/AM387x TI EVM terminal.

    I am using NFS rootfs from the DM814x/AM387x EZSDK with slight modifications:

    ti-ezsdk_dm814x-evm_5_05_02_00/filesystem/ezsdk-dm814x-evm-rootfs.tar.gz

    BR
    Pavel

  • Hi, Pavel.

    Unfortunately I haven't much details.

    We use Linux kernel from ti-ezsdk_dm814x-evm_5_04_00_11 and rootfs that we created based on busybox (not from ti-ezsdk).

    If we run it from NAND than the system starts working more or less normally, but in a few minutes its performance slows down.

    With NFS rootfs we see bad performance from the very beginning.

    We tried to use file system from ti-ezsdk_dm814x-evm_5_05_02_00, but than the system couldn't start Linux, you can see partial log in attachment.

    I do not think that in our case performance problem relates to rootfs, maybe its something in kernel configuration.

    Thanks,

    Anatoly

    8741.ezsdk_nfs.txt

    Root-NFS: nfsroot=/tftpboot/rootfs,nfsvers=4,clientaddr=192.168.1.109NFS: nfs mount opts='nfsvers=4,clientaddr=192.168.1.109,nolock,addr=192.168.1.109'NFS:   parsing nfs mount option 'nfsvers=4'NFS:   parsing nfs mount option 'clientaddr=192.168.1.109'NFS:   parsing nfs mount option 'nolock'NFS:   parsing nfs mount option 'addr=192.168.1.109'NFS: MNTPATH: '/tftpboot/rootfs'--> nfs4_try_mount()PHY: 0:01 - Link is Up - 100/Full<-- nfs4_try_mount() = 0VFS: Mounted root (nfs4 filesystem) on device 0:15.devtmpfs: mountedFreeing init memory: 260K192.168.1.109-m used greatest stack depth: 5020 bytes leftINIT: version 2.86 bootingwarning: can't open /etc/mtab: No such file or dmount used greatest stack depth: 4380 bytes leftirectorymount: only root can mount proc on /procgrep: /proc/cmdline: No such file or directory/etc/rcS.d/S01psplash: line 16: can't open /proc/cpuinfo: no such fileS01psplash used greatest stack depth: 4316 bytes left/etc/rcS.d/S01psplash: line 16: can't open /proc/cpuinfo: no such filemount: only root can do that (effective UID is -2)Please wait: booting...S02banner used greatest stack depth: 4296 bytes leftmount: only root can do that (effective UID is -2)grep: /proc/filesystems: No suchS03sysfs used greatest stack depth: 4244 bytes left file or directoryError Cannot open /dev/tty0: Permission deniedError opening /dev/fb0: No such file or directorymount: only root can do that (effective UID is -2)uname used greatest stack depth: 4032 bytes leftgrep: /proc/mounts: No such file or directorygrep: /proc/mounts: No such file or directoryRemounting root file system...mount: only root can do that (effective UID is -2)mount: only root can do that (effective UID is -2)mount: only root can do that (effective UID is -2)Caching udev devnodesWARNING: -e needs -E or -FFATAL: Could not open /lib/modules/2.6.37/modules.dep.temp for writing: Permission deniedlogger: mount: only root can do that (effective UID is -2)/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedchown: /var/volatile/cache: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/volatile/lock: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedchmod: /var/volatile/cache: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedchown: /var/volatile/tmp: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/volatile/tmp: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/volatile/log: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/volatile/run: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/volatile/run: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/volatile/log: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/volatile/lock: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedtouch: /var/log/wtmp: Permission deniedchown: /var/lock/subsys: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/log/wtmp: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/log/wtmp: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedtouch: /var/log/lastlog: Permission deniedchmod: /var/lock/subsys: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedtouch: /var/run/utmp: Permission deniedchown: /var/log/lastlog: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/log/lastlog: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/run/utmp: Invalid argument/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission denied/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/run/utmp: Operation not permitted/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission denied/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedtouch: /var/run/resolv.conf: Permission deniedtouch: /var/run/resolv.conf: Permission deniedchown: /var/run/resolv.conf: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/run/resolv.conf: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchown: /var/run/resolv.conf: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedchmod: /var/run/resolv.conf: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedUndefined users:Skipping /etc/default/volatiles/99_hal/etc/init.d/rc: /etc/rcS.d/S37populate-volatile.sh: line 1: can't create /etc/volatile.cache: Permission deniedmkdir: cannot create directory '/var/run/wpa_supplicant': Permission deniedgrep: /proc/filesystems: No such file or directorychown: /var/run/wpa_supplicant: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission deniedALSA: Restoring mixer settings...chmod: /var/run/wpa_supplicant: No such file or directory/etc/init.d/rc: eval: line 1: can't create /dev/tty0: Permission denied/usr/sbin/alsactl: load_state:1625: No soundcards found...hostname: permission denied. (are you root?)rm: cannot remove '/etc/rcS.d/S40configure': Permission deniedsed: /proc/mounts: No such file or directoryCollected errors: * opkg_conf_load: Could not create lock file /usr/lib/opkg/lock: Permission denied.sed: /proc/mounts: No such file or directorysed: /proc/mounts: No such file or directoryConfiguring network interfaces... ifconfig: SIOCSIFADDR: Permission deniedifup: can't open '/var/run/ifstate': Permission denieddone.Setting up IP spoofing protection: FAILED.grep: /proc/mounts: No such file or directoryrm: cannot remove '/tmp': Permission deniedhwclock: can't open '/dev/misc/rtc': No such file or directorydate: cannot set date: Operation not permittedMon Dec 31 10:37:00 UTC 2012hwclock: can't open '/dev/misc/rtc': No such file or directory/etc/init.d/rc: /etc/rcS.d/S99finish.sh: line 5: can't create /etc/.configured: Permission deniedINIT: Entering runlevel: 5Loading HDVICP2 FirmwareDM814X prcm_config_app version: 2.0.0.1Could not open the mem fileDoing PRCM settings...        PRCM for IVHD0 is in Progress, Please wait.....Could not map the register at addr: 0x48180600Segmentation faultFATAL: Could not load /lib/modules/2.6.37/modules.dep: No such file or directory

  • Anatoly,

    Can you first modify ti-ezsdk_dm814x-evm_5_04_00_11/filesystem/ezsdk-dm814x-evm-rootfs.tar.gz as below and then try again:

    1. Remove /targetfs/lib/modules/2.6.37/kernel/net/ipv6/ipv6.ko
    2. Edit /targetfs/etc/init.d/load-hd-firmware.sh

    case "$1" in
    start)
    #echo "Loading HDVICP2 Firmware"
    #prcm_config_app s
    #modprobe syslink
    #until [[ -e /dev/syslinkipc_ProcMgr && -e /dev/syslinkipc_ClientNotifyMgr ]]
    #do
    # sleep 0.5
    #done
    #firmware_loader $HDVICP2_ID /usr/share/ti/ti-media-controller-utils/dm814x_hdvicp.xem3 start
    #echo "Loading HDVPSS Firmware"
    #firmware_loader $HDVPSS_ID /usr/share/ti/ti-media-controller-utils/dm814x_hdvpss.xem3 start
    #modprobe vpss sbufaddr=0xBFB00000 mode=hdmi:1080p-60 i2c_mode=1
    #modprobe ti81xxfb vram=0:24M,1:16M,2:6M
    #configure_lcd
    #modprobe ti81xxhdmi
    #modprobe tlc59108
    ;;

    Can you also try with the minimal rootfs ti-ezsdk_dm814x-evm_5_04_00_11/filesystem/arago-base-tisdk-image-dm814x-evm.tar.gz

    Can you also try with the default linux kernel image?

    ti-ezsdk_dm814x-evm_5_04_00_11/board-support/linux-2.6.37-psp04.04.00.01
    $ make CROSS_COMPILE=arm-none-linux-gnueabi- ARCH=arm distclean
    $ make CROSS_COMPILE=arm-none-linux-gnueabi- ARCH=arm ti8148_evm_defconfig
    $ make CROSS_COMPILE=arm-none-linux-gnueabi- ARCH=arm uImage

    BR
    Pavel
  • Pavel,

    I tried both modified ti-ezsdk_dm814x-evm_5_04_00_11 rootfs and minimal rootfs and got the same result as with ti-ezsdk_dm814x-evm_5_05.

    I cannot run original linux image as we work with custom board, but I configured linux kernel as close as possible to ti8148_evm_defconfig and got exactly the same results.

    So now I'm probably have to check HW configuration.

    Anatoly

  • Anatoly,

    You can use the DM814x/AM387x TI EVM UART HW diagnostic tests to check.

    UART0 - This CCS test application validates the UART-0 Port on the board for its connectivity. This test configures the UART-0 for 115200,8,N and verified the transmission & receiption functionality in polled mode. This test case requries the external loop-back cable to be connected to the UART-0 port (that is connector P2 - DM814X DB9) on the DM814X EVM Base board.

    UART_0_EchoTest - This CCS test application validates the UART-0 Port on the board for its connectivity. This test configures the UART-0 for 115200,8,N and verified the transmission & receiption functionality in polled mode. This test case requries the one end of serial cabel to be connected to the UART-0 port (that is connector P2 - DM814X DB9) on the DM814X EVM Base board and other end to the pc.This does Uart0 echo test.

    You might modify these CCS/JTAG based test to match your custom board.

    BR
    Pavel