AM5726: Reboot not working

Mahesh Prajapati

Part Number: AM5726

We are upgrading the SDK 05..03.0.00.7 on our customized board and facing issue of reboot command is not working if we can use the reboot -f and it is working fine.

SDK : 05.03.00.07

Kernel : 4.14.79

Please refer below log for reboot command

[ 39.883977] watchdog: watchdog0: watchdog did not stop!

[   39.895636] systemd-shutdow: 158 output lines suppressed due to ratelimiting
[   39.983483] systemd-shutdown[1]: Sending SIGTERM to remaining processes...
[   39.998960] systemd-journald[84]: Received SIGTERM from PID 1 (systemd-shutdow).
[   40.081458] systemd-shutdown[1]: Sending SIGKILL to remaining processes...
[   40.095874] systemd-shutdown[1]: Hardware watchdog 'OMAP Watchdog', version 0
[   40.105298] systemd-shutdown[1]: Unmounting file systems.
[   40.111149] systemd-shutdown[1]: Remounting '/' read-only with options 'data=ordered'.
[   40.155119] EXT4-fs (mmcblk0p2): re-mounted. Opts: data=ordered
[   40.172085] systemd-shutdown[1]: Remounting '/' read-only with options 'data=ordered'.
[   40.180330] EXT4-fs (mmcblk0p2): re-mounted. Opts: data=ordered
[   40.186389] systemd-shutdown[1]: All filesystems unmounted.
[   40.192092] systemd-shutdown[1]: Deactivating swaps.
[   40.197294] systemd-shutdown[1]: All swaps deactivated.
[   40.202798] systemd-shutdown[1]: Detaching loop devices.
<<<<<<<<<<<<<<<STUCK HERE >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

over 6 years ago

0 Pavel Botev over 6 years ago

TI__Guru**** 170625 points

Hi Mahesh,

From what I understand you are using AM572x custom board with PSDK Linux 5.03 (kernel 4.14.79).

reboot command is NOT working, while "reboot -f" command is working fine.

Can you provide full console log starting from the reboot command execution? Please provide non-working and working logs. You can put these logs in txt files and attach these txt files here in this e2e thread.

Regards,
Pavel

0 Mahesh Prajapati over 6 years ago in reply to Pavel Botev

Intellectual 300 points

Please refer working and non working logs and also attached same in text file

Fullscreen Reboot_command_log.txt Download

Please refer working and non working log



Non -Working log

===================================================================== 

reboot

[  OK  ] Closed Load/Save RF Kill Switch Status /dev/rfkill Watch.
         Stopping User Manager for UID 0...
         Stopping Session c1 of user root.
[  OK  ] Stopped target Timers.
[  OK  ] Stopped Daily rotation of log files.
[  OK  ] Stopped Daily Cleanup of Temporary Directories.
         Stopping TI MultiCore Tools Daemon...[   48.793886] Watchdog Timer is disabled

         Stopping NFS status monitor for[  OK  ] Stopped Kernel Logging Service.
[  OK  ] Stopped Job spooling tools.
[   48.855345] ubi: mtd13 is already attached to ubi1
[  OK  ] Stopped Periodic Command Scheduler.
[  OK  ] Stopped strongSwan IPsec IKEv1/IKEv2 daemon using[  OK  ] Stopped Permit User Sessions.
udhcpc (v1.24.1) started
[  OK  ] Stopped target Remote File Systems.
eth0      Link encap:Ethernet  HWaddr B0:7E:11:12:E2:C6  
          inet addr:10.100.108.236  Bcast:10.100.111.255  Mask:255.255.248.0
          inet6 addr: fe80::b27e:11ff:fe12:e2c6%3068667288/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:368 errors:0 dropped:13 overruns:0 frame:0
          TX packets:66 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:31239 (30.5 KiB)  TX bytes:6140 (5.9 KiB)
          Interrupt:97 

am57xx-evm
variable is null Default is US/Estern
[  OK  ] Stopped Network Name Resolution.
[  OK  ] Stopped target Network.
         Stopping Network Service...
Sending discover...
Sending select for 10.100.108.236...
[  OK  ] Stopped Network Service.
Lease of 10.100.108.236 obtained, lease time 1209600
deleting routers
am57xx-evm
variable is null Default is US/Estern
adding dns 192.168.6.55
adding dns 192.168.6.56
adding dns 10.107.0.18
[  OK  ] Stopped g3z-init.service.
         Stopping thermal-zone-init.service...
[  OK  ] Stopped thermal-zone-init.service.
         Stopping rng-tools.service...
[  OK  ] Stopped rng-tools.service.
         Stopping rc.pvr.service...
[  OK  ] Stopped rc.pvr.service.
         Stopping uim-sysfs.service...
[  OK  ] Stopped uim-sysfs.service.
[  OK  ] Stopped target Basic System.
[  OK  ] Stopped target Slices.
[  OK  ] Removed slice User and Session Slice.
[  OK  ] Stopped target Paths.
[  OK  ] Stopped Forward Password Requests to Wall Directory Watch.
[  OK  ] Stopped Dispatch Password Requests to Console Directory Watch.
[  OK  ] Stopped target Sockets.
[  OK  ] Closed RPCbind Server Activation Socket.
[  OK  ] Closed Syslog Socket.
[  OK  ] Closed D-Bus System Message Bus Socket.
[  OK  ] Stopped target System Initialization.
         Stopping Network Time Synchronization...
         Stopping Load/Save Random Seed...
[  OK  ] Stopped Apply Kernel Variables.
[  OK  ] Stopped Load Kernel Modules.
[  OK  ] Stopped Network Time Synchronization.
[  OK  ] Stopped Load/Save Random Seed.
[  OK  ] Stopped Create Volatile Files and Directories.
[  OK  ] Stopped target Local File Systems.
         Unmounting /mnt/nand...
         Unmounting /run/user/0...
         Unmounting Temporary Directory (/tmp)...
         Unmounting /media/ram...
         Unmounting /var/volatile...
[FAILED] Failed unmounting /mnt/nand.
[  OK  ] Unmounted /run/user/0.
[  OK  ] Unmounted Temporary Directory (/tmp).
[  OK  ] Unmounted /media/ram.
[FAILED] Failed unmounting /var/volatile.
[  OK  ] Stopped target Swap.
[  OK  ] Reached target Unmount All Filesystems.
[  OK  ] Stopped target Local File Systems (Pre).
[  OK  ] Stopped Create Static Device Nodes in /dev.
[  OK  ] Stopped Remount Root and Kernel File Systems.
[  OK  ] Reached target Shutdown.
[   51.175501] watchdog: watchdog0: watchdog did not stop!
[   51.186259] systemd-shutdow: 30 output lines suppressed due to ratelimiting
[   51.279515] systemd-shutdown[1]: Sending SIGTERM to remaining processes...
[   51.297364] systemd-journald[74]: Received SIGTERM from PID 1 (systemd-shutdow).
[   51.502258] systemd-shutdown[1]: Sending SIGKILL to remaining processes...
[   51.516705] systemd-shutdown[1]: Hardware watchdog 'OMAP Watchdog', version 0
[   51.526486] systemd-shutdown[1]: Unmounting file systems.
[   51.532342] systemd-shutdown[1]: Remounting '/mnt/nand' read-only with options 'ubi=1,vol=0'.
[   51.545118] UBIFS (ubi1:0): background thread "ubifs_bgt1_0" stops
[   51.552887] systemd-shutdown[1]: Unmounting /mnt/nand.
[   51.571466] UBIFS (ubi1:0): un-mount UBI device 1
[   51.611149] systemd-shutdown[1]: Remounting '/var/volatile' read-only with options 'size=51200k'.
[   51.620213] systemd-shutdown[1]: Unmounting /var/volatile.
[   51.671037] systemd-shutdown[1]: Remounting '/' read-only with options 'ubi=0,vol=0'.
[   51.679857] systemd-shutdown[1]: Remounting '/' read-only with options 'ubi=0,vol=0'.



Working Log
======================================================================================================

root@am57xx-evm:~# 
root@am57xx-evm:~# reboot -f
Rebooting.
[   96.108448] reboot: Restarting system

Non -Working log

=====================================================================

reboot

[ OK ] Closed Load/Save RF Kill Switch Status /dev/rfkill Watch.

Stopping User Manager for UID 0...

Stopping Session c1 of user root.

[ OK ] Stopped target Timers.

[ OK ] Stopped Daily rotation of log files.

[ OK ] Stopped Daily Cleanup of Temporary Directories.

Stopping TI MultiCore Tools Daemon...[ 48.793886] Watchdog Timer is disabled

Stopping NFS status monitor for[ OK ] Stopped Kernel Logging Service.

[ OK ] Stopped Job spooling tools.

[ 48.855345] ubi: mtd13 is already attached to ubi1

[ OK ] Stopped Periodic Command Scheduler.

[ OK ] Stopped strongSwan IPsec IKEv1/IKEv2 daemon using[ OK ] Stopped Permit User Sessions.

udhcpc (v1.24.1) started

[ OK ] Stopped target Remote File Systems.

eth0 Link encap:Ethernet HWaddr B0:7E:11:12:E2:C6

inet addr:10.100.108.236 Bcast:10.100.111.255 Mask:255.255.248.0

inet6 addr: fe80::b27e:11ff:fe12:e2c6%3068667288/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:368 errors:0 dropped:13 overruns:0 frame:0

TX packets:66 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:31239 (30.5 KiB) TX bytes:6140 (5.9 KiB)

Interrupt:97

am57xx-evm

variable is null Default is US/Estern

[ OK ] Stopped Network Name Resolution.

[ OK ] Stopped target Network.

Stopping Network Service...

Sending discover...

Sending select for 10.100.108.236...

[ OK ] Stopped Network Service.

Lease of 10.100.108.236 obtained, lease time 1209600

deleting routers

am57xx-evm

variable is null Default is US/Estern

adding dns 192.168.6.55

adding dns 192.168.6.56

adding dns 10.107.0.18

[ OK ] Stopped g3z-init.service.

Stopping thermal-zone-init.service...

[ OK ] Stopped thermal-zone-init.service.

Stopping rng-tools.service...

[ OK ] Stopped rng-tools.service.

Stopping rc.pvr.service...

[ OK ] Stopped rc.pvr.service.

Stopping uim-sysfs.service...

[ OK ] Stopped uim-sysfs.service.

[ OK ] Stopped target Basic System.

[ OK ] Stopped target Slices.

[ OK ] Removed slice User and Session Slice.

[ OK ] Stopped target Paths.

[ OK ] Stopped Forward Password Requests to Wall Directory Watch.

[ OK ] Stopped Dispatch Password Requests to Console Directory Watch.

[ OK ] Stopped target Sockets.

[ OK ] Closed RPCbind Server Activation Socket.

[ OK ] Closed Syslog Socket.

[ OK ] Closed D-Bus System Message Bus Socket.

[ OK ] Stopped target System Initialization.

Stopping Network Time Synchronization...

Stopping Load/Save Random Seed...

[ OK ] Stopped Apply Kernel Variables.

[ OK ] Stopped Load Kernel Modules.

[ OK ] Stopped Network Time Synchronization.

[ OK ] Stopped Load/Save Random Seed.

[ OK ] Stopped Create Volatile Files and Directories.

[ OK ] Stopped target Local File Systems.

Unmounting /mnt/nand...

Unmounting /run/user/0...

Unmounting Temporary Directory (/tmp)...

Unmounting /media/ram...

Unmounting /var/volatile...

[FAILED] Failed unmounting /mnt/nand.

[ OK ] Unmounted /run/user/0.

[ OK ] Unmounted Temporary Directory (/tmp).

[ OK ] Unmounted /media/ram.

[FAILED] Failed unmounting /var/volatile.

[ OK ] Stopped target Swap.

[ OK ] Reached target Unmount All Filesystems.

[ OK ] Stopped target Local File Systems (Pre).

[ OK ] Stopped Create Static Device Nodes in /dev.

[ OK ] Stopped Remount Root and Kernel File Systems.

[ OK ] Reached target Shutdown.

[ 51.175501] watchdog: watchdog0: watchdog did not stop!

[ 51.186259] systemd-shutdow: 30 output lines suppressed due to ratelimiting

[ 51.279515] systemd-shutdown[1]: Sending SIGTERM to remaining processes...

[ 51.297364] systemd-journald[74]: Received SIGTERM from PID 1 (systemd-shutdow).

[ 51.502258] systemd-shutdown[1]: Sending SIGKILL to remaining processes...

[ 51.516705] systemd-shutdown[1]: Hardware watchdog 'OMAP Watchdog', version 0

[ 51.526486] systemd-shutdown[1]: Unmounting file systems.

[ 51.532342] systemd-shutdown[1]: Remounting '/mnt/nand' read-only with options 'ubi=1,vol=0'.

[ 51.545118] UBIFS (ubi1:0): background thread "ubifs_bgt1_0" stops

[ 51.552887] systemd-shutdown[1]: Unmounting /mnt/nand.

[ 51.571466] UBIFS (ubi1:0): un-mount UBI device 1

[ 51.611149] systemd-shutdown[1]: Remounting '/var/volatile' read-only with options 'size=51200k'.

[ 51.620213] systemd-shutdown[1]: Unmounting /var/volatile.

[ 51.671037] systemd-shutdown[1]: Remounting '/' read-only with options 'ubi=0,vol=0'.

[ 51.679857] systemd-shutdown[1]: Remounting '/' read-only with options 'ubi=0,vol=0'.

Working Log

======================================================================================================

root@am57xx-evm:~#

root@am57xx-evm:~# reboot -f

Rebooting.

[ 96.108448] reboot: Restarting system

0 Pavel Botev over 6 years ago in reply to Mahesh Prajapati

TI__Guru**** 170625 points

Mahesh,

Mahesh Prajapati said:
[FAILED] Failed unmounting /mnt/nand.

Mahesh Prajapati said:
[ 51.679857] systemd-shutdown[1]: Remounting '/' read-only with options 'ubi=0,vol=0'.

Do you have your filesystem (rootfs) on NAND flash? It seems to me you have some errors in your NAND UBIFS and it can not be safely unmounted.

Can you try to place your filesystem on MMC/SD card and try reboot in this use case? On my side (AM572x EVM with SD card rootfs) I have:

[ OK ] Unmounted /run/media/mmcblk1p3.
[ OK ] Unmounted /run/media/mmcblk0p1.
[ OK ] Unmounted /var/volatile.
[ OK ] Unmounted /run/media/mmcblk1p2.
[ OK ] Unmounted /media/ram.
[ OK ] Unmounted /run/user/0.
[ OK ] Unmounted /run/media/mmcblk1p1.
..........
[   68.086701] systemd-shutdown[1]: Hardware watchdog 'OMAP Watchdog', version 0
[   68.096161] systemd-shutdown[1]: Unmounting file systems.
[   68.102015] systemd-shutdown[1]: Remounting '/' read-only with options 'data=ordered'.
[   68.162892] EXT4-fs (mmcblk0p2): re-mounted. Opts: data=ordered
[   68.181889] systemd-shutdown[1]: Remounting '/' read-only with options 'data=ordered'.
[   68.189935] EXT4-fs (mmcblk0p2): re-mounted. Opts: data=ordered
[   68.195928] systemd-shutdown[1]: All filesystems unmounted.
[   68.201562] systemd-shutdown[1]: Deactivating swaps.
[   68.206716] systemd-shutdown[1]: All swaps deactivated.
[   68.212323] systemd-shutdown[1]: Detaching loop devices.
[   68.300828] reboot: Restarting system

U-Boot SPL 2018.01-g825ac6e1ac (Apr 06 2019 - 06:02:20)

You can also try to manually unmount NAND flash filesystem and see if that will work.

Regards,
Pavel

0 Mahesh Prajapati over 6 years ago in reply to Pavel Botev

Intellectual 300 points

Yes, rootf file system on NAND flash

We have also tried to boot from SD card and there is no luck

Regards,

Mahesh

0 Pavel Botev over 6 years ago in reply to Mahesh Prajapati

TI__Guru**** 170625 points

Mahesh,

In MMC/SD card case, can you put the log (boot up + reboot command) in txt file and attached it here in this e2e thread?

Also you state that this problem occur in PSDK Linux 05..03.0.00.7, but do reboot command working fine on older PSDK Linux version?

Do all your custom boards have the same reboot issue, or only one board?

Regards,
Pavel

0 Mahesh Prajapati over 6 years ago in reply to Pavel Botev

Intellectual 300 points

Hi Pavel

Please find txt file for boot up and reboot command

Yes older PSDK-04.03.00.05 working fine the reboot command

Yes, all costume board have the same issue and we flashed older PSDK-04.03.00.05 in same boards and it working fine

Regards,

Mahesh

boot_up_reboo.txt

0 Pavel Botev over 6 years ago in reply to Mahesh Prajapati

TI__Guru**** 170625 points

Mahesh,

I can provide you the below debug hints:

1. Make sure you are using create-sdcard.sh script to create your bootable SD card

2. "omap_hwmod: gpu: cannot be enabled for reset (3)" - do you have the same message in PSDK 4.03 boot up flow? If no, fix this kernel error message and try reboot

3. "rtc_ds1307: disagrees about version of symbol device_property_present"

"extcon_palmas: disagrees about version of symbol dev_err"

"rtc_palmas: disagrees about version of symbol dev_err"

"rtc_omap: disagrees about version of symbol _dev_info"

Do you have these error messages in PSDK 4.03 boot up flow? If no, fix this kernel error messages and try reboot

Regards,
Pavel

Processors

Processors forum

AM5726: Reboot not working