This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

PROCESSOR-SDK-AM62A: Deep Sleep Error on Linux SDK 10.01.00.05

Part Number: PROCESSOR-SDK-AM62A
Other Parts Discussed in Thread: SK-AM62A-LP, AM62P

Tool/software:

Using SDK 10.01.00.05 on the SK-AM62A-LP board, attempting to evaluate low power mode characteristics, and am encountering both of the failure modes seen in this E2E post.

I'm encountering their first error when using the pre-compiled Linux SDK binary (download) linked from the EVK product page (printk output below):

root@am62axx-evm:/opt/edgeai-gst-apps# echo mem > /sys/power/state
[   61.280981] PM: suspend entry (deep)
[   61.435793] Filesystems sync: 0.151 seconds
[   61.442022] Freezing user space processes
[   61.447664] Freezing user space processes completed (elapsed 0.001 seconds)
[   61.454655] OOM killer disabled.
[   61.457881] Freezing remaining freezable tasks
[   61.463580] Freezing remaining freezable tasks completed (elapsed 0.001 seconds)
[   61.484017] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 179: state: 1: ret 0
[   61.494081] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 178: state: 1: ret 0
[   61.511906] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 117: state: 1: ret 0
[   62.524727] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_suspend+0x144/0x170)
[   62.534225] ti-sci 44043000.system-controller: Mbox send fail -110
[   62.540402] ti-sci 44043000.system-controller: PM: dpm_run_callback(): platform_pm_suspend+0x0/0x6c returns -110
[   62.550573] ti-sci 44043000.system-controller: PM: failed to suspend: error -110
[   62.557964] PM: Some devices failed to suspend, or early wake event detected
[   62.565025] Internal error: synchronous external abort: 0000000096000010 [#1] PREEMPT SMP
[   62.573185] Modules linked in: wave5 overlay cfg80211 bluetooth ecdh_generic ecc rfkill snd_soc_hdmi_codec rpmsg_ctrl rpmsg_char crct10dif_ce snd_soc_simple_card snd_soc_simple_card_utils e5010_jpeg_enc rtc_ti_k3 display_connector v4l2_jpeg k3_j72xx_bandgap rti_wdt ti_k3_r5_remoteproc videobuf2_dma_contig tps6598x videobuf2_memops v4l2_mem2mem tidss videobuf2_v4l2 snd_soc_davinci_mcasp typec sii902x snd_soc_ti_udma drm_dma_helper videobuf2_common mcrc64 drm_kms_helper snd_soc_ti_edma snd_soc_ti_sdma ti_k3_dsp_remoteproc videodev omap_hwspinlock snd_soc_tlv320aic3x_i2c sa2ul mc snd_soc_tlv320aic3x omap_mailbox cryptodev(O) fuse drm drm_panel_orientation_quirks backlight ipv6 [last unloaded: wave5]
[   62.634886] CPU: 3 PID: 1458 Comm: sh Tainted: G           O       6.6.58-ti-01497-ga7758da17c28-dirty #1
[   62.644434] Hardware name: Texas Instruments AM62A7 SK (DT)
[   62.649992] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   62.656939] pc : e5010_hw_bypass_mmu+0x4/0x28 [e5010_jpeg_enc]
[   62.662774] lr : e5010_init_device+0x20/0x134 [e5010_jpeg_enc]
[   62.668602] sp : ffff800082debac0
[   62.671904] x29: ffff800082debac0 x28: ffff000813248e40 x27: 0000000000000000
[   62.679029] x26: 0000000000000000 x25: ffff800081478500 x24: ffff8000813b9840
[   62.686154] x23: ffff800080738674 x22: 0000000000000000 x21: ffff00080166f480
[   62.693278] x20: ffff00080015d010 x19: ffff00080166f480 x18: 0000000000000006
[   62.700402] x17: 7463657465642074 x16: 6e65766520656b61 x15: ffff800082deb620
[   62.707527] x14: 0000000000000000 x13: ffff8000812ef178 x12: 000000000000066f
[   62.714651] x11: 0000000000000225 x10: ffff800081347178 x9 : ffff8000812ef178
[   62.721777] x8 : 00000000ffffefff x7 : 0000000000019a27 x6 : 000000033e2b2bb0
[   62.728901] x5 : 03ffffffffffffff x4 : 00284af100000000 x3 : 0000000000000018
[   62.736025] x2 : 0000000000003380 x1 : 0000000000000001 x0 : ffff800082241270
[   62.743149] Call trace:
[   62.745588]  e5010_hw_bypass_mmu+0x4/0x28 [e5010_jpeg_enc]
[   62.751069]  e5010_resume+0x30/0x80 [e5010_jpeg_enc]
[   62.756029]  pm_generic_resume+0x2c/0x44
[   62.759946]  ti_sci_pd_resume+0x20/0x2c
[   62.763775]  __device_resume+0x84/0x230
[   62.767606]  dpm_resume+0x9c/0x124
[   62.771001]  dpm_resume_end+0x18/0x30
[   62.774656]  suspend_devices_and_enter+0x1b0/0x550
[   62.779439]  pm_suspend+0x1ac/0x260
[   62.782917]  state_store+0x80/0xec
[   62.786314]  kobj_attr_store+0x18/0x2c
[   62.790059]  sysfs_kf_write+0x44/0x54
[   62.793716]  kernfs_fop_write_iter+0x120/0x1cc
[   62.798150]  vfs_write+0x1c0/0x308
[   62.801546]  ksys_write+0x74/0x10c
[   62.804941]  __arm64_sys_write+0x1c/0x28
[   62.808855]  invoke_syscall+0x48/0x114
[   62.812599]  el0_svc_common.constprop.0+0xc0/0xe0
[   62.817293]  do_el0_svc+0x1c/0x28
[   62.820600]  el0_svc+0x2c/0x84
[   62.823647]  el0t_64_sync_handler+0x120/0x12c
[   62.827995]  el0t_64_sync+0x190/0x194
[   62.831651] Code: 9124e021 95bdbea0 17ffffe8 9101c000 (b9400002)
[   62.837730] ---[ end trace 0000000000000000 ]---

and encountering their second error when using the tiny image installed by the installer script (download) from the same page (printk output below, truncated after the first 2 repeats of the mmc1 register dump):

root@am62axx-evm:~# echo mem > /sys/power/state
[  201.133120] PM: suspend entry (deep)
[  201.147862] Filesystems sync: 0.011 seconds
[  201.153154] Freezing user space processes
[  201.158514] Freezing user space processes completed (elapsed 0.001 seconds)
[  201.165506] OOM killer disabled.
[  201.168723] Freezing remaining freezable tasks
[  201.174341] Freezing remaining freezable tasks completed (elapsed 0.001 seconds)
[  201.194829] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 179: state: 1
: ret 0
[  201.204890] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 178: state: 1
: ret 0
[  202.232779] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_suspend+0x144/0x17
0)
[  202.242295] ti-sci 44043000.system-controller: Mbox send fail -110
[  202.248476] ti-sci 44043000.system-controller: PM: dpm_run_callback(): platform_pm_suspend+0x0/0x6c re
turns -110
[  202.258648] ti-sci 44043000.system-controller: PM: failed to suspend: error -110
[  202.266038] PM: Some devices failed to suspend, or early wake event detected
[  203.288769] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_device_exc
lusive+0x18/0x24)
[  203.299557] ti-sci 44043000.system-controller: Mbox send fail -110
[  203.305737] spi-nand spi0.0: resume failed with -110
[  204.312775] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: k3_ringacc_ring_cfg_sci+0
x94/0xf8)
[  204.322877] ti-sci 44043000.system-controller: RM_RA:Mbox config send fail -110
[  204.330181] ti-udma 485c0000.dma-controller: TISCI config ring fail (-110) ring_idx 19
[  204.338097] am65-cpsw-nuss 8000000.ethernet: Failed to cfg ringtx -110
[  204.344709] am65-cpsw-nuss 8000000.ethernet: error -ETIMEDOUT: Failed to request tx dma channel
[  204.353413] am65-cpsw-nuss 8000000.ethernet: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110
[  204.363154] am65-cpsw-nuss 8000000.ethernet: PM: failed to resume: error -110
[  205.400767] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34)
[  206.434593] ti-sci 44043000.system-controller: Mbox send fail -110
[  207.448771] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34)
[  207.458599] ti-sci 44043000.system-controller: Mbox send fail -110
[  207.464782] sdhci-am654 fa10000.mmc: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110
[  207.473824] sdhci-am654 fa10000.mmc: PM: failed to resume: error -110
[  208.504768] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34)
[  208.514598] ti-sci 44043000.system-controller: Mbox send fail -110
[  208.520780] sdhci-am654 fa00000.mmc: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110
[  208.529822] sdhci-am654 fa00000.mmc: PM: failed to resume: error -110
[  209.560770] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec)
[  209.570771] ti-sci 44043000.system-controller: Mbox send fail -110
[  209.576948] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110
[  210.616770] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec)
[  210.626769] ti-sci 44043000.system-controller: Mbox send fail -110
[  210.632944] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110
[  211.672766] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec)
[  211.682765] ti-sci 44043000.system-controller: Mbox send fail -110
[  211.688940] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110
[  211.699625] cpu cpu0: _opp_config_clk_single: failed to set clock rate: -22
[  211.706579] cpufreq: __target_index: Failed to change cpu frequency: -22
[  211.714114] OOM killer enabled.
[  211.717284] Restarting tasks ... done.
[  211.722677] random: crng reseeded on system resumption
[  211.728006] PM: suspend exit
sh: write error: Connection timed out
root@am62axx-evm:~# [  212.728779] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_device_exclusive+0x18/0x24)
[  212.728788] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  212.728819] ti-sci 44043000.system-controller: Mbox send fail -110
[  212.739593] ti-sci 44043000.system-controller: Mbox send fail -110
[  212.749500] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34)
[  212.771660] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  212.781583] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  212.791495] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  212.801416] ti-sci 44043000.system-controller: Mbox send fail -110
[  212.807604] ti-sci 44043000.system-controller: Mbox send fail -110
[  212.813803] ti-sci 44043000.system-controller: Mbox send fail -110
[  212.820027] ti-sci 44043000.system-controller: Mbox send fail -110
[  213.848774] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  213.858699] ti-sci 44043000.system-controller: Mbox send fail -110
[  216.120769] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24)
[  216.130701] ti-sci 44043000.system-controller: Mbox send fail -110
[  223.992756] mmc1: Timeout waiting for hardware cmd interrupt.
[  223.998501] mmc1: sdhci: ============ SDHCI REGISTER DUMP ===========
[  224.004926] mmc1: sdhci: Sys addr:  0x00000000 | Version:  0x00001004
[  224.011351] mmc1: sdhci: Blk size:  0x00000000 | Blk cnt:  0x00000000
[  224.017775] mmc1: sdhci: Argument:  0x00000000 | Trn mode: 0x00000000
[  224.024200] mmc1: sdhci: Present:   0x01ff0000 | Host ctl: 0x00000000
[  224.030624] mmc1: sdhci: Power:     0x0000000f | Blk gap:  0x00000080
[  224.037049] mmc1: sdhci: Wake-up:   0x00000000 | Clock:    0x0000fa07
[  224.043473] mmc1: sdhci: Timeout:   0x00000000 | Int stat: 0x00000000
[  224.049898] mmc1: sdhci: Int enab:  0x00000000 | Sig enab: 0x00000000
[  224.056322] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000
[  224.062746] mmc1: sdhci: Caps:      0x3de8c801 | Caps_1:   0x18002407
[  224.069171] mmc1: sdhci: Cmd:       0x00000000 | Max curr: 0x00000000
[  224.075595] mmc1: sdhci: Resp[0]:   0x00000000 | Resp[1]:  0x00000000
[  224.082019] mmc1: sdhci: Resp[2]:   0x00000000 | Resp[3]:  0x00000000
[  224.088443] mmc1: sdhci: Host ctl2: 0x00000000
[  224.092874] mmc1: sdhci: ADMA Err:  0x00000000 | ADMA Ptr: 0x0000000000000000
[  224.099992] mmc1: sdhci: ============================================
[  234.232755] mmc1: Timeout waiting for hardware cmd interrupt.
[  234.238497] mmc1: sdhci: ============ SDHCI REGISTER DUMP ===========
[  234.244921] mmc1: sdhci: Sys addr:  0x00000000 | Version:  0x00001004
[  234.251346] mmc1: sdhci: Blk size:  0x00000000 | Blk cnt:  0x00000000
[  234.257771] mmc1: sdhci: Argument:  0x000001aa | Trn mode: 0x00000000
[  234.264195] mmc1: sdhci: Present:   0x01ff0000 | Host ctl: 0x00000000
[  234.270619] mmc1: sdhci: Power:     0x0000000f | Blk gap:  0x00000080
[  234.277044] mmc1: sdhci: Wake-up:   0x00000000 | Clock:    0x0000fa07
[  234.283468] mmc1: sdhci: Timeout:   0x00000000 | Int stat: 0x00000000
[  234.289892] mmc1: sdhci: Int enab:  0x00000000 | Sig enab: 0x00000000
[  234.296317] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000
[  234.302741] mmc1: sdhci: Caps:      0x3de8c801 | Caps_1:   0x18002407
[  234.309165] mmc1: sdhci: Cmd:       0x0000081a | Max curr: 0x00000000
[  234.315590] mmc1: sdhci: Resp[0]:   0x000001aa | Resp[1]:  0x00000000
[  234.322014] mmc1: sdhci: Resp[2]:   0x00000000 | Resp[3]:  0x00000000
[  234.328438] mmc1: sdhci: Host ctl2: 0x00000000
[  234.332869] mmc1: sdhci: ADMA Err:  0x00000000 | ADMA Ptr: 0x0000000000000000
[  234.339987] mmc1: sdhci: ============================================
[  244.472755] mmc1: Timeout waiting for hardware cmd interrupt.
[  244.478504] mmc1: sdhci: ============ SDHCI REGISTER DUMP ===========
[  244.484928] mmc1: sdhci: Sys addr:  0x00000000 | Version:  0x00001004
[  244.491353] mmc1: sdhci: Blk size:  0x00000000 | Blk cnt:  0x00000000
[  244.497777] mmc1: sdhci: Argument:  0x00000000 | Trn mode: 0x00000000
[  244.504201] mmc1: sdhci: Present:   0x01ff0000 | Host ctl: 0x00000000
[  244.510626] mmc1: sdhci: Power:     0x0000000f | Blk gap:  0x00000080
[  244.517050] mmc1: sdhci: Wake-up:   0x00000000 | Clock:    0x0000fa07
[  244.523474] mmc1: sdhci: Timeout:   0x00000000 | Int stat: 0x00000000
[  244.529898] mmc1: sdhci: Int enab:  0x00000000 | Sig enab: 0x00000000
[  244.536323] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000
[  244.542747] mmc1: sdhci: Caps:      0x3de8c801 | Caps_1:   0x18002407
[  244.549171] mmc1: sdhci: Cmd:       0x0000371a | Max curr: 0x00000000
[  244.555596] mmc1: sdhci: Resp[0]:   0x00000120 | Resp[1]:  0x00000000
[  244.562021] mmc1: sdhci: Resp[2]:   0x00000000 | Resp[3]:  0x00000000
[  244.568445] mmc1: sdhci: Host ctl2: 0x00000000
[  244.572874] mmc1: sdhci: ADMA Err:  0x00000000 | ADMA Ptr: 0x0000000000000000
[  244.579991] mmc1: sdhci: ============================================

Would appreciate support in getting suspend to memory mode to function.