Other Parts Discussed in Thread: SK-AM62A-LP, AM62P
Tool/software:
Using SDK 10.01.00.05 on the SK-AM62A-LP board, attempting to evaluate low power mode characteristics, and am encountering both of the failure modes seen in this E2E post.
I'm encountering their first error when using the pre-compiled Linux SDK binary (download) linked from the EVK product page (printk output below):
root@am62axx-evm:/opt/edgeai-gst-apps# echo mem > /sys/power/state [ 61.280981] PM: suspend entry (deep) [ 61.435793] Filesystems sync: 0.151 seconds [ 61.442022] Freezing user space processes [ 61.447664] Freezing user space processes completed (elapsed 0.001 seconds) [ 61.454655] OOM killer disabled. [ 61.457881] Freezing remaining freezable tasks [ 61.463580] Freezing remaining freezable tasks completed (elapsed 0.001 seconds) [ 61.484017] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 179: state: 1: ret 0 [ 61.494081] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 178: state: 1: ret 0 [ 61.511906] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 117: state: 1: ret 0 [ 62.524727] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_suspend+0x144/0x170) [ 62.534225] ti-sci 44043000.system-controller: Mbox send fail -110 [ 62.540402] ti-sci 44043000.system-controller: PM: dpm_run_callback(): platform_pm_suspend+0x0/0x6c returns -110 [ 62.550573] ti-sci 44043000.system-controller: PM: failed to suspend: error -110 [ 62.557964] PM: Some devices failed to suspend, or early wake event detected [ 62.565025] Internal error: synchronous external abort: 0000000096000010 [#1] PREEMPT SMP [ 62.573185] Modules linked in: wave5 overlay cfg80211 bluetooth ecdh_generic ecc rfkill snd_soc_hdmi_codec rpmsg_ctrl rpmsg_char crct10dif_ce snd_soc_simple_card snd_soc_simple_card_utils e5010_jpeg_enc rtc_ti_k3 display_connector v4l2_jpeg k3_j72xx_bandgap rti_wdt ti_k3_r5_remoteproc videobuf2_dma_contig tps6598x videobuf2_memops v4l2_mem2mem tidss videobuf2_v4l2 snd_soc_davinci_mcasp typec sii902x snd_soc_ti_udma drm_dma_helper videobuf2_common mcrc64 drm_kms_helper snd_soc_ti_edma snd_soc_ti_sdma ti_k3_dsp_remoteproc videodev omap_hwspinlock snd_soc_tlv320aic3x_i2c sa2ul mc snd_soc_tlv320aic3x omap_mailbox cryptodev(O) fuse drm drm_panel_orientation_quirks backlight ipv6 [last unloaded: wave5] [ 62.634886] CPU: 3 PID: 1458 Comm: sh Tainted: G O 6.6.58-ti-01497-ga7758da17c28-dirty #1 [ 62.644434] Hardware name: Texas Instruments AM62A7 SK (DT) [ 62.649992] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 62.656939] pc : e5010_hw_bypass_mmu+0x4/0x28 [e5010_jpeg_enc] [ 62.662774] lr : e5010_init_device+0x20/0x134 [e5010_jpeg_enc] [ 62.668602] sp : ffff800082debac0 [ 62.671904] x29: ffff800082debac0 x28: ffff000813248e40 x27: 0000000000000000 [ 62.679029] x26: 0000000000000000 x25: ffff800081478500 x24: ffff8000813b9840 [ 62.686154] x23: ffff800080738674 x22: 0000000000000000 x21: ffff00080166f480 [ 62.693278] x20: ffff00080015d010 x19: ffff00080166f480 x18: 0000000000000006 [ 62.700402] x17: 7463657465642074 x16: 6e65766520656b61 x15: ffff800082deb620 [ 62.707527] x14: 0000000000000000 x13: ffff8000812ef178 x12: 000000000000066f [ 62.714651] x11: 0000000000000225 x10: ffff800081347178 x9 : ffff8000812ef178 [ 62.721777] x8 : 00000000ffffefff x7 : 0000000000019a27 x6 : 000000033e2b2bb0 [ 62.728901] x5 : 03ffffffffffffff x4 : 00284af100000000 x3 : 0000000000000018 [ 62.736025] x2 : 0000000000003380 x1 : 0000000000000001 x0 : ffff800082241270 [ 62.743149] Call trace: [ 62.745588] e5010_hw_bypass_mmu+0x4/0x28 [e5010_jpeg_enc] [ 62.751069] e5010_resume+0x30/0x80 [e5010_jpeg_enc] [ 62.756029] pm_generic_resume+0x2c/0x44 [ 62.759946] ti_sci_pd_resume+0x20/0x2c [ 62.763775] __device_resume+0x84/0x230 [ 62.767606] dpm_resume+0x9c/0x124 [ 62.771001] dpm_resume_end+0x18/0x30 [ 62.774656] suspend_devices_and_enter+0x1b0/0x550 [ 62.779439] pm_suspend+0x1ac/0x260 [ 62.782917] state_store+0x80/0xec [ 62.786314] kobj_attr_store+0x18/0x2c [ 62.790059] sysfs_kf_write+0x44/0x54 [ 62.793716] kernfs_fop_write_iter+0x120/0x1cc [ 62.798150] vfs_write+0x1c0/0x308 [ 62.801546] ksys_write+0x74/0x10c [ 62.804941] __arm64_sys_write+0x1c/0x28 [ 62.808855] invoke_syscall+0x48/0x114 [ 62.812599] el0_svc_common.constprop.0+0xc0/0xe0 [ 62.817293] do_el0_svc+0x1c/0x28 [ 62.820600] el0_svc+0x2c/0x84 [ 62.823647] el0t_64_sync_handler+0x120/0x12c [ 62.827995] el0t_64_sync+0x190/0x194 [ 62.831651] Code: 9124e021 95bdbea0 17ffffe8 9101c000 (b9400002) [ 62.837730] ---[ end trace 0000000000000000 ]---
and encountering their second error when using the tiny image installed by the installer script (download) from the same page (printk output below, truncated after the first 2 repeats of the mmc1 register dump):
root@am62axx-evm:~# echo mem > /sys/power/state [ 201.133120] PM: suspend entry (deep) [ 201.147862] Filesystems sync: 0.011 seconds [ 201.153154] Freezing user space processes [ 201.158514] Freezing user space processes completed (elapsed 0.001 seconds) [ 201.165506] OOM killer disabled. [ 201.168723] Freezing remaining freezable tasks [ 201.174341] Freezing remaining freezable tasks completed (elapsed 0.001 seconds) [ 201.194829] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 179: state: 1 : ret 0 [ 201.204890] ti-sci 44043000.system-controller: ti_sci_cmd_set_device_constraint: device: 178: state: 1 : ret 0 [ 202.232779] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_suspend+0x144/0x17 0) [ 202.242295] ti-sci 44043000.system-controller: Mbox send fail -110 [ 202.248476] ti-sci 44043000.system-controller: PM: dpm_run_callback(): platform_pm_suspend+0x0/0x6c re turns -110 [ 202.258648] ti-sci 44043000.system-controller: PM: failed to suspend: error -110 [ 202.266038] PM: Some devices failed to suspend, or early wake event detected [ 203.288769] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_device_exc lusive+0x18/0x24) [ 203.299557] ti-sci 44043000.system-controller: Mbox send fail -110 [ 203.305737] spi-nand spi0.0: resume failed with -110 [ 204.312775] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: k3_ringacc_ring_cfg_sci+0 x94/0xf8) [ 204.322877] ti-sci 44043000.system-controller: RM_RA:Mbox config send fail -110 [ 204.330181] ti-udma 485c0000.dma-controller: TISCI config ring fail (-110) ring_idx 19 [ 204.338097] am65-cpsw-nuss 8000000.ethernet: Failed to cfg ringtx -110 [ 204.344709] am65-cpsw-nuss 8000000.ethernet: error -ETIMEDOUT: Failed to request tx dma channel [ 204.353413] am65-cpsw-nuss 8000000.ethernet: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110 [ 204.363154] am65-cpsw-nuss 8000000.ethernet: PM: failed to resume: error -110 [ 205.400767] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34) [ 206.434593] ti-sci 44043000.system-controller: Mbox send fail -110 [ 207.448771] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34) [ 207.458599] ti-sci 44043000.system-controller: Mbox send fail -110 [ 207.464782] sdhci-am654 fa10000.mmc: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110 [ 207.473824] sdhci-am654 fa10000.mmc: PM: failed to resume: error -110 [ 208.504768] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34) [ 208.514598] ti-sci 44043000.system-controller: Mbox send fail -110 [ 208.520780] sdhci-am654 fa00000.mmc: PM: dpm_run_callback(): ti_sci_pd_resume+0x0/0x2c returns -110 [ 208.529822] sdhci-am654 fa00000.mmc: PM: failed to resume: error -110 [ 209.560770] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec) [ 209.570771] ti-sci 44043000.system-controller: Mbox send fail -110 [ 209.576948] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110 [ 210.616770] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec) [ 210.626769] ti-sci 44043000.system-controller: Mbox send fail -110 [ 210.632944] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110 [ 211.672766] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: sci_clk_determine_rate+0x68/0xec) [ 211.682765] ti-sci 44043000.system-controller: Mbox send fail -110 [ 211.688940] ti-sci-clk 44043000.system-controller:clock-controller: determine-rate failed for dev=135, clk=0, ret=-110 [ 211.699625] cpu cpu0: _opp_config_clk_single: failed to set clock rate: -22 [ 211.706579] cpufreq: __target_index: Failed to change cpu frequency: -22 [ 211.714114] OOM killer enabled. [ 211.717284] Restarting tasks ... done. [ 211.722677] random: crng reseeded on system resumption [ 211.728006] PM: suspend exit sh: write error: Connection timed out root@am62axx-evm:~# [ 212.728779] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_device_exclusive+0x18/0x24) [ 212.728788] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 212.728819] ti-sci 44043000.system-controller: Mbox send fail -110 [ 212.739593] ti-sci 44043000.system-controller: Mbox send fail -110 [ 212.749500] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_get_clock+0x28/0x34) [ 212.771660] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 212.781583] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 212.791495] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 212.801416] ti-sci 44043000.system-controller: Mbox send fail -110 [ 212.807604] ti-sci 44043000.system-controller: Mbox send fail -110 [ 212.813803] ti-sci 44043000.system-controller: Mbox send fail -110 [ 212.820027] ti-sci 44043000.system-controller: Mbox send fail -110 [ 213.848774] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 213.858699] ti-sci 44043000.system-controller: Mbox send fail -110 [ 216.120769] ti-sci 44043000.system-controller: Mbox timedout in resp(caller: ti_sci_cmd_put_device+0x18/0x24) [ 216.130701] ti-sci 44043000.system-controller: Mbox send fail -110 [ 223.992756] mmc1: Timeout waiting for hardware cmd interrupt. [ 223.998501] mmc1: sdhci: ============ SDHCI REGISTER DUMP =========== [ 224.004926] mmc1: sdhci: Sys addr: 0x00000000 | Version: 0x00001004 [ 224.011351] mmc1: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 224.017775] mmc1: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 224.024200] mmc1: sdhci: Present: 0x01ff0000 | Host ctl: 0x00000000 [ 224.030624] mmc1: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 224.037049] mmc1: sdhci: Wake-up: 0x00000000 | Clock: 0x0000fa07 [ 224.043473] mmc1: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 224.049898] mmc1: sdhci: Int enab: 0x00000000 | Sig enab: 0x00000000 [ 224.056322] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 224.062746] mmc1: sdhci: Caps: 0x3de8c801 | Caps_1: 0x18002407 [ 224.069171] mmc1: sdhci: Cmd: 0x00000000 | Max curr: 0x00000000 [ 224.075595] mmc1: sdhci: Resp[0]: 0x00000000 | Resp[1]: 0x00000000 [ 224.082019] mmc1: sdhci: Resp[2]: 0x00000000 | Resp[3]: 0x00000000 [ 224.088443] mmc1: sdhci: Host ctl2: 0x00000000 [ 224.092874] mmc1: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x0000000000000000 [ 224.099992] mmc1: sdhci: ============================================ [ 234.232755] mmc1: Timeout waiting for hardware cmd interrupt. [ 234.238497] mmc1: sdhci: ============ SDHCI REGISTER DUMP =========== [ 234.244921] mmc1: sdhci: Sys addr: 0x00000000 | Version: 0x00001004 [ 234.251346] mmc1: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 234.257771] mmc1: sdhci: Argument: 0x000001aa | Trn mode: 0x00000000 [ 234.264195] mmc1: sdhci: Present: 0x01ff0000 | Host ctl: 0x00000000 [ 234.270619] mmc1: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 234.277044] mmc1: sdhci: Wake-up: 0x00000000 | Clock: 0x0000fa07 [ 234.283468] mmc1: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 234.289892] mmc1: sdhci: Int enab: 0x00000000 | Sig enab: 0x00000000 [ 234.296317] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 234.302741] mmc1: sdhci: Caps: 0x3de8c801 | Caps_1: 0x18002407 [ 234.309165] mmc1: sdhci: Cmd: 0x0000081a | Max curr: 0x00000000 [ 234.315590] mmc1: sdhci: Resp[0]: 0x000001aa | Resp[1]: 0x00000000 [ 234.322014] mmc1: sdhci: Resp[2]: 0x00000000 | Resp[3]: 0x00000000 [ 234.328438] mmc1: sdhci: Host ctl2: 0x00000000 [ 234.332869] mmc1: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x0000000000000000 [ 234.339987] mmc1: sdhci: ============================================ [ 244.472755] mmc1: Timeout waiting for hardware cmd interrupt. [ 244.478504] mmc1: sdhci: ============ SDHCI REGISTER DUMP =========== [ 244.484928] mmc1: sdhci: Sys addr: 0x00000000 | Version: 0x00001004 [ 244.491353] mmc1: sdhci: Blk size: 0x00000000 | Blk cnt: 0x00000000 [ 244.497777] mmc1: sdhci: Argument: 0x00000000 | Trn mode: 0x00000000 [ 244.504201] mmc1: sdhci: Present: 0x01ff0000 | Host ctl: 0x00000000 [ 244.510626] mmc1: sdhci: Power: 0x0000000f | Blk gap: 0x00000080 [ 244.517050] mmc1: sdhci: Wake-up: 0x00000000 | Clock: 0x0000fa07 [ 244.523474] mmc1: sdhci: Timeout: 0x00000000 | Int stat: 0x00000000 [ 244.529898] mmc1: sdhci: Int enab: 0x00000000 | Sig enab: 0x00000000 [ 244.536323] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000000 [ 244.542747] mmc1: sdhci: Caps: 0x3de8c801 | Caps_1: 0x18002407 [ 244.549171] mmc1: sdhci: Cmd: 0x0000371a | Max curr: 0x00000000 [ 244.555596] mmc1: sdhci: Resp[0]: 0x00000120 | Resp[1]: 0x00000000 [ 244.562021] mmc1: sdhci: Resp[2]: 0x00000000 | Resp[3]: 0x00000000 [ 244.568445] mmc1: sdhci: Host ctl2: 0x00000000 [ 244.572874] mmc1: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x0000000000000000 [ 244.579991] mmc1: sdhci: ============================================
Would appreciate support in getting suspend to memory mode to function.