This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

AM5728: Node.js Hangs on cryptodev_hash_update

Part Number: AM5728

Hi,

Currently we are experiencing this issue where node processes fall into the uninterruptable sleep (D) state and become unresponsive.

Following instructions in this article (https://www.suse.com/support/kb/doc/?id=000016919) yields the result:

user@linux:~# ps -eo ppid,pid,user,stat,pcpu,comm,wchan:32 | grep " D"
1959  2057 user     D     0.0 node            cryptodev_hash_update
    1  2601 user     D     0.6 node            cryptodev_hash_update
    1  2839 user     D    10.1 node            cryptodev_hash_update
    1  8578 user     D     0.0 node            cryptodev_hash_update
    1 14435 user     D     0.0 node            cryptodev_hash_update
    1 20161 user     D     0.1 node            cryptodev_hash_update
    1 20882 user     D     0.0 node            cryptodev_hash_update
    1 28230 user     D     0.0 node            cryptodev_hash_update
    1 31444 user     D     0.0 node            cryptodev_hash_update

Dec  4 15:18:35 linux user.info kernel: [264153.203702] sysrq: SysRq : Show Blocked State
Dec  4 15:18:35 linux user.info kernel: [264153.203721]   task                PC stack   pid father
Dec  4 15:18:35 linux user.info kernel: [264153.203776] node            D    0  2057   1959 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.203788] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.203813] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.203821]  r10:ed95a1d8 r9:d113e078 r8:00000000 r7:00000002 r6:ec3fe000 r5:d113e07c
Dec  4 15:18:35 linux user.warn kernel: [264153.203826]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.203837] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.203842]  r5:d113e07c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.203852] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.203858]  r8:00000000 r7:00000002 r6:ec3fe000 r5:d113e07c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.203868] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.203874]  r9:ec3fe000 r8:00000009 r7:d13d9200 r6:00000000 r5:d113e000 r4:d113e068
Dec  4 15:18:35 linux user.warn kernel: [264153.203897] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.203916] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.203920]  r4:d113e000
Dec  4 15:18:35 linux user.warn kernel: [264153.203936] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.203941]  r7:00000085 r6:00000000 r5:d113e000 r4:ec3ffddc
Dec  4 15:18:35 linux user.warn kernel: [264153.203958] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.203968]  r8:00000009 r7:ec3ffddc r6:eda14300 r5:eda140c0 r4:bed037cc
Dec  4 15:18:35 linux user.warn kernel: [264153.203996] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.204003]  r8:00000009 r7:c01c6368 r6:00000009 r5:eda14300 r4:bed037cc
Dec  4 15:18:35 linux user.warn kernel: [264153.204013] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.204020]  r10:00000036 r9:ec3fe000 r8:bed037cc r7:c01c6368 r6:00000009 r5:eda14300
Dec  4 15:18:35 linux user.warn kernel: [264153.204024]  r4:eda14301
Dec  4 15:18:35 linux user.warn kernel: [264153.204035] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204041]  r9:ec3fe000 r8:c0207e44 r7:00000036 r6:bed03828 r5:bed03808 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.204057] node            D    0  2601      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.204071] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.204086] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.204094]  r10:ed95a1d8 r9:eda52f78 r8:00000000 r7:00000002 r6:d41f8000 r5:eda52f7c
Dec  4 15:18:35 linux user.warn kernel: [264153.204099]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.204109] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.204114]  r5:eda52f7c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204125] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.204133]  r8:00000000 r7:00000002 r6:d41f8000 r5:eda52f7c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204142] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204148]  r9:d41f8000 r8:0000000a r7:d247be00 r6:00000000 r5:eda52f00 r4:eda52f68
Dec  4 15:18:35 linux user.warn kernel: [264153.204375] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204394] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204398]  r4:eda52f00
Dec  4 15:18:35 linux user.warn kernel: [264153.204415] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204421]  r7:000000f0 r6:00000000 r5:eda52f00 r4:d41f9ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.204438] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204443]  r8:0000000a r7:d41f9ddc r6:edace3c0 r5:ed9aa840 r4:befcb56c
Dec  4 15:18:35 linux user.warn kernel: [264153.204457] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.204464]  r8:0000000a r7:c01c6368 r6:0000000a r5:edace3c0 r4:befcb56c
Dec  4 15:18:35 linux user.warn kernel: [264153.204475] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.204483]  r10:00000036 r9:d41f8000 r8:befcb56c r7:c01c6368 r6:0000000a r5:edace3c0
Dec  4 15:18:35 linux user.warn kernel: [264153.204492]  r4:edace3c1
Dec  4 15:18:35 linux user.warn kernel: [264153.204504] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204511]  r9:d41f8000 r8:c0207e44 r7:00000036 r6:befcb5a8 r5:befcb5a4 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.204536] node            D    0  2839      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.204551] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.204563] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.204570]  r10:ed95a1d8 r9:eda84738 r8:00000000 r7:00000002 r6:d3576000 r5:eda8473c
Dec  4 15:18:35 linux user.warn kernel: [264153.204574]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.204581] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.204586]  r5:eda8473c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204595] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.204601]  r8:00000000 r7:00000002 r6:d3576000 r5:eda8473c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204608] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204614]  r9:d3576000 r8:0000000a r7:d26b7200 r6:00000000 r5:eda846c0 r4:eda84728
Dec  4 15:18:35 linux user.warn kernel: [264153.204627] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204644] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux daemon.info vaio_start.sh[14147]: GUI listen thread got NO msg
Dec  4 15:18:35 linux user.warn kernel: [264153.204648]  r4:eda846c0
Dec  4 15:18:35 linux user.warn kernel: [264153.204664] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204671]  r7:000002ca r6:00000000 r5:eda846c0 r4:d3577ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.204692] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204698]  r8:0000000a r7:d3577ddc r6:d2b90480 r5:d2b90900 r4:be9845ac
Dec  4 15:18:35 linux user.warn kernel: [264153.204712] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.204718]  r8:0000000a r7:c01c6368 r6:0000000a r5:d2b90480 r4:be9845ac
Dec  4 15:18:35 linux user.warn kernel: [264153.204726] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.204733]  r10:00000036 r9:d3576000 r8:be9845ac r7:c01c6368 r6:0000000a r5:d2b90480
Dec  4 15:18:35 linux user.warn kernel: [264153.204737]  r4:d2b90481
Dec  4 15:18:35 linux user.warn kernel: [264153.204745] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204753]  r9:d3576000 r8:c0207e44 r7:00000036 r6:be9845f0 r5:be9845e8 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.204782] node            D    0 20161      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.204794] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.204811] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.204819]  r10:ed95a1d8 r9:eda5d5b8 r8:00000000 r7:00000002 r6:d0ace000 r5:eda5d5bc
Dec  4 15:18:35 linux user.warn kernel: [264153.204824]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.204834] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.204843]  r5:eda5d5bc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204855] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.204861]  r8:00000000 r7:00000002 r6:d0ace000 r5:eda5d5bc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.204869] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.204875]  r9:d0ace000 r8:00000009 r7:d13d8200 r6:00000000 r5:eda5d540 r4:eda5d5a8
Dec  4 15:18:35 linux user.warn kernel: [264153.204890] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204907] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204913]  r4:eda5d540
Dec  4 15:18:35 linux user.warn kernel: [264153.204930] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204936]  r7:00000736 r6:00000000 r5:eda5d540 r4:d0acfddc
Dec  4 15:18:35 linux user.warn kernel: [264153.204952] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.204958]  r8:00000009 r7:d0acfddc r6:d13cbe40 r5:d13cb480 r4:bebd3784
Dec  4 15:18:35 linux user.warn kernel: [264153.204971] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.204977]  r8:00000009 r7:c01c6368 r6:00000009 r5:d13cbe40 r4:bebd3784
Dec  4 15:18:35 linux user.warn kernel: [264153.204986] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.204993]  r10:00000036 r9:d0ace000 r8:bebd3784 r7:c01c6368 r6:00000009 r5:d13cbe40
Dec  4 15:18:35 linux user.warn kernel: [264153.204997]  r4:d13cbe41
Dec  4 15:18:35 linux user.warn kernel: [264153.205006] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205012]  r9:d0ace000 r8:c0207e44 r7:00000036 r6:00000736 r5:01013b60 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.205029] node            D    0 14435      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.205038] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.205050] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.205057]  r10:ed95a1d8 r9:eda60978 r8:00000000 r7:00000002 r6:d37c8000 r5:eda6097c
Dec  4 15:18:35 linux user.warn kernel: [264153.205061]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.205069] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.205074]  r5:eda6097c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205082] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.205088]  r8:00000000 r7:00000002 r6:d37c8000 r5:eda6097c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205096] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205103]  r9:d37c8000 r8:0000000a r7:d13d9400 r6:00000000 r5:eda60900 r4:eda60968
Dec  4 15:18:35 linux user.warn kernel: [264153.205115] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205133] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205137]  r4:eda60900
Dec  4 15:18:35 linux user.warn kernel: [264153.205153] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205160]  r7:000007cd r6:00000000 r5:eda60900 r4:d37c9ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.205176] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205182]  r8:0000000a r7:d37c9ddc r6:d410d6c0 r5:d410d9c0 r4:bed0723c
Dec  4 15:18:35 linux user.warn kernel: [264153.205195] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.205200]  r8:0000000a r7:c01c6368 r6:0000000a r5:d410d6c0 r4:bed0723c
Dec  4 15:18:35 linux user.warn kernel: [264153.205210] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.205215]  r10:00000036 r9:d37c8000 r8:bed0723c r7:c01c6368 r6:0000000a r5:d410d6c0
Dec  4 15:18:35 linux user.warn kernel: [264153.205220]  r4:d410d6c1
Dec  4 15:18:35 linux user.warn kernel: [264153.205228] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205234]  r9:d37c8000 r8:c0207e44 r7:00000036 r6:000007cd r5:01101b30 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.205239] node            D    0  8578      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.205248] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.205259] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.205266]  r10:ed95a1d8 r9:d42212b8 r8:00000000 r7:00000002 r6:d0a24000 r5:d42212bc
Dec  4 15:18:35 linux user.warn kernel: [264153.205270]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.205280] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.205285]  r5:d42212bc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205293] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.205298]  r8:00000000 r7:00000002 r6:d0a24000 r5:d42212bc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205306] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205313]  r9:d0a24000 r8:0000000a r7:edbd1c00 r6:00000000 r5:d4221240 r4:d42212a8
Dec  4 15:18:35 linux user.warn kernel: [264153.205325] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205341] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205346]  r4:d4221240
Dec  4 15:18:35 linux user.warn kernel: [264153.205363] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205369]  r7:000007cd r6:00000000 r5:d4221240 r4:d0a25ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.205385] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205391]  r8:0000000a r7:d0a25ddc r6:ed3abcc0 r5:ed3ab9c0 r4:beb9123c
Dec  4 15:18:35 linux user.warn kernel: [264153.205403] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.205409]  r8:0000000a r7:c01c6368 r6:0000000a r5:ed3abcc0 r4:beb9123c
Dec  4 15:18:35 linux user.warn kernel: [264153.205417] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.205424]  r10:00000036 r9:d0a24000 r8:beb9123c r7:c01c6368 r6:0000000a r5:ed3abcc0
Dec  4 15:18:35 linux user.warn kernel: [264153.205428]  r4:ed3abcc1
Dec  4 15:18:35 linux user.warn kernel: [264153.205437] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205443]  r9:d0a24000 r8:c0207e44 r7:00000036 r6:000007cd r5:01100938 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.205461] node            D    0 28230      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.205469] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.205480] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.205487]  r10:ed95a1d8 r9:d2b0e438 r8:00000000 r7:00000002 r6:d0b6c000 r5:d2b0e43c
Dec  4 15:18:35 linux user.warn kernel: [264153.205490]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.205499] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.205504]  r5:d2b0e43c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205513] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.205518]  r8:00000000 r7:00000002 r6:d0b6c000 r5:d2b0e43c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205526] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205532]  r9:d0b6c000 r8:0000000a r7:edbd0a00 r6:00000000 r5:d2b0e3c0 r4:d2b0e428
Dec  4 15:18:35 linux user.warn kernel: [264153.205544] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205560] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205565]  r4:d2b0e3c0
Dec  4 15:18:35 linux user.warn kernel: [264153.205581] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205586]  r7:000007cd r6:00000000 r5:d2b0e3c0 r4:d0b6dddc
Dec  4 15:18:35 linux user.warn kernel: [264153.205603] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205608]  r8:0000000a r7:d0b6dddc r6:d4081d80 r5:d4081c00 r4:be9dd23c
Dec  4 15:18:35 linux user.warn kernel: [264153.205621] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.205626]  r8:0000000a r7:c01c6368 r6:0000000a r5:d4081d80 r4:be9dd23c
Dec  4 15:18:35 linux user.warn kernel: [264153.205635] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.205640]  r10:00000036 r9:d0b6c000 r8:be9dd23c r7:c01c6368 r6:0000000a r5:d4081d80
Dec  4 15:18:35 linux user.warn kernel: [264153.205645]  r4:d4081d81
Dec  4 15:18:35 linux user.warn kernel: [264153.205655] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205660]  r9:d0b6c000 r8:c0207e44 r7:00000036 r6:000007cd r5:01101618 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.205664] node            D    0 20882      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.205672] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.205683] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.205688]  r10:ed95a1d8 r9:edbd8f78 r8:00000000 r7:00000002 r6:d1232000 r5:edbd8f7c
Dec  4 15:18:35 linux user.warn kernel: [264153.205692]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.205700] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.205705]  r5:edbd8f7c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205712] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.205718]  r8:00000000 r7:00000002 r6:d1232000 r5:edbd8f7c r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205732] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205742]  r9:d1232000 r8:0000000d r7:d2b8c400 r6:00000000 r5:edbd8f00 r4:edbd8f68
Dec  4 15:18:35 linux user.warn kernel: [264153.205756] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205773] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205777]  r4:edbd8f00
Dec  4 15:18:35 linux user.warn kernel: [264153.205792] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205798]  r7:000007cd r6:00000000 r5:edbd8f00 r4:d1233ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.205814] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205819]  r8:0000000d r7:d1233ddc r6:ec963a80 r5:ec963780 r4:be98774c
Dec  4 15:18:35 linux user.warn kernel: [264153.205831] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.205836]  r8:0000000d r7:c01c6368 r6:0000000d r5:ec963a80 r4:be98774c
Dec  4 15:18:35 linux user.warn kernel: [264153.205844] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.205850]  r10:00000036 r9:d1232000 r8:be98774c r7:c01c6368 r6:0000000d r5:ec963a80
Dec  4 15:18:35 linux user.warn kernel: [264153.205853]  r4:ec963a81
Dec  4 15:18:35 linux user.warn kernel: [264153.205861] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205867]  r9:d1232000 r8:c0207e44 r7:00000036 r6:000007cd r5:01103570 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.205872] node            D    0 31444      1 0x00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.205881] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.205891] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.205897]  r10:ed95a1d8 r9:d08337f8 r8:00000000 r7:00000002 r6:d1310000 r5:d08337fc
Dec  4 15:18:35 linux user.warn kernel: [264153.205902]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.205909] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.205914]  r5:d08337fc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205922] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:35 linux user.warn kernel: [264153.205927]  r8:00000000 r7:00000002 r6:d1310000 r5:d08337fc r4:7fffffff
Dec  4 15:18:35 linux user.warn kernel: [264153.205935] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:35 linux user.warn kernel: [264153.205940]  r9:d1310000 r8:0000000d r7:ecaaa000 r6:00000000 r5:d0833780 r4:d08337e8
Dec  4 15:18:35 linux user.warn kernel: [264153.205953] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205969] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205973]  r4:d0833780
Dec  4 15:18:35 linux user.warn kernel: [264153.205988] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.205993]  r7:000007cd r6:00000000 r5:d0833780 r4:d1311ddc
Dec  4 15:18:35 linux user.warn kernel: [264153.206008] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:35 linux user.warn kernel: [264153.206013]  r8:0000000d r7:d1311ddc r6:d42e5900 r5:d42e5240 r4:be91e74c
Dec  4 15:18:35 linux user.warn kernel: [264153.206026] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:35 linux user.warn kernel: [264153.206031]  r8:0000000d r7:c01c6368 r6:0000000d r5:d42e5900 r4:be91e74c
Dec  4 15:18:35 linux user.warn kernel: [264153.206039] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:35 linux user.warn kernel: [264153.206044]  r10:00000036 r9:d1310000 r8:be91e74c r7:c01c6368 r6:0000000d r5:d42e5900
Dec  4 15:18:35 linux user.warn kernel: [264153.206048]  r4:d42e5901
Dec  4 15:18:35 linux user.warn kernel: [264153.206057] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:35 linux user.warn kernel: [264153.206062]  r9:d1310000 r8:c0207e44 r7:00000036 r6:000007cd r5:01103848 r4:00000000
Dec  4 15:18:35 linux user.info kernel: [264153.206084] kworker/u4:1    D    0 12642      2 0x00000000
Dec  4 15:18:35 linux user.info kernel: [264153.206097] Workqueue: events_unbound commit_work
Dec  4 15:18:35 linux user.warn kernel: [264153.206103] Backtrace:
Dec  4 15:18:35 linux user.warn kernel: [264153.206114] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:35 linux user.warn kernel: [264153.206120]  r10:c1002d00 r9:00000000 r8:c1002d00 r7:d4af5e18 r6:eed20580 r5:eed20580
Dec  4 15:18:35 linux user.warn kernel: [264153.206124]  r4:ffffe000
Dec  4 15:18:35 linux user.warn kernel: [264153.206132] [<c096db68>] (schedule) from [<c0971414>] (schedule_timeout+0x158/0x258)
Dec  4 15:18:35 linux user.warn kernel: [264153.206136]  r5:eed20580 r4:0192a196
Dec  4 15:18:35 linux user.warn kernel: [264153.206148] [<c09712bc>] (schedule_timeout) from [<c064503c>] (omap_crtc_wait_pending+0x9c/0x100)
Dec  4 15:18:35 linux user.warn kernel: [264153.206154]  r8:d2d245c0 r7:edcacbcc r6:00000019 r5:edcac800 r4:00000001
Dec  4 15:18:35 linux user.warn kernel: [264153.206162] [<c0644fa0>] (omap_crtc_wait_pending) from [<c0642adc>] (omap_atomic_wait_for_completion+0x78/0x94)
Dec  4 15:18:35 linux user.warn kernel: [264153.206167]  r7:edc93c00 r6:c0c03454 r5:00000000 r4:00000000
Dec  4 15:18:35 linux user.warn kernel: [264153.206174] [<c0642a64>] (omap_atomic_wait_for_completion) from [<c0642b74>] (omap_atomic_commit_tail+0x7c/0xc0)
Dec  4 15:18:35 linux user.warn kernel: [264153.206180]  r9:00000000 r8:00000000 r7:ee804300 r6:edc95a10 r5:edc93c00 r4:d2d245c0
Dec  4 15:18:35 linux user.warn kernel: [264153.206187] [<c0642af8>] (omap_atomic_commit_tail) from [<c05f8dd8>] (commit_tail+0x48/0x8c)
Dec  4 15:18:35 linux user.warn kernel: [264153.206191]  r7:ee804300 r6:ee806200 r5:c0a5ab1c r4:d2d245c0
Dec  4 15:18:35 linux user.warn kernel: [264153.206197] [<c05f8d90>] (commit_tail) from [<c05f8e30>] (commit_work+0x14/0x18)
Dec  4 15:18:35 linux user.warn kernel: [264153.206201]  r5:d4b88180 r4:d2d245e8
Dec  4 15:18:35 linux user.warn kernel: [264153.206211] [<c05f8e1c>] (commit_work) from [<c0242aac>] (process_one_work+0x1dc/0x418)
Dec  4 15:18:35 linux user.warn kernel: [264153.206219] [<c02428d0>] (process_one_work) from [<c0243860>] (worker_thread+0x5c/0x5b4)
Dec  4 15:18:35 linux user.warn kernel: [264153.206225]  r10:c1002d00 r9:00000088 r8:ffffe000 r7:ee806218 r6:d4b88198 r5:ee806200
Dec  4 15:18:35 linux user.warn kernel: [264153.206229]  r4:d4b88180
Dec  4 15:18:35 linux user.warn kernel: [264153.206238] [<c0243804>] (worker_thread) from [<c0248ba8>] (kthread+0x164/0x16c)
Dec  4 15:18:35 linux user.warn kernel: [264153.206243]  r10:d2887e80 r9:c0243804 r8:d4b88180 r7:d4af4000 r6:00000000 r5:ce8c2840
Dec  4 15:18:35 linux user.warn kernel: [264153.206247]  r4:ce8c2a80
Dec  4 15:18:35 linux user.warn kernel: [264153.206255] [<c0248a44>] (kthread) from [<c0207d18>] (ret_from_fork+0x14/0x3c)
Dec  4 15:18:35 linux user.warn kernel: [264153.206260]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0248a44
Dec  4 15:18:35 linux user.warn kernel: [264153.206265]  r4:ce8c2840
Dec  4 15:18:35 linux user.info kernel: [264153.206272] node            D    0 14159  14147 0x00000000
Dec  4 15:18:35 linux user.warn kernel: [264153.206280] Backtrace:
Dec  4 15:18:36 linux user.warn kernel: [264153.206291] [<c096d3c8>] (__schedule) from [<c096dbc0>] (schedule+0x58/0xc4)
Dec  4 15:18:36 linux user.warn kernel: [264153.206296]  r10:ed95a1d8 r9:eda9f1f8 r8:00000000 r7:00000002 r6:d026a000 r5:eda9f1fc
Dec  4 15:18:36 linux user.warn kernel: [264153.206300]  r4:ffffe000
Dec  4 15:18:36 linux user.warn kernel: [264153.206309] [<c096db68>] (schedule) from [<c0971464>] (schedule_timeout+0x1a8/0x258)
Dec  4 15:18:36 linux user.warn kernel: [264153.206313]  r5:eda9f1fc r4:7fffffff
Dec  4 15:18:36 linux user.warn kernel: [264153.206321] [<c09712bc>] (schedule_timeout) from [<c096e8b8>] (wait_for_common+0x94/0x140)
Dec  4 15:18:36 linux user.warn kernel: [264153.206326]  r8:00000000 r7:00000002 r6:d026a000 r5:eda9f1fc r4:7fffffff
Dec  4 15:18:36 linux user.warn kernel: [264153.206333] [<c096e824>] (wait_for_common) from [<c096e97c>] (wait_for_completion+0x18/0x1c)
Dec  4 15:18:36 linux user.warn kernel: [264153.206339]  r9:d026a000 r8:0000000a r7:d247b400 r6:00000000 r5:eda9f180 r4:eda9f1e8
Dec  4 15:18:36 linux user.warn kernel: [264153.206352] [<c096e964>] (wait_for_completion) from [<bf0143e0>] (cryptodev_hash_update+0x64/0xc8 [cryptodev])
Dec  4 15:18:36 linux user.warn kernel: [264153.206368] [<bf01437c>] (cryptodev_hash_update [cryptodev]) from [<bf012f30>] (hash_n_crypt+0xe8/0x144 [cryptodev])
Dec  4 15:18:36 linux user.warn kernel: [264153.206372]  r4:eda9f180
Dec  4 15:18:36 linux user.warn kernel: [264153.206388] [<bf012e48>] (hash_n_crypt [cryptodev]) from [<bf013468>] (crypto_run+0x204/0x520 [cryptodev])
Dec  4 15:18:36 linux user.warn kernel: [264153.206392]  r7:000002ca r6:00000000 r5:eda9f180 r4:d026bddc
Dec  4 15:18:36 linux user.warn kernel: [264153.206408] [<bf013264>] (crypto_run [cryptodev]) from [<bf012898>] (cryptodev_ioctl+0x37c/0x92c [cryptodev])
Dec  4 15:18:36 linux user.warn kernel: [264153.206414]  r8:0000000a r7:d026bddc r6:edf8f240 r5:edf8f480 r4:beb85dcc
Dec  4 15:18:36 linux user.warn kernel: [264153.206426] [<bf01251c>] (cryptodev_ioctl [cryptodev]) from [<c034e9fc>] (do_vfs_ioctl+0xa8/0x790)
Dec  4 15:18:36 linux user.warn kernel: [264153.206431]  r8:0000000a r7:c01c6368 r6:0000000a r5:edf8f240 r4:beb85dcc
Dec  4 15:18:36 linux user.warn kernel: [264153.206440] [<c034e954>] (do_vfs_ioctl) from [<c034f120>] (SyS_ioctl+0x3c/0x60)
Dec  4 15:18:36 linux user.warn kernel: [264153.206447]  r10:00000036 r9:d026a000 r8:beb85dcc r7:c01c6368 r6:0000000a r5:edf8f240
Dec  4 15:18:36 linux user.warn kernel: [264153.206452]  r4:edf8f241
Dec  4 15:18:36 linux user.warn kernel: [264153.206461] [<c034f0e4>] (SyS_ioctl) from [<c0207c40>] (ret_fast_syscall+0x0/0x4c)
Dec  4 15:18:36 linux user.warn kernel: [264153.206468]  r9:d026a000 r8:c0207e44 r7:00000036 r6:beb85e10 r5:beb85e08 r4:00000000

So far we haven't found a way to reproduce this issue, but just want to create a post first to consult the experts here what may be causing this issue. Based on the information in the sysrq stack trace it seems to be quite similar to the related post. Thanks.

System information

  • Arago 2018.10
  • Linux kernel 4.14.79+
  • Node.js 8.4.0
  • Hello Herbert,

    As in the other thread, this could be a buggy Linux cryptodev driver.

    My suggestions are:

    -To isolate this issue, maybe disable this module on the kernel and see if you still see the same issue.

    -You could try to move your application to a newer kernel, or back-port a newer version of the driver to your kernel.

    Disclaimer: The kernel being used is from an SDK from 2019 so it is very difficult for us to support. The latest kernel is 5.10.

    Our standard software offering does not include node.js development so any application in this environment is at the purview of the customer.

    Hope this helps.

    -Josue

  • Hi Josue,

    Thanks for your reply. I'll try your suggestions.

    -Herbert