Scheduled Maintenance: We are aware of an issue with Google, AOL, and Yahoo services as email providers which are blocking new registrations. We are trying to fix the issue and we have several internal and external support tickets in process to resolve the issue. Please see: viewtopic.php?t=158230

 

 

 

Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

New to Debian (Or Linux in general)? Ask your questions here!
Post Reply
Message
Author
User avatar
pollen
Posts: 2
Joined: 2022-05-15 16:06

Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#1 Post by pollen »

I'm using Debian 11 on a spare desktop as a server, and after anywhere from 5 to 25 days it'll lock up and I'll have to force restart it by holding the power button. This is the first time I've thought to actually check logs, though.
The cpu is an AMD Ryzen 5 1600 and I'm on kernel version 5.10.0-14-amd64.

journalctl logs prior to the freeze:

Code: Select all

May 15 06:59:07 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]
May 15 06:59:07 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 06:59:07 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 06:59:07 5gum kernel: CPU: 0 PID: 571013 Comm: runc Not tainted 5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 06:59:07 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 06:59:07 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 06:59:07 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 06:59:07 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 06:59:07 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 06:59:07 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 06:59:07 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 06:59:07 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 06:59:07 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 06:59:07 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 06:59:07 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 06:59:07 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 06:59:07 5gum kernel: Call Trace:
May 15 06:59:07 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 06:59:07 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 06:59:07 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 06:59:07 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 06:59:07 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 06:59:07 5gum kernel:  path_openat+0xb82/0x1080
May 15 06:59:07 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 06:59:07 5gum kernel:  do_filp_open+0x88/0x130
May 15 06:59:07 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 06:59:07 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 06:59:07 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 06:59:07 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 06:59:07 5gum kernel:  do_syscall_64+0x33/0x80
May 15 06:59:07 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 06:59:07 5gum kernel: RIP: 0033:0x4c2b2a
May 15 06:59:07 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 06:59:07 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 06:59:07 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 06:59:07 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 06:59:07 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 06:59:07 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 06:59:07 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 06:59:10 5gum containerd[679]: time="2022-05-15T06:59:10.936560729-05:00" level=error msg="forward event" error="context deadline exceeded"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.608698016-05:00" level=warning msg="Health check for container a80d8ee32506f93c2982419e0e3ffa337f392a1dfb6e8a548a48bc98f21f76ff error: context deadline exceeded"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.610274807-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.610282842-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.616188657-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.617184194-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.617250477-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.621825049-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.621932810-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.622213524-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.622370447-05:00" level=warning msg="Health check for container cb8e222cef53249eb72da4b18d8ddcc1f145f6d532379868e83f1112a2bc40c5 error: context deadline exceeded"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.627731917-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:12 5gum dockerd[648]: time="2022-05-15T06:59:12.627866397-05:00" level=error msg="stream copy error: reading from a closed fifo"
May 15 06:59:19 5gum dockerd[648]: time="2022-05-15T06:59:19.753176889-05:00" level=warning msg="Health check for container 91ed6f47d92fa7ae8e912e5cd3f78ee7a17d59975bf0b031cd0f0b2218489d4b error: context deadline exceeded"
May 15 06:59:19 5gum containerd[679]: time="2022-05-15T06:59:19.936889019-05:00" level=error msg="forward event" error="context deadline exceeded"
May 15 06:59:29 5gum containerd[679]: time="2022-05-15T06:59:29.937160236-05:00" level=error msg="forward event" error="context deadline exceeded"
May 15 06:59:35 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]
May 15 06:59:35 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 06:59:35 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 06:59:35 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 06:59:35 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 06:59:35 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 06:59:35 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 06:59:35 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 06:59:35 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 06:59:35 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 06:59:35 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 06:59:35 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 06:59:35 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 06:59:35 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 06:59:35 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 06:59:35 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 06:59:35 5gum kernel: Call Trace:
May 15 06:59:35 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 06:59:35 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 06:59:35 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 06:59:35 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 06:59:35 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 06:59:35 5gum kernel:  path_openat+0xb82/0x1080
May 15 06:59:35 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 06:59:35 5gum kernel:  do_filp_open+0x88/0x130
May 15 06:59:35 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 06:59:35 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 06:59:35 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 06:59:35 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 06:59:35 5gum kernel:  do_syscall_64+0x33/0x80
May 15 06:59:35 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 06:59:35 5gum kernel: RIP: 0033:0x4c2b2a
May 15 06:59:35 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 06:59:35 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 06:59:35 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 06:59:35 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 06:59:35 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 06:59:35 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 06:59:35 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 06:59:35 5gum containerd[679]: time="2022-05-15T06:59:35.937288992-05:00" level=error msg="evicting /tasks/exec-added from queue because of retry count"
May 15 06:59:36 5gum dockerd[648]: time="2022-05-15T06:59:36.259153365-05:00" level=warning msg="Health check for container c64dabcb1f324df7a9999a6247d7f71f62dc6f97638a41e0f5816922ceb88a33 error: context deadline exceeded"
May 15 06:59:57 5gum dockerd[648]: time="2022-05-15T06:59:57.611191255-05:00" level=warning msg="Health check for container 360ee29906b337575d1746fb53abb8f4d44ce413bd2e3beec8a779079cfc6db0 error: context deadline exceeded"
May 15 06:59:57 5gum dockerd[648]: time="2022-05-15T06:59:57.618358012-05:00" level=warning msg="Health check for container 177cdbd6efc4e17df80e7ef116cedb3bcab99b1c670be48f91f83e09bd300522 error: context deadline exceeded"
May 15 06:59:57 5gum dockerd[648]: time="2022-05-15T06:59:57.622402155-05:00" level=warning msg="Health check for container 94178ddf38f6aac10eafebdbc5ca804ba90b34c459ea4d3f2cfade25b2ed6c0e error: context deadline exceeded"
May 15 06:59:57 5gum dockerd[648]: time="2022-05-15T06:59:57.628778678-05:00" level=warning msg="Health check for container 077e395cbf4298e14e328d4bf8a310cd14d6d1f41a71b2b8870b9f6400aa0a46 error: context deadline exceeded"
May 15 07:00:01 5gum ntfy[657]: 2022/05/15 07:00:01 Stats: 0 message(s) published, 0 in cache, 0 successful mails, 0 failed, 0 topic(s) active, 0 subscriber(s), 0 visitor(s)
May 15 07:00:03 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runc:571013]
May 15 07:00:03 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:00:03 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:00:03 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:00:03 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:00:03 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:00:03 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:00:03 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:00:03 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:00:03 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:00:03 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:00:03 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:00:03 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:00:03 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:00:03 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:00:03 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:00:03 5gum kernel: Call Trace:
May 15 07:00:03 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:00:03 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:00:03 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:00:03 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:00:03 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:00:03 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:00:03 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:00:03 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:00:03 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:00:03 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:00:03 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:00:03 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:00:03 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:00:03 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:00:03 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:00:03 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:00:03 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:00:03 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:00:03 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:00:03 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:00:03 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:00:03 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:00:31 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runc:571013]
May 15 07:00:31 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:00:31 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:00:31 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:00:31 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:00:31 5gum kernel: RIP: 0010:smp_call_function_single+0x99/0x120
May 15 07:00:31 5gum kernel: Code: 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 8b 46 08 a8 01 <75> f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe ff ff 41 89 c0
May 15 07:00:31 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:00:31 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:00:31 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:00:31 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:00:31 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:00:31 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:00:31 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:00:31 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:00:31 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:00:31 5gum kernel: Call Trace:
May 15 07:00:31 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:00:31 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:00:31 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:00:31 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:00:31 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:00:31 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:00:31 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:00:31 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:00:31 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:00:31 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:00:31 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:00:31 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:00:31 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:00:31 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:00:31 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:00:31 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:00:31 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:00:31 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:00:31 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:00:31 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:00:31 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:00:31 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:00:59 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runc:571013]
May 15 07:00:59 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:00:59 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:00:59 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:00:59 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:00:59 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:00:59 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:00:59 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:00:59 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:00:59 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:00:59 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:00:59 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:00:59 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:00:59 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:00:59 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:00:59 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:00:59 5gum kernel: Call Trace:
May 15 07:00:59 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:00:59 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:00:59 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:00:59 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:00:59 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:00:59 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:00:59 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:00:59 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:00:59 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:00:59 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:00:59 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:00:59 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:00:59 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:00:59 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:00:59 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:00:59 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:00:59 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:00:59 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:00:59 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:00:59 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:00:59 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:00:59 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:00:59 5gum systemd[1]: systemd-udevd.service: Watchdog timeout (limit 3min)!
May 15 07:00:59 5gum systemd[1]: systemd-udevd.service: Killing process 359 (systemd-udevd) with signal SIGABRT.
May 15 07:01:01 5gum ntfy[657]: 2022/05/15 07:01:01 Stats: 0 message(s) published, 0 in cache, 0 successful mails, 0 failed, 0 topic(s) active, 0 subscriber(s), 0 visitor(s)
May 15 07:01:27 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runc:571013]
May 15 07:01:27 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:01:27 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:01:27 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:01:27 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:01:27 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:01:27 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:01:27 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:01:27 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:01:27 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:01:27 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:01:27 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:01:27 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:01:27 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:01:27 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:01:27 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:01:27 5gum kernel: Call Trace:
May 15 07:01:27 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:01:27 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:01:27 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:01:27 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:01:27 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:01:27 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:01:27 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:01:27 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:01:27 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:01:27 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:01:27 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:01:27 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:01:27 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:01:27 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:01:27 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:01:27 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:01:27 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:01:27 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:01:27 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:01:27 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:01:27 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:01:27 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:01:55 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runc:571013]
May 15 07:01:55 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:01:55 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:01:55 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:01:55 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:01:55 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:01:55 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:01:55 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:01:55 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:01:55 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:01:55 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:01:55 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:01:55 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:01:55 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:01:55 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:01:55 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:01:55 5gum kernel: Call Trace:
May 15 07:01:55 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:01:55 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:01:55 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:01:55 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:01:55 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:01:55 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:01:55 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:01:55 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:01:55 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:01:55 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:01:55 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:01:55 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:01:55 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:01:55 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:01:55 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:01:55 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:01:55 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:01:55 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:01:55 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:01:55 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:01:55 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:01:55 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:02:01 5gum ntfy[657]: 2022/05/15 07:02:01 Stats: 0 message(s) published, 0 in cache, 0 successful mails, 0 failed, 0 topic(s) active, 0 subscriber(s), 0 visitor(s)
May 15 07:02:23 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]
May 15 07:02:23 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:02:23 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:02:23 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:02:23 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:02:23 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:02:23 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:02:23 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:02:23 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:02:23 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:02:23 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:02:23 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:02:23 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:02:23 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:02:23 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:02:23 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:02:23 5gum kernel: Call Trace:
May 15 07:02:23 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:02:23 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:02:23 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:02:23 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:02:23 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:02:23 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:02:23 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:02:23 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:02:23 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:02:23 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:02:23 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:02:23 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:02:23 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:02:23 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:02:23 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:02:23 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:02:23 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:02:23 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:02:23 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:02:23 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:02:23 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:02:23 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:02:29 5gum systemd[1]: systemd-udevd.service: State 'stop-watchdog' timed out. Killing.
May 15 07:02:29 5gum systemd[1]: systemd-udevd.service: Killing process 359 (systemd-udevd) with signal SIGKILL.
May 15 07:02:51 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]
May 15 07:02:51 5gum kernel: Modules linked in: binfmt_misc veth xt_nat nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink xfrm_user xfrm_algo br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler overlay nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6_tables ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG nft_limit edac_mce_amd snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ledtrig_audio snd_hda_codec_hdmi kvm snd_hda_intel snd_intel_dspcfg soundwire_intel soundwire_generic_allocation snd_soc_core irqbypass snd_compress soundwire_cadence nls_ascii nls_cp437 nouveau ghash_clmulni_intel snd_hda_codec xt_limit vfat xt_addrtype fat snd_hda_core evdev xt_tcpudp snd_hwdep soundwire_bus mxm_wmi ttm snd_pcm aesni_intel xt_conntrack eeepc_wmi nf_conntrack asus_wmi drm_kms_helper libaes crypto_simd battery cryptd nf_defrag_ipv6 sparse_keymap snd_timer glue_helper nf_defrag_ipv4 rfkill nft_compat rapl snd cec video efi_pstore wmi_bmof i2c_algo_bit pcspkr ccp nft_counter soundcore sg
May 15 07:02:51 5gum kernel:  sp5100_tco rng_core watchdog k10temp button acpi_cpufreq nf_tables libcrc32c nfnetlink drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod ahci r8169 libahci xhci_pci xhci_hcd libata realtek mdio_devres nvme crc32_pclmul crc32c_intel usbcore libphy scsi_mod nvme_core i2c_piix4 t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul usb_common wmi crct10dif_common gpio_amdpt gpio_generic
May 15 07:02:51 5gum kernel: CPU: 0 PID: 571013 Comm: runc Tainted: G             L    5.10.0-14-amd64 #1 Debian 5.10.113-1
May 15 07:02:51 5gum kernel: Hardware name: System manufacturer System Product Name/PRIME B350M-A, BIOS 0604 04/06/2017
May 15 07:02:51 5gum kernel: RIP: 0010:smp_call_function_single+0x94/0x120
May 15 07:02:51 5gum kernel: Code: af 4e 75 a9 00 01 ff 00 0f 85 9a 00 00 00 85 c9 75 48 48 c7 c6 80 0b 03 00 65 48 03 35 3d 49 4e 75 8b 46 08 a8 01 74 09 f3 90 <8b> 46 08 a8 01 75 f7 83 4e 08 01 4c 89 46 10 48 89 56 18 e8 84 fe
May 15 07:02:51 5gum kernel: RSP: 0018:ffffaea0430c3c40 EFLAGS: 00000202
May 15 07:02:51 5gum kernel: RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
May 15 07:02:51 5gum kernel: RDX: 0000000000000000 RSI: ffff8c52bee30b80 RDI: 0000000000000003
May 15 07:02:51 5gum kernel: RBP: ffffaea0430c3c98 R08: ffffffff8aa406c0 R09: 0000000000000003
May 15 07:02:51 5gum kernel: R10: 0000000000010000 R11: 006f666e69757063 R12: 00004204faebbf5a
May 15 07:02:51 5gum kernel: R13: 000000000001bbe8 R14: 0000000000000001 R15: 00000005e805e171
May 15 07:02:51 5gum kernel: FS:  00007f60a2717740(0000) GS:ffff8c52bee00000(0000) knlGS:0000000000000000
May 15 07:02:51 5gum kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 15 07:02:51 5gum kernel: CR2: 000000000078c040 CR3: 0000000102b9a000 CR4: 00000000003506f0
May 15 07:02:51 5gum kernel: Call Trace:
May 15 07:02:51 5gum kernel:  ? ktime_get+0x38/0xa0
May 15 07:02:51 5gum kernel:  arch_freq_prepare_all+0x8a/0xd0
May 15 07:02:51 5gum kernel:  ? proc_reg_write+0x90/0x90
May 15 07:02:51 5gum kernel:  cpuinfo_open+0xe/0x20
May 15 07:02:51 5gum kernel:  do_dentry_open+0x14b/0x360
May 15 07:02:51 5gum kernel:  path_openat+0xb82/0x1080
May 15 07:02:51 5gum kernel:  ? filename_lookup+0x123/0x1b0
May 15 07:02:51 5gum kernel:  do_filp_open+0x88/0x130
May 15 07:02:51 5gum kernel:  ? getname_flags.part.0+0x29/0x1a0
May 15 07:02:51 5gum kernel:  ? __check_object_size+0x136/0x150
May 15 07:02:51 5gum kernel:  do_sys_openat2+0x97/0x150
May 15 07:02:51 5gum kernel:  __x64_sys_openat+0x54/0x90
May 15 07:02:51 5gum kernel:  do_syscall_64+0x33/0x80
May 15 07:02:51 5gum kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
May 15 07:02:51 5gum kernel: RIP: 0033:0x4c2b2a
May 15 07:02:51 5gum kernel: Code: e8 5b 87 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 4c 8b 54 24 28 4c 8b 44 24 30 4c 8b 4c 24 38 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 40 ff ff ff ff 48 c7 44 24 48
May 15 07:02:51 5gum kernel: RSP: 002b:000000c00010ef38 EFLAGS: 00000216 ORIG_RAX: 0000000000000101
May 15 07:02:51 5gum kernel: RAX: ffffffffffffffda RBX: 000000c00002e000 RCX: 00000000004c2b2a
May 15 07:02:51 5gum kernel: RDX: 0000000000080000 RSI: 000000c0000258d0 RDI: ffffffffffffff9c
May 15 07:02:51 5gum kernel: RBP: 000000c00010efb0 R08: 0000000000000000 R09: 0000000000000000
May 15 07:02:51 5gum kernel: R10: 0000000000000000 R11: 0000000000000216 R12: 000000000000018e
May 15 07:02:51 5gum kernel: R13: 000000000000018d R14: 0000000000000200 R15: 0000000000000200
May 15 07:03:01 5gum ntfy[657]: 2022/05/15 07:03:01 Stats: 0 message(s) published, 0 in cache, 0 successful mails, 0 failed, 0 topic(s) active, 0 subscriber(s), 0 visitor(s)
May 15 07:03:19 5gum kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]
The last watchdog message is the last thing from the logs from the previous boot, after that it's fully frozen. I don't believe anything especially resource intensive is going on right before the crashes either.

I do have the latest microcode and it's picked up by grub, so that shouldn't be the issue. I've looked through the forums and elsewhere, but any other watchdog soft lockups seem to be unrelated.
I'm not sure what additional information I could provide, but if anything else is needed I'll be happy to provide it, although it may take a while since crashes are infrequent and unexpected.

User avatar
NorthEast
Posts: 349
Joined: 2018-11-18 04:35
Has thanked: 12 times
Been thanked: 30 times

Re: Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#2 Post by NorthEast »

An online search for: "BUG: soft lockup - CPU#0 stuck for s" brings up some info. It may be kernel looping due to too much load. Load can accumulate over time.

User avatar
pollen
Posts: 2
Joined: 2022-05-15 16:06

Re: Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#3 Post by pollen »

What could I do to find out if load is accumulating over time? I don't believe it is but I'm more than willing to check or put some monitor in place.

User avatar
NorthEast
Posts: 349
Joined: 2018-11-18 04:35
Has thanked: 12 times
Been thanked: 30 times

Re: Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#4 Post by NorthEast »

The problem may or may not be accumulation of load, but so far as I understand it, it is related to load which induces the kernel to loop because it's not able to give all processes demanding its attention, due attention. You could try to increase the measure that watchdog uses before it signals soft lockup by increasing the sysctl parameter: kernel.watchdog_thresh. The default is 10, so maybe double it, e.g. echo 20 > /proc/sys/kernel/watchdog_thresh. Maybe that will help by only messaging after the kernel has more time to adjust. Check online as I suggested for similar and other ideas. To make such a config adjustment permanent, you could configure it in /etc/sysctl.conf.

CwF
Global Moderator
Global Moderator
Posts: 2636
Joined: 2018-06-20 15:16
Location: Colorado
Has thanked: 41 times
Been thanked: 192 times

Re: Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#5 Post by CwF »

pollen wrote: 2022-05-16 02:04 What could I do to find out if load is accumulating over time?
Since 4.20 and newer, so 11, there is /proc/pressure/cpu and /io and /memory.
Not much has been made of it yet...

User avatar
NorthEast
Posts: 349
Joined: 2018-11-18 04:35
Has thanked: 12 times
Been thanked: 30 times

Re: Freezing with "watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [runc:571013]"

#6 Post by NorthEast »

CwF wrote:
there is /proc/pressure/cpu
Thanks for that. Good to know. Usable for scripting cpu "pressure" over time.

Post Reply